Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260810 11:30:03.881033 26383 test_util.cc:268] Using random seed: -1393871404
2026-08-10T11:30:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T11:30:03Z Disabled control of system clock
I20260810 11:30:03.938858 26383 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
/tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.195.254:41125
--webserver_interface=127.25.195.254
--webserver_port=0
--builtin_ntp_servers=127.25.195.212:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260810 11:30:04.565966 26394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 11:30:04.566534 26394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 11:30:04.566736 26394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 11:30:04.576429 26394 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 11:30:04.576659 26394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 11:30:04.576766 26394 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 11:30:04.576876 26394 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 11:30:04.588514 26394 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.195.212:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.195.254:41125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.195.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 10:32:47 UTC on ccycloud.quasar-nosthy.root.comops.site
build id 4577509
ASAN enabled
I20260810 11:30:04.590867 26394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 11:30:04.593825 26394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 11:30:04.622300 26400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 11:30:04.622509 26403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 11:30:04.622459 26401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 11:30:04.626178 26394 server_base.cc:1034] running on GCE node
I20260810 11:30:04.627624 26394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 11:30:04.630748 26394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 11:30:04.632267 26394 hybrid_clock.cc:648] HybridClock initialized: now 1786361404632113 us; error 131 us; skew 500 ppm
I20260810 11:30:04.633047 26394 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 11:30:04.637475 26394 webserver.cc:460] Webserver started at http://127.25.195.254:36939/ using document root <none> and password file <none>
I20260810 11:30:04.638787 26394 fs_manager.cc:359] Metadata directory not provided
I20260810 11:30:04.638998 26394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 11:30:04.639545 26394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 11:30:04.645126 26394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/data/instance:
uuid: "83cc8e39a3b9455f8242a6da6a54c38a"
format_stamp: "Formatted at 2026-08-10 11:30:04 on dist-test-slave-rgb1"
I20260810 11:30:04.646519 26394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/wal/instance:
uuid: "83cc8e39a3b9455f8242a6da6a54c38a"
format_stamp: "Formatted at 2026-08-10 11:30:04 on dist-test-slave-rgb1"
I20260810 11:30:04.656740 26394 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.010s sys 0.000s
I20260810 11:30:04.665300 26409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 11:30:04.667824 26394 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.001s sys 0.002s
I20260810 11:30:04.668531 26394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/data,/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/wal
uuid: "83cc8e39a3b9455f8242a6da6a54c38a"
format_stamp: "Formatted at 2026-08-10 11:30:04 on dist-test-slave-rgb1"
I20260810 11:30:04.669181 26394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 11:30:04.694298 26394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 11:30:04.695677 26394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 11:30:04.696197 26394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 11:30:04.732343 26394 rpc_server.cc:307] RPC server started. Bound to: 127.25.195.254:41125
I20260810 11:30:04.732543 26462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.195.254:41125 every 8 connection(s)
I20260810 11:30:04.735189 26394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/data/info.pb
I20260810 11:30:04.745424 26463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:04.746719 26383 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu as pid 26394
I20260810 11:30:04.747236 26383 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/wal/instance
I20260810 11:30:04.752236 26383 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
/tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.195.253:34547
--webserver_interface=127.25.195.253
--webserver_port=0
--builtin_ntp_servers=127.25.195.212:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260810 11:30:04.762837 26463 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } has no permanent_uuid. Determining permanent_uuid...
I20260810 11:30:04.794382 26463 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } has no permanent_uuid. Determining permanent_uuid...
W20260810 11:30:04.796222 26410 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111)
W20260810 11:30:04.798722 26463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.195.253:34547: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111)
I20260810 11:30:04.848313 26463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } attempt: 1
W20260810 11:30:04.851490 26463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.195.253:34547: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111)
I20260810 11:30:04.919936 26463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } attempt: 2
W20260810 11:30:04.922461 26463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.195.253:34547: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111)
I20260810 11:30:05.014072 26463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } attempt: 3
W20260810 11:30:05.016863 26463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.195.253:34547: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111)
I20260810 11:30:05.160349 26463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } attempt: 4
W20260810 11:30:05.164466 26463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.195.253:34547: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111)
W20260810 11:30:05.266007 26465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 11:30:05.266436 26465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 11:30:05.266587 26465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 11:30:05.276543 26465 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 11:30:05.276847 26465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 11:30:05.276973 26465 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 11:30:05.277112 26465 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 11:30:05.288690 26465 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.195.212:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.195.253:34547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.195.253
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 10:32:47 UTC on ccycloud.quasar-nosthy.root.comops.site
build id 4577509
ASAN enabled
I20260810 11:30:05.290408 26465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 11:30:05.292933 26465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 11:30:05.309376 26473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 11:30:05.309398 26476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 11:30:05.309240 26474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 11:30:05.310889 26465 server_base.cc:1034] running on GCE node
I20260810 11:30:05.311923 26465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 11:30:05.313933 26465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 11:30:05.315255 26465 hybrid_clock.cc:648] HybridClock initialized: now 1786361405315175 us; error 67 us; skew 500 ppm
I20260810 11:30:05.315691 26465 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 11:30:05.318967 26465 webserver.cc:460] Webserver started at http://127.25.195.253:42129/ using document root <none> and password file <none>
I20260810 11:30:05.320278 26465 fs_manager.cc:359] Metadata directory not provided
I20260810 11:30:05.320617 26465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 11:30:05.321144 26465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 11:30:05.325476 26465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data/instance:
uuid: "c40c76e125b44de181b88b7f63a566f7"
format_stamp: "Formatted at 2026-08-10 11:30:05 on dist-test-slave-rgb1"
I20260810 11:30:05.326570 26465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/wal/instance:
uuid: "c40c76e125b44de181b88b7f63a566f7"
format_stamp: "Formatted at 2026-08-10 11:30:05 on dist-test-slave-rgb1"
I20260810 11:30:05.333851 26465 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.005s
I20260810 11:30:05.341423 26483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 11:30:05.344059 26465 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.003s
I20260810 11:30:05.344384 26465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data,/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/wal
uuid: "c40c76e125b44de181b88b7f63a566f7"
format_stamp: "Formatted at 2026-08-10 11:30:05 on dist-test-slave-rgb1"
I20260810 11:30:05.344730 26465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 11:30:05.390573 26465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 11:30:05.391465 26465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 11:30:05.391747 26465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 11:30:05.422756 26465 rpc_server.cc:307] RPC server started. Bound to: 127.25.195.253:34547
I20260810 11:30:05.422796 26538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.195.253:34547 every 8 connection(s)
I20260810 11:30:05.424388 26465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data/info.pb
I20260810 11:30:05.427523 26383 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu as pid 26465
I20260810 11:30:05.427748 26383 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/wal/instance
I20260810 11:30:05.429036 26383 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
/tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.195.252:34489
--webserver_interface=127.25.195.252
--webserver_port=0
--builtin_ntp_servers=127.25.195.212:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260810 11:30:05.429124 26539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:05.439355 26539 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } has no permanent_uuid. Determining permanent_uuid...
I20260810 11:30:05.461758 26539 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } has no permanent_uuid. Determining permanent_uuid...
I20260810 11:30:05.463871 26463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } attempt: 5
I20260810 11:30:05.481679 26463 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } has no permanent_uuid. Determining permanent_uuid...
I20260810 11:30:05.482028 26539 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } has no permanent_uuid. Determining permanent_uuid...
W20260810 11:30:05.485384 26487 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.195.252:34489: connect: Connection refused (error 111)
W20260810 11:30:05.489406 26539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.195.252:34489: Network error: Client connection negotiation failed: client connection to 127.25.195.252:34489: connect: Connection refused (error 111)
W20260810 11:30:05.495884 26463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.195.252:34489: Network error: Client connection negotiation failed: client connection to 127.25.195.252:34489: connect: Connection refused (error 111)
I20260810 11:30:05.538991 26539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } attempt: 1
W20260810 11:30:05.543339 26539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.195.252:34489: Network error: Client connection negotiation failed: client connection to 127.25.195.252:34489: connect: Connection refused (error 111)
I20260810 11:30:05.547432 26463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } attempt: 1
W20260810 11:30:05.552001 26463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.195.252:34489: Network error: Client connection negotiation failed: client connection to 127.25.195.252:34489: connect: Connection refused (error 111)
I20260810 11:30:05.612020 26539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } attempt: 2
W20260810 11:30:05.615248 26539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.195.252:34489: Network error: Client connection negotiation failed: client connection to 127.25.195.252:34489: connect: Connection refused (error 111)
I20260810 11:30:05.620417 26463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } attempt: 2
W20260810 11:30:05.623864 26463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.195.252:34489: Network error: Client connection negotiation failed: client connection to 127.25.195.252:34489: connect: Connection refused (error 111)
I20260810 11:30:05.706700 26539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } attempt: 3
W20260810 11:30:05.710474 26539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.195.252:34489: Network error: Client connection negotiation failed: client connection to 127.25.195.252:34489: connect: Connection refused (error 111)
I20260810 11:30:05.730199 26463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } attempt: 3
W20260810 11:30:05.732443 26463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.195.252:34489: Network error: Client connection negotiation failed: client connection to 127.25.195.252:34489: connect: Connection refused (error 111)
I20260810 11:30:05.853933 26539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } attempt: 4
W20260810 11:30:05.856854 26539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.195.252:34489: Network error: Client connection negotiation failed: client connection to 127.25.195.252:34489: connect: Connection refused (error 111)
I20260810 11:30:05.909758 26463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } attempt: 4
W20260810 11:30:05.912153 26463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.195.252:34489: Network error: Client connection negotiation failed: client connection to 127.25.195.252:34489: connect: Connection refused (error 111)
W20260810 11:30:05.987542 26541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 11:30:05.987989 26541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 11:30:05.988209 26541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 11:30:05.997187 26541 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 11:30:05.997323 26541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 11:30:05.997370 26541 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 11:30:05.997515 26541 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 11:30:06.014809 26541 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.195.212:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.195.252:34489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.195.252
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 10:32:47 UTC on ccycloud.quasar-nosthy.root.comops.site
build id 4577509
ASAN enabled
I20260810 11:30:06.016485 26541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 11:30:06.019080 26541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 11:30:06.037242 26553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 11:30:06.037614 26556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 11:30:06.037729 26554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 11:30:06.039989 26541 server_base.cc:1034] running on GCE node
I20260810 11:30:06.041244 26541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 11:30:06.043160 26541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 11:30:06.044492 26541 hybrid_clock.cc:648] HybridClock initialized: now 1786361406044394 us; error 81 us; skew 500 ppm
I20260810 11:30:06.044950 26541 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 11:30:06.053426 26541 webserver.cc:460] Webserver started at http://127.25.195.252:34033/ using document root <none> and password file <none>
I20260810 11:30:06.054370 26541 fs_manager.cc:359] Metadata directory not provided
I20260810 11:30:06.054557 26541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 11:30:06.055385 26541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 11:30:06.059757 26541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-2/data/instance:
uuid: "ac259bcf213a4aa297d1d8e73b262361"
format_stamp: "Formatted at 2026-08-10 11:30:06 on dist-test-slave-rgb1"
I20260810 11:30:06.060858 26541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-2/wal/instance:
uuid: "ac259bcf213a4aa297d1d8e73b262361"
format_stamp: "Formatted at 2026-08-10 11:30:06 on dist-test-slave-rgb1"
I20260810 11:30:06.070204 26541 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.007s sys 0.000s
I20260810 11:30:06.075536 26563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 11:30:06.078152 26541 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260810 11:30:06.078476 26541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-2/data,/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-2/wal
uuid: "ac259bcf213a4aa297d1d8e73b262361"
format_stamp: "Formatted at 2026-08-10 11:30:06 on dist-test-slave-rgb1"
I20260810 11:30:06.078768 26541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 11:30:06.099666 26541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 11:30:06.100925 26541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 11:30:06.101390 26541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 11:30:06.139716 26541 rpc_server.cc:307] RPC server started. Bound to: 127.25.195.252:34489
I20260810 11:30:06.139748 26615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.195.252:34489 every 8 connection(s)
I20260810 11:30:06.141990 26541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-2/data/info.pb
I20260810 11:30:06.145267 26383 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu as pid 26541
I20260810 11:30:06.145607 26383 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-2/wal/instance
I20260810 11:30:06.149094 26617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:06.156167 26539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } attempt: 5
I20260810 11:30:06.158949 26617 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } has no permanent_uuid. Determining permanent_uuid...
I20260810 11:30:06.189706 26463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } attempt: 5
I20260810 11:30:06.197050 26617 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } has no permanent_uuid. Determining permanent_uuid...
I20260810 11:30:06.206769 26539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Bootstrap starting.
I20260810 11:30:06.217026 26539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:06.219785 26463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Bootstrap starting.
I20260810 11:30:06.219884 26539 log.cc:824] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Log is configured to *not* fsync() on all Append() calls
I20260810 11:30:06.223966 26617 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } has no permanent_uuid. Determining permanent_uuid...
I20260810 11:30:06.225279 26463 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:06.227046 26463 log.cc:824] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Log is configured to *not* fsync() on all Append() calls
I20260810 11:30:06.233351 26463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: No bootstrap required, opened a new log
I20260810 11:30:06.234599 26539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: No bootstrap required, opened a new log
I20260810 11:30:06.239735 26617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Bootstrap starting.
I20260810 11:30:06.245364 26617 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:06.246742 26539 raft_consensus.cc:348] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:06.247413 26539 raft_consensus.cc:374] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:06.247599 26617 log.cc:824] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Log is configured to *not* fsync() on all Append() calls
I20260810 11:30:06.247686 26539 raft_consensus.cc:729] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c40c76e125b44de181b88b7f63a566f7, State: Initialized, Role: FOLLOWER
I20260810 11:30:06.249305 26539 consensus_queue.cc:260] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:06.250608 26463 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:06.251027 26463 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:06.251205 26463 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83cc8e39a3b9455f8242a6da6a54c38a, State: Initialized, Role: FOLLOWER
I20260810 11:30:06.252125 26463 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:06.252077 26630 sys_catalog.cc:455] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:06.252660 26630 sys_catalog.cc:458] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:06.253991 26617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: No bootstrap required, opened a new log
I20260810 11:30:06.253785 26631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:06.254900 26631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:06.255391 26539 sys_catalog.cc:564] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 11:30:06.255590 26463 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 11:30:06.272260 26617 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:06.273042 26617 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:06.273222 26617 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac259bcf213a4aa297d1d8e73b262361, State: Initialized, Role: FOLLOWER
I20260810 11:30:06.274333 26617 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:06.281813 26617 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 11:30:06.289130 26650 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:06.290045 26650 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 11:30:06.315842 26659 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 11:30:06.316190 26659 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260810 11:30:06.317844 26648 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 11:30:06.318127 26648 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 11:30:06.287086 26394 master_runner.cc:186] Error getting master registration for 127.25.195.253:34547: OK, instance_id { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" instance_seqno: 1786361405414528 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 11:30:06.319645 26394 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 11:30:06.312182 26465 master_runner.cc:186] Error getting master registration for 127.25.195.252:34489: OK, instance_id { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" instance_seqno: 1786361406127490 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 11:30:06.331667 26465 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 11:30:06.348716 26631 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:06.349249 26631 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
W20260810 11:30:06.355252 26569 tablet.cc:2369] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 11:30:06.356601 26541 master_runner.cc:263] No leader master found from master ac259bcf213a4aa297d1d8e73b262361
I20260810 11:30:06.356812 26541 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 11:30:06.357692 26511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c40c76e125b44de181b88b7f63a566f7" is_pre_election: true
I20260810 11:30:06.358755 26511 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83cc8e39a3b9455f8242a6da6a54c38a in term 0.
I20260810 11:30:06.359892 26410 leader_election.cc:302] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83cc8e39a3b9455f8242a6da6a54c38a, c40c76e125b44de181b88b7f63a566f7; no voters:
I20260810 11:30:06.361505 26631 leader_election.cc:288] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
I20260810 11:30:06.362223 26631 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:06.362847 26631 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:06.362643 26591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361" is_pre_election: true
I20260810 11:30:06.363356 26631 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:06.363646 26591 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83cc8e39a3b9455f8242a6da6a54c38a in term 0.
I20260810 11:30:06.368402 26631 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
W20260810 11:30:06.374454 26669 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 11:30:06.374661 26669 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 11:30:06.380070 26511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c40c76e125b44de181b88b7f63a566f7"
I20260810 11:30:06.380528 26511 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:06.386655 26511 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83cc8e39a3b9455f8242a6da6a54c38a in term 1.
I20260810 11:30:06.387580 26410 leader_election.cc:302] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83cc8e39a3b9455f8242a6da6a54c38a, c40c76e125b44de181b88b7f63a566f7; no voters:
I20260810 11:30:06.388139 26671 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 1 FOLLOWER]: Leader election won for term 1
W20260810 11:30:06.395689 26489 tablet.cc:2369] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 11:30:06.400753 26591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361"
I20260810 11:30:06.401116 26591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:06.402065 26631 leader_election.cc:288] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 1 election: Requested vote from peers c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
I20260810 11:30:06.406831 26671 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 1 LEADER]: Becoming Leader. State: Replica: 83cc8e39a3b9455f8242a6da6a54c38a, State: Running, Role: LEADER
I20260810 11:30:06.406785 26591 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83cc8e39a3b9455f8242a6da6a54c38a in term 1.
I20260810 11:30:06.408244 26671 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:06.440310 26631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83cc8e39a3b9455f8242a6da6a54c38a. Latest consensus state: current_term: 1 leader_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:06.440881 26631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: This master's current role is: LEADER
I20260810 11:30:06.450011 26674 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260810 11:30:06.455672 26415 tablet.cc:2369] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 11:30:06.457300 26674 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 11:30:06.492062 26591 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 1 FOLLOWER]: Refusing update from remote peer 83cc8e39a3b9455f8242a6da6a54c38a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 11:30:06.492486 26511 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 1 FOLLOWER]: Refusing update from remote peer 83cc8e39a3b9455f8242a6da6a54c38a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 11:30:06.493835 26631 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:06.495561 26631 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:06.521498 26650 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83cc8e39a3b9455f8242a6da6a54c38a. Latest consensus state: current_term: 1 leader_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:06.521940 26650 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:06.522653 26675 mvcc.cc:205] Tried to move back new op lower bound from 7316936320969814016 to 7316936320658173952. Current Snapshot: MvccSnapshot[applied={T|T < 7316936320969814016}]
I20260810 11:30:06.540069 26650 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:06.540537 26650 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:06.539839 26672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:06.541160 26672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: This master's current role is: LEADER
I20260810 11:30:06.546416 26674 catalog_manager.cc:1347] Generated new cluster ID: 5081849c8420415b9be91728667896d5
I20260810 11:30:06.546566 26674 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 11:30:06.568519 26630 sys_catalog.cc:455] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83cc8e39a3b9455f8242a6da6a54c38a. Latest consensus state: current_term: 1 leader_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:06.569141 26630 sys_catalog.cc:458] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:06.575089 26679 mvcc.cc:205] Tried to move back new op lower bound from 7316936320969814016 to 7316936320658173952. Current Snapshot: MvccSnapshot[applied={T|T < 7316936320969814016}]
I20260810 11:30:06.572326 26672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:06.575974 26672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: This master's current role is: LEADER
I20260810 11:30:06.581615 26630 sys_catalog.cc:455] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:06.581983 26630 sys_catalog.cc:458] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:06.595533 26674 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 11:30:06.597723 26674 catalog_manager.cc:1504] Loading token signing keys...
I20260810 11:30:06.620393 26674 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Generated new TSK 0
I20260810 11:30:06.621863 26674 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 11:30:06.649935 26383 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
/tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.195.193:0
--local_ip_for_outbound_sockets=127.25.195.193
--webserver_interface=127.25.195.193
--webserver_port=0
--tserver_master_addrs=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--builtin_ntp_servers=127.25.195.212:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260810 11:30:07.319639 26659 catalog_manager.cc:1259] Loaded cluster ID: 5081849c8420415b9be91728667896d5
I20260810 11:30:07.319867 26659 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: loading cluster ID for follower catalog manager: success
I20260810 11:30:07.325279 26659 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: acquiring CA information for follower catalog manager: success
I20260810 11:30:07.329407 26659 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 11:30:07.371827 26684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 11:30:07.372177 26684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 11:30:07.372291 26684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 11:30:07.377364 26669 catalog_manager.cc:1259] Loaded cluster ID: 5081849c8420415b9be91728667896d5
I20260810 11:30:07.377521 26669 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: loading cluster ID for follower catalog manager: success
I20260810 11:30:07.380698 26669 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: acquiring CA information for follower catalog manager: success
W20260810 11:30:07.382047 26684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 11:30:07.382421 26684 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.195.193
I20260810 11:30:07.383324 26669 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 11:30:07.397066 26684 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.195.212:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.195.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.195.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.195.193
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 10:32:47 UTC on ccycloud.quasar-nosthy.root.comops.site
build id 4577509
ASAN enabled
I20260810 11:30:07.399071 26684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 11:30:07.402305 26684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 11:30:07.425156 26691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 11:30:07.425148 26689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 11:30:07.426028 26693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 11:30:07.426443 26684 server_base.cc:1034] running on GCE node
I20260810 11:30:07.427160 26684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 11:30:07.428371 26684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 11:30:07.429716 26684 hybrid_clock.cc:648] HybridClock initialized: now 1786361407429585 us; error 88 us; skew 500 ppm
I20260810 11:30:07.430146 26684 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 11:30:07.434286 26684 webserver.cc:460] Webserver started at http://127.25.195.193:44271/ using document root <none> and password file <none>
I20260810 11:30:07.435252 26684 fs_manager.cc:359] Metadata directory not provided
I20260810 11:30:07.435472 26684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 11:30:07.435909 26684 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 11:30:07.439234 26684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/data/instance:
uuid: "443ec871f1ed4232b932ecfb0b18510d"
format_stamp: "Formatted at 2026-08-10 11:30:07 on dist-test-slave-rgb1"
I20260810 11:30:07.440225 26684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/instance:
uuid: "443ec871f1ed4232b932ecfb0b18510d"
format_stamp: "Formatted at 2026-08-10 11:30:07 on dist-test-slave-rgb1"
I20260810 11:30:07.446976 26684 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260810 11:30:07.451995 26699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 11:30:07.453974 26684 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260810 11:30:07.454334 26684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal
uuid: "443ec871f1ed4232b932ecfb0b18510d"
format_stamp: "Formatted at 2026-08-10 11:30:07 on dist-test-slave-rgb1"
I20260810 11:30:07.454694 26684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 11:30:07.481381 26684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 11:30:07.483187 26684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 11:30:07.483896 26684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 11:30:07.485646 26684 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 11:30:07.488662 26684 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 11:30:07.489051 26684 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260810 11:30:07.489517 26684 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 11:30:07.489809 26684 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 11:30:07.558187 26804 raft_consensus.cc:482] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83cc8e39a3b9455f8242a6da6a54c38a)
I20260810 11:30:07.558604 26804 raft_consensus.cc:504] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:07.562229 26437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c40c76e125b44de181b88b7f63a566f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" is_pre_election: true
I20260810 11:30:07.562616 26591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c40c76e125b44de181b88b7f63a566f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361" is_pre_election: true
I20260810 11:30:07.564277 26487 leader_election.cc:302] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c40c76e125b44de181b88b7f63a566f7; no voters: 83cc8e39a3b9455f8242a6da6a54c38a, ac259bcf213a4aa297d1d8e73b262361
I20260810 11:30:07.564743 26804 leader_election.cc:288] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
I20260810 11:30:07.565081 26804 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:07.567358 26684 rpc_server.cc:307] RPC server started. Bound to: 127.25.195.193:36885
I20260810 11:30:07.567446 26820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.195.193:36885 every 8 connection(s)
I20260810 11:30:07.569137 26684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/data/info.pb
I20260810 11:30:07.576951 26383 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu as pid 26684
I20260810 11:30:07.577241 26383 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/instance
I20260810 11:30:07.587895 26383 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
/tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.195.194:0
--local_ip_for_outbound_sockets=127.25.195.194
--webserver_interface=127.25.195.194
--webserver_port=0
--tserver_master_addrs=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--builtin_ntp_servers=127.25.195.212:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260810 11:30:07.625352 26821 heartbeater.cc:347] Connected to a master server at 127.25.195.252:34489
I20260810 11:30:07.625948 26821 heartbeater.cc:464] Registering TS with master...
I20260810 11:30:07.626556 26822 heartbeater.cc:347] Connected to a master server at 127.25.195.254:41125
I20260810 11:30:07.626709 26822 heartbeater.cc:464] Registering TS with master...
I20260810 11:30:07.627272 26823 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:07.627463 26823 heartbeater.cc:464] Registering TS with master...
I20260810 11:30:07.627547 26822 heartbeater.cc:511] Master 127.25.195.254:41125 requested a full tablet report, sending...
I20260810 11:30:07.627463 26821 heartbeater.cc:511] Master 127.25.195.252:34489 requested a full tablet report, sending...
I20260810 11:30:07.629527 26823 heartbeater.cc:511] Master 127.25.195.253:34547 requested a full tablet report, sending...
I20260810 11:30:07.631546 26581 ts_manager.cc:194] Registered new tserver with Master: 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:07.631664 26500 ts_manager.cc:194] Registered new tserver with Master: 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:07.634276 26426 ts_manager.cc:194] Registered new tserver with Master: 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:07.637528 26426 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.195.193:58979
I20260810 11:30:08.006733 26832 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83cc8e39a3b9455f8242a6da6a54c38a)
I20260810 11:30:08.007012 26832 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:08.008750 26832 leader_election.cc:288] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547)
I20260810 11:30:08.009289 26437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac259bcf213a4aa297d1d8e73b262361" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" is_pre_election: true
I20260810 11:30:08.009450 26511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac259bcf213a4aa297d1d8e73b262361" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c40c76e125b44de181b88b7f63a566f7" is_pre_election: true
I20260810 11:30:08.010910 26564 leader_election.cc:302] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac259bcf213a4aa297d1d8e73b262361; no voters: 83cc8e39a3b9455f8242a6da6a54c38a, c40c76e125b44de181b88b7f63a566f7
I20260810 11:30:08.011555 26832 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 11:30:08.113373 26831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 11:30:08.113698 26831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 11:30:08.113867 26831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 11:30:08.125648 26831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 11:30:08.125921 26831 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.195.194
I20260810 11:30:08.137953 26831 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.195.212:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.195.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.195.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.195.194
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 10:32:47 UTC on ccycloud.quasar-nosthy.root.comops.site
build id 4577509
ASAN enabled
I20260810 11:30:08.140499 26831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 11:30:08.141909 26822 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:08.142952 26831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 11:30:08.166786 26838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 11:30:08.167596 26837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 11:30:08.168902 26840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 11:30:08.169401 26831 server_base.cc:1034] running on GCE node
I20260810 11:30:08.170236 26831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 11:30:08.171440 26831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 11:30:08.172991 26831 hybrid_clock.cc:648] HybridClock initialized: now 1786361408172881 us; error 78 us; skew 500 ppm
I20260810 11:30:08.173360 26831 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 11:30:08.177063 26831 webserver.cc:460] Webserver started at http://127.25.195.194:34921/ using document root <none> and password file <none>
I20260810 11:30:08.177892 26831 fs_manager.cc:359] Metadata directory not provided
I20260810 11:30:08.178058 26831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 11:30:08.178444 26831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 11:30:08.182271 26831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/data/instance:
uuid: "b6079090b1124d84aa4477974bb53700"
format_stamp: "Formatted at 2026-08-10 11:30:08 on dist-test-slave-rgb1"
I20260810 11:30:08.183314 26831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/instance:
uuid: "b6079090b1124d84aa4477974bb53700"
format_stamp: "Formatted at 2026-08-10 11:30:08 on dist-test-slave-rgb1"
I20260810 11:30:08.190482 26831 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.002s
I20260810 11:30:08.194984 26846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 11:30:08.197232 26831 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260810 11:30:08.197535 26831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal
uuid: "b6079090b1124d84aa4477974bb53700"
format_stamp: "Formatted at 2026-08-10 11:30:08 on dist-test-slave-rgb1"
I20260810 11:30:08.197849 26831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 11:30:08.222191 26831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 11:30:08.223204 26831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 11:30:08.223603 26831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 11:30:08.224879 26831 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 11:30:08.227460 26831 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 11:30:08.227636 26831 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 11:30:08.227866 26831 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 11:30:08.227981 26831 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 11:30:08.292021 26831 rpc_server.cc:307] RPC server started. Bound to: 127.25.195.194:41945
I20260810 11:30:08.292152 26962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.195.194:41945 every 8 connection(s)
I20260810 11:30:08.293917 26831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/data/info.pb
I20260810 11:30:08.302893 26383 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu as pid 26831
I20260810 11:30:08.303159 26383 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/instance
I20260810 11:30:08.312500 26383 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
/tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.195.195:0
--local_ip_for_outbound_sockets=127.25.195.195
--webserver_interface=127.25.195.195
--webserver_port=0
--tserver_master_addrs=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--builtin_ntp_servers=127.25.195.212:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260810 11:30:08.326599 26965 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:08.327085 26965 heartbeater.cc:464] Registering TS with master...
I20260810 11:30:08.328333 26965 heartbeater.cc:511] Master 127.25.195.253:34547 requested a full tablet report, sending...
I20260810 11:30:08.330650 26500 ts_manager.cc:194] Registered new tserver with Master: b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:08.337129 26963 heartbeater.cc:347] Connected to a master server at 127.25.195.252:34489
I20260810 11:30:08.337080 26964 heartbeater.cc:347] Connected to a master server at 127.25.195.254:41125
I20260810 11:30:08.337384 26963 heartbeater.cc:464] Registering TS with master...
I20260810 11:30:08.337409 26964 heartbeater.cc:464] Registering TS with master...
I20260810 11:30:08.338313 26964 heartbeater.cc:511] Master 127.25.195.254:41125 requested a full tablet report, sending...
I20260810 11:30:08.338420 26963 heartbeater.cc:511] Master 127.25.195.252:34489 requested a full tablet report, sending...
I20260810 11:30:08.339813 26426 ts_manager.cc:194] Registered new tserver with Master: b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:08.340157 26581 ts_manager.cc:194] Registered new tserver with Master: b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:08.341040 26426 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.195.194:35251
I20260810 11:30:08.453315 26974 raft_consensus.cc:482] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83cc8e39a3b9455f8242a6da6a54c38a)
I20260810 11:30:08.453612 26974 raft_consensus.cc:504] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:08.454922 26974 leader_election.cc:288] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
I20260810 11:30:08.455574 26591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c40c76e125b44de181b88b7f63a566f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361" is_pre_election: true
I20260810 11:30:08.455597 26437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c40c76e125b44de181b88b7f63a566f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" is_pre_election: true
I20260810 11:30:08.456353 26486 leader_election.cc:302] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c40c76e125b44de181b88b7f63a566f7; no voters: 83cc8e39a3b9455f8242a6da6a54c38a, ac259bcf213a4aa297d1d8e73b262361
I20260810 11:30:08.456818 26974 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:08.844051 26964 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
W20260810 11:30:08.844318 26973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 11:30:08.844870 26973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 11:30:08.845153 26973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 11:30:08.855304 26973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 11:30:08.855847 26973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.195.195
I20260810 11:30:08.869197 26973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.195.212:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.195.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.195.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.195.195
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 10:32:47 UTC on ccycloud.quasar-nosthy.root.comops.site
build id 4577509
ASAN enabled
I20260810 11:30:08.870733 26973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 11:30:08.872845 26973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 11:30:08.892738 26982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 11:30:08.892899 26984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 11:30:08.892688 26981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 11:30:08.894935 26973 server_base.cc:1034] running on GCE node
I20260810 11:30:08.896123 26973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 11:30:08.898341 26973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 11:30:08.899878 26973 hybrid_clock.cc:648] HybridClock initialized: now 1786361408899671 us; error 63 us; skew 500 ppm
I20260810 11:30:08.900938 26973 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 11:30:08.905536 26973 webserver.cc:460] Webserver started at http://127.25.195.195:34203/ using document root <none> and password file <none>
I20260810 11:30:08.906620 26973 fs_manager.cc:359] Metadata directory not provided
I20260810 11:30:08.906821 26973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 11:30:08.907205 26973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 11:30:08.911535 26973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/data/instance:
uuid: "482e605580be48cbbacce05a3e61c215"
format_stamp: "Formatted at 2026-08-10 11:30:08 on dist-test-slave-rgb1"
I20260810 11:30:08.912751 26973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/instance:
uuid: "482e605580be48cbbacce05a3e61c215"
format_stamp: "Formatted at 2026-08-10 11:30:08 on dist-test-slave-rgb1"
I20260810 11:30:08.922179 26973 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.008s sys 0.000s
I20260810 11:30:08.927585 26990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 11:30:08.929819 26973 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260810 11:30:08.930209 26973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal
uuid: "482e605580be48cbbacce05a3e61c215"
format_stamp: "Formatted at 2026-08-10 11:30:08 on dist-test-slave-rgb1"
I20260810 11:30:08.930531 26973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 11:30:08.975291 26973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 11:30:08.976753 26973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 11:30:08.977134 26973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 11:30:08.978508 26973 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 11:30:08.980727 26973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 11:30:08.980845 26973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 11:30:08.981006 26973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 11:30:08.981093 26973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 11:30:09.054296 27106 raft_consensus.cc:482] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83cc8e39a3b9455f8242a6da6a54c38a)
I20260810 11:30:09.054746 27106 raft_consensus.cc:504] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:09.055852 27106 leader_election.cc:288] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
I20260810 11:30:09.056962 26591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c40c76e125b44de181b88b7f63a566f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361" is_pre_election: true
I20260810 11:30:09.057441 26973 rpc_server.cc:307] RPC server started. Bound to: 127.25.195.195:38993
I20260810 11:30:09.057920 26437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c40c76e125b44de181b88b7f63a566f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" is_pre_election: true
I20260810 11:30:09.058645 26486 leader_election.cc:302] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c40c76e125b44de181b88b7f63a566f7; no voters: 83cc8e39a3b9455f8242a6da6a54c38a, ac259bcf213a4aa297d1d8e73b262361
I20260810 11:30:09.058790 27109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.195.195:38993 every 8 connection(s)
I20260810 11:30:09.059242 27106 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:09.060127 26973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/data/info.pb
I20260810 11:30:09.063645 26383 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu as pid 26973
I20260810 11:30:09.064121 26383 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/instance
I20260810 11:30:09.104750 27112 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:09.105773 27112 heartbeater.cc:464] Registering TS with master...
I20260810 11:30:09.105985 27111 heartbeater.cc:347] Connected to a master server at 127.25.195.254:41125
I20260810 11:30:09.106149 27111 heartbeater.cc:464] Registering TS with master...
I20260810 11:30:09.107139 27110 heartbeater.cc:347] Connected to a master server at 127.25.195.252:34489
I20260810 11:30:09.107295 27110 heartbeater.cc:464] Registering TS with master...
I20260810 11:30:09.107478 27111 heartbeater.cc:511] Master 127.25.195.254:41125 requested a full tablet report, sending...
I20260810 11:30:09.107774 27110 heartbeater.cc:511] Master 127.25.195.252:34489 requested a full tablet report, sending...
I20260810 11:30:09.108634 27112 heartbeater.cc:511] Master 127.25.195.253:34547 requested a full tablet report, sending...
I20260810 11:30:09.109544 26426 ts_manager.cc:194] Registered new tserver with Master: 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:09.109572 26581 ts_manager.cc:194] Registered new tserver with Master: 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:09.111074 26426 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.195.195:51159
I20260810 11:30:09.115167 26500 ts_manager.cc:194] Registered new tserver with Master: 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:09.134789 26383 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 11:30:09.204774 26426 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59076:
name: "default.Table_80f23d66647d48c2a24e5c11b40f4932"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:09.208730 26426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80f23d66647d48c2a24e5c11b40f4932 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:09.210425 26427 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59076:
name: "default.Table_0a2318e6a188452ba3731b73fe8c0590"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:09.211220 26427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a2318e6a188452ba3731b73fe8c0590 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:09.212412 26424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59076:
name: "default.Table_5c354deadd5943ed9d8cc6bf11b6c3a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:09.213274 26424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c354deadd5943ed9d8cc6bf11b6c3a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:09.213991 26422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59076:
name: "default.Table_e357d66833d64d288ba5af583be4f231"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:09.214908 26422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e357d66833d64d288ba5af583be4f231 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:09.214087 26423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59076:
name: "default.Table_4fac58f730b84ef28a9afe1460dd9b1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:09.218755 26423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4fac58f730b84ef28a9afe1460dd9b1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:09.214915 26421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59076:
name: "default.Table_979c5c1a66864f10a48b927021170a19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:09.216493 26418 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59076:
name: "default.Table_005934b4a2ed4bbcb221aed7de825cb8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:09.225816 26421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_979c5c1a66864f10a48b927021170a19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:09.224305 26425 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59076:
name: "default.Table_743bacd50baf4506bbbd14c3b53112fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:09.226946 26418 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_005934b4a2ed4bbcb221aed7de825cb8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:09.225580 26419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59076:
name: "default.Table_8811a91aaa3d40018d38fe9e8bf5c496"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:09.231037 26425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_743bacd50baf4506bbbd14c3b53112fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:09.234777 26419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8811a91aaa3d40018d38fe9e8bf5c496 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:09.240061 26417 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59076:
name: "default.Table_6a53772ebc024e5eaf4056861e96cb76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:09.241591 26417 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a53772ebc024e5eaf4056861e96cb76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:09.334774 26423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59076:
table { table_name: "default.Table_979c5c1a66864f10a48b927021170a19" } modify_external_catalogs: true
I20260810 11:30:09.335736 26423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59076:
table { table_name: "default.Table_979c5c1a66864f10a48b927021170a19" } modify_external_catalogs: true
I20260810 11:30:09.337265 26426 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59076:
table { table_name: "default.Table_80f23d66647d48c2a24e5c11b40f4932" } new_table_name: "default.Table_d0408c25651147ccac283681b9c88a6d" modify_external_catalogs: true
I20260810 11:30:09.338726 26419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59076:
table { table_name: "default.Table_743bacd50baf4506bbbd14c3b53112fe" } modify_external_catalogs: true
I20260810 11:30:09.339012 26419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59076:
table { table_name: "default.Table_743bacd50baf4506bbbd14c3b53112fe" } modify_external_catalogs: true
I20260810 11:30:09.341027 26422 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59076:
table { table_name: "default.Table_0a2318e6a188452ba3731b73fe8c0590" } new_table_name: "default.Table_f8e4d0bbde74426ab975bf7b91029861" modify_external_catalogs: true
I20260810 11:30:09.342694 26424 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59076:
table { table_name: "default.Table_5c354deadd5943ed9d8cc6bf11b6c3a8" } new_table_name: "default.Table_7374f0a22f4d45fc8dd0acc70f9feae5" modify_external_catalogs: true
I20260810 11:30:09.343191 26427 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59076:
table { table_name: "default.Table_e357d66833d64d288ba5af583be4f231" } new_table_name: "default.Table_c161f851586646a2989d355ca8e98fe7" modify_external_catalogs: true
I20260810 11:30:09.344115 26383 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu pid 26394
I20260810 11:30:09.345805 26425 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59076:
table { table_name: "default.Table_8811a91aaa3d40018d38fe9e8bf5c496" } new_table_name: "default.Table_60904d6759be49d28ea3e6d26c2fd7ea" modify_external_catalogs: true
I20260810 11:30:09.345052 26417 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59076:
table { table_name: "default.Table_6a53772ebc024e5eaf4056861e96cb76" } modify_external_catalogs: true
I20260810 11:30:09.347594 26417 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59076:
table { table_name: "default.Table_6a53772ebc024e5eaf4056861e96cb76" } modify_external_catalogs: true
I20260810 11:30:09.345583 26421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59076:
table { table_name: "default.Table_005934b4a2ed4bbcb221aed7de825cb8" } modify_external_catalogs: true
I20260810 11:30:09.351791 26458 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 11:30:09.352355 26421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59076:
table { table_name: "default.Table_005934b4a2ed4bbcb221aed7de825cb8" } modify_external_catalogs: true
I20260810 11:30:09.352403 26418 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59076:
table { table_name: "default.Table_4fac58f730b84ef28a9afe1460dd9b1c" } modify_external_catalogs: true
I20260810 11:30:09.504371 26418 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59076:
table { table_name: "default.Table_4fac58f730b84ef28a9afe1460dd9b1c" } modify_external_catalogs: true
I20260810 11:30:09.505198 26383 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu with pid 26394
W20260810 11:30:09.531610 27122 connection.cc:535] client connection to 127.25.195.254:41125 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 11:30:09.532059 26964 heartbeater.cc:644] Failed to heartbeat to 127.25.195.254:41125 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.25.195.254:41125 (error 108)
W20260810 11:30:09.533105 27122 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.25.195.254:41125)
W20260810 11:30:09.533702 27122 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.25.195.254:41125)
W20260810 11:30:09.534554 27122 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.25.195.254:41125)
I20260810 11:30:09.615845 27111 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
W20260810 11:30:09.617704 27111 heartbeater.cc:644] Failed to heartbeat to 127.25.195.254:41125 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.195.254:41125: connect: Connection refused (error 111)
W20260810 11:30:09.652382 26822 heartbeater.cc:644] Failed to heartbeat to 127.25.195.254:41125 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.195.254:41125: connect: Connection refused (error 111)
I20260810 11:30:09.854518 27183 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83cc8e39a3b9455f8242a6da6a54c38a)
I20260810 11:30:09.854807 27183 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:09.855046 27184 raft_consensus.cc:482] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83cc8e39a3b9455f8242a6da6a54c38a)
I20260810 11:30:09.855235 27184 raft_consensus.cc:504] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:09.855863 27183 leader_election.cc:288] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547)
I20260810 11:30:09.856478 26511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac259bcf213a4aa297d1d8e73b262361" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "c40c76e125b44de181b88b7f63a566f7" is_pre_election: true
I20260810 11:30:09.857024 26511 raft_consensus.cc:2396] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac259bcf213a4aa297d1d8e73b262361 for term 2 because replica has last-logged OpId of term: 1 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 15.
W20260810 11:30:09.857116 26566 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.195.254:41125: connect: Connection refused (error 111)
I20260810 11:30:09.857275 27184 leader_election.cc:288] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
I20260810 11:30:09.858651 26591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c40c76e125b44de181b88b7f63a566f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361" is_pre_election: true
I20260810 11:30:09.859005 26591 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c40c76e125b44de181b88b7f63a566f7 in term 1.
I20260810 11:30:09.859556 26487 leader_election.cc:302] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac259bcf213a4aa297d1d8e73b262361, c40c76e125b44de181b88b7f63a566f7; no voters:
W20260810 11:30:09.859527 26566 leader_election.cc:334] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125): Network error: Client connection negotiation failed: client connection to 127.25.195.254:41125: connect: Connection refused (error 111)
I20260810 11:30:09.859791 26566 leader_election.cc:302] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac259bcf213a4aa297d1d8e73b262361; no voters: 83cc8e39a3b9455f8242a6da6a54c38a, c40c76e125b44de181b88b7f63a566f7
I20260810 11:30:09.859899 27184 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260810 11:30:09.859949 26486 leader_election.cc:334] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125): Network error: Client connection negotiation failed: client connection to 127.25.195.254:41125: connect: Connection refused (error 111)
I20260810 11:30:09.860047 27184 raft_consensus.cc:482] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83cc8e39a3b9455f8242a6da6a54c38a)
I20260810 11:30:09.860105 27183 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:09.860174 27184 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:09.864225 27184 raft_consensus.cc:504] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:09.865656 27184 leader_election.cc:288] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 2 election: Requested vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
I20260810 11:30:09.866417 26591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c40c76e125b44de181b88b7f63a566f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361"
I20260810 11:30:09.866729 26591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 1 FOLLOWER]: Advancing to term 2
W20260810 11:30:09.867857 26486 leader_election.cc:334] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125): Network error: Client connection negotiation failed: client connection to 127.25.195.254:41125: connect: Connection refused (error 111)
I20260810 11:30:09.869750 26591 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c40c76e125b44de181b88b7f63a566f7 in term 2.
I20260810 11:30:09.870337 26487 leader_election.cc:302] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac259bcf213a4aa297d1d8e73b262361, c40c76e125b44de181b88b7f63a566f7; no voters: 83cc8e39a3b9455f8242a6da6a54c38a
I20260810 11:30:09.870708 27184 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 11:30:09.871275 27184 raft_consensus.cc:686] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 2 LEADER]: Becoming Leader. State: Replica: c40c76e125b44de181b88b7f63a566f7, State: Running, Role: LEADER
I20260810 11:30:09.871765 27184 consensus_queue.cc:237] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 1.16, Last appended by leader: 15, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:09.873433 27189 sys_catalog.cc:455] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c40c76e125b44de181b88b7f63a566f7. Latest consensus state: current_term: 2 leader_uuid: "c40c76e125b44de181b88b7f63a566f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:09.874665 27189 sys_catalog.cc:458] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: This master's current role is: LEADER
W20260810 11:30:10.324313 26486 consensus_peers.cc:487] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 -> Peer 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125): Couldn't send request to peer 83cc8e39a3b9455f8242a6da6a54c38a. Status: Network error: Client connection negotiation failed: client connection to 127.25.195.254:41125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:10.354619 26383 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
/tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.195.254:41125
--webserver_interface=127.25.195.254
--webserver_port=36939
--builtin_ntp_servers=127.25.195.212:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260810 11:30:10.469103 26591 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 2 FOLLOWER]: Refusing update from remote peer c40c76e125b44de181b88b7f63a566f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 2 index: 17. (index mismatch)
I20260810 11:30:10.470100 27189 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
I20260810 11:30:10.473683 27195 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c40c76e125b44de181b88b7f63a566f7. Latest consensus state: current_term: 2 leader_uuid: "c40c76e125b44de181b88b7f63a566f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:10.474152 27195 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:10.478459 27195 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "c40c76e125b44de181b88b7f63a566f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:10.478863 27195 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:10.480741 27204 sys_catalog.cc:455] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "c40c76e125b44de181b88b7f63a566f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:10.481040 27204 sys_catalog.cc:458] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: This master's current role is: LEADER
I20260810 11:30:10.521842 27190 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 11:30:10.525946 27190 catalog_manager.cc:669] Loaded metadata for table default.Table_6a53772ebc024e5eaf4056861e96cb76 [id=3e75819319a640be8338314ed63612a8]
I20260810 11:30:10.526588 27190 catalog_manager.cc:669] Loaded metadata for table default.Table_979c5c1a66864f10a48b927021170a19 [id=559a1b8b32474e5ca77db79796c40396]
I20260810 11:30:10.527016 27190 catalog_manager.cc:669] Loaded metadata for table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]
I20260810 11:30:10.527520 27190 catalog_manager.cc:669] Loaded metadata for table default.Table_8811a91aaa3d40018d38fe9e8bf5c496 [id=6d8fc88a491140548a45c7fbb403bb36]
I20260810 11:30:10.527904 27190 catalog_manager.cc:669] Loaded metadata for table default.Table_5c354deadd5943ed9d8cc6bf11b6c3a8 [id=83d99a766e604e4e9c21a029241cf624]
I20260810 11:30:10.528363 27190 catalog_manager.cc:669] Loaded metadata for table default.Table_e357d66833d64d288ba5af583be4f231 [id=8d5da0e5fab74127880f199687b0d3eb]
I20260810 11:30:10.528811 27190 catalog_manager.cc:669] Loaded metadata for table default.Table_4fac58f730b84ef28a9afe1460dd9b1c [id=94f926d61d0d41d69239788ab4c92389]
I20260810 11:30:10.529240 27190 catalog_manager.cc:669] Loaded metadata for table default.Table_0a2318e6a188452ba3731b73fe8c0590 [id=a0e3fe57b37a415aa5123ca2199b9968]
I20260810 11:30:10.529657 27190 catalog_manager.cc:669] Loaded metadata for table default.Table_005934b4a2ed4bbcb221aed7de825cb8 [id=d0efd4d5e3ab4cfe9ffce97baa70c9c2]
I20260810 11:30:10.532181 27190 tablet_loader.cc:96] loaded metadata for tablet 2c6b3f8626724d12986f388b1ca90b3c (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a])
I20260810 11:30:10.532541 27190 tablet_loader.cc:96] loaded metadata for tablet 2d7e745f05534917a5deecce410722e6 (table default.Table_8811a91aaa3d40018d38fe9e8bf5c496 [id=6d8fc88a491140548a45c7fbb403bb36])
I20260810 11:30:10.532954 27190 tablet_loader.cc:96] loaded metadata for tablet 686734ebc954491d8087d7119bf0d4b2 (table default.Table_6a53772ebc024e5eaf4056861e96cb76 [id=3e75819319a640be8338314ed63612a8])
I20260810 11:30:10.533295 27190 tablet_loader.cc:96] loaded metadata for tablet 694c020ef0854f5dae0482d2b9055c88 (table default.Table_005934b4a2ed4bbcb221aed7de825cb8 [id=d0efd4d5e3ab4cfe9ffce97baa70c9c2])
I20260810 11:30:10.533588 27190 tablet_loader.cc:96] loaded metadata for tablet 95666290db784be49d71a78b2b3512b3 (table default.Table_979c5c1a66864f10a48b927021170a19 [id=559a1b8b32474e5ca77db79796c40396])
I20260810 11:30:10.533859 27190 tablet_loader.cc:96] loaded metadata for tablet a147ef9ea19841688880fd4f7e05d447 (table default.Table_4fac58f730b84ef28a9afe1460dd9b1c [id=94f926d61d0d41d69239788ab4c92389])
I20260810 11:30:10.534144 27190 tablet_loader.cc:96] loaded metadata for tablet a9615b1ff3454a46a1a27cfcea20ad00 (table default.Table_0a2318e6a188452ba3731b73fe8c0590 [id=a0e3fe57b37a415aa5123ca2199b9968])
I20260810 11:30:10.534571 27190 tablet_loader.cc:96] loaded metadata for tablet f05f2fc60d0f43f6a72fca16828f94f9 (table default.Table_e357d66833d64d288ba5af583be4f231 [id=8d5da0e5fab74127880f199687b0d3eb])
I20260810 11:30:10.534844 27190 tablet_loader.cc:96] loaded metadata for tablet f4a8a3553014448096836f888bdc2835 (table default.Table_5c354deadd5943ed9d8cc6bf11b6c3a8 [id=83d99a766e604e4e9c21a029241cf624])
I20260810 11:30:10.535185 27190 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 11:30:10.536880 27190 catalog_manager.cc:1259] Loaded cluster ID: 5081849c8420415b9be91728667896d5
I20260810 11:30:10.537052 27190 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 11:30:10.539070 27190 catalog_manager.cc:1504] Loading token signing keys...
I20260810 11:30:10.540294 27190 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Loaded TSK: 0
I20260810 11:30:10.541751 27190 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 11:30:10.559470 26501 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_80f23d66647d48c2a24e5c11b40f4932" } new_table_name: "default.Table_d0408c25651147ccac283681b9c88a6d" modify_external_catalogs: true
I20260810 11:30:10.561121 26495 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_4fac58f730b84ef28a9afe1460dd9b1c" } modify_external_catalogs: true
I20260810 11:30:10.561709 26495 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_4fac58f730b84ef28a9afe1460dd9b1c" } modify_external_catalogs: true
I20260810 11:30:10.561157 26501 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_8811a91aaa3d40018d38fe9e8bf5c496" } new_table_name: "default.Table_60904d6759be49d28ea3e6d26c2fd7ea" modify_external_catalogs: true
I20260810 11:30:10.561627 26499 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5c354deadd5943ed9d8cc6bf11b6c3a8" } new_table_name: "default.Table_7374f0a22f4d45fc8dd0acc70f9feae5" modify_external_catalogs: true
I20260810 11:30:10.562034 26497 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_0a2318e6a188452ba3731b73fe8c0590" } new_table_name: "default.Table_f8e4d0bbde74426ab975bf7b91029861" modify_external_catalogs: true
I20260810 11:30:10.562233 26496 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_005934b4a2ed4bbcb221aed7de825cb8" } modify_external_catalogs: true
I20260810 11:30:10.565320 26496 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_005934b4a2ed4bbcb221aed7de825cb8" } modify_external_catalogs: true
I20260810 11:30:10.561563 26498 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_e357d66833d64d288ba5af583be4f231" } new_table_name: "default.Table_c161f851586646a2989d355ca8e98fe7" modify_external_catalogs: true
I20260810 11:30:10.562906 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_6a53772ebc024e5eaf4056861e96cb76" } modify_external_catalogs: true
I20260810 11:30:10.571061 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_6a53772ebc024e5eaf4056861e96cb76" } modify_external_catalogs: true
I20260810 11:30:10.562597 26493 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_979c5c1a66864f10a48b927021170a19" } modify_external_catalogs: true
I20260810 11:30:10.571383 26493 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_979c5c1a66864f10a48b927021170a19" } modify_external_catalogs: true
I20260810 11:30:10.562340 26492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_743bacd50baf4506bbbd14c3b53112fe" } modify_external_catalogs: true
I20260810 11:30:10.572006 26492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_743bacd50baf4506bbbd14c3b53112fe" } modify_external_catalogs: true
I20260810 11:30:10.568918 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_585d72239d734868bb2b8b952b14c477"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:10.573597 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_585d72239d734868bb2b8b952b14c477 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:10.580255 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_fd954e7bf8b44188a999b4c66593196f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:10.581139 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd954e7bf8b44188a999b4c66593196f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:10.586485 26495 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet a147ef9ea19841688880fd4f7e05d447
I20260810 11:30:10.587258 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_b609612a64d045b086440c601c257f30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:10.588236 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b609612a64d045b086440c601c257f30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:10.590943 26496 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 694c020ef0854f5dae0482d2b9055c88
W20260810 11:30:10.592667 26497 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9615b1ff3454a46a1a27cfcea20ad00 has no consensus state
I20260810 11:30:10.593472 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_c43921fb6a024b50b218fad3b85e6904"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:10.593802 26501 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d7e745f05534917a5deecce410722e6 has no consensus state
W20260810 11:30:10.594321 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c43921fb6a024b50b218fad3b85e6904 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:10.594772 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_db5d76a4f7fe4b97956329a4066ab729"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:10.594550 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_96a70f4812ec4dec8208ba26426bf964"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:10.595455 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96a70f4812ec4dec8208ba26426bf964 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:10.596354 26493 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 95666290db784be49d71a78b2b3512b3
W20260810 11:30:10.596607 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db5d76a4f7fe4b97956329a4066ab729 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:10.596818 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_a22053d83a1b4da9830e4cfc1b0eff07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:10.597476 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a22053d83a1b4da9830e4cfc1b0eff07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:10.606101 26498 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f05f2fc60d0f43f6a72fca16828f94f9 has no consensus state
W20260810 11:30:10.606467 26499 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4a8a3553014448096836f888bdc2835 has no consensus state
I20260810 11:30:10.609313 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_e5642a48d99746bd93084164c85f0d03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:10.610030 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e5642a48d99746bd93084164c85f0d03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:10.611234 26491 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 686734ebc954491d8087d7119bf0d4b2
I20260810 11:30:10.611114 26492 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_60904d6759be49d28ea3e6d26c2fd7ea" } new_table_name: "default.Table_58a86f8f0e094935a6188bc670ffebf5" modify_external_catalogs: true
I20260810 11:30:10.613185 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_5b586fe77bb94d2ab0185ad1758fb770"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:10.613634 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_f8e4d0bbde74426ab975bf7b91029861" } modify_external_catalogs: true
I20260810 11:30:10.614512 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_f8e4d0bbde74426ab975bf7b91029861" } modify_external_catalogs: true
W20260810 11:30:10.614913 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b586fe77bb94d2ab0185ad1758fb770 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:10.619544 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_8e3537dc1b294128b70896bf5501c85e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:10.620312 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e3537dc1b294128b70896bf5501c85e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:10.635846 26492 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d7e745f05534917a5deecce410722e6 has no consensus state
W20260810 11:30:10.636314 26487 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 2d7e745f05534917a5deecce410722e6 (table default.Table_58a86f8f0e094935a6188bc670ffebf5 [id=6d8fc88a491140548a45c7fbb403bb36], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2d7e745f05534917a5deecce410722e6 has no consensus state
I20260810 11:30:10.665135 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet a9615b1ff3454a46a1a27cfcea20ad00
I20260810 11:30:10.705875 26745 tablet_service.cc:1467] Processing CreateTablet for tablet 2c6b3f8626724d12986f388b1ca90b3c (DEFAULT_TABLE table=default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.708154 26746 tablet_service.cc:1467] Processing CreateTablet for tablet 2d7e745f05534917a5deecce410722e6 (DEFAULT_TABLE table=default.Table_58a86f8f0e094935a6188bc670ffebf5 [id=6d8fc88a491140548a45c7fbb403bb36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.709362 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d7e745f05534917a5deecce410722e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.711519 26894 tablet_service.cc:1467] Processing CreateTablet for tablet f05f2fc60d0f43f6a72fca16828f94f9 (DEFAULT_TABLE table=default.Table_c161f851586646a2989d355ca8e98fe7 [id=8d5da0e5fab74127880f199687b0d3eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.713258 26747 tablet_service.cc:1467] Processing CreateTablet for tablet f05f2fc60d0f43f6a72fca16828f94f9 (DEFAULT_TABLE table=default.Table_c161f851586646a2989d355ca8e98fe7 [id=8d5da0e5fab74127880f199687b0d3eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.713503 27037 tablet_service.cc:1467] Processing CreateTablet for tablet 2d7e745f05534917a5deecce410722e6 (DEFAULT_TABLE table=default.Table_58a86f8f0e094935a6188bc670ffebf5 [id=6d8fc88a491140548a45c7fbb403bb36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.713819 26747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f05f2fc60d0f43f6a72fca16828f94f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.714533 27036 tablet_service.cc:1467] Processing CreateTablet for tablet 2c6b3f8626724d12986f388b1ca90b3c (DEFAULT_TABLE table=default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.714692 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d7e745f05534917a5deecce410722e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.714970 27039 tablet_service.cc:1467] Processing CreateTablet for tablet a9615b1ff3454a46a1a27cfcea20ad00 (DEFAULT_TABLE table=default.Table_f8e4d0bbde74426ab975bf7b91029861 [id=a0e3fe57b37a415aa5123ca2199b9968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.715505 27039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9615b1ff3454a46a1a27cfcea20ad00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.714252 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet a9615b1ff3454a46a1a27cfcea20ad00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:10.717200 26748 tablet_service.cc:1467] Processing CreateTablet for tablet a9615b1ff3454a46a1a27cfcea20ad00 (DEFAULT_TABLE table=default.Table_f8e4d0bbde74426ab975bf7b91029861 [id=a0e3fe57b37a415aa5123ca2199b9968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.717376 26895 tablet_service.cc:1467] Processing CreateTablet for tablet a9615b1ff3454a46a1a27cfcea20ad00 (DEFAULT_TABLE table=default.Table_f8e4d0bbde74426ab975bf7b91029861 [id=a0e3fe57b37a415aa5123ca2199b9968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.713153 27038 tablet_service.cc:1467] Processing CreateTablet for tablet f05f2fc60d0f43f6a72fca16828f94f9 (DEFAULT_TABLE table=default.Table_c161f851586646a2989d355ca8e98fe7 [id=8d5da0e5fab74127880f199687b0d3eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.718137 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9615b1ff3454a46a1a27cfcea20ad00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.718969 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f05f2fc60d0f43f6a72fca16828f94f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.719736 26745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c6b3f8626724d12986f388b1ca90b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.720052 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9615b1ff3454a46a1a27cfcea20ad00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.720983 27032 tablet_service.cc:1467] Processing CreateTablet for tablet 201bafec782a4570a556f1c920e84898 (DEFAULT_TABLE table=default.Table_e5642a48d99746bd93084164c85f0d03 [id=31781820c0814fb0bee423b2ce6ae615]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.722693 26892 tablet_service.cc:1467] Processing CreateTablet for tablet 2c6b3f8626724d12986f388b1ca90b3c (DEFAULT_TABLE table=default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.722774 26893 tablet_service.cc:1467] Processing CreateTablet for tablet 2d7e745f05534917a5deecce410722e6 (DEFAULT_TABLE table=default.Table_58a86f8f0e094935a6188bc670ffebf5 [id=6d8fc88a491140548a45c7fbb403bb36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.723361 26892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c6b3f8626724d12986f388b1ca90b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.724181 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d7e745f05534917a5deecce410722e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.727770 26891 tablet_service.cc:1467] Processing CreateTablet for tablet f4a8a3553014448096836f888bdc2835 (DEFAULT_TABLE table=default.Table_7374f0a22f4d45fc8dd0acc70f9feae5 [id=83d99a766e604e4e9c21a029241cf624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.728413 26891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4a8a3553014448096836f888bdc2835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.733100 27036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c6b3f8626724d12986f388b1ca90b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.734802 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f05f2fc60d0f43f6a72fca16828f94f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.735816 27035 tablet_service.cc:1467] Processing CreateTablet for tablet f4a8a3553014448096836f888bdc2835 (DEFAULT_TABLE table=default.Table_7374f0a22f4d45fc8dd0acc70f9feae5 [id=83d99a766e604e4e9c21a029241cf624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.743788 27032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 201bafec782a4570a556f1c920e84898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.744112 26744 tablet_service.cc:1467] Processing CreateTablet for tablet f4a8a3553014448096836f888bdc2835 (DEFAULT_TABLE table=default.Table_7374f0a22f4d45fc8dd0acc70f9feae5 [id=83d99a766e604e4e9c21a029241cf624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.745229 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4a8a3553014448096836f888bdc2835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.746708 27026 tablet_service.cc:1467] Processing CreateTablet for tablet a8197318b04a470791dd639742547fce (DEFAULT_TABLE table=default.Table_b609612a64d045b086440c601c257f30 [id=9b210311762a4c07bde13fd8ec4d7568]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.747291 27027 tablet_service.cc:1467] Processing CreateTablet for tablet 566bf0f68c2946a89203472786e82512 (DEFAULT_TABLE table=default.Table_fd954e7bf8b44188a999b4c66593196f [id=a2d890f4b9874411a503888263d07d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.747826 27030 tablet_service.cc:1467] Processing CreateTablet for tablet c0120575c9fd4b2fb32ca7392db277bf (DEFAULT_TABLE table=default.Table_8e3537dc1b294128b70896bf5501c85e [id=91a6a06504b24b8892a26d1ec11da667]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.748253 27029 tablet_service.cc:1467] Processing CreateTablet for tablet 50e61e835429436d9bdc585b8c7381f6 (DEFAULT_TABLE table=default.Table_96a70f4812ec4dec8208ba26426bf964 [id=4a855b81f02147958d928720286121df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.749136 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4a8a3553014448096836f888bdc2835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.750042 27027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 566bf0f68c2946a89203472786e82512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.750597 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet a9615b1ff3454a46a1a27cfcea20ad00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:10.750783 27030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0120575c9fd4b2fb32ca7392db277bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.751425 27029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50e61e835429436d9bdc585b8c7381f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.752453 27026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8197318b04a470791dd639742547fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.753636 27025 tablet_service.cc:1467] Processing CreateTablet for tablet 417f48ddea6440a5a86fa05f7e514005 (DEFAULT_TABLE table=default.Table_c43921fb6a024b50b218fad3b85e6904 [id=982ed623ee924e059c884584da03c56a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.754509 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 417f48ddea6440a5a86fa05f7e514005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.754801 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 66a7790587ed478b843fa9e997e50893 (DEFAULT_TABLE table=default.Table_585d72239d734868bb2b8b952b14c477 [id=b2754904694140cab5a7a82d31449a70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.756950 27033 tablet_service.cc:1467] Processing CreateTablet for tablet 2984cf53478e437d955aa3d0917287e9 (DEFAULT_TABLE table=default.Table_5b586fe77bb94d2ab0185ad1758fb770 [id=395fa947a5c445ad8b35ae050cca583b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.756785 27031 tablet_service.cc:1467] Processing CreateTablet for tablet 7edd85afa247429f92d4ed2f7c35ee16 (DEFAULT_TABLE table=default.Table_a22053d83a1b4da9830e4cfc1b0eff07 [id=6bc27d6198fc4654aa20602a3917569e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.758297 27024 tablet_service.cc:1467] Processing CreateTablet for tablet b1cd64deb8e24c81ba2d4214bb38f5da (DEFAULT_TABLE table=default.Table_db5d76a4f7fe4b97956329a4066ab729 [id=03dca1a3a16e42049c194a46978bbfec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.760699 27031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7edd85afa247429f92d4ed2f7c35ee16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.762287 27033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2984cf53478e437d955aa3d0917287e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.763918 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66a7790587ed478b843fa9e997e50893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.765408 27024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1cd64deb8e24c81ba2d4214bb38f5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.771040 27222 tablet_bootstrap.cc:492] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:10.772060 26742 tablet_service.cc:1467] Processing CreateTablet for tablet 2984cf53478e437d955aa3d0917287e9 (DEFAULT_TABLE table=default.Table_5b586fe77bb94d2ab0185ad1758fb770 [id=395fa947a5c445ad8b35ae050cca583b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.777005 26734 tablet_service.cc:1467] Processing CreateTablet for tablet b1cd64deb8e24c81ba2d4214bb38f5da (DEFAULT_TABLE table=default.Table_db5d76a4f7fe4b97956329a4066ab729 [id=03dca1a3a16e42049c194a46978bbfec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.777402 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2984cf53478e437d955aa3d0917287e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.777686 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1cd64deb8e24c81ba2d4214bb38f5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.773227 26741 tablet_service.cc:1467] Processing CreateTablet for tablet 7edd85afa247429f92d4ed2f7c35ee16 (DEFAULT_TABLE table=default.Table_a22053d83a1b4da9830e4cfc1b0eff07 [id=6bc27d6198fc4654aa20602a3917569e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.778198 26741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7edd85afa247429f92d4ed2f7c35ee16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.774180 26740 tablet_service.cc:1467] Processing CreateTablet for tablet c0120575c9fd4b2fb32ca7392db277bf (DEFAULT_TABLE table=default.Table_8e3537dc1b294128b70896bf5501c85e [id=91a6a06504b24b8892a26d1ec11da667]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.781096 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0120575c9fd4b2fb32ca7392db277bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.774345 26739 tablet_service.cc:1467] Processing CreateTablet for tablet 50e61e835429436d9bdc585b8c7381f6 (DEFAULT_TABLE table=default.Table_96a70f4812ec4dec8208ba26426bf964 [id=4a855b81f02147958d928720286121df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.785235 26739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50e61e835429436d9bdc585b8c7381f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.775228 26738 tablet_service.cc:1467] Processing CreateTablet for tablet 66a7790587ed478b843fa9e997e50893 (DEFAULT_TABLE table=default.Table_585d72239d734868bb2b8b952b14c477 [id=b2754904694140cab5a7a82d31449a70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.791675 26738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66a7790587ed478b843fa9e997e50893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.794225 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_96a70f4812ec4dec8208ba26426bf964" } modify_external_catalogs: true
I20260810 11:30:10.794548 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_96a70f4812ec4dec8208ba26426bf964" } modify_external_catalogs: true
I20260810 11:30:10.775516 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 566bf0f68c2946a89203472786e82512 (DEFAULT_TABLE table=default.Table_fd954e7bf8b44188a999b4c66593196f [id=a2d890f4b9874411a503888263d07d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.797271 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 566bf0f68c2946a89203472786e82512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.775949 26736 tablet_service.cc:1467] Processing CreateTablet for tablet a8197318b04a470791dd639742547fce (DEFAULT_TABLE table=default.Table_b609612a64d045b086440c601c257f30 [id=9b210311762a4c07bde13fd8ec4d7568]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.801716 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8197318b04a470791dd639742547fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.801999 26499 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_db5d76a4f7fe4b97956329a4066ab729" } new_table_name: "default.Table_c704b35715424f678bdb8f7af876ff0d" modify_external_catalogs: true
I20260810 11:30:10.802201 26500 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_58a86f8f0e094935a6188bc670ffebf5" } new_table_name: "default.Table_5e6805f352774d24922eaf28498034d5" modify_external_catalogs: true
I20260810 11:30:10.803228 26498 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_b609612a64d045b086440c601c257f30" } modify_external_catalogs: true
I20260810 11:30:10.803718 26498 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_b609612a64d045b086440c601c257f30" } modify_external_catalogs: true
I20260810 11:30:10.803817 26492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5b586fe77bb94d2ab0185ad1758fb770" } modify_external_catalogs: true
I20260810 11:30:10.804001 26492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5b586fe77bb94d2ab0185ad1758fb770" } modify_external_catalogs: true
I20260810 11:30:10.776707 26735 tablet_service.cc:1467] Processing CreateTablet for tablet 417f48ddea6440a5a86fa05f7e514005 (DEFAULT_TABLE table=default.Table_c43921fb6a024b50b218fad3b85e6904 [id=982ed623ee924e059c884584da03c56a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.805348 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 417f48ddea6440a5a86fa05f7e514005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.809508 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 50e61e835429436d9bdc585b8c7381f6
I20260810 11:30:10.810913 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_3ac53693e5d649f0be8542fa2d55f936"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:10.811620 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ac53693e5d649f0be8542fa2d55f936 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:10.812512 26500 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d7e745f05534917a5deecce410722e6 consensus state has no leader
I20260810 11:30:10.812702 26496 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_a22053d83a1b4da9830e4cfc1b0eff07" } new_table_name: "default.Table_6ded95de14fd42ef926969f573a166c5" modify_external_catalogs: true
I20260810 11:30:10.815620 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet 50e61e835429436d9bdc585b8c7381f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:10.815819 26500 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c43921fb6a024b50b218fad3b85e6904" } modify_external_catalogs: true
I20260810 11:30:10.816439 26491 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c161f851586646a2989d355ca8e98fe7" } new_table_name: "default.Table_646a67105a2344659bc01af8a4d8dd5a" modify_external_catalogs: true
I20260810 11:30:10.816828 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_2511fda0071847d1a412482192a6bbb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:10.817507 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2511fda0071847d1a412482192a6bbb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:10.819242 26500 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c43921fb6a024b50b218fad3b85e6904" } modify_external_catalogs: true
I20260810 11:30:10.820004 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_20f0074b10a34dec9790646fd1761385"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:10.820652 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20f0074b10a34dec9790646fd1761385 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:10.827919 26492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 2984cf53478e437d955aa3d0917287e9
I20260810 11:30:10.824709 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_614b87ec3a9442249a842d3816126fbb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:10.830338 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet 2984cf53478e437d955aa3d0917287e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:35790
W20260810 11:30:10.831249 26499 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b1cd64deb8e24c81ba2d4214bb38f5da consensus state has no leader
I20260810 11:30:10.831394 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_c2c10310e09d44fdae1c00c7997c03f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:10.831701 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_5c1990a7c1d64a6eb801c2a2ae958db8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:10.832132 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c1990a7c1d64a6eb801c2a2ae958db8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:10.832134 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2c10310e09d44fdae1c00c7997c03f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:10.833578 26498 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet a8197318b04a470791dd639742547fce
I20260810 11:30:10.835124 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet a8197318b04a470791dd639742547fce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:35790
W20260810 11:30:10.835539 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_614b87ec3a9442249a842d3816126fbb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:10.836855 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_34a96af6cf15489aa83ecaba921b4f17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:10.837669 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34a96af6cf15489aa83ecaba921b4f17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:10.840364 26890 tablet_service.cc:1514] Processing DeleteTablet for tablet a9615b1ff3454a46a1a27cfcea20ad00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:10.848837 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 201bafec782a4570a556f1c920e84898 (DEFAULT_TABLE table=default.Table_e5642a48d99746bd93084164c85f0d03 [id=31781820c0814fb0bee423b2ce6ae615]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.851503 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 201bafec782a4570a556f1c920e84898. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:10.855747 26496 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7edd85afa247429f92d4ed2f7c35ee16 consensus state has no leader
I20260810 11:30:10.861713 26500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 417f48ddea6440a5a86fa05f7e514005
I20260810 11:30:10.861593 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 2984cf53478e437d955aa3d0917287e9 (DEFAULT_TABLE table=default.Table_5b586fe77bb94d2ab0185ad1758fb770 [id=395fa947a5c445ad8b35ae050cca583b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.862416 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2984cf53478e437d955aa3d0917287e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.872997 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet 417f48ddea6440a5a86fa05f7e514005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:10.880538 26888 tablet_service.cc:1467] Processing CreateTablet for tablet 201bafec782a4570a556f1c920e84898 (DEFAULT_TABLE table=default.Table_e5642a48d99746bd93084164c85f0d03 [id=31781820c0814fb0bee423b2ce6ae615]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.880767 26887 tablet_service.cc:1467] Processing CreateTablet for tablet 7edd85afa247429f92d4ed2f7c35ee16 (DEFAULT_TABLE table=default.Table_a22053d83a1b4da9830e4cfc1b0eff07 [id=6bc27d6198fc4654aa20602a3917569e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.881304 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 201bafec782a4570a556f1c920e84898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.887166 26501 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_585d72239d734868bb2b8b952b14c477" } new_table_name: "default.Table_c051f1f117b04fdd9c1ed11f426ae316" modify_external_catalogs: true
I20260810 11:30:10.891042 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_642d4dc06a4a436ea666abb1ae5e6f7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:10.892624 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_642d4dc06a4a436ea666abb1ae5e6f7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:10.894424 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_45031e01640c41469cf6724429b043b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:10.895684 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45031e01640c41469cf6724429b043b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:10.895756 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_cfc8961345fa4f11bad13079b98e496f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:10.896517 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfc8961345fa4f11bad13079b98e496f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:10.901682 27222 tablet_bootstrap.cc:654] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:10.908209 26491 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f05f2fc60d0f43f6a72fca16828f94f9 consensus state has no leader
I20260810 11:30:10.911475 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_6ded95de14fd42ef926969f573a166c5" } modify_external_catalogs: true
I20260810 11:30:10.912061 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_6ded95de14fd42ef926969f573a166c5" } modify_external_catalogs: true
I20260810 11:30:10.917268 26884 tablet_service.cc:1467] Processing CreateTablet for tablet 66a7790587ed478b843fa9e997e50893 (DEFAULT_TABLE table=default.Table_585d72239d734868bb2b8b952b14c477 [id=b2754904694140cab5a7a82d31449a70]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:10.930477 26486 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.195.254:41125: connect: Connection refused (error 111) [suppressed 7 similar messages]
I20260810 11:30:10.959714 27023 tablet_service.cc:1467] Processing CreateTablet for tablet 2efaf8b45a824e34b7f23037de5eec45 (DEFAULT_TABLE table=default.Table_3ac53693e5d649f0be8542fa2d55f936 [id=bf77960e83134a008f3e19008893a6e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.962832 26878 tablet_service.cc:1514] Processing DeleteTablet for tablet 2984cf53478e437d955aa3d0917287e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:10.965265 26887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7edd85afa247429f92d4ed2f7c35ee16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.968223 26876 tablet_service.cc:1514] Processing DeleteTablet for tablet 417f48ddea6440a5a86fa05f7e514005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:10.972210 26884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66a7790587ed478b843fa9e997e50893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.977461 26880 tablet_service.cc:1467] Processing CreateTablet for tablet b1cd64deb8e24c81ba2d4214bb38f5da (DEFAULT_TABLE table=default.Table_db5d76a4f7fe4b97956329a4066ab729 [id=03dca1a3a16e42049c194a46978bbfec]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:10.978286 26501 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 66a7790587ed478b843fa9e997e50893 consensus state has no leader
I20260810 11:30:10.978505 26880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1cd64deb8e24c81ba2d4214bb38f5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.978837 26882 tablet_service.cc:1467] Processing CreateTablet for tablet a8197318b04a470791dd639742547fce (DEFAULT_TABLE table=default.Table_b609612a64d045b086440c601c257f30 [id=9b210311762a4c07bde13fd8ec4d7568]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.979553 26882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8197318b04a470791dd639742547fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.981217 26886 tablet_service.cc:1467] Processing CreateTablet for tablet c0120575c9fd4b2fb32ca7392db277bf (DEFAULT_TABLE table=default.Table_8e3537dc1b294128b70896bf5501c85e [id=91a6a06504b24b8892a26d1ec11da667]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.981889 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0120575c9fd4b2fb32ca7392db277bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.982128 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 417f48ddea6440a5a86fa05f7e514005 (DEFAULT_TABLE table=default.Table_c43921fb6a024b50b218fad3b85e6904 [id=982ed623ee924e059c884584da03c56a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.982681 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 417f48ddea6440a5a86fa05f7e514005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.970223 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet 50e61e835429436d9bdc585b8c7381f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:10.998059 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 566bf0f68c2946a89203472786e82512 (DEFAULT_TABLE table=default.Table_fd954e7bf8b44188a999b4c66593196f [id=a2d890f4b9874411a503888263d07d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:10.998843 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 566bf0f68c2946a89203472786e82512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.000347 26885 tablet_service.cc:1467] Processing CreateTablet for tablet 50e61e835429436d9bdc585b8c7381f6 (DEFAULT_TABLE table=default.Table_96a70f4812ec4dec8208ba26426bf964 [id=4a855b81f02147958d928720286121df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.001600 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50e61e835429436d9bdc585b8c7381f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:10.994164 26877 tablet_service.cc:1514] Processing DeleteTablet for tablet a8197318b04a470791dd639742547fce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:11.004891 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 7edd85afa247429f92d4ed2f7c35ee16
I20260810 11:30:11.007408 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2efaf8b45a824e34b7f23037de5eec45. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:11.012729 26486 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.254:41125, user_credentials={real_user=slave}} blocked reactor thread for 82319us
I20260810 11:30:11.013199 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c051f1f117b04fdd9c1ed11f426ae316" } modify_external_catalogs: true
I20260810 11:30:11.013420 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c051f1f117b04fdd9c1ed11f426ae316" } modify_external_catalogs: true
I20260810 11:30:11.016862 26500 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c704b35715424f678bdb8f7af876ff0d" } new_table_name: "default.Table_7e1ff16472f842438c14184ab96741e1" modify_external_catalogs: true
I20260810 11:30:11.021112 27022 tablet_service.cc:1467] Processing CreateTablet for tablet 3dabfbd779c5406cb10ecf70f5a142e7 (DEFAULT_TABLE table=default.Table_2511fda0071847d1a412482192a6bbb4 [id=66cb5c83b5894c1a9bc02e9019921428]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.023195 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dabfbd779c5406cb10ecf70f5a142e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.023715 27222 log.cc:824] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d: Log is configured to *not* fsync() on all Append() calls
I20260810 11:30:11.024020 27020 tablet_service.cc:1467] Processing CreateTablet for tablet 607b055f8ced4372800adf5817b46e0b (DEFAULT_TABLE table=default.Table_614b87ec3a9442249a842d3816126fbb [id=68a29d5ebf8140198fbf4da3cd974847]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.026364 27020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 607b055f8ced4372800adf5817b46e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.032291 26493 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_2511fda0071847d1a412482192a6bbb4" } modify_external_catalogs: true
I20260810 11:30:11.032747 26493 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_2511fda0071847d1a412482192a6bbb4" } modify_external_catalogs: true
I20260810 11:30:11.022471 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 256af4222bb34745ac018dd82a9c4f9b (DEFAULT_TABLE table=default.Table_5c1990a7c1d64a6eb801c2a2ae958db8 [id=3332dd1574f04ec1a34468ad5908602b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.037957 26501 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_e5642a48d99746bd93084164c85f0d03" } new_table_name: "default.Table_01ba22149a2f482782c70caa4d2244ea" modify_external_catalogs: true
I20260810 11:30:11.038380 26498 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_45031e01640c41469cf6724429b043b7" } modify_external_catalogs: true
I20260810 11:30:11.038645 26498 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_45031e01640c41469cf6724429b043b7" } modify_external_catalogs: true
I20260810 11:30:11.039681 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 256af4222bb34745ac018dd82a9c4f9b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:11.050694 26500 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b1cd64deb8e24c81ba2d4214bb38f5da consensus state has no leader
I20260810 11:30:11.053140 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 50e61e835429436d9bdc585b8c7381f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:11.054505 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 2984cf53478e437d955aa3d0917287e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:11.055305 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet a8197318b04a470791dd639742547fce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:11.055025 26485 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet a9615b1ff3454a46a1a27cfcea20ad00 because the tablet was not found. No further retry: Not found: Tablet not found: a9615b1ff3454a46a1a27cfcea20ad00
W20260810 11:30:11.057960 26485 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 50e61e835429436d9bdc585b8c7381f6 because the tablet was not found. No further retry: Not found: Tablet not found: 50e61e835429436d9bdc585b8c7381f6
I20260810 11:30:11.058501 26500 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_614b87ec3a9442249a842d3816126fbb" } new_table_name: "default.Table_04f7b0feaa934fe38250c47e0371c1b6" modify_external_catalogs: true
W20260810 11:30:11.060750 26485 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 2984cf53478e437d955aa3d0917287e9 because the tablet was not found. No further retry: Not found: Tablet not found: 2984cf53478e437d955aa3d0917287e9
I20260810 11:30:11.062958 26498 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 952fc4eb5e5c4d9597f4b6eee860ab3a
I20260810 11:30:11.063149 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 66a7790587ed478b843fa9e997e50893
I20260810 11:30:11.064255 26493 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 3dabfbd779c5406cb10ecf70f5a142e7
W20260810 11:30:11.065147 26501 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 201bafec782a4570a556f1c920e84898 consensus state has no leader
I20260810 11:30:11.065014 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_1515258cce7d473aa7c53c67c527ff8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:11.065800 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1515258cce7d473aa7c53c67c527ff8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.069974 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 417f48ddea6440a5a86fa05f7e514005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:11.071026 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 2efaf8b45a824e34b7f23037de5eec45 (DEFAULT_TABLE table=default.Table_3ac53693e5d649f0be8542fa2d55f936 [id=bf77960e83134a008f3e19008893a6e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.072221 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2efaf8b45a824e34b7f23037de5eec45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.076514 26493 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c2c10310e09d44fdae1c00c7997c03f1" } modify_external_catalogs: true
I20260810 11:30:11.077051 26493 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c2c10310e09d44fdae1c00c7997c03f1" } modify_external_catalogs: true
I20260810 11:30:11.079506 26746 tablet_service.cc:1467] Processing CreateTablet for tablet 3dabfbd779c5406cb10ecf70f5a142e7 (DEFAULT_TABLE table=default.Table_2511fda0071847d1a412482192a6bbb4 [id=66cb5c83b5894c1a9bc02e9019921428]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.080345 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_bc8bc2c9015443fb865751881638284b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:11.080590 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dabfbd779c5406cb10ecf70f5a142e7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:11.081003 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc8bc2c9015443fb865751881638284b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.082636 26748 tablet_service.cc:1467] Processing CreateTablet for tablet 256af4222bb34745ac018dd82a9c4f9b (DEFAULT_TABLE table=default.Table_5c1990a7c1d64a6eb801c2a2ae958db8 [id=3332dd1574f04ec1a34468ad5908602b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.083053 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 256af4222bb34745ac018dd82a9c4f9b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:11.085040 26500 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 607b055f8ced4372800adf5817b46e0b consensus state has no leader
I20260810 11:30:11.085474 26740 tablet_service.cc:1467] Processing CreateTablet for tablet debc114073e14ec1839c5c4c7c2f1f1e (DEFAULT_TABLE table=default.Table_20f0074b10a34dec9790646fd1761385 [id=49171f94f6254f3f8e02643ee05e6e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.085912 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet debc114073e14ec1839c5c4c7c2f1f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.090184 26493 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet e2732660f8964feeb5c03365df065a54
I20260810 11:30:11.094368 26738 tablet_service.cc:1514] Processing DeleteTablet for tablet 7edd85afa247429f92d4ed2f7c35ee16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:11.096125 26485 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet a8197318b04a470791dd639742547fce because the tablet was not found. No further retry: Not found: Tablet not found: a8197318b04a470791dd639742547fce
W20260810 11:30:11.099787 26485 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 417f48ddea6440a5a86fa05f7e514005 because the tablet was not found. No further retry: Not found: Tablet not found: 417f48ddea6440a5a86fa05f7e514005
I20260810 11:30:11.102800 27034 tablet_service.cc:1467] Processing CreateTablet for tablet 6c5b650bc02f4fa393bada5b54c77f1f (DEFAULT_TABLE table=default.Table_34a96af6cf15489aa83ecaba921b4f17 [id=3d8c46d7a15e457a93fd615ad99a4f36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.103051 27222 tablet_bootstrap.cc:492] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:11.103724 27222 ts_tablet_manager.cc:1397] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.333s user 0.012s sys 0.018s
I20260810 11:30:11.104656 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 6c5b650bc02f4fa393bada5b54c77f1f (DEFAULT_TABLE table=default.Table_34a96af6cf15489aa83ecaba921b4f17 [id=3d8c46d7a15e457a93fd615ad99a4f36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.107749 26738 tablet_service.cc:1467] Processing CreateTablet for tablet e2732660f8964feeb5c03365df065a54 (DEFAULT_TABLE table=default.Table_c2c10310e09d44fdae1c00c7997c03f1 [id=8ef1221306af485aa67dabbcd7079139]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.109767 26738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2732660f8964feeb5c03365df065a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.111654 26501 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_cfc8961345fa4f11bad13079b98e496f" } new_table_name: "default.Table_38150fc48b7148a8bc17eb85f039d7b3" modify_external_catalogs: true
I20260810 11:30:11.112370 26734 tablet_service.cc:1467] Processing CreateTablet for tablet d98948300fe6472295ea53cedb7d386c (DEFAULT_TABLE table=default.Table_642d4dc06a4a436ea666abb1ae5e6f7f [id=e3215507fa424c3d9fce745d5b906536]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.113085 26742 tablet_service.cc:1467] Processing CreateTablet for tablet fc2d129e99f24c018e4f8e43f211171d (DEFAULT_TABLE table=default.Table_cfc8961345fa4f11bad13079b98e496f [id=b54ba03677734f2da90a534a0f5ff58e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.113916 26739 tablet_service.cc:1467] Processing CreateTablet for tablet 952fc4eb5e5c4d9597f4b6eee860ab3a (DEFAULT_TABLE table=default.Table_45031e01640c41469cf6724429b043b7 [id=f7a8dbb4151a4e41b8f0c985a5f80149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.113889 26745 tablet_service.cc:1467] Processing CreateTablet for tablet 607b055f8ced4372800adf5817b46e0b (DEFAULT_TABLE table=default.Table_614b87ec3a9442249a842d3816126fbb [id=68a29d5ebf8140198fbf4da3cd974847]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.114930 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c5b650bc02f4fa393bada5b54c77f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.115216 26739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 952fc4eb5e5c4d9597f4b6eee860ab3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.116644 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc2d129e99f24c018e4f8e43f211171d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.120824 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d98948300fe6472295ea53cedb7d386c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:11.122629 26501 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc2d129e99f24c018e4f8e43f211171d consensus state has no leader
I20260810 11:30:11.133297 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_0d167841bc1d4e28906bca3f0a77028b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:11.133740 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_2c4f698292bc49e6b03fd2d1b37bfbcc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:11.134053 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d167841bc1d4e28906bca3f0a77028b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:11.134466 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c4f698292bc49e6b03fd2d1b37bfbcc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.147436 27112 heartbeater.cc:503] Master 127.25.195.253:34547 was elected leader, sending a full tablet report...
I20260810 11:30:11.149778 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c5b650bc02f4fa393bada5b54c77f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.151435 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dabfbd779c5406cb10ecf70f5a142e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:11.151943 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet e2732660f8964feeb5c03365df065a54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:11.152621 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 97d586d35ff144a681ad52756f4be2b6 (DEFAULT_TABLE table=default.Table_1515258cce7d473aa7c53c67c527ff8b [id=5051d9c6d4b8419fbc5e34fbcfe62e7e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:11.153389 26486 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet a9615b1ff3454a46a1a27cfcea20ad00 because the tablet was not found. No further retry: Not found: Tablet not found: a9615b1ff3454a46a1a27cfcea20ad00
W20260810 11:30:11.154794 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 50e61e835429436d9bdc585b8c7381f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50e61e835429436d9bdc585b8c7381f6 already in progress: creating tablet
W20260810 11:30:11.156387 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2984cf53478e437d955aa3d0917287e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2984cf53478e437d955aa3d0917287e9 already in progress: creating tablet
W20260810 11:30:11.156843 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet a8197318b04a470791dd639742547fce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8197318b04a470791dd639742547fce already in progress: creating tablet
W20260810 11:30:11.157472 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 417f48ddea6440a5a86fa05f7e514005 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 417f48ddea6440a5a86fa05f7e514005 already in progress: creating tablet
I20260810 11:30:11.157632 27033 tablet_service.cc:1514] Processing DeleteTablet for tablet 7edd85afa247429f92d4ed2f7c35ee16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:35790
W20260810 11:30:11.158093 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7edd85afa247429f92d4ed2f7c35ee16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7edd85afa247429f92d4ed2f7c35ee16 already in progress: creating tablet
I20260810 11:30:11.158126 27033 tablet_service.cc:1467] Processing CreateTablet for tablet debc114073e14ec1839c5c4c7c2f1f1e (DEFAULT_TABLE table=default.Table_20f0074b10a34dec9790646fd1761385 [id=49171f94f6254f3f8e02643ee05e6e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.158604 27033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet debc114073e14ec1839c5c4c7c2f1f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.169011 26745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 607b055f8ced4372800adf5817b46e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.171406 27035 tablet_service.cc:1467] Processing CreateTablet for tablet fc2d129e99f24c018e4f8e43f211171d (DEFAULT_TABLE table=default.Table_cfc8961345fa4f11bad13079b98e496f [id=b54ba03677734f2da90a534a0f5ff58e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.173741 26739 tablet_service.cc:1514] Processing DeleteTablet for tablet 66a7790587ed478b843fa9e997e50893 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:11.177971 26739 tablet_service.cc:1467] Processing CreateTablet for tablet 2e2c9112462f442e8de5b4a944cfdc6b (DEFAULT_TABLE table=default.Table_bc8bc2c9015443fb865751881638284b [id=3d0ee62af94a45ebb75470e84997368f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.178495 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 952fc4eb5e5c4d9597f4b6eee860ab3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:11.180348 26485 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7edd85afa247429f92d4ed2f7c35ee16 because the tablet was not found. No further retry: Not found: Tablet not found: 7edd85afa247429f92d4ed2f7c35ee16
W20260810 11:30:11.182267 26486 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 3dabfbd779c5406cb10ecf70f5a142e7 because the tablet was not found. No further retry: Not found: Tablet not found: 3dabfbd779c5406cb10ecf70f5a142e7
I20260810 11:30:11.185463 26823 heartbeater.cc:503] Master 127.25.195.253:34547 was elected leader, sending a full tablet report...
I20260810 11:30:11.186184 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc2d129e99f24c018e4f8e43f211171d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.188346 27036 tablet_service.cc:1514] Processing DeleteTablet for tablet 952fc4eb5e5c4d9597f4b6eee860ab3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:11.189133 26739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e2c9112462f442e8de5b4a944cfdc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.189396 27036 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dabfbd779c5406cb10ecf70f5a142e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:11.190395 27036 tablet_service.cc:1514] Processing DeleteTablet for tablet e2732660f8964feeb5c03365df065a54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:11.191510 27037 tablet_service.cc:1467] Processing CreateTablet for tablet 97d586d35ff144a681ad52756f4be2b6 (DEFAULT_TABLE table=default.Table_1515258cce7d473aa7c53c67c527ff8b [id=5051d9c6d4b8419fbc5e34fbcfe62e7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.192063 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97d586d35ff144a681ad52756f4be2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.195922 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97d586d35ff144a681ad52756f4be2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.196502 27029 tablet_service.cc:1467] Processing CreateTablet for tablet 952fc4eb5e5c4d9597f4b6eee860ab3a (DEFAULT_TABLE table=default.Table_45031e01640c41469cf6724429b043b7 [id=f7a8dbb4151a4e41b8f0c985a5f80149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.199927 27032 tablet_service.cc:1467] Processing CreateTablet for tablet e2732660f8964feeb5c03365df065a54 (DEFAULT_TABLE table=default.Table_c2c10310e09d44fdae1c00c7997c03f1 [id=8ef1221306af485aa67dabbcd7079139]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.200527 27026 tablet_service.cc:1514] Processing DeleteTablet for tablet 66a7790587ed478b843fa9e997e50893 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:11.203428 26496 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 2d7e745f05534917a5deecce410722e6 (table default.Table_5e6805f352774d24922eaf28498034d5 [id=6d8fc88a491140548a45c7fbb403bb36]). Expected version 3 got 0
I20260810 11:30:11.204023 26496 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b1cd64deb8e24c81ba2d4214bb38f5da (table default.Table_7e1ff16472f842438c14184ab96741e1 [id=03dca1a3a16e42049c194a46978bbfec]). Expected version 2 got 0
I20260810 11:30:11.204262 26496 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f4a8a3553014448096836f888bdc2835 (table default.Table_7374f0a22f4d45fc8dd0acc70f9feae5 [id=83d99a766e604e4e9c21a029241cf624]). Expected version 1 got 0
I20260810 11:30:11.204428 26496 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 2c6b3f8626724d12986f388b1ca90b3c (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:11.204591 26496 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f05f2fc60d0f43f6a72fca16828f94f9 (table default.Table_646a67105a2344659bc01af8a4d8dd5a [id=8d5da0e5fab74127880f199687b0d3eb]). Expected version 2 got 0
I20260810 11:30:11.204743 26496 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet fc2d129e99f24c018e4f8e43f211171d (table default.Table_38150fc48b7148a8bc17eb85f039d7b3 [id=b54ba03677734f2da90a534a0f5ff58e]). Expected version 1 got 0
I20260810 11:30:11.204926 26496 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 201bafec782a4570a556f1c920e84898 (table default.Table_01ba22149a2f482782c70caa4d2244ea [id=31781820c0814fb0bee423b2ce6ae615]). Expected version 1 got 0
I20260810 11:30:11.208647 27029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 952fc4eb5e5c4d9597f4b6eee860ab3a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:11.209843 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet e2732660f8964feeb5c03365df065a54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2732660f8964feeb5c03365df065a54 already in progress: creating tablet
W20260810 11:30:11.210458 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 66a7790587ed478b843fa9e997e50893 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66a7790587ed478b843fa9e997e50893 already in progress: creating tablet
W20260810 11:30:11.211143 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 952fc4eb5e5c4d9597f4b6eee860ab3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 952fc4eb5e5c4d9597f4b6eee860ab3a already in progress: creating tablet
I20260810 11:30:11.213569 26740 tablet_service.cc:1467] Processing CreateTablet for tablet 3ccef06fa06c4c519d8760fa948d6c8b (DEFAULT_TABLE table=default.Table_0d167841bc1d4e28906bca3f0a77028b [id=ba999b4084c84b2f8e0313b96849b169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.214251 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ccef06fa06c4c519d8760fa948d6c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.215664 27028 tablet_service.cc:1467] Processing CreateTablet for tablet d98948300fe6472295ea53cedb7d386c (DEFAULT_TABLE table=default.Table_642d4dc06a4a436ea666abb1ae5e6f7f [id=e3215507fa424c3d9fce745d5b906536]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.218560 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 79953795f07845aba3f028741cdcdd9e (DEFAULT_TABLE table=default.Table_2c4f698292bc49e6b03fd2d1b37bfbcc [id=ec470484b1bf4e62917f36ce46438d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.219147 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79953795f07845aba3f028741cdcdd9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.219465 27032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2732660f8964feeb5c03365df065a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.222339 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d98948300fe6472295ea53cedb7d386c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.222494 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 952fc4eb5e5c4d9597f4b6eee860ab3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:11.222733 27036 tablet_service.cc:1467] Processing CreateTablet for tablet 2e2c9112462f442e8de5b4a944cfdc6b (DEFAULT_TABLE table=default.Table_bc8bc2c9015443fb865751881638284b [id=3d0ee62af94a45ebb75470e84997368f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:11.223706 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 952fc4eb5e5c4d9597f4b6eee860ab3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 952fc4eb5e5c4d9597f4b6eee860ab3a already in progress: creating tablet
I20260810 11:30:11.225874 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 417f48ddea6440a5a86fa05f7e514005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:11.226634 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 417f48ddea6440a5a86fa05f7e514005 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 417f48ddea6440a5a86fa05f7e514005 already in progress: creating tablet
I20260810 11:30:11.228112 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 7edd85afa247429f92d4ed2f7c35ee16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:11.228895 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7edd85afa247429f92d4ed2f7c35ee16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7edd85afa247429f92d4ed2f7c35ee16 already in progress: creating tablet
I20260810 11:30:11.229079 27036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e2c9112462f442e8de5b4a944cfdc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.233652 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet e2732660f8964feeb5c03365df065a54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:11.234522 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet e2732660f8964feeb5c03365df065a54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2732660f8964feeb5c03365df065a54 already in progress: creating tablet
I20260810 11:30:11.237733 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet a8197318b04a470791dd639742547fce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:11.238636 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet a8197318b04a470791dd639742547fce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8197318b04a470791dd639742547fce already in progress: creating tablet
I20260810 11:30:11.239655 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 66a7790587ed478b843fa9e997e50893 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:11.240294 26496 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 2c6b3f8626724d12986f388b1ca90b3c (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 2c6b3f8626724d12986f388b1ca90b3c consensus state has no leader
W20260810 11:30:11.245389 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 66a7790587ed478b843fa9e997e50893 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66a7790587ed478b843fa9e997e50893 already in progress: creating tablet
I20260810 11:30:11.247203 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 50e61e835429436d9bdc585b8c7381f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:11.247041 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet 2984cf53478e437d955aa3d0917287e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:11.250316 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 50e61e835429436d9bdc585b8c7381f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50e61e835429436d9bdc585b8c7381f6 already in progress: creating tablet
I20260810 11:30:11.250805 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet a9615b1ff3454a46a1a27cfcea20ad00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:11.251189 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2984cf53478e437d955aa3d0917287e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2984cf53478e437d955aa3d0917287e9 already in progress: creating tablet
W20260810 11:30:11.257756 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet a9615b1ff3454a46a1a27cfcea20ad00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9615b1ff3454a46a1a27cfcea20ad00 already in progress: creating tablet
I20260810 11:30:11.257611 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_c80de92e9c2f45469ed63441d62eb4bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:11.258693 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c80de92e9c2f45469ed63441d62eb4bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.286525 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 9b754dc2568849deafc7a8dc6d81924c (DEFAULT_TABLE table=default.Table_c80de92e9c2f45469ed63441d62eb4bf [id=396d42b7a2ec4e80a0b0129dec3ebd68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.287118 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b754dc2568849deafc7a8dc6d81924c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.289999 27222 raft_consensus.cc:348] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:11.290287 27228 tablet_bootstrap.cc:492] T 2984cf53478e437d955aa3d0917287e9 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:11.290772 27222 raft_consensus.cc:374] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:11.290904 27222 raft_consensus.cc:729] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:11.291756 27222 consensus_queue.cc:260] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:11.299551 26496 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f4a8a3553014448096836f888bdc2835 (table default.Table_7374f0a22f4d45fc8dd0acc70f9feae5 [id=83d99a766e604e4e9c21a029241cf624]). Expected version 1 got 0
I20260810 11:30:11.302299 27222 ts_tablet_manager.cc:1428] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.198s user 0.016s sys 0.005s
I20260810 11:30:11.305147 26496 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f4a8a3553014448096836f888bdc2835 (table default.Table_7374f0a22f4d45fc8dd0acc70f9feae5 [id=83d99a766e604e4e9c21a029241cf624]). Expected version 1 got 0
I20260810 11:30:11.306242 27222 tablet_bootstrap.cc:492] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:11.308171 27222 tablet_bootstrap.cc:654] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:11.333204 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_35c17c06f74e412fa340b5a9bfed2911"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:11.334131 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35c17c06f74e412fa340b5a9bfed2911 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.333494 26465 master_runner.cc:186] Error getting master registration for 127.25.195.254:41125: Network error: Client connection negotiation failed: client connection to 127.25.195.254:41125: connect: Connection refused (error 111),
I20260810 11:30:11.335929 26465 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 11:30:11.337368 27228 tablet_bootstrap.cc:654] T 2984cf53478e437d955aa3d0917287e9 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:11.338197 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_924e63bbc09d4d8fabd76cd54211744b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:11.339017 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_924e63bbc09d4d8fabd76cd54211744b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.341504 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_0bbe57bacdf5461d82b017f0a97edab1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:11.342051 26500 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_0d167841bc1d4e28906bca3f0a77028b" } new_table_name: "default.Table_b4b51e28dc3c4452ad9e1404aeb19653" modify_external_catalogs: true
W20260810 11:30:11.342393 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0bbe57bacdf5461d82b017f0a97edab1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.344359 26491 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_590ce8c7b9f647ecb1e81a793a66f3b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:11.345302 26491 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_590ce8c7b9f647ecb1e81a793a66f3b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.347280 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_ce2f8e731f78471eb52e92a07edce1d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:11.347844 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce2f8e731f78471eb52e92a07edce1d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.353619 26499 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_7374f0a22f4d45fc8dd0acc70f9feae5" } modify_external_catalogs: true
I20260810 11:30:11.353936 26499 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_7374f0a22f4d45fc8dd0acc70f9feae5" } modify_external_catalogs: true
I20260810 11:30:11.356071 26495 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_646a67105a2344659bc01af8a4d8dd5a" } new_table_name: "default.Table_c6f8501fb26f49688f4c9e7c3cabc233" modify_external_catalogs: true
I20260810 11:30:11.357905 26492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_642d4dc06a4a436ea666abb1ae5e6f7f" } modify_external_catalogs: true
I20260810 11:30:11.358183 26492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_642d4dc06a4a436ea666abb1ae5e6f7f" } modify_external_catalogs: true
W20260810 11:30:11.359577 26824 tablet.cc:2369] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 11:30:11.371095 26497 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_3ac53693e5d649f0be8542fa2d55f936" } new_table_name: "default.Table_a006976247434094b81729d5aa32d9f7" modify_external_catalogs: true
I20260810 11:30:11.373677 26501 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_1515258cce7d473aa7c53c67c527ff8b" } modify_external_catalogs: true
I20260810 11:30:11.374092 26501 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_1515258cce7d473aa7c53c67c527ff8b" } modify_external_catalogs: true
I20260810 11:30:11.387650 27228 log.cc:824] T 2984cf53478e437d955aa3d0917287e9 P b6079090b1124d84aa4477974bb53700: Log is configured to *not* fsync() on all Append() calls
W20260810 11:30:11.388235 26500 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ccef06fa06c4c519d8760fa948d6c8b consensus state has no leader
I20260810 11:30:11.388855 26500 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_01ba22149a2f482782c70caa4d2244ea" } modify_external_catalogs: true
I20260810 11:30:11.389154 26500 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_01ba22149a2f482782c70caa4d2244ea" } modify_external_catalogs: true
I20260810 11:30:11.390606 26493 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_34a96af6cf15489aa83ecaba921b4f17" } new_table_name: "default.Table_e40bf66a38dc4113bae2db1ed288bf7e" modify_external_catalogs: true
I20260810 11:30:11.392573 26965 heartbeater.cc:503] Master 127.25.195.253:34547 was elected leader, sending a full tablet report...
I20260810 11:30:11.394611 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 3dabfbd779c5406cb10ecf70f5a142e7 (DEFAULT_TABLE table=default.Table_2511fda0071847d1a412482192a6bbb4 [id=66cb5c83b5894c1a9bc02e9019921428]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.395224 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dabfbd779c5406cb10ecf70f5a142e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.396450 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_b400d58717834fafa8a580a57cd0e325"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:11.397467 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b400d58717834fafa8a580a57cd0e325 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.403049 27020 tablet_service.cc:1467] Processing CreateTablet for tablet 79953795f07845aba3f028741cdcdd9e (DEFAULT_TABLE table=default.Table_2c4f698292bc49e6b03fd2d1b37bfbcc [id=ec470484b1bf4e62917f36ce46438d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.403645 27020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79953795f07845aba3f028741cdcdd9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.409849 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 2efaf8b45a824e34b7f23037de5eec45 (DEFAULT_TABLE table=default.Table_3ac53693e5d649f0be8542fa2d55f936 [id=bf77960e83134a008f3e19008893a6e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.410346 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2efaf8b45a824e34b7f23037de5eec45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.400460 26541 master_runner.cc:186] Error getting master registration for 127.25.195.254:41125: Network error: Client connection negotiation failed: client connection to 127.25.195.254:41125: connect: Connection refused (error 111),
I20260810 11:30:11.411142 26541 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 11:30:11.427457 26497 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2efaf8b45a824e34b7f23037de5eec45 consensus state has no leader
I20260810 11:30:11.428084 26497 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5c1990a7c1d64a6eb801c2a2ae958db8" } modify_external_catalogs: true
I20260810 11:30:11.428450 26497 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5c1990a7c1d64a6eb801c2a2ae958db8" } modify_external_catalogs: true
I20260810 11:30:11.428498 26491 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_5920ba1cda06446c8f95e65aec6a42bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:11.427528 26492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet d98948300fe6472295ea53cedb7d386c
W20260810 11:30:11.429608 26491 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5920ba1cda06446c8f95e65aec6a42bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.430318 26492 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_20f0074b10a34dec9790646fd1761385" } new_table_name: "default.Table_bb1e980acff941e9918bbe5d83256c40" modify_external_catalogs: true
I20260810 11:30:11.432853 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet d98948300fe6472295ea53cedb7d386c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:11.433708 26493 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6c5b650bc02f4fa393bada5b54c77f1f consensus state has no leader
W20260810 11:30:11.433849 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet d98948300fe6472295ea53cedb7d386c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d98948300fe6472295ea53cedb7d386c already in progress: creating tablet
I20260810 11:30:11.456347 26498 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 2c6b3f8626724d12986f388b1ca90b3c (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:11.456660 26498 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 2d7e745f05534917a5deecce410722e6 (table default.Table_5e6805f352774d24922eaf28498034d5 [id=6d8fc88a491140548a45c7fbb403bb36]). Expected version 3 got 0
I20260810 11:30:11.456918 26498 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f05f2fc60d0f43f6a72fca16828f94f9 (table default.Table_646a67105a2344659bc01af8a4d8dd5a [id=8d5da0e5fab74127880f199687b0d3eb]). Expected version 2 got 0
W20260810 11:30:11.457700 26495 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f05f2fc60d0f43f6a72fca16828f94f9 consensus state has no leader
I20260810 11:30:11.458097 26499 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet f4a8a3553014448096836f888bdc2835
I20260810 11:30:11.458374 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 7e3707ae32624f6483866208321eefde (DEFAULT_TABLE table=default.Table_35c17c06f74e412fa340b5a9bfed2911 [id=742f385d32c24e459b83a90971ad60ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.458943 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e3707ae32624f6483866208321eefde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.461133 26739 tablet_service.cc:1514] Processing DeleteTablet for tablet f4a8a3553014448096836f888bdc2835 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:11.461586 27221 tablet_replica.cc:330] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:11.462335 27221 raft_consensus.cc:2229] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:11.462805 27221 raft_consensus.cc:2258] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:11.470232 26889 tablet_service.cc:1467] Processing CreateTablet for tablet e2732660f8964feeb5c03365df065a54 (DEFAULT_TABLE table=default.Table_c2c10310e09d44fdae1c00c7997c03f1 [id=8ef1221306af485aa67dabbcd7079139]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.470868 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2732660f8964feeb5c03365df065a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.473017 26888 tablet_service.cc:1467] Processing CreateTablet for tablet 607b055f8ced4372800adf5817b46e0b (DEFAULT_TABLE table=default.Table_614b87ec3a9442249a842d3816126fbb [id=68a29d5ebf8140198fbf4da3cd974847]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.474248 27221 ts_tablet_manager.cc:1905] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:11.477908 26492 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet debc114073e14ec1839c5c4c7c2f1f1e consensus state has no leader
I20260810 11:30:11.481357 26497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 256af4222bb34745ac018dd82a9c4f9b
I20260810 11:30:11.481953 26501 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 97d586d35ff144a681ad52756f4be2b6
I20260810 11:30:11.483902 26883 tablet_service.cc:1467] Processing CreateTablet for tablet debc114073e14ec1839c5c4c7c2f1f1e (DEFAULT_TABLE table=default.Table_20f0074b10a34dec9790646fd1761385 [id=49171f94f6254f3f8e02643ee05e6e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.485056 26739 tablet_service.cc:1514] Processing DeleteTablet for tablet 256af4222bb34745ac018dd82a9c4f9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:11.488268 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 97d586d35ff144a681ad52756f4be2b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:11.488415 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 607b055f8ced4372800adf5817b46e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.489447 26880 tablet_service.cc:1514] Processing DeleteTablet for tablet 7edd85afa247429f92d4ed2f7c35ee16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:11.490450 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet debc114073e14ec1839c5c4c7c2f1f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.496512 26500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 201bafec782a4570a556f1c920e84898
I20260810 11:30:11.503317 26887 tablet_service.cc:1467] Processing CreateTablet for tablet 6c5b650bc02f4fa393bada5b54c77f1f (DEFAULT_TABLE table=default.Table_34a96af6cf15489aa83ecaba921b4f17 [id=3d8c46d7a15e457a93fd615ad99a4f36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.504175 26887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c5b650bc02f4fa393bada5b54c77f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.505035 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 201bafec782a4570a556f1c920e84898 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:11.505355 27221 ts_tablet_manager.cc:1918] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:11.505635 27221 log.cc:1196] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/f4a8a3553014448096836f888bdc2835
I20260810 11:30:11.506275 27221 ts_tablet_manager.cc:1939] T f4a8a3553014448096836f888bdc2835 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:11.513284 27034 tablet_service.cc:1467] Processing CreateTablet for tablet 3ccef06fa06c4c519d8760fa948d6c8b (DEFAULT_TABLE table=default.Table_0d167841bc1d4e28906bca3f0a77028b [id=ba999b4084c84b2f8e0313b96849b169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.513537 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet f4a8a3553014448096836f888bdc2835 (table default.Table_7374f0a22f4d45fc8dd0acc70f9feae5 [id=83d99a766e604e4e9c21a029241cf624]) successfully deleted
I20260810 11:30:11.517095 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ccef06fa06c4c519d8760fa948d6c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.522168 26739 tablet_service.cc:1467] Processing CreateTablet for tablet f3c6bd6803c245b7bb3d78423de482b6 (DEFAULT_TABLE table=default.Table_590ce8c7b9f647ecb1e81a793a66f3b1 [id=8de62290aa814a5492665eca65a37230]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.522795 26739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3c6bd6803c245b7bb3d78423de482b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.525677 26740 tablet_service.cc:1467] Processing CreateTablet for tablet 2fc76603bf8843dab18c95fdab9a8be0 (DEFAULT_TABLE table=default.Table_ce2f8e731f78471eb52e92a07edce1d7 [id=5d056773247c41129d9d8f3ef88b1bee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.525949 26745 tablet_service.cc:1467] Processing CreateTablet for tablet d14091e1c111438bac8bcf3d36123d80 (DEFAULT_TABLE table=default.Table_0bbe57bacdf5461d82b017f0a97edab1 [id=abc46123737f48398c9ed367a3aeebda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.526193 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fc76603bf8843dab18c95fdab9a8be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.527745 26885 tablet_service.cc:1467] Processing CreateTablet for tablet 256af4222bb34745ac018dd82a9c4f9b (DEFAULT_TABLE table=default.Table_5c1990a7c1d64a6eb801c2a2ae958db8 [id=3332dd1574f04ec1a34468ad5908602b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.528432 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 256af4222bb34745ac018dd82a9c4f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.528726 26745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d14091e1c111438bac8bcf3d36123d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.529148 26737 tablet_service.cc:1467] Processing CreateTablet for tablet ec788db5b0ca40f1811b6660276d0254 (DEFAULT_TABLE table=default.Table_b400d58717834fafa8a580a57cd0e325 [id=9d4e514d06c54ffc8db5d4b3e3ec65c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.529629 26880 tablet_service.cc:1467] Processing CreateTablet for tablet fc2d129e99f24c018e4f8e43f211171d (DEFAULT_TABLE table=default.Table_cfc8961345fa4f11bad13079b98e496f [id=b54ba03677734f2da90a534a0f5ff58e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.532989 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 949f31fa0c124eefbee695cfc7f50cbe (DEFAULT_TABLE table=default.Table_924e63bbc09d4d8fabd76cd54211744b [id=de28bf5b1f604446a69f9651a1eb9b93]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:11.542200 26485 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 952fc4eb5e5c4d9597f4b6eee860ab3a because the tablet was not found. No further retry: Not found: Tablet not found: 952fc4eb5e5c4d9597f4b6eee860ab3a
I20260810 11:30:11.542969 27023 tablet_service.cc:1467] Processing CreateTablet for tablet 9b754dc2568849deafc7a8dc6d81924c (DEFAULT_TABLE table=default.Table_c80de92e9c2f45469ed63441d62eb4bf [id=396d42b7a2ec4e80a0b0129dec3ebd68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.543766 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b754dc2568849deafc7a8dc6d81924c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.545830 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec788db5b0ca40f1811b6660276d0254. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:11.552608 26485 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 3dabfbd779c5406cb10ecf70f5a142e7 because the tablet was not found. No further retry: Not found: Tablet not found: 3dabfbd779c5406cb10ecf70f5a142e7
W20260810 11:30:11.554797 26485 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet e2732660f8964feeb5c03365df065a54 because the tablet was not found. No further retry: Not found: Tablet not found: e2732660f8964feeb5c03365df065a54
W20260810 11:30:11.555241 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 66a7790587ed478b843fa9e997e50893 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66a7790587ed478b843fa9e997e50893 already in progress: creating tablet
W20260810 11:30:11.556368 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 256af4222bb34745ac018dd82a9c4f9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 256af4222bb34745ac018dd82a9c4f9b already in progress: creating tablet
W20260810 11:30:11.557041 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 97d586d35ff144a681ad52756f4be2b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97d586d35ff144a681ad52756f4be2b6 already in progress: creating tablet
I20260810 11:30:11.557423 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 949f31fa0c124eefbee695cfc7f50cbe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:11.557610 27194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 11:30:11.558095 27194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 11:30:11.558248 27194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 11:30:11.559736 26740 tablet_service.cc:1467] Processing CreateTablet for tablet 66908164ff2a4ee5b55da6158699e0c6 (DEFAULT_TABLE table=default.Table_5920ba1cda06446c8f95e65aec6a42bf [id=10cadcb426e64a27a94df23fc8956de1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.559923 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_3449a59ebd4f47d58e6a93dee9ef6f73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:11.560678 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3449a59ebd4f47d58e6a93dee9ef6f73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:11.561214 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 201bafec782a4570a556f1c920e84898 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 201bafec782a4570a556f1c920e84898 already in progress: creating tablet
I20260810 11:30:11.562335 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_29f8cf6d48514b87bae05b1c797607cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:11.562971 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29f8cf6d48514b87bae05b1c797607cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.569205 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66908164ff2a4ee5b55da6158699e0c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.585394 26884 tablet_service.cc:1467] Processing CreateTablet for tablet d98948300fe6472295ea53cedb7d386c (DEFAULT_TABLE table=default.Table_642d4dc06a4a436ea666abb1ae5e6f7f [id=e3215507fa424c3d9fce745d5b906536]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.587378 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 952fc4eb5e5c4d9597f4b6eee860ab3a (DEFAULT_TABLE table=default.Table_45031e01640c41469cf6724429b043b7 [id=f7a8dbb4151a4e41b8f0c985a5f80149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.588706 26880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc2d129e99f24c018e4f8e43f211171d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.609596 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 952fc4eb5e5c4d9597f4b6eee860ab3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.617637 26891 tablet_service.cc:1514] Processing DeleteTablet for tablet 66a7790587ed478b843fa9e997e50893 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:11.619675 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet e2732660f8964feeb5c03365df065a54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:11.621140 26884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d98948300fe6472295ea53cedb7d386c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.621820 26882 tablet_service.cc:1514] Processing DeleteTablet for tablet 952fc4eb5e5c4d9597f4b6eee860ab3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:11.623687 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dabfbd779c5406cb10ecf70f5a142e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:11.640115 26886 tablet_service.cc:1467] Processing CreateTablet for tablet 97d586d35ff144a681ad52756f4be2b6 (DEFAULT_TABLE table=default.Table_1515258cce7d473aa7c53c67c527ff8b [id=5051d9c6d4b8419fbc5e34fbcfe62e7e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:11.641717 26485 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 607b055f8ced4372800adf5817b46e0b (table default.Table_04f7b0feaa934fe38250c47e0371c1b6 [id=68a29d5ebf8140198fbf4da3cd974847], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 607b055f8ced4372800adf5817b46e0b consensus state has no leader
W20260810 11:30:11.643538 27194 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 11:30:11.643826 27194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 11:30:11.644029 27194 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 11:30:11.644194 27194 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 11:30:11.649967 26745 tablet_service.cc:1467] Processing CreateTablet for tablet b7a3b877457c4a2489d397f3f864d6b2 (DEFAULT_TABLE table=default.Table_3449a59ebd4f47d58e6a93dee9ef6f73 [id=6a400e6303ea4b42a4fa36252c95a62b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.650848 26745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7a3b877457c4a2489d397f3f864d6b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.662550 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 7eae49e1c6554ba2ae831831ff4bb45c (DEFAULT_TABLE table=default.Table_29f8cf6d48514b87bae05b1c797607cd [id=aee0dce4bed94ceebb0ad9fbba02f4b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.663615 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eae49e1c6554ba2ae831831ff4bb45c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.672696 27194 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.195.212:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.195.254:41125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.195.254
--webserver_port=36939
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 10:32:47 UTC on ccycloud.quasar-nosthy.root.comops.site
build id 4577509
ASAN enabled
I20260810 11:30:11.677002 27194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 11:30:11.681275 27194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 11:30:11.682044 26893 tablet_service.cc:1467] Processing CreateTablet for tablet 9b754dc2568849deafc7a8dc6d81924c (DEFAULT_TABLE table=default.Table_c80de92e9c2f45469ed63441d62eb4bf [id=396d42b7a2ec4e80a0b0129dec3ebd68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.684221 26891 tablet_service.cc:1514] Processing DeleteTablet for tablet d98948300fe6472295ea53cedb7d386c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:11.685206 26882 tablet_service.cc:1467] Processing CreateTablet for tablet 3ccef06fa06c4c519d8760fa948d6c8b (DEFAULT_TABLE table=default.Table_0d167841bc1d4e28906bca3f0a77028b [id=ba999b4084c84b2f8e0313b96849b169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.690493 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97d586d35ff144a681ad52756f4be2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.691672 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 79953795f07845aba3f028741cdcdd9e (DEFAULT_TABLE table=default.Table_2c4f698292bc49e6b03fd2d1b37bfbcc [id=ec470484b1bf4e62917f36ce46438d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.692819 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b754dc2568849deafc7a8dc6d81924c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.696509 26882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ccef06fa06c4c519d8760fa948d6c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.700062 26891 tablet_service.cc:1467] Processing CreateTablet for tablet 7e3707ae32624f6483866208321eefde (DEFAULT_TABLE table=default.Table_35c17c06f74e412fa340b5a9bfed2911 [id=742f385d32c24e459b83a90971ad60ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.701740 26892 tablet_service.cc:1514] Processing DeleteTablet for tablet f4a8a3553014448096836f888bdc2835 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:11.702363 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 2e2c9112462f442e8de5b4a944cfdc6b (DEFAULT_TABLE table=default.Table_bc8bc2c9015443fb865751881638284b [id=3d0ee62af94a45ebb75470e84997368f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.709164 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79953795f07845aba3f028741cdcdd9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.709659 26891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e3707ae32624f6483866208321eefde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.713428 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e2c9112462f442e8de5b4a944cfdc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.717490 26892 tablet_service.cc:1514] Processing DeleteTablet for tablet 256af4222bb34745ac018dd82a9c4f9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:11.720022 26892 tablet_service.cc:1514] Processing DeleteTablet for tablet 97d586d35ff144a681ad52756f4be2b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:11.722889 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_22360b2c6a9e46f99bbc036074cb7441"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:11.724218 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22360b2c6a9e46f99bbc036074cb7441 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.725829 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_01f43a19b7a44ee489416111da1c78df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:11.726603 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01f43a19b7a44ee489416111da1c78df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.745178 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet f4a8a3553014448096836f888bdc2835 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:11.745940 27033 tablet_service.cc:1514] Processing DeleteTablet for tablet d98948300fe6472295ea53cedb7d386c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:11.755772 27036 tablet_service.cc:1514] Processing DeleteTablet for tablet 256af4222bb34745ac018dd82a9c4f9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:11.756922 26892 tablet_service.cc:1467] Processing CreateTablet for tablet ec788db5b0ca40f1811b6660276d0254 (DEFAULT_TABLE table=default.Table_b400d58717834fafa8a580a57cd0e325 [id=9d4e514d06c54ffc8db5d4b3e3ec65c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.758116 27033 tablet_service.cc:1514] Processing DeleteTablet for tablet 97d586d35ff144a681ad52756f4be2b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:11.758850 27022 tablet_service.cc:1467] Processing CreateTablet for tablet f3c6bd6803c245b7bb3d78423de482b6 (DEFAULT_TABLE table=default.Table_590ce8c7b9f647ecb1e81a793a66f3b1 [id=8de62290aa814a5492665eca65a37230]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.760098 27025 tablet_service.cc:1467] Processing CreateTablet for tablet b7a3b877457c4a2489d397f3f864d6b2 (DEFAULT_TABLE table=default.Table_3449a59ebd4f47d58e6a93dee9ef6f73 [id=6a400e6303ea4b42a4fa36252c95a62b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.760037 26500 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_b4b51e28dc3c4452ad9e1404aeb19653" } new_table_name: "default.Table_c0eb3404046346ce92f8b3da2cf20095" modify_external_catalogs: true
I20260810 11:30:11.761119 27035 tablet_service.cc:1467] Processing CreateTablet for tablet 7e3707ae32624f6483866208321eefde (DEFAULT_TABLE table=default.Table_35c17c06f74e412fa340b5a9bfed2911 [id=742f385d32c24e459b83a90971ad60ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.761924 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3c6bd6803c245b7bb3d78423de482b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.762449 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7a3b877457c4a2489d397f3f864d6b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.764297 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_d297e25211404611a6ba6a454c9dd5fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:11.764653 26495 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_b400d58717834fafa8a580a57cd0e325" } modify_external_catalogs: true
I20260810 11:30:11.766568 26892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec788db5b0ca40f1811b6660276d0254. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:11.767186 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d297e25211404611a6ba6a454c9dd5fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.767861 26496 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_01f43a19b7a44ee489416111da1c78df" } new_table_name: "default.Table_baaf705869df4c36a233bb967b25455a" modify_external_catalogs: true
I20260810 11:30:11.765173 26495 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_b400d58717834fafa8a580a57cd0e325" } modify_external_catalogs: true
I20260810 11:30:11.770296 26498 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_924e63bbc09d4d8fabd76cd54211744b" } new_table_name: "default.Table_d4cbe876014f4433b57552ea4db823b6" modify_external_catalogs: true
I20260810 11:30:11.772360 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_7f57913383ec42ce958846fccae03631"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:11.773417 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f57913383ec42ce958846fccae03631 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.773998 27030 tablet_service.cc:1467] Processing CreateTablet for tablet 2fc76603bf8843dab18c95fdab9a8be0 (DEFAULT_TABLE table=default.Table_ce2f8e731f78471eb52e92a07edce1d7 [id=5d056773247c41129d9d8f3ef88b1bee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.774506 27024 tablet_service.cc:1467] Processing CreateTablet for tablet d14091e1c111438bac8bcf3d36123d80 (DEFAULT_TABLE table=default.Table_0bbe57bacdf5461d82b017f0a97edab1 [id=abc46123737f48398c9ed367a3aeebda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.774644 26491 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_d4b2bc41d44d4dbeb8416907091e7dca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:11.774894 27038 tablet_service.cc:1467] Processing CreateTablet for tablet 66908164ff2a4ee5b55da6158699e0c6 (DEFAULT_TABLE table=default.Table_5920ba1cda06446c8f95e65aec6a42bf [id=10cadcb426e64a27a94df23fc8956de1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.775244 27039 tablet_service.cc:1467] Processing CreateTablet for tablet 7eae49e1c6554ba2ae831831ff4bb45c (DEFAULT_TABLE table=default.Table_29f8cf6d48514b87bae05b1c797607cd [id=aee0dce4bed94ceebb0ad9fbba02f4b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.775607 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 949f31fa0c124eefbee695cfc7f50cbe (DEFAULT_TABLE table=default.Table_924e63bbc09d4d8fabd76cd54211744b [id=de28bf5b1f604446a69f9651a1eb9b93]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:11.775858 26491 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4b2bc41d44d4dbeb8416907091e7dca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.775979 27029 tablet_service.cc:1467] Processing CreateTablet for tablet ec788db5b0ca40f1811b6660276d0254 (DEFAULT_TABLE table=default.Table_b400d58717834fafa8a580a57cd0e325 [id=9d4e514d06c54ffc8db5d4b3e3ec65c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.778666 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_95523d7d33a4423099b179a2d91867f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:11.776463 27020 tablet_service.cc:1514] Processing DeleteTablet for tablet 201bafec782a4570a556f1c920e84898 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
W20260810 11:30:11.779515 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95523d7d33a4423099b179a2d91867f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.780982 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_5763dcd0b2ae40b4945a6966bfd23099"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:11.783376 26740 tablet_service.cc:1467] Processing CreateTablet for tablet db5adccd80a04e328e13793b461c38b1 (DEFAULT_TABLE table=default.Table_01f43a19b7a44ee489416111da1c78df [id=f325caa441054ab180909b9af9de3ba6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.784057 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db5adccd80a04e328e13793b461c38b1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:11.785430 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5763dcd0b2ae40b4945a6966bfd23099 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:11.789126 26501 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_ce2f8e731f78471eb52e92a07edce1d7" } new_table_name: "default.Table_0cf99364f1364aedae81ca0f8f3c8b38" modify_external_catalogs: true
W20260810 11:30:11.789721 26500 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ccef06fa06c4c519d8760fa948d6c8b consensus state has no leader
I20260810 11:30:11.789893 27231 tablet_bootstrap.cc:492] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:11.790411 26500 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_590ce8c7b9f647ecb1e81a793a66f3b1" } modify_external_catalogs: true
I20260810 11:30:11.790478 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e3707ae32624f6483866208321eefde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.790695 26500 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_590ce8c7b9f647ecb1e81a793a66f3b1" } modify_external_catalogs: true
I20260810 11:30:11.790920 27024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d14091e1c111438bac8bcf3d36123d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.794370 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 949f31fa0c124eefbee695cfc7f50cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.794606 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66908164ff2a4ee5b55da6158699e0c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.794848 27030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fc76603bf8843dab18c95fdab9a8be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.795212 27039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eae49e1c6554ba2ae831831ff4bb45c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.798468 27029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec788db5b0ca40f1811b6660276d0254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.799479 26890 tablet_service.cc:1467] Processing CreateTablet for tablet 2fc76603bf8843dab18c95fdab9a8be0 (DEFAULT_TABLE table=default.Table_ce2f8e731f78471eb52e92a07edce1d7 [id=5d056773247c41129d9d8f3ef88b1bee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.802814 27020 tablet_service.cc:1467] Processing CreateTablet for tablet db5adccd80a04e328e13793b461c38b1 (DEFAULT_TABLE table=default.Table_01f43a19b7a44ee489416111da1c78df [id=f325caa441054ab180909b9af9de3ba6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.804837 26890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fc76603bf8843dab18c95fdab9a8be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.806866 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_7c36df9513654205b604d1a8a1d7c2ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:11.807582 26498 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 949f31fa0c124eefbee695cfc7f50cbe consensus state has no leader
I20260810 11:30:11.808210 26498 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_bb1e980acff941e9918bbe5d83256c40" } new_table_name: "default.Table_14fdf4f2b306464d848549d724acb47e" modify_external_catalogs: true
W20260810 11:30:11.808929 26496 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet db5adccd80a04e328e13793b461c38b1 consensus state has no leader
I20260810 11:30:11.809427 26496 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_3449a59ebd4f47d58e6a93dee9ef6f73" } modify_external_catalogs: true
I20260810 11:30:11.809881 26496 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_3449a59ebd4f47d58e6a93dee9ef6f73" } modify_external_catalogs: true
W20260810 11:30:11.807615 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c36df9513654205b604d1a8a1d7c2ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:11.811185 27247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 11:30:11.814874 26879 tablet_service.cc:1467] Processing CreateTablet for tablet d14091e1c111438bac8bcf3d36123d80 (DEFAULT_TABLE table=default.Table_0bbe57bacdf5461d82b017f0a97edab1 [id=abc46123737f48398c9ed367a3aeebda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.817088 26879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d14091e1c111438bac8bcf3d36123d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.815536 26877 tablet_service.cc:1467] Processing CreateTablet for tablet f3c6bd6803c245b7bb3d78423de482b6 (DEFAULT_TABLE table=default.Table_590ce8c7b9f647ecb1e81a793a66f3b1 [id=8de62290aa814a5492665eca65a37230]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.827859 27020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db5adccd80a04e328e13793b461c38b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.821390 26876 tablet_service.cc:1467] Processing CreateTablet for tablet 66908164ff2a4ee5b55da6158699e0c6 (DEFAULT_TABLE table=default.Table_5920ba1cda06446c8f95e65aec6a42bf [id=10cadcb426e64a27a94df23fc8956de1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.837325 27222 tablet_bootstrap.cc:492] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:11.837613 27222 ts_tablet_manager.cc:1397] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.531s user 0.118s sys 0.149s
I20260810 11:30:11.837704 26878 tablet_service.cc:1467] Processing CreateTablet for tablet b7a3b877457c4a2489d397f3f864d6b2 (DEFAULT_TABLE table=default.Table_3449a59ebd4f47d58e6a93dee9ef6f73 [id=6a400e6303ea4b42a4fa36252c95a62b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.839053 27222 raft_consensus.cc:348] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:11.839339 27222 raft_consensus.cc:374] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:11.839435 27222 raft_consensus.cc:729] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:11.839761 27222 consensus_queue.cc:260] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:11.840608 27194 server_base.cc:1034] running on GCE node
W20260810 11:30:11.841981 26484 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet a9615b1ff3454a46a1a27cfcea20ad00 because the tablet was not found. No further retry: Not found: Tablet not found: a9615b1ff3454a46a1a27cfcea20ad00
I20260810 11:30:11.844326 26877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3c6bd6803c245b7bb3d78423de482b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.846251 26876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66908164ff2a4ee5b55da6158699e0c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.849002 27222 ts_tablet_manager.cc:1428] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.011s user 0.002s sys 0.006s
I20260810 11:30:11.849531 27222 tablet_bootstrap.cc:492] T a8197318b04a470791dd639742547fce P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:11.853070 27222 tablet_bootstrap.cc:654] T a8197318b04a470791dd639742547fce P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:11.853417 26484 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 2984cf53478e437d955aa3d0917287e9 because the tablet was not found. No further retry: Not found: Tablet not found: 2984cf53478e437d955aa3d0917287e9
I20260810 11:30:11.853613 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 201bafec782a4570a556f1c920e84898 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
W20260810 11:30:11.853950 26484 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 417f48ddea6440a5a86fa05f7e514005 because the tablet was not found. No further retry: Not found: Tablet not found: 417f48ddea6440a5a86fa05f7e514005
W20260810 11:30:11.854213 26484 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 50e61e835429436d9bdc585b8c7381f6 because the tablet was not found. No further retry: Not found: Tablet not found: 50e61e835429436d9bdc585b8c7381f6
I20260810 11:30:11.855144 26888 tablet_service.cc:1467] Processing CreateTablet for tablet 949f31fa0c124eefbee695cfc7f50cbe (DEFAULT_TABLE table=default.Table_924e63bbc09d4d8fabd76cd54211744b [id=de28bf5b1f604446a69f9651a1eb9b93]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:11.864526 26484 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet a8197318b04a470791dd639742547fce because the tablet was not found. No further retry: Not found: Tablet not found: a8197318b04a470791dd639742547fce
I20260810 11:30:11.864764 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7a3b877457c4a2489d397f3f864d6b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.865438 27222 tablet_bootstrap.cc:492] T a8197318b04a470791dd639742547fce P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:11.865763 27222 ts_tablet_manager.cc:1397] T a8197318b04a470791dd639742547fce P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.003s
W20260810 11:30:11.867803 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet f4a8a3553014448096836f888bdc2835 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4a8a3553014448096836f888bdc2835 already in progress: creating tablet
W20260810 11:30:11.869993 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet d98948300fe6472295ea53cedb7d386c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d98948300fe6472295ea53cedb7d386c already in progress: creating tablet
I20260810 11:30:11.867322 27222 raft_consensus.cc:348] T a8197318b04a470791dd639742547fce P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:11.870344 27222 raft_consensus.cc:374] T a8197318b04a470791dd639742547fce P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:11.870481 27222 raft_consensus.cc:729] T a8197318b04a470791dd639742547fce P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:11.871699 27222 consensus_queue.cc:260] T a8197318b04a470791dd639742547fce P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:11.873450 27222 ts_tablet_manager.cc:1428] T a8197318b04a470791dd639742547fce P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260810 11:30:11.873996 27222 tablet_bootstrap.cc:492] T 7edd85afa247429f92d4ed2f7c35ee16 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:11.878108 27245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 11:30:11.879680 27222 tablet_bootstrap.cc:654] T 7edd85afa247429f92d4ed2f7c35ee16 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:11.882021 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 256af4222bb34745ac018dd82a9c4f9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 256af4222bb34745ac018dd82a9c4f9b already in progress: creating tablet
W20260810 11:30:11.883249 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 97d586d35ff144a681ad52756f4be2b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97d586d35ff144a681ad52756f4be2b6 already in progress: creating tablet
I20260810 11:30:11.883247 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 7eae49e1c6554ba2ae831831ff4bb45c (DEFAULT_TABLE table=default.Table_29f8cf6d48514b87bae05b1c797607cd [id=aee0dce4bed94ceebb0ad9fbba02f4b3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:11.884171 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 201bafec782a4570a556f1c920e84898 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 201bafec782a4570a556f1c920e84898 already in progress: creating tablet
I20260810 11:30:11.887874 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 949f31fa0c124eefbee695cfc7f50cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:11.889118 27222 tablet_bootstrap.cc:492] T 7edd85afa247429f92d4ed2f7c35ee16 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:11.889323 27222 ts_tablet_manager.cc:1397] T 7edd85afa247429f92d4ed2f7c35ee16 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.005s
I20260810 11:30:11.890372 27222 raft_consensus.cc:348] T 7edd85afa247429f92d4ed2f7c35ee16 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:11.890725 27222 raft_consensus.cc:374] T 7edd85afa247429f92d4ed2f7c35ee16 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:11.890841 27222 raft_consensus.cc:729] T 7edd85afa247429f92d4ed2f7c35ee16 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
W20260810 11:30:11.893548 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7edd85afa247429f92d4ed2f7c35ee16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7edd85afa247429f92d4ed2f7c35ee16 already in progress: creating tablet
I20260810 11:30:11.893599 27222 consensus_queue.cc:260] T 7edd85afa247429f92d4ed2f7c35ee16 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:11.894369 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 66a7790587ed478b843fa9e997e50893 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66a7790587ed478b843fa9e997e50893 already in progress: creating tablet
W20260810 11:30:11.894690 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet e2732660f8964feeb5c03365df065a54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2732660f8964feeb5c03365df065a54 already in progress: creating tablet
W20260810 11:30:11.895123 26484 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 952fc4eb5e5c4d9597f4b6eee860ab3a because the tablet was not found. No further retry: Not found: Tablet not found: 952fc4eb5e5c4d9597f4b6eee860ab3a
W20260810 11:30:11.895565 26484 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 3dabfbd779c5406cb10ecf70f5a142e7 because the tablet was not found. No further retry: Not found: Tablet not found: 3dabfbd779c5406cb10ecf70f5a142e7
I20260810 11:30:11.896647 27222 ts_tablet_manager.cc:1428] T 7edd85afa247429f92d4ed2f7c35ee16 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
W20260810 11:30:11.897142 26484 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet d98948300fe6472295ea53cedb7d386c because the tablet was not found. No further retry: Not found: Tablet not found: d98948300fe6472295ea53cedb7d386c
I20260810 11:30:11.897361 27222 tablet_bootstrap.cc:492] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:11.897665 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet f4a8a3553014448096836f888bdc2835 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4a8a3553014448096836f888bdc2835 already in progress: creating tablet
W20260810 11:30:11.900133 26484 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 256af4222bb34745ac018dd82a9c4f9b because the tablet was not found. No further retry: Not found: Tablet not found: 256af4222bb34745ac018dd82a9c4f9b
I20260810 11:30:11.902508 27231 tablet_bootstrap.cc:654] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:11.906263 27222 tablet_bootstrap.cc:654] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:11.912772 27228 tablet_bootstrap.cc:492] T 2984cf53478e437d955aa3d0917287e9 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
W20260810 11:30:11.917179 26484 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 97d586d35ff144a681ad52756f4be2b6 because the tablet was not found. No further retry: Not found: Tablet not found: 97d586d35ff144a681ad52756f4be2b6
W20260810 11:30:11.918388 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 201bafec782a4570a556f1c920e84898 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 201bafec782a4570a556f1c920e84898 already in progress: creating tablet
W20260810 11:30:11.918812 27027 thread.cc:636] tablet-open [worker] (thread pool) Time spent creating pthread: real 0.765s user 0.049s sys 0.075s
W20260810 11:30:11.945616 27027 thread.cc:602] tablet-open [worker] (thread pool) Time spent starting thread: real 0.792s user 0.049s sys 0.075s
I20260810 11:30:11.945938 27027 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35790 (request call id 12) took 1208 ms. Trace:
I20260810 11:30:11.946285 27027 rpcz_store.cc:276] 0810 11:30:10.737561 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:10.737634 (+ 73us) service_pool.cc:227] Handling call
0810 11:30:10.747515 (+ 9881us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:10.747531 (+ 16us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:10.952148 (+204617us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:11.152409 (+200261us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:11.766107 (+613698us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0810 11:30:11.945867 (+179760us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-open.queue_time_us":612830,"thread_start_us":792532,"threads_started":1}
I20260810 11:30:11.950587 27231 log.cc:824] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215: Log is configured to *not* fsync() on all Append() calls
W20260810 11:30:11.965535 27244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 11:30:11.967283 27194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 11:30:11.969326 27231 tablet_bootstrap.cc:492] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:11.970222 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5920ba1cda06446c8f95e65aec6a42bf" } modify_external_catalogs: true
I20260810 11:30:11.970386 26493 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c80de92e9c2f45469ed63441d62eb4bf" } modify_external_catalogs: true
I20260810 11:30:11.970530 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5920ba1cda06446c8f95e65aec6a42bf" } modify_external_catalogs: true
I20260810 11:30:11.970618 26493 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c80de92e9c2f45469ed63441d62eb4bf" } modify_external_catalogs: true
I20260810 11:30:11.970809 27231 ts_tablet_manager.cc:1397] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.205s user 0.006s sys 0.011s
I20260810 11:30:11.978848 27222 tablet_bootstrap.cc:492] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:11.979117 27222 ts_tablet_manager.cc:1397] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.082s user 0.026s sys 0.039s
I20260810 11:30:11.980544 27222 raft_consensus.cc:348] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:11.981153 27222 raft_consensus.cc:374] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:11.981703 27222 raft_consensus.cc:729] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:11.982180 27222 consensus_queue.cc:260] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:11.982995 26887 tablet_service.cc:1467] Processing CreateTablet for tablet db5adccd80a04e328e13793b461c38b1 (DEFAULT_TABLE table=default.Table_01f43a19b7a44ee489416111da1c78df [id=f325caa441054ab180909b9af9de3ba6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:11.983533 27222 ts_tablet_manager.cc:1428] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260810 11:30:11.984115 27222 tablet_bootstrap.cc:492] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:11.984233 27228 ts_tablet_manager.cc:1397] T 2984cf53478e437d955aa3d0917287e9 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.625s user 0.008s sys 0.009s
I20260810 11:30:11.985272 26500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet f3c6bd6803c245b7bb3d78423de482b6
I20260810 11:30:11.986588 27222 tablet_bootstrap.cc:654] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:11.987951 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet f3c6bd6803c245b7bb3d78423de482b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:11.987970 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet f3c6bd6803c245b7bb3d78423de482b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
W20260810 11:30:11.988827 26484 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet f3c6bd6803c245b7bb3d78423de482b6 because the tablet was not found. No further retry: Not found: Tablet not found: f3c6bd6803c245b7bb3d78423de482b6
I20260810 11:30:11.993187 26495 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet ec788db5b0ca40f1811b6660276d0254
I20260810 11:30:11.995493 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eae49e1c6554ba2ae831831ff4bb45c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.000742 26887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db5adccd80a04e328e13793b461c38b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.011128 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet ec788db5b0ca40f1811b6660276d0254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
W20260810 11:30:12.014330 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet f3c6bd6803c245b7bb3d78423de482b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3c6bd6803c245b7bb3d78423de482b6 already in progress: creating tablet
I20260810 11:30:12.017026 27231 raft_consensus.cc:348] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.019183 27231 raft_consensus.cc:374] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.019429 27231 raft_consensus.cc:729] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:12.020323 27231 consensus_queue.cc:260] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.029333 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_b487cad441b24b01a9f452bc934ba2f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:12.030396 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b487cad441b24b01a9f452bc934ba2f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:12.031239 26497 master_service.cc:946] ReplaceTablet: received request to replace tablet 2984cf53478e437d955aa3d0917287e9 from {username='slave'} at 127.0.0.1:47672
W20260810 11:30:12.029459 26501 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2fc76603bf8843dab18c95fdab9a8be0 consensus state has no leader
I20260810 11:30:12.032619 26497 master_service.cc:946] ReplaceTablet: received request to replace tablet 2984cf53478e437d955aa3d0917287e9 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:12.032717 26501 master_service.cc:946] ReplaceTablet: received request to replace tablet 2984cf53478e437d955aa3d0917287e9 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:12.033068 26497 master_service.cc:946] ReplaceTablet: received request to replace tablet 2d7e745f05534917a5deecce410722e6 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:12.033491 26501 master_service.cc:946] ReplaceTablet: received request to replace tablet a9615b1ff3454a46a1a27cfcea20ad00 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:12.034214 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_9843e1f7503944a89021499a57571a86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:12.035055 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9843e1f7503944a89021499a57571a86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:12.035789 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_be3e02683a404e28a86de9c55aae7ba8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:12.036794 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be3e02683a404e28a86de9c55aae7ba8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:12.037209 26498 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet debc114073e14ec1839c5c4c7c2f1f1e consensus state has no leader
I20260810 11:30:12.038048 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_5f37e5816e5545ba909087c7751c55c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:12.038822 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f37e5816e5545ba909087c7751c55c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:12.043015 26495 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_04f7b0feaa934fe38250c47e0371c1b6" } new_table_name: "default.Table_dc355f349bc9426eb26a69cf93c089cf" modify_external_catalogs: true
I20260810 11:30:12.045218 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet ec788db5b0ca40f1811b6660276d0254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:12.049533 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet f3c6bd6803c245b7bb3d78423de482b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:12.050779 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ec788db5b0ca40f1811b6660276d0254 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec788db5b0ca40f1811b6660276d0254 already in progress: creating tablet
W20260810 11:30:12.051498 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet f3c6bd6803c245b7bb3d78423de482b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3c6bd6803c245b7bb3d78423de482b6 already in progress: creating tablet
I20260810 11:30:12.057083 27194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 11:30:12.057077 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet ec788db5b0ca40f1811b6660276d0254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:12.059350 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ec788db5b0ca40f1811b6660276d0254 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec788db5b0ca40f1811b6660276d0254 already in progress: creating tablet
W20260810 11:30:12.065774 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet ec788db5b0ca40f1811b6660276d0254 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec788db5b0ca40f1811b6660276d0254 already in progress: creating tablet
I20260810 11:30:12.077926 27231 ts_tablet_manager.cc:1428] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.107s user 0.018s sys 0.019s
I20260810 11:30:12.089941 27194 hybrid_clock.cc:648] HybridClock initialized: now 1786361412087802 us; error 2044 us; skew 500 ppm
I20260810 11:30:12.090735 27194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 11:30:12.103981 27231 tablet_bootstrap.cc:492] T 201bafec782a4570a556f1c920e84898 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:12.106179 26745 tablet_service.cc:1467] Processing CreateTablet for tablet 3ff4e19071fc435fbae4490799325e37 (DEFAULT_TABLE table=default.Table_22360b2c6a9e46f99bbc036074cb7441 [id=80c0857a46a84400aa9ce1e7f2e39d25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.106696 27231 tablet_bootstrap.cc:654] T 201bafec782a4570a556f1c920e84898 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:12.106894 26745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ff4e19071fc435fbae4490799325e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.112870 27222 tablet_bootstrap.cc:492] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:12.113090 27222 ts_tablet_manager.cc:1397] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.129s user 0.049s sys 0.066s
I20260810 11:30:12.114305 27222 raft_consensus.cc:348] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.114778 27222 raft_consensus.cc:374] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.114957 27222 raft_consensus.cc:729] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:12.115300 27222 consensus_queue.cc:260] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.116011 27222 ts_tablet_manager.cc:1428] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:12.116384 27222 tablet_bootstrap.cc:492] T 50e61e835429436d9bdc585b8c7381f6 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:12.119208 27222 tablet_bootstrap.cc:654] T 50e61e835429436d9bdc585b8c7381f6 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:12.127624 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 3ff4e19071fc435fbae4490799325e37 (DEFAULT_TABLE table=default.Table_22360b2c6a9e46f99bbc036074cb7441 [id=80c0857a46a84400aa9ce1e7f2e39d25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.127771 27231 tablet_bootstrap.cc:492] T 201bafec782a4570a556f1c920e84898 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:12.127961 27231 ts_tablet_manager.cc:1397] T 201bafec782a4570a556f1c920e84898 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.005s
I20260810 11:30:12.128150 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ff4e19071fc435fbae4490799325e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.129300 27231 raft_consensus.cc:348] T 201bafec782a4570a556f1c920e84898 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.129602 27231 raft_consensus.cc:374] T 201bafec782a4570a556f1c920e84898 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.129732 27231 raft_consensus.cc:729] T 201bafec782a4570a556f1c920e84898 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:12.130075 27231 consensus_queue.cc:260] T 201bafec782a4570a556f1c920e84898 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.131661 27231 ts_tablet_manager.cc:1428] T 201bafec782a4570a556f1c920e84898 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 11:30:12.132740 27231 tablet_bootstrap.cc:492] T 2984cf53478e437d955aa3d0917287e9 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:12.135604 27231 tablet_bootstrap.cc:654] T 2984cf53478e437d955aa3d0917287e9 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:12.096089 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_aa6798d7140e47fd8b1709e531dbbd10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:12.147572 27231 tablet_bootstrap.cc:492] T 2984cf53478e437d955aa3d0917287e9 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
W20260810 11:30:12.147774 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa6798d7140e47fd8b1709e531dbbd10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:12.147848 27231 ts_tablet_manager.cc:1397] T 2984cf53478e437d955aa3d0917287e9 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.010s
I20260810 11:30:12.097175 26501 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_2c4f698292bc49e6b03fd2d1b37bfbcc" } new_table_name: "default.Table_c753d94e8f1c4f459963bdfc55366320" modify_external_catalogs: true
I20260810 11:30:12.149935 27231 raft_consensus.cc:348] T 2984cf53478e437d955aa3d0917287e9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.150300 27231 raft_consensus.cc:374] T 2984cf53478e437d955aa3d0917287e9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.150383 27231 raft_consensus.cc:729] T 2984cf53478e437d955aa3d0917287e9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:12.150698 27231 consensus_queue.cc:260] T 2984cf53478e437d955aa3d0917287e9 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:12.151603 26485 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 86024.2us
I20260810 11:30:12.100270 26500 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f05f2fc60d0f43f6a72fca16828f94f9 (table default.Table_c6f8501fb26f49688f4c9e7c3cabc233 [id=8d5da0e5fab74127880f199687b0d3eb]). Expected version 3 got 0
I20260810 11:30:12.153744 27231 ts_tablet_manager.cc:1428] T 2984cf53478e437d955aa3d0917287e9 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.006s user 0.000s sys 0.006s
I20260810 11:30:12.155711 27231 tablet_bootstrap.cc:492] T 66a7790587ed478b843fa9e997e50893 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:12.158475 27035 tablet_service.cc:1467] Processing CreateTablet for tablet 3ff4e19071fc435fbae4490799325e37 (DEFAULT_TABLE table=default.Table_22360b2c6a9e46f99bbc036074cb7441 [id=80c0857a46a84400aa9ce1e7f2e39d25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.159044 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ff4e19071fc435fbae4490799325e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.159174 27231 tablet_bootstrap.cc:654] T 66a7790587ed478b843fa9e997e50893 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:12.159511 27228 raft_consensus.cc:348] T 2984cf53478e437d955aa3d0917287e9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.160343 27228 raft_consensus.cc:374] T 2984cf53478e437d955aa3d0917287e9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.160609 27228 raft_consensus.cc:729] T 2984cf53478e437d955aa3d0917287e9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:12.161640 27194 webserver.cc:460] Webserver started at http://127.25.195.254:36939/ using document root <none> and password file <none>
I20260810 11:30:12.163334 27194 fs_manager.cc:359] Metadata directory not provided
I20260810 11:30:12.164057 27194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 11:30:12.173553 26496 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet b7a3b877457c4a2489d397f3f864d6b2
I20260810 11:30:12.173717 27228 consensus_queue.cc:260] T 2984cf53478e437d955aa3d0917287e9 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.110131 26498 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_d4b2bc41d44d4dbeb8416907091e7dca" } new_table_name: "default.Table_f813dbe6bdc548f993a19d3d38613037" modify_external_catalogs: true
I20260810 11:30:12.177296 26887 tablet_service.cc:1514] Processing DeleteTablet for tablet b7a3b877457c4a2489d397f3f864d6b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
W20260810 11:30:12.146778 26495 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 607b055f8ced4372800adf5817b46e0b consensus state has no leader
W20260810 11:30:12.179883 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet b7a3b877457c4a2489d397f3f864d6b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7a3b877457c4a2489d397f3f864d6b2 already in progress: creating tablet
I20260810 11:30:12.190954 27228 ts_tablet_manager.cc:1428] T 2984cf53478e437d955aa3d0917287e9 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.206s user 0.020s sys 0.003s
I20260810 11:30:12.193908 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_2bd85b203b7c4859a8018ec6107bdf48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:12.195170 27228 tablet_bootstrap.cc:492] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
W20260810 11:30:12.196200 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bd85b203b7c4859a8018ec6107bdf48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:12.199208 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 2984cf53478e437d955aa3d0917287e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:12.199903 27223 tablet_replica.cc:330] T 2984cf53478e437d955aa3d0917287e9 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:12.200874 27223 raft_consensus.cc:2229] T 2984cf53478e437d955aa3d0917287e9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:12.201674 27223 raft_consensus.cc:2258] T 2984cf53478e437d955aa3d0917287e9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:12.204476 27223 ts_tablet_manager.cc:1905] T 2984cf53478e437d955aa3d0917287e9 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:12.206455 27020 tablet_service.cc:1514] Processing DeleteTablet for tablet b7a3b877457c4a2489d397f3f864d6b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:12.202931 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_7157cb4b94764bf6ab05e84468872791"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:12.210095 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7157cb4b94764bf6ab05e84468872791 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:12.211769 27231 tablet_bootstrap.cc:492] T 66a7790587ed478b843fa9e997e50893 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:12.212098 27231 ts_tablet_manager.cc:1397] T 66a7790587ed478b843fa9e997e50893 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.058s user 0.034s sys 0.015s
I20260810 11:30:12.204478 26499 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_baaf705869df4c36a233bb967b25455a" } modify_external_catalogs: true
I20260810 11:30:12.212608 26499 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_baaf705869df4c36a233bb967b25455a" } modify_external_catalogs: true
I20260810 11:30:12.213120 27231 raft_consensus.cc:348] T 66a7790587ed478b843fa9e997e50893 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.213465 27228 tablet_bootstrap.cc:654] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:12.213513 27231 raft_consensus.cc:374] T 66a7790587ed478b843fa9e997e50893 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.213617 27231 raft_consensus.cc:729] T 66a7790587ed478b843fa9e997e50893 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:12.214046 27231 consensus_queue.cc:260] T 66a7790587ed478b843fa9e997e50893 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.215925 27231 ts_tablet_manager.cc:1428] T 66a7790587ed478b843fa9e997e50893 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 11:30:12.217916 27231 tablet_bootstrap.cc:492] T f4a8a3553014448096836f888bdc2835 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
W20260810 11:30:12.219882 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet b7a3b877457c4a2489d397f3f864d6b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7a3b877457c4a2489d397f3f864d6b2 already in progress: creating tablet
I20260810 11:30:12.224984 27223 ts_tablet_manager.cc:1918] T 2984cf53478e437d955aa3d0917287e9 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:12.225294 27223 log.cc:1196] T 2984cf53478e437d955aa3d0917287e9 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/2984cf53478e437d955aa3d0917287e9
I20260810 11:30:12.226012 27223 ts_tablet_manager.cc:1939] T 2984cf53478e437d955aa3d0917287e9 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:12.228475 27231 tablet_bootstrap.cc:654] T f4a8a3553014448096836f888bdc2835 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:12.229449 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 2984cf53478e437d955aa3d0917287e9 (table default.Table_5b586fe77bb94d2ab0185ad1758fb770 [id=395fa947a5c445ad8b35ae050cca583b]) successfully deleted
I20260810 11:30:12.234613 27231 tablet_bootstrap.cc:492] T f4a8a3553014448096836f888bdc2835 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:12.234900 27231 ts_tablet_manager.cc:1397] T f4a8a3553014448096836f888bdc2835 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.003s
I20260810 11:30:12.236052 27231 raft_consensus.cc:348] T f4a8a3553014448096836f888bdc2835 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.236356 27231 raft_consensus.cc:374] T f4a8a3553014448096836f888bdc2835 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.236462 27231 raft_consensus.cc:729] T f4a8a3553014448096836f888bdc2835 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:12.236770 27231 consensus_queue.cc:260] T f4a8a3553014448096836f888bdc2835 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.240262 27231 ts_tablet_manager.cc:1428] T f4a8a3553014448096836f888bdc2835 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260810 11:30:12.240728 27231 tablet_bootstrap.cc:492] T 50e61e835429436d9bdc585b8c7381f6 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:12.243094 27231 tablet_bootstrap.cc:654] T 50e61e835429436d9bdc585b8c7381f6 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:12.248766 27194 fs_manager.cc:709] Time spent opening directory manager: real 0.064s user 0.017s sys 0.004s
I20260810 11:30:12.254154 26493 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 9b754dc2568849deafc7a8dc6d81924c
I20260810 11:30:12.255611 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_891d3f4e3019401fbb1b13496065cb5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:12.257074 27231 tablet_bootstrap.cc:492] T 50e61e835429436d9bdc585b8c7381f6 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:12.257229 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 66908164ff2a4ee5b55da6158699e0c6
I20260810 11:30:12.257340 27231 ts_tablet_manager.cc:1397] T 50e61e835429436d9bdc585b8c7381f6 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.001s
I20260810 11:30:12.258213 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_8e3537dc1b294128b70896bf5501c85e" } modify_external_catalogs: true
I20260810 11:30:12.258524 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_8e3537dc1b294128b70896bf5501c85e" } modify_external_catalogs: true
I20260810 11:30:12.258917 27231 raft_consensus.cc:348] T 50e61e835429436d9bdc585b8c7381f6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.259323 27231 raft_consensus.cc:374] T 50e61e835429436d9bdc585b8c7381f6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.259567 27231 raft_consensus.cc:729] T 50e61e835429436d9bdc585b8c7381f6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:12.259896 27231 consensus_queue.cc:260] T 50e61e835429436d9bdc585b8c7381f6 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:12.260499 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_891d3f4e3019401fbb1b13496065cb5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:12.263319 27278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 11:30:12.264719 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b754dc2568849deafc7a8dc6d81924c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:12.266431 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 66908164ff2a4ee5b55da6158699e0c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:12.268010 27231 ts_tablet_manager.cc:1428] T 50e61e835429436d9bdc585b8c7381f6 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260810 11:30:12.278667 27231 tablet_bootstrap.cc:492] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:12.285298 27194 fs_manager.cc:725] Time spent opening block manager: real 0.033s user 0.002s sys 0.005s
W20260810 11:30:12.300956 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 9b754dc2568849deafc7a8dc6d81924c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b754dc2568849deafc7a8dc6d81924c already in progress: creating tablet
I20260810 11:30:12.305501 27020 tablet_service.cc:1514] Processing DeleteTablet for tablet 66908164ff2a4ee5b55da6158699e0c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
W20260810 11:30:12.301748 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 66908164ff2a4ee5b55da6158699e0c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66908164ff2a4ee5b55da6158699e0c6 already in progress: creating tablet
I20260810 11:30:12.308796 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b754dc2568849deafc7a8dc6d81924c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:12.285712 27194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/data,/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/wal
uuid: "83cc8e39a3b9455f8242a6da6a54c38a"
format_stamp: "Formatted at 2026-08-10 11:30:04 on dist-test-slave-rgb1"
I20260810 11:30:12.311131 27194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 11:30:12.312107 27252 raft_consensus.cc:482] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:12.312707 27252 raft_consensus.cc:504] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.317941 27231 tablet_bootstrap.cc:654] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:12.318465 27252 leader_election.cc:288] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:12.326776 27113 tablet.cc:2369] T 201bafec782a4570a556f1c920e84898 P 482e605580be48cbbacce05a3e61c215: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 11:30:12.328239 26497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 2d7e745f05534917a5deecce410722e6
I20260810 11:30:12.328948 26497 catalog_manager.cc:6565] ReplaceTablet: tablet 2d7e745f05534917a5deecce410722e6 deleted and replaced by tablet 725d2e70e1d441b497d56a278e1de0ad
I20260810 11:30:12.329630 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_5845c9677afb47d1af6ddd98bed76886"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:12.330518 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5845c9677afb47d1af6ddd98bed76886 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:12.339402 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d7e745f05534917a5deecce410722e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 725d2e70e1d441b497d56a278e1de0ad) from {username='slave'} at 127.0.0.1:52560
W20260810 11:30:12.341310 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 2d7e745f05534917a5deecce410722e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d7e745f05534917a5deecce410722e6 already in progress: creating tablet
I20260810 11:30:12.341629 27263 raft_consensus.cc:482] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:12.341989 27263 raft_consensus.cc:504] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.343531 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet a8197318b04a470791dd639742547fce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:12.344031 27221 tablet_replica.cc:330] T a8197318b04a470791dd639742547fce P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:12.344488 27221 raft_consensus.cc:2229] T a8197318b04a470791dd639742547fce P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:12.345009 27221 raft_consensus.cc:2258] T a8197318b04a470791dd639742547fce P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:12.346122 27221 ts_tablet_manager.cc:1905] T a8197318b04a470791dd639742547fce P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:12.346722 27263 leader_election.cc:288] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:12.346151 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet 7edd85afa247429f92d4ed2f7c35ee16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:12.354281 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet 417f48ddea6440a5a86fa05f7e514005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:12.356406 27221 ts_tablet_manager.cc:1918] T a8197318b04a470791dd639742547fce P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:12.359897 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet b7a3b877457c4a2489d397f3f864d6b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:12.373631 27221 log.cc:1196] T a8197318b04a470791dd639742547fce P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/a8197318b04a470791dd639742547fce
I20260810 11:30:12.373719 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b754dc2568849deafc7a8dc6d81924c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:12.374168 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 66908164ff2a4ee5b55da6158699e0c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:12.374791 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d7e745f05534917a5deecce410722e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 725d2e70e1d441b497d56a278e1de0ad) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:12.375546 27221 ts_tablet_manager.cc:1939] T a8197318b04a470791dd639742547fce P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:12.377915 27221 tablet_replica.cc:330] T 7edd85afa247429f92d4ed2f7c35ee16 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:12.378212 27221 raft_consensus.cc:2229] T 7edd85afa247429f92d4ed2f7c35ee16 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:12.377859 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "417f48ddea6440a5a86fa05f7e514005" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:12.378587 27221 raft_consensus.cc:2258] T 7edd85afa247429f92d4ed2f7c35ee16 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:12.379734 26702 leader_election.cc:341] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:12.380143 27221 ts_tablet_manager.cc:1905] T 7edd85afa247429f92d4ed2f7c35ee16 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:12.381330 27231 tablet_bootstrap.cc:492] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:12.385291 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet a8197318b04a470791dd639742547fce (table default.Table_b609612a64d045b086440c601c257f30 [id=9b210311762a4c07bde13fd8ec4d7568]) successfully deleted
I20260810 11:30:12.387605 27231 ts_tablet_manager.cc:1397] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.103s user 0.005s sys 0.004s
I20260810 11:30:12.389588 27231 raft_consensus.cc:348] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.390084 27231 raft_consensus.cc:374] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.390210 27231 raft_consensus.cc:729] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:12.395967 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "566bf0f68c2946a89203472786e82512" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:12.397660 26991 leader_election.cc:341] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:12.397936 27231 consensus_queue.cc:260] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.404686 27231 ts_tablet_manager.cc:1428] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.017s user 0.004s sys 0.001s
I20260810 11:30:12.407356 27231 tablet_bootstrap.cc:492] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:12.410496 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d7e745f05534917a5deecce410722e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 725d2e70e1d441b497d56a278e1de0ad) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:12.413194 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "417f48ddea6440a5a86fa05f7e514005" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:12.414216 26700 leader_election.cc:341] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:12.414489 26700 leader_election.cc:302] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:12.415256 27252 raft_consensus.cc:2726] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:12.438102 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "566bf0f68c2946a89203472786e82512" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:12.439049 26771 raft_consensus.cc:2454] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:12.440797 26993 leader_election.cc:302] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:12.442092 27263 raft_consensus.cc:2781] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:12.442373 27263 raft_consensus.cc:482] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:12.442516 27263 raft_consensus.cc:3037] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:12.447631 27263 raft_consensus.cc:504] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.438189 27231 tablet_bootstrap.cc:654] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:12.449258 27228 tablet_bootstrap.cc:492] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:12.449640 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "566bf0f68c2946a89203472786e82512" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:12.450112 26771 raft_consensus.cc:3037] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:12.454216 27263 leader_election.cc:288] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:12.454913 26771 raft_consensus.cc:2454] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:12.455220 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "566bf0f68c2946a89203472786e82512" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:12.455479 26993 leader_election.cc:302] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:12.455824 27263 raft_consensus.cc:2781] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 11:30:12.455981 26991 leader_election.cc:341] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:12.457155 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 201bafec782a4570a556f1c920e84898 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:12.457358 27228 ts_tablet_manager.cc:1397] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.262s user 0.057s sys 0.114s
I20260810 11:30:12.458033 27248 tablet_replica.cc:330] T 201bafec782a4570a556f1c920e84898 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:12.458810 27248 raft_consensus.cc:2229] T 201bafec782a4570a556f1c920e84898 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:12.459807 27248 raft_consensus.cc:2258] T 201bafec782a4570a556f1c920e84898 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:12.461338 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 2984cf53478e437d955aa3d0917287e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:12.462056 26492 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5e6805f352774d24922eaf28498034d5" } new_table_name: "default.Table_59ed990b31964d6080614081ee46a6de" modify_external_catalogs: true
I20260810 11:30:12.464354 27248 ts_tablet_manager.cc:1905] T 201bafec782a4570a556f1c920e84898 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:12.465241 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_5f6a37537c33412a80f2642fb0162da6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:12.466143 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f6a37537c33412a80f2642fb0162da6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:12.485705 27231 tablet_bootstrap.cc:492] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:12.485999 27231 ts_tablet_manager.cc:1397] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.079s user 0.000s sys 0.007s
I20260810 11:30:12.487448 27231 raft_consensus.cc:348] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.487856 27231 raft_consensus.cc:374] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.488001 27231 raft_consensus.cc:729] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
W20260810 11:30:12.493907 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 66908164ff2a4ee5b55da6158699e0c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66908164ff2a4ee5b55da6158699e0c6 already in progress: creating tablet
W20260810 11:30:12.494385 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 9b754dc2568849deafc7a8dc6d81924c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b754dc2568849deafc7a8dc6d81924c already in progress: creating tablet
W20260810 11:30:12.494766 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 2d7e745f05534917a5deecce410722e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d7e745f05534917a5deecce410722e6 already in progress: creating tablet
W20260810 11:30:12.496325 26501 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 79953795f07845aba3f028741cdcdd9e consensus state has no leader
W20260810 11:30:12.501927 26498 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96cae4eb16c84410926a317af70e44f7 has no consensus state
I20260810 11:30:12.501760 27228 raft_consensus.cc:348] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.502223 27228 raft_consensus.cc:374] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.502348 27228 raft_consensus.cc:729] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:12.502477 26498 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_0cf99364f1364aedae81ca0f8f3c8b38" } new_table_name: "default.Table_bb2f94800564493cbd9ed08e4ea7dc24" modify_external_catalogs: true
I20260810 11:30:12.503232 27228 consensus_queue.cc:260] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.504087 27228 ts_tablet_manager.cc:1428] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.046s user 0.002s sys 0.000s
I20260810 11:30:12.505946 26501 master_service.cc:946] ReplaceTablet: received request to replace tablet fc2d129e99f24c018e4f8e43f211171d from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:12.513314 27263 raft_consensus.cc:686] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:12.515259 27263 consensus_queue.cc:237] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.488444 27231 consensus_queue.cc:260] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.517318 27231 ts_tablet_manager.cc:1428] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.031s user 0.001s sys 0.003s
I20260810 11:30:12.517756 27231 tablet_bootstrap.cc:492] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:12.519497 27222 tablet_bootstrap.cc:492] T 50e61e835429436d9bdc585b8c7381f6 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:12.519426 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 66a7790587ed478b843fa9e997e50893 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:12.519999 27228 tablet_bootstrap.cc:492] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:12.523115 27228 tablet_bootstrap.cc:654] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:12.524797 27222 ts_tablet_manager.cc:1397] T 50e61e835429436d9bdc585b8c7381f6 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.404s user 0.118s sys 0.156s
I20260810 11:30:12.526413 27222 raft_consensus.cc:348] T 50e61e835429436d9bdc585b8c7381f6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.526800 27222 raft_consensus.cc:374] T 50e61e835429436d9bdc585b8c7381f6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.526808 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 50e61e835429436d9bdc585b8c7381f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:12.526901 27222 raft_consensus.cc:729] T 50e61e835429436d9bdc585b8c7381f6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:12.530421 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet f4a8a3553014448096836f888bdc2835 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:12.533859 27248 ts_tablet_manager.cc:1918] T 201bafec782a4570a556f1c920e84898 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:12.534106 27248 log.cc:1196] T 201bafec782a4570a556f1c920e84898 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/201bafec782a4570a556f1c920e84898
I20260810 11:30:12.534570 27248 ts_tablet_manager.cc:1939] T 201bafec782a4570a556f1c920e84898 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:12.537689 27222 consensus_queue.cc:260] T 50e61e835429436d9bdc585b8c7381f6 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.539499 27222 ts_tablet_manager.cc:1428] T 50e61e835429436d9bdc585b8c7381f6 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.014s user 0.001s sys 0.002s
I20260810 11:30:12.540172 27222 tablet_bootstrap.cc:492] T 2984cf53478e437d955aa3d0917287e9 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:12.543272 27231 tablet_bootstrap.cc:654] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:12.546900 27222 tablet_bootstrap.cc:654] T 2984cf53478e437d955aa3d0917287e9 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:12.549546 27221 ts_tablet_manager.cc:1918] T 7edd85afa247429f92d4ed2f7c35ee16 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:12.549705 27221 log.cc:1196] T 7edd85afa247429f92d4ed2f7c35ee16 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/7edd85afa247429f92d4ed2f7c35ee16
W20260810 11:30:12.552752 26966 tablet.cc:2369] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 11:30:12.554968 27221 ts_tablet_manager.cc:1939] T 7edd85afa247429f92d4ed2f7c35ee16 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:12.559624 27228 tablet_bootstrap.cc:492] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:12.560151 27228 ts_tablet_manager.cc:1397] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.040s user 0.007s sys 0.000s
I20260810 11:30:12.560441 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet a8197318b04a470791dd639742547fce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:12.561931 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 7edd85afa247429f92d4ed2f7c35ee16 (table default.Table_6ded95de14fd42ef926969f573a166c5 [id=6bc27d6198fc4654aa20602a3917569e]) successfully deleted
I20260810 11:30:12.561808 27228 raft_consensus.cc:348] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.562422 27228 raft_consensus.cc:374] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.562529 27228 raft_consensus.cc:729] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:12.562588 27221 tablet_replica.cc:330] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:12.562830 27221 raft_consensus.cc:2229] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:12.563216 27221 raft_consensus.cc:2258] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:12.563982 27221 ts_tablet_manager.cc:1905] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:12.564766 27228 consensus_queue.cc:260] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.572839 26499 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet db5adccd80a04e328e13793b461c38b1
I20260810 11:30:12.573566 26499 master_service.cc:946] ReplaceTablet: received request to replace tablet 607b055f8ced4372800adf5817b46e0b from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:12.574102 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet c0120575c9fd4b2fb32ca7392db277bf
I20260810 11:30:12.574931 26491 master_service.cc:946] ReplaceTablet: received request to replace tablet 2e2c9112462f442e8de5b4a944cfdc6b from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:12.577289 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet 50e61e835429436d9bdc585b8c7381f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:12.577548 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet db5adccd80a04e328e13793b461c38b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:12.577881 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet c0120575c9fd4b2fb32ca7392db277bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:12.581745 27222 tablet_bootstrap.cc:492] T 2984cf53478e437d955aa3d0917287e9 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:12.582075 27222 ts_tablet_manager.cc:1397] T 2984cf53478e437d955aa3d0917287e9 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.000s
I20260810 11:30:12.582635 27194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 11:30:12.583387 27222 raft_consensus.cc:348] T 2984cf53478e437d955aa3d0917287e9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.583706 27222 raft_consensus.cc:374] T 2984cf53478e437d955aa3d0917287e9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.583853 27222 raft_consensus.cc:729] T 2984cf53478e437d955aa3d0917287e9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:12.584343 27222 consensus_queue.cc:260] T 2984cf53478e437d955aa3d0917287e9 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.584924 27194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 11:30:12.584944 27020 tablet_service.cc:1514] Processing DeleteTablet for tablet c0120575c9fd4b2fb32ca7392db277bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:12.580791 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet db5adccd80a04e328e13793b461c38b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:12.585336 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet db5adccd80a04e328e13793b461c38b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:12.585450 27194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 11:30:12.580964 26887 tablet_service.cc:1514] Processing DeleteTablet for tablet c0120575c9fd4b2fb32ca7392db277bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:52560
W20260810 11:30:12.586162 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet db5adccd80a04e328e13793b461c38b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db5adccd80a04e328e13793b461c38b1 already in progress: creating tablet
I20260810 11:30:12.586833 27222 ts_tablet_manager.cc:1428] T 2984cf53478e437d955aa3d0917287e9 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260810 11:30:12.567045 27228 ts_tablet_manager.cc:1428] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.007s user 0.003s sys 0.001s
W20260810 11:30:12.587390 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet c0120575c9fd4b2fb32ca7392db277bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0120575c9fd4b2fb32ca7392db277bf already in progress: creating tablet
I20260810 11:30:12.587734 27228 tablet_bootstrap.cc:492] T f4a8a3553014448096836f888bdc2835 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:12.590298 27221 ts_tablet_manager.cc:1918] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:12.590396 27228 tablet_bootstrap.cc:654] T f4a8a3553014448096836f888bdc2835 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:12.590526 27221 log.cc:1196] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/417f48ddea6440a5a86fa05f7e514005
I20260810 11:30:12.590955 27221 ts_tablet_manager.cc:1939] T 417f48ddea6440a5a86fa05f7e514005 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:12.593372 27222 tablet_bootstrap.cc:492] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:12.598213 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 417f48ddea6440a5a86fa05f7e514005 (table default.Table_c43921fb6a024b50b218fad3b85e6904 [id=982ed623ee924e059c884584da03c56a]) successfully deleted
W20260810 11:30:12.601423 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet b7a3b877457c4a2489d397f3f864d6b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7a3b877457c4a2489d397f3f864d6b2 already in progress: creating tablet
W20260810 11:30:12.602319 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 9b754dc2568849deafc7a8dc6d81924c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b754dc2568849deafc7a8dc6d81924c already in progress: creating tablet
W20260810 11:30:12.604205 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 66908164ff2a4ee5b55da6158699e0c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66908164ff2a4ee5b55da6158699e0c6 already in progress: creating tablet
I20260810 11:30:12.604779 27263 raft_consensus.cc:482] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:12.605096 27263 raft_consensus.cc:504] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.605854 27263 leader_election.cc:288] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:12.606592 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c6b3f8626724d12986f388b1ca90b3c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:12.607122 26916 raft_consensus.cc:2454] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:12.607127 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c6b3f8626724d12986f388b1ca90b3c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:12.607849 26991 leader_election.cc:302] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
W20260810 11:30:12.608207 26993 leader_election.cc:341] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:12.608259 27263 raft_consensus.cc:2781] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:12.608407 27263 raft_consensus.cc:482] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:12.608592 27263 raft_consensus.cc:3037] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:12.608628 27221 tablet_replica.cc:330] T 50e61e835429436d9bdc585b8c7381f6 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
W20260810 11:30:12.608736 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2d7e745f05534917a5deecce410722e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d7e745f05534917a5deecce410722e6 already in progress: creating tablet
I20260810 11:30:12.612207 27231 tablet_bootstrap.cc:492] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:12.612470 27231 ts_tablet_manager.cc:1397] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.095s user 0.005s sys 0.001s
I20260810 11:30:12.613727 27231 raft_consensus.cc:348] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.614132 27231 raft_consensus.cc:374] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.614244 27231 raft_consensus.cc:729] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:12.614501 27248 tablet_replica.cc:330] T 2984cf53478e437d955aa3d0917287e9 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:12.614861 27248 raft_consensus.cc:2229] T 2984cf53478e437d955aa3d0917287e9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:12.615197 27248 raft_consensus.cc:2258] T 2984cf53478e437d955aa3d0917287e9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:12.616262 27248 ts_tablet_manager.cc:1905] T 2984cf53478e437d955aa3d0917287e9 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:12.614681 27231 consensus_queue.cc:260] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.617231 27222 tablet_bootstrap.cc:654] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:12.617937 26497 master_service.cc:946] ReplaceTablet: received request to replace tablet fc2d129e99f24c018e4f8e43f211171d from {username='slave'} at 127.0.0.1:47672
W20260810 11:30:12.618588 26492 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 725d2e70e1d441b497d56a278e1de0ad has no consensus state
I20260810 11:30:12.618578 27221 raft_consensus.cc:2229] T 50e61e835429436d9bdc585b8c7381f6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:12.618873 27221 raft_consensus.cc:2258] T 50e61e835429436d9bdc585b8c7381f6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:12.619295 27231 ts_tablet_manager.cc:1428] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.007s user 0.000s sys 0.003s
I20260810 11:30:12.620967 27231 tablet_bootstrap.cc:492] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:12.622988 27228 tablet_bootstrap.cc:492] T f4a8a3553014448096836f888bdc2835 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:12.622884 27263 raft_consensus.cc:504] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.623178 27228 ts_tablet_manager.cc:1397] T f4a8a3553014448096836f888bdc2835 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
I20260810 11:30:12.623203 27221 ts_tablet_manager.cc:1905] T 50e61e835429436d9bdc585b8c7381f6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:12.624292 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c6b3f8626724d12986f388b1ca90b3c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:12.624292 27228 raft_consensus.cc:348] T f4a8a3553014448096836f888bdc2835 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.624636 27228 raft_consensus.cc:374] T f4a8a3553014448096836f888bdc2835 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.624768 27228 raft_consensus.cc:729] T f4a8a3553014448096836f888bdc2835 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
W20260810 11:30:12.625080 26993 leader_election.cc:341] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:12.625077 27228 consensus_queue.cc:260] T f4a8a3553014448096836f888bdc2835 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.625809 27228 ts_tablet_manager.cc:1428] T f4a8a3553014448096836f888bdc2835 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:12.626355 27263 leader_election.cc:288] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:12.627120 27228 tablet_bootstrap.cc:492] T a9615b1ff3454a46a1a27cfcea20ad00 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:12.629107 27231 tablet_bootstrap.cc:654] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:12.629259 27228 tablet_bootstrap.cc:654] T a9615b1ff3454a46a1a27cfcea20ad00 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:12.631039 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c6b3f8626724d12986f388b1ca90b3c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:12.631394 26916 raft_consensus.cc:3037] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:12.640736 27248 ts_tablet_manager.cc:1918] T 2984cf53478e437d955aa3d0917287e9 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:12.641055 27248 log.cc:1196] T 2984cf53478e437d955aa3d0917287e9 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/2984cf53478e437d955aa3d0917287e9
I20260810 11:30:12.643684 26916 raft_consensus.cc:2454] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
W20260810 11:30:12.645653 26484 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 3ccef06fa06c4c519d8760fa948d6c8b (table default.Table_c0eb3404046346ce92f8b3da2cf20095 [id=ba999b4084c84b2f8e0313b96849b169], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3ccef06fa06c4c519d8760fa948d6c8b consensus state has no leader
I20260810 11:30:12.646631 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 201bafec782a4570a556f1c920e84898 (table default.Table_01ba22149a2f482782c70caa4d2244ea [id=31781820c0814fb0bee423b2ce6ae615]) successfully deleted
I20260810 11:30:12.651336 26991 leader_election.cc:302] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:12.651932 27263 raft_consensus.cc:2781] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:12.652220 27263 raft_consensus.cc:686] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:12.652580 27263 consensus_queue.cc:237] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.653313 27248 ts_tablet_manager.cc:1939] T 2984cf53478e437d955aa3d0917287e9 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:12.654510 27248 tablet_replica.cc:330] T 66a7790587ed478b843fa9e997e50893 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:12.654778 27248 raft_consensus.cc:2229] T 66a7790587ed478b843fa9e997e50893 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:12.655128 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 2984cf53478e437d955aa3d0917287e9 (table default.Table_5b586fe77bb94d2ab0185ad1758fb770 [id=395fa947a5c445ad8b35ae050cca583b]) successfully deleted
I20260810 11:30:12.655213 27248 raft_consensus.cc:2258] T 66a7790587ed478b843fa9e997e50893 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:12.659677 27221 ts_tablet_manager.cc:1918] T 50e61e835429436d9bdc585b8c7381f6 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:12.659973 27221 log.cc:1196] T 50e61e835429436d9bdc585b8c7381f6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/50e61e835429436d9bdc585b8c7381f6
I20260810 11:30:12.660429 27221 ts_tablet_manager.cc:1939] T 50e61e835429436d9bdc585b8c7381f6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:12.669193 27248 ts_tablet_manager.cc:1905] T 66a7790587ed478b843fa9e997e50893 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:12.682840 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 50e61e835429436d9bdc585b8c7381f6 (table default.Table_96a70f4812ec4dec8208ba26426bf964 [id=4a855b81f02147958d928720286121df]) successfully deleted
I20260810 11:30:12.689256 26501 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet fc2d129e99f24c018e4f8e43f211171d
I20260810 11:30:12.690011 26501 catalog_manager.cc:6565] ReplaceTablet: tablet fc2d129e99f24c018e4f8e43f211171d deleted and replaced by tablet 478c0c39658349c39e3afa1aa1653e82
W20260810 11:30:12.693432 26498 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2fc76603bf8843dab18c95fdab9a8be0 consensus state has no leader
I20260810 11:30:12.695614 26887 tablet_service.cc:1514] Processing DeleteTablet for tablet fc2d129e99f24c018e4f8e43f211171d with delete_type TABLET_DATA_DELETED (replaced by tablet 478c0c39658349c39e3afa1aa1653e82) from {username='slave'} at 127.0.0.1:52560
W20260810 11:30:12.699290 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet fc2d129e99f24c018e4f8e43f211171d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc2d129e99f24c018e4f8e43f211171d already in progress: creating tablet
I20260810 11:30:12.702543 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet fc2d129e99f24c018e4f8e43f211171d with delete_type TABLET_DATA_DELETED (replaced by tablet 478c0c39658349c39e3afa1aa1653e82) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:12.703898 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet fc2d129e99f24c018e4f8e43f211171d with delete_type TABLET_DATA_DELETED (replaced by tablet 478c0c39658349c39e3afa1aa1653e82) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:12.704505 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet db5adccd80a04e328e13793b461c38b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db5adccd80a04e328e13793b461c38b1 already in progress: creating tablet
W20260810 11:30:12.705163 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet c0120575c9fd4b2fb32ca7392db277bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0120575c9fd4b2fb32ca7392db277bf already in progress: creating tablet
W20260810 11:30:12.705649 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet fc2d129e99f24c018e4f8e43f211171d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc2d129e99f24c018e4f8e43f211171d already in progress: creating tablet
I20260810 11:30:12.708189 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_73605ca3d8ed4b83bf92156282c66625"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:12.709120 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73605ca3d8ed4b83bf92156282c66625 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:12.711074 27248 ts_tablet_manager.cc:1918] T 66a7790587ed478b843fa9e997e50893 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:12.711272 27248 log.cc:1196] T 66a7790587ed478b843fa9e997e50893 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/66a7790587ed478b843fa9e997e50893
I20260810 11:30:12.711098 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_59042145856943e1a20d5bb917f89bd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:12.711730 27248 ts_tablet_manager.cc:1939] T 66a7790587ed478b843fa9e997e50893 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
W20260810 11:30:12.711931 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59042145856943e1a20d5bb917f89bd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:12.715278 26493 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_bc8bc2c9015443fb865751881638284b" } modify_external_catalogs: true
I20260810 11:30:12.715662 26493 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_bc8bc2c9015443fb865751881638284b" } modify_external_catalogs: true
I20260810 11:30:12.720009 27263 raft_consensus.cc:482] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:12.720266 27263 raft_consensus.cc:504] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.721634 27263 leader_election.cc:288] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:12.722847 26993 leader_election.cc:341] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: a8197318b04a470791dd639742547fce
I20260810 11:30:12.723912 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_cc55e38123c6426fb73e83da0b48d081"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:12.724736 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc55e38123c6426fb73e83da0b48d081 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:12.725744 27248 tablet_replica.cc:330] T 50e61e835429436d9bdc585b8c7381f6 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:12.726032 27248 raft_consensus.cc:2229] T 50e61e835429436d9bdc585b8c7381f6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:12.726297 27248 raft_consensus.cc:2258] T 50e61e835429436d9bdc585b8c7381f6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:12.726979 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_ed278fa8f2db4fe8a3215e71eb2d3f9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:12.727872 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed278fa8f2db4fe8a3215e71eb2d3f9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:12.728160 27248 ts_tablet_manager.cc:1905] T 50e61e835429436d9bdc585b8c7381f6 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:12.733841 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 66a7790587ed478b843fa9e997e50893 (table default.Table_c051f1f117b04fdd9c1ed11f426ae316 [id=b2754904694140cab5a7a82d31449a70]) successfully deleted
I20260810 11:30:12.735191 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8197318b04a470791dd639742547fce" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:12.736202 26991 leader_election.cc:341] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:12.736413 26991 leader_election.cc:302] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:12.736832 27263 raft_consensus.cc:2726] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:12.738364 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet 2984cf53478e437d955aa3d0917287e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:12.738749 27221 tablet_replica.cc:330] T 2984cf53478e437d955aa3d0917287e9 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:12.738992 27221 raft_consensus.cc:2229] T 2984cf53478e437d955aa3d0917287e9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:12.739218 27221 raft_consensus.cc:2258] T 2984cf53478e437d955aa3d0917287e9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:12.739481 27263 raft_consensus.cc:482] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:12.739714 27263 raft_consensus.cc:504] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.740265 27221 ts_tablet_manager.cc:1905] T 2984cf53478e437d955aa3d0917287e9 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:12.741441 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d7e745f05534917a5deecce410722e6" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:12.741786 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d7e745f05534917a5deecce410722e6" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:12.742129 26916 raft_consensus.cc:2454] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
W20260810 11:30:12.742178 26993 leader_election.cc:341] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:12.742461 27263 leader_election.cc:288] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:12.742703 26991 leader_election.cc:302] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:12.743055 27263 raft_consensus.cc:2781] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:12.743209 27263 raft_consensus.cc:482] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:12.743338 27263 raft_consensus.cc:3037] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:12.748883 27263 raft_consensus.cc:504] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.749914 27263 leader_election.cc:288] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:12.750512 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d7e745f05534917a5deecce410722e6" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
W20260810 11:30:12.752265 26993 leader_election.cc:341] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:12.753715 27221 ts_tablet_manager.cc:1918] T 2984cf53478e437d955aa3d0917287e9 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:12.753931 27221 log.cc:1196] T 2984cf53478e437d955aa3d0917287e9 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/2984cf53478e437d955aa3d0917287e9
I20260810 11:30:12.754936 27221 ts_tablet_manager.cc:1939] T 2984cf53478e437d955aa3d0917287e9 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:12.763041 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d7e745f05534917a5deecce410722e6" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:12.763585 26916 raft_consensus.cc:3037] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:12.764998 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 2984cf53478e437d955aa3d0917287e9 (table default.Table_5b586fe77bb94d2ab0185ad1758fb770 [id=395fa947a5c445ad8b35ae050cca583b]) successfully deleted
I20260810 11:30:12.769863 26916 raft_consensus.cc:2454] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:12.770967 26991 leader_election.cc:302] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:12.771569 27263 raft_consensus.cc:2781] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:12.771827 27263 raft_consensus.cc:686] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:12.772202 27263 consensus_queue.cc:237] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.774242 26496 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 2c6b3f8626724d12986f388b1ca90b3c (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:12.777881 27248 ts_tablet_manager.cc:1918] T 50e61e835429436d9bdc585b8c7381f6 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:12.779584 27248 log.cc:1196] T 50e61e835429436d9bdc585b8c7381f6 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/50e61e835429436d9bdc585b8c7381f6
I20260810 11:30:12.780552 27248 ts_tablet_manager.cc:1939] T 50e61e835429436d9bdc585b8c7381f6 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:12.779882 26495 catalog_manager.cc:5495] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:12.781824 26495 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 2c6b3f8626724d12986f388b1ca90b3c (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:12.783741 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 50e61e835429436d9bdc585b8c7381f6 (table default.Table_96a70f4812ec4dec8208ba26426bf964 [id=4a855b81f02147958d928720286121df]) successfully deleted
I20260810 11:30:12.785025 27248 tablet_replica.cc:330] T f4a8a3553014448096836f888bdc2835 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:12.785982 27248 raft_consensus.cc:2229] T f4a8a3553014448096836f888bdc2835 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:12.787194 26887 tablet_service.cc:1467] Processing CreateTablet for tablet 23637a02b6464e17aa2a69ea5cc4ddfe (DEFAULT_TABLE table=default.Table_7c36df9513654205b604d1a8a1d7c2ca [id=bb3435760ed6476fbec4aee7d609cd85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.787767 26887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23637a02b6464e17aa2a69ea5cc4ddfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.793601 26883 tablet_service.cc:1467] Processing CreateTablet for tablet b28f3dcbd6d74559b372d3452e13ce9f (DEFAULT_TABLE table=default.Table_95523d7d33a4423099b179a2d91867f9 [id=01eb86f74b7e4434a2d6aae5dd94b3b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.793697 26878 tablet_service.cc:1467] Processing CreateTablet for tablet 31888ddeafe14738b818016a9c0a4ad3 (DEFAULT_TABLE table=default.Table_5763dcd0b2ae40b4945a6966bfd23099 [id=9ec5a85bb4b34875b465a5ee221ab4f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.794118 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b28f3dcbd6d74559b372d3452e13ce9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.794440 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31888ddeafe14738b818016a9c0a4ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.790091 27035 tablet_service.cc:1467] Processing CreateTablet for tablet 23637a02b6464e17aa2a69ea5cc4ddfe (DEFAULT_TABLE table=default.Table_7c36df9513654205b604d1a8a1d7c2ca [id=bb3435760ed6476fbec4aee7d609cd85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.796247 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23637a02b6464e17aa2a69ea5cc4ddfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.790899 27020 tablet_service.cc:1467] Processing CreateTablet for tablet b28f3dcbd6d74559b372d3452e13ce9f (DEFAULT_TABLE table=default.Table_95523d7d33a4423099b179a2d91867f9 [id=01eb86f74b7e4434a2d6aae5dd94b3b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.796607 27039 tablet_service.cc:1467] Processing CreateTablet for tablet d729baae40a64e6e8c23e6870f230afb (DEFAULT_TABLE table=default.Table_d297e25211404611a6ba6a454c9dd5fd [id=093a9315d9f14cb28b5da3f910c28b0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.794269 27027 tablet_service.cc:1467] Processing CreateTablet for tablet 31888ddeafe14738b818016a9c0a4ad3 (DEFAULT_TABLE table=default.Table_5763dcd0b2ae40b4945a6966bfd23099 [id=9ec5a85bb4b34875b465a5ee221ab4f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.795123 27021 tablet_service.cc:1467] Processing CreateTablet for tablet d722b93fe27f4c08a592bc393046b6bd (DEFAULT_TABLE table=default.Table_7f57913383ec42ce958846fccae03631 [id=0faf073b01654e38b8f6083f5012abd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.797106 27020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b28f3dcbd6d74559b372d3452e13ce9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.803305 26501 master_service.cc:946] ReplaceTablet: received request to replace tablet c0120575c9fd4b2fb32ca7392db277bf from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:12.804692 26888 tablet_service.cc:1467] Processing CreateTablet for tablet d722b93fe27f4c08a592bc393046b6bd (DEFAULT_TABLE table=default.Table_7f57913383ec42ce958846fccae03631 [id=0faf073b01654e38b8f6083f5012abd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.805050 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d722b93fe27f4c08a592bc393046b6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.805492 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d722b93fe27f4c08a592bc393046b6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.807384 26492 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_35c17c06f74e412fa340b5a9bfed2911" } new_table_name: "default.Table_dcc367d62a8f4e07a9e10fbb2faa27d1" modify_external_catalogs: true
I20260810 11:30:12.809211 27027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31888ddeafe14738b818016a9c0a4ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.809165 26500 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_95523d7d33a4423099b179a2d91867f9" } modify_external_catalogs: true
I20260810 11:30:12.809419 26500 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_95523d7d33a4423099b179a2d91867f9" } modify_external_catalogs: true
I20260810 11:30:12.811736 26876 tablet_service.cc:1467] Processing CreateTablet for tablet d729baae40a64e6e8c23e6870f230afb (DEFAULT_TABLE table=default.Table_d297e25211404611a6ba6a454c9dd5fd [id=093a9315d9f14cb28b5da3f910c28b0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.811750 26879 tablet_service.cc:1467] Processing CreateTablet for tablet a28849649c704f2fbdec1aced9ce01b1 (DEFAULT_TABLE table=default.Table_9843e1f7503944a89021499a57571a86 [id=eef14446a15e42b495e191bce11574a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.812433 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_a88d168f91f6427e898a55cb391840af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:12.812832 26876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d729baae40a64e6e8c23e6870f230afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.813158 27039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d729baae40a64e6e8c23e6870f230afb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:12.813248 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a88d168f91f6427e898a55cb391840af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:12.814294 26879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a28849649c704f2fbdec1aced9ce01b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.815797 26498 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_29f8cf6d48514b87bae05b1c797607cd" } modify_external_catalogs: true
I20260810 11:30:12.816252 26498 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_29f8cf6d48514b87bae05b1c797607cd" } modify_external_catalogs: true
I20260810 11:30:12.818154 26501 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_7f57913383ec42ce958846fccae03631" } new_table_name: "default.Table_7d9e01b8d13f45e8bf5208d972be99dc" modify_external_catalogs: true
I20260810 11:30:12.840026 27034 tablet_service.cc:1467] Processing CreateTablet for tablet a28849649c704f2fbdec1aced9ce01b1 (DEFAULT_TABLE table=default.Table_9843e1f7503944a89021499a57571a86 [id=eef14446a15e42b495e191bce11574a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.840896 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a28849649c704f2fbdec1aced9ce01b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.842883 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 96cae4eb16c84410926a317af70e44f7 (DEFAULT_TABLE table=default.Table_f813dbe6bdc548f993a19d3d38613037 [id=b471e1c958484bbc95c4cbb4c79bea91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.843420 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96cae4eb16c84410926a317af70e44f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.857038 27248 raft_consensus.cc:2258] T f4a8a3553014448096836f888bdc2835 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:12.858307 27248 ts_tablet_manager.cc:1905] T f4a8a3553014448096836f888bdc2835 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:12.860805 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 2e2c9112462f442e8de5b4a944cfdc6b
I20260810 11:30:12.861487 26491 catalog_manager.cc:6565] ReplaceTablet: tablet 2e2c9112462f442e8de5b4a944cfdc6b deleted and replaced by tablet 0ad96bbd29ad4ce9a766ac84db1a9c60
I20260810 11:30:12.862087 26491 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5f37e5816e5545ba909087c7751c55c3" } new_table_name: "default.Table_9981bbc86a934c98814b8a6164ffd51b" modify_external_catalogs: true
I20260810 11:30:12.862644 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e2c9112462f442e8de5b4a944cfdc6b with delete_type TABLET_DATA_DELETED (replaced by tablet 0ad96bbd29ad4ce9a766ac84db1a9c60) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:12.865343 26499 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 607b055f8ced4372800adf5817b46e0b
I20260810 11:30:12.866144 26499 catalog_manager.cc:6565] ReplaceTablet: tablet 607b055f8ced4372800adf5817b46e0b deleted and replaced by tablet e25ae21cc8cc4749a507fcab5ee225a3
I20260810 11:30:12.867107 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 607b055f8ced4372800adf5817b46e0b with delete_type TABLET_DATA_DELETED (replaced by tablet e25ae21cc8cc4749a507fcab5ee225a3) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:12.866932 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_4d9bc84fc41e4b87ac2f6432852e5d61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:12.868119 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d9bc84fc41e4b87ac2f6432852e5d61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:12.872800 26887 tablet_service.cc:1514] Processing DeleteTablet for tablet 607b055f8ced4372800adf5817b46e0b with delete_type TABLET_DATA_DELETED (replaced by tablet e25ae21cc8cc4749a507fcab5ee225a3) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:12.873220 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e2c9112462f442e8de5b4a944cfdc6b with delete_type TABLET_DATA_DELETED (replaced by tablet 0ad96bbd29ad4ce9a766ac84db1a9c60) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:12.873122 26495 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_a006976247434094b81729d5aa32d9f7" } modify_external_catalogs: true
I20260810 11:30:12.873407 26495 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_a006976247434094b81729d5aa32d9f7" } modify_external_catalogs: true
I20260810 11:30:12.876675 26497 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 2c6b3f8626724d12986f388b1ca90b3c (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:12.878615 26497 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_2bd85b203b7c4859a8018ec6107bdf48" } modify_external_catalogs: true
I20260810 11:30:12.878983 26497 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_2bd85b203b7c4859a8018ec6107bdf48" } modify_external_catalogs: true
W20260810 11:30:12.881501 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 607b055f8ced4372800adf5817b46e0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 607b055f8ced4372800adf5817b46e0b already in progress: creating tablet
W20260810 11:30:12.881824 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 2e2c9112462f442e8de5b4a944cfdc6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e2c9112462f442e8de5b4a944cfdc6b already in progress: creating tablet
I20260810 11:30:12.881950 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet f4a8a3553014448096836f888bdc2835 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:12.882303 27223 tablet_replica.cc:330] T f4a8a3553014448096836f888bdc2835 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:12.882555 27223 raft_consensus.cc:2229] T f4a8a3553014448096836f888bdc2835 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:12.882788 27223 raft_consensus.cc:2258] T f4a8a3553014448096836f888bdc2835 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:12.884059 27223 ts_tablet_manager.cc:1905] T f4a8a3553014448096836f888bdc2835 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:12.885303 26492 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e3707ae32624f6483866208321eefde consensus state has no leader
I20260810 11:30:12.885897 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_8c84c3aae4ab4d3a9a7bf26d7407722f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:12.886940 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c84c3aae4ab4d3a9a7bf26d7407722f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:12.887889 27248 ts_tablet_manager.cc:1918] T f4a8a3553014448096836f888bdc2835 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:12.888046 27248 log.cc:1196] T f4a8a3553014448096836f888bdc2835 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/f4a8a3553014448096836f888bdc2835
I20260810 11:30:12.888742 27248 ts_tablet_manager.cc:1939] T f4a8a3553014448096836f888bdc2835 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:12.889495 26500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet b28f3dcbd6d74559b372d3452e13ce9f
I20260810 11:30:12.890383 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet f4a8a3553014448096836f888bdc2835 (table default.Table_7374f0a22f4d45fc8dd0acc70f9feae5 [id=83d99a766e604e4e9c21a029241cf624]) successfully deleted
I20260810 11:30:12.890377 26500 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_fd954e7bf8b44188a999b4c66593196f" } new_table_name: "default.Table_367660e7b3674b518a63fbba74bcca1d" modify_external_catalogs: true
I20260810 11:30:12.890862 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet b28f3dcbd6d74559b372d3452e13ce9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:12.893847 27223 ts_tablet_manager.cc:1918] T f4a8a3553014448096836f888bdc2835 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:12.893709 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_f3ada0ff5ab04a808b0572baf1ed9c15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:12.894505 27223 log.cc:1196] T f4a8a3553014448096836f888bdc2835 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/f4a8a3553014448096836f888bdc2835
I20260810 11:30:12.894829 27248 tablet_replica.cc:330] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:12.894964 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3ada0ff5ab04a808b0572baf1ed9c15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:12.895051 27223 ts_tablet_manager.cc:1939] T f4a8a3553014448096836f888bdc2835 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:12.895120 27248 raft_consensus.cc:2229] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:12.895354 27248 raft_consensus.cc:2258] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:12.894275 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d7e745f05534917a5deecce410722e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 725d2e70e1d441b497d56a278e1de0ad) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:12.896955 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet f4a8a3553014448096836f888bdc2835 (table default.Table_7374f0a22f4d45fc8dd0acc70f9feae5 [id=83d99a766e604e4e9c21a029241cf624]) successfully deleted
I20260810 11:30:12.897215 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet b28f3dcbd6d74559b372d3452e13ce9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:12.897976 27223 tablet_replica.cc:330] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:12.898340 27223 raft_consensus.cc:2229] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:12.898074 26498 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 7eae49e1c6554ba2ae831831ff4bb45c
I20260810 11:30:12.896126 27248 ts_tablet_manager.cc:1905] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:12.899879 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 7eae49e1c6554ba2ae831831ff4bb45c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:12.903523 27223 raft_consensus.cc:2258] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:12.904971 27223 ts_tablet_manager.cc:1905] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:12.908953 26498 catalog_manager.cc:5495] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:12.913939 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 7eae49e1c6554ba2ae831831ff4bb45c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:12.915176 26498 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 2c6b3f8626724d12986f388b1ca90b3c (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:12.919361 27248 ts_tablet_manager.cc:1918] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:12.919584 27248 log.cc:1196] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/a8197318b04a470791dd639742547fce
I20260810 11:30:12.920046 27248 ts_tablet_manager.cc:1939] T a8197318b04a470791dd639742547fce P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:12.928247 27223 ts_tablet_manager.cc:1918] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:12.933188 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet a8197318b04a470791dd639742547fce (table default.Table_b609612a64d045b086440c601c257f30 [id=9b210311762a4c07bde13fd8ec4d7568]) successfully deleted
I20260810 11:30:12.935942 27035 tablet_service.cc:1467] Processing CreateTablet for tablet 96cae4eb16c84410926a317af70e44f7 (DEFAULT_TABLE table=default.Table_f813dbe6bdc548f993a19d3d38613037 [id=b471e1c958484bbc95c4cbb4c79bea91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.936326 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 7bd67ebf23694ae7b0ede6c5d1a06f88 (DEFAULT_TABLE table=default.Table_b487cad441b24b01a9f452bc934ba2f9 [id=a1f146c12202425da0d345c5bca3b82c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.936841 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd67ebf23694ae7b0ede6c5d1a06f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.937155 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96cae4eb16c84410926a317af70e44f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.943125 27252 raft_consensus.cc:482] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:12.944978 26737 tablet_service.cc:1467] Processing CreateTablet for tablet b28f3dcbd6d74559b372d3452e13ce9f (DEFAULT_TABLE table=default.Table_95523d7d33a4423099b179a2d91867f9 [id=01eb86f74b7e4434a2d6aae5dd94b3b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.945438 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b28f3dcbd6d74559b372d3452e13ce9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.944778 26740 tablet_service.cc:1467] Processing CreateTablet for tablet 23637a02b6464e17aa2a69ea5cc4ddfe (DEFAULT_TABLE table=default.Table_7c36df9513654205b604d1a8a1d7c2ca [id=bb3435760ed6476fbec4aee7d609cd85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.946905 27252 raft_consensus.cc:504] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.948786 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23637a02b6464e17aa2a69ea5cc4ddfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.948846 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f05f2fc60d0f43f6a72fca16828f94f9" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:12.934547 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 7bd67ebf23694ae7b0ede6c5d1a06f88 (DEFAULT_TABLE table=default.Table_b487cad441b24b01a9f452bc934ba2f9 [id=a1f146c12202425da0d345c5bca3b82c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.950309 27231 tablet_bootstrap.cc:492] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:12.950528 27231 ts_tablet_manager.cc:1397] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.330s user 0.035s sys 0.095s
I20260810 11:30:12.950692 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd67ebf23694ae7b0ede6c5d1a06f88. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:12.951589 26702 leader_election.cc:341] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:12.951711 27231 raft_consensus.cc:348] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.951584 26745 tablet_service.cc:1467] Processing CreateTablet for tablet 31888ddeafe14738b818016a9c0a4ad3 (DEFAULT_TABLE table=default.Table_5763dcd0b2ae40b4945a6966bfd23099 [id=9ec5a85bb4b34875b465a5ee221ab4f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.951956 27231 raft_consensus.cc:374] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.952106 27231 raft_consensus.cc:729] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:12.952378 27231 consensus_queue.cc:260] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:12.952663 27252 leader_election.cc:288] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:12.952840 26743 tablet_service.cc:1467] Processing CreateTablet for tablet d722b93fe27f4c08a592bc393046b6bd (DEFAULT_TABLE table=default.Table_7f57913383ec42ce958846fccae03631 [id=0faf073b01654e38b8f6083f5012abd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.953706 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet 2984cf53478e437d955aa3d0917287e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:12.954385 26744 tablet_service.cc:1467] Processing CreateTablet for tablet a28849649c704f2fbdec1aced9ce01b1 (DEFAULT_TABLE table=default.Table_9843e1f7503944a89021499a57571a86 [id=eef14446a15e42b495e191bce11574a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.954993 26739 tablet_service.cc:1467] Processing CreateTablet for tablet d729baae40a64e6e8c23e6870f230afb (DEFAULT_TABLE table=default.Table_d297e25211404611a6ba6a454c9dd5fd [id=093a9315d9f14cb28b5da3f910c28b0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.955315 26746 tablet_service.cc:1467] Processing CreateTablet for tablet 96cae4eb16c84410926a317af70e44f7 (DEFAULT_TABLE table=default.Table_f813dbe6bdc548f993a19d3d38613037 [id=b471e1c958484bbc95c4cbb4c79bea91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.955422 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet b28f3dcbd6d74559b372d3452e13ce9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:12.955832 27231 ts_tablet_manager.cc:1428] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260810 11:30:12.956013 26735 tablet_service.cc:1467] Processing CreateTablet for tablet 7bd67ebf23694ae7b0ede6c5d1a06f88 (DEFAULT_TABLE table=default.Table_b487cad441b24b01a9f452bc934ba2f9 [id=a1f146c12202425da0d345c5bca3b82c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:12.956314 26738 tablet_service.cc:1514] Processing DeleteTablet for tablet 607b055f8ced4372800adf5817b46e0b with delete_type TABLET_DATA_DELETED (replaced by tablet e25ae21cc8cc4749a507fcab5ee225a3) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:12.956646 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet 7eae49e1c6554ba2ae831831ff4bb45c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:12.957212 26745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31888ddeafe14738b818016a9c0a4ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.957254 27223 log.cc:1196] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/2d7e745f05534917a5deecce410722e6
I20260810 11:30:12.957515 27231 tablet_bootstrap.cc:492] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:12.957767 27223 ts_tablet_manager.cc:1939] T 2d7e745f05534917a5deecce410722e6 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:12.957858 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96cae4eb16c84410926a317af70e44f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.958307 26739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d729baae40a64e6e8c23e6870f230afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.958218 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e2c9112462f442e8de5b4a944cfdc6b with delete_type TABLET_DATA_DELETED (replaced by tablet 0ad96bbd29ad4ce9a766ac84db1a9c60) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:12.961297 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d722b93fe27f4c08a592bc393046b6bd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:12.965301 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet c0120575c9fd4b2fb32ca7392db277bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0120575c9fd4b2fb32ca7392db277bf already in progress: creating tablet
W20260810 11:30:12.965703 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet db5adccd80a04e328e13793b461c38b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db5adccd80a04e328e13793b461c38b1 already in progress: creating tablet
W20260810 11:30:12.965955 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet fc2d129e99f24c018e4f8e43f211171d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc2d129e99f24c018e4f8e43f211171d already in progress: creating tablet
W20260810 11:30:12.966267 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 2e2c9112462f442e8de5b4a944cfdc6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e2c9112462f442e8de5b4a944cfdc6b already in progress: creating tablet
W20260810 11:30:12.966570 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 607b055f8ced4372800adf5817b46e0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 607b055f8ced4372800adf5817b46e0b already in progress: creating tablet
I20260810 11:30:12.967312 27231 tablet_bootstrap.cc:654] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:12.967178 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet b28f3dcbd6d74559b372d3452e13ce9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b28f3dcbd6d74559b372d3452e13ce9f already in progress: creating tablet
W20260810 11:30:12.968688 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7eae49e1c6554ba2ae831831ff4bb45c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7eae49e1c6554ba2ae831831ff4bb45c already in progress: creating tablet
I20260810 11:30:12.969573 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a28849649c704f2fbdec1aced9ce01b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:12.970733 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 2d7e745f05534917a5deecce410722e6 (table default.Table_59ed990b31964d6080614081ee46a6de [id=6d8fc88a491140548a45c7fbb403bb36]) successfully deleted
W20260810 11:30:12.971140 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet b28f3dcbd6d74559b372d3452e13ce9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b28f3dcbd6d74559b372d3452e13ce9f already in progress: creating tablet
W20260810 11:30:12.971478 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7eae49e1c6554ba2ae831831ff4bb45c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7eae49e1c6554ba2ae831831ff4bb45c already in progress: creating tablet
I20260810 11:30:12.971879 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd67ebf23694ae7b0ede6c5d1a06f88. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:12.973493 26486 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2984cf53478e437d955aa3d0917287e9 because the tablet was not found. No further retry: Not found: Tablet not found: 2984cf53478e437d955aa3d0917287e9
W20260810 11:30:12.974064 26486 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet b28f3dcbd6d74559b372d3452e13ce9f because the tablet was not found. No further retry: Not found: Tablet not found: b28f3dcbd6d74559b372d3452e13ce9f
W20260810 11:30:12.974756 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 607b055f8ced4372800adf5817b46e0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 607b055f8ced4372800adf5817b46e0b already in progress: creating tablet
W20260810 11:30:12.975206 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7eae49e1c6554ba2ae831831ff4bb45c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7eae49e1c6554ba2ae831831ff4bb45c already in progress: creating tablet
W20260810 11:30:12.975661 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2e2c9112462f442e8de5b4a944cfdc6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e2c9112462f442e8de5b4a944cfdc6b already in progress: creating tablet
I20260810 11:30:12.985253 27231 tablet_bootstrap.cc:492] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:12.985603 27231 ts_tablet_manager.cc:1397] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.004s
I20260810 11:30:12.986948 27231 raft_consensus.cc:348] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:12.987401 27231 raft_consensus.cc:374] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:12.987534 27231 raft_consensus.cc:729] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:12.988044 27231 consensus_queue.cc:260] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:13.002969 27231 ts_tablet_manager.cc:1428] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.017s user 0.001s sys 0.003s
I20260810 11:30:13.016601 27231 tablet_bootstrap.cc:492] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:13.019632 27231 tablet_bootstrap.cc:654] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.028038 27231 tablet_bootstrap.cc:492] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:13.028340 27231 ts_tablet_manager.cc:1397] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.004s
I20260810 11:30:13.029745 27231 raft_consensus.cc:348] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.030315 27231 raft_consensus.cc:374] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.030586 27231 raft_consensus.cc:729] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.031064 27231 consensus_queue.cc:260] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.037568 27231 ts_tablet_manager.cc:1428] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.009s user 0.000s sys 0.004s
I20260810 11:30:13.039693 27231 tablet_bootstrap.cc:492] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:13.043026 27231 tablet_bootstrap.cc:654] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.063040 27231 tablet_bootstrap.cc:492] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:13.063366 27231 ts_tablet_manager.cc:1397] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.000s
I20260810 11:30:13.064600 27231 raft_consensus.cc:348] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.065034 27231 raft_consensus.cc:374] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.065181 27231 raft_consensus.cc:729] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.065570 27231 consensus_queue.cc:260] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.069444 27231 ts_tablet_manager.cc:1428] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260810 11:30:13.074218 27231 tablet_bootstrap.cc:492] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:13.077355 27231 tablet_bootstrap.cc:654] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.067894 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f05f2fc60d0f43f6a72fca16828f94f9" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:13.088599 26700 leader_election.cc:341] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:13.088827 26700 leader_election.cc:302] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:13.089792 27252 raft_consensus.cc:2726] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:13.093266 27228 tablet_bootstrap.cc:492] T a9615b1ff3454a46a1a27cfcea20ad00 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:13.093525 27228 ts_tablet_manager.cc:1397] T a9615b1ff3454a46a1a27cfcea20ad00 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.466s user 0.028s sys 0.096s
I20260810 11:30:13.094630 27228 raft_consensus.cc:348] T a9615b1ff3454a46a1a27cfcea20ad00 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:13.095028 27228 raft_consensus.cc:374] T a9615b1ff3454a46a1a27cfcea20ad00 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.095160 27228 raft_consensus.cc:729] T a9615b1ff3454a46a1a27cfcea20ad00 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.095506 27228 consensus_queue.cc:260] T a9615b1ff3454a46a1a27cfcea20ad00 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:13.097733 26491 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f3884736eec74c8992b8d51b37465875 has no consensus state
I20260810 11:30:13.098845 27228 ts_tablet_manager.cc:1428] T a9615b1ff3454a46a1a27cfcea20ad00 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260810 11:30:13.098794 26491 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_ccb396a7af014ac09a7c63585995ec26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:13.099853 26491 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ccb396a7af014ac09a7c63585995ec26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.100647 27228 tablet_bootstrap.cc:492] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
W20260810 11:30:13.101922 26501 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d722b93fe27f4c08a592bc393046b6bd consensus state has no leader
I20260810 11:30:13.102659 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_f5a7bc22bb0b432bb5cee5e3576180fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:13.103971 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5a7bc22bb0b432bb5cee5e3576180fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.107645 27228 tablet_bootstrap.cc:654] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.111791 26493 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 0ad96bbd29ad4ce9a766ac84db1a9c60
I20260810 11:30:13.114276 26493 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_e40bf66a38dc4113bae2db1ed288bf7e" } new_table_name: "default.Table_857806a7841646449e10e93beec175f2" modify_external_catalogs: true
I20260810 11:30:13.118321 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet a9615b1ff3454a46a1a27cfcea20ad00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:13.118729 27223 tablet_replica.cc:330] T a9615b1ff3454a46a1a27cfcea20ad00 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:13.119027 27223 raft_consensus.cc:2229] T a9615b1ff3454a46a1a27cfcea20ad00 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:13.119272 27223 raft_consensus.cc:2258] T a9615b1ff3454a46a1a27cfcea20ad00 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:13.120431 27223 ts_tablet_manager.cc:1905] T a9615b1ff3454a46a1a27cfcea20ad00 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:13.121779 27228 tablet_bootstrap.cc:492] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:13.122800 27228 ts_tablet_manager.cc:1397] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.007s
I20260810 11:30:13.123958 27228 raft_consensus.cc:348] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.124348 27228 raft_consensus.cc:374] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.131374 27223 ts_tablet_manager.cc:1918] T a9615b1ff3454a46a1a27cfcea20ad00 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:13.131637 27223 log.cc:1196] T a9615b1ff3454a46a1a27cfcea20ad00 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/a9615b1ff3454a46a1a27cfcea20ad00
I20260810 11:30:13.132261 27223 ts_tablet_manager.cc:1939] T a9615b1ff3454a46a1a27cfcea20ad00 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:13.124536 27228 raft_consensus.cc:729] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.134693 27231 tablet_bootstrap.cc:492] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:13.134889 27231 ts_tablet_manager.cc:1397] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.061s user 0.006s sys 0.007s
I20260810 11:30:13.138208 27231 raft_consensus.cc:348] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.138743 27231 raft_consensus.cc:374] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.138967 27231 raft_consensus.cc:729] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.139724 27228 consensus_queue.cc:260] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.140774 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet a9615b1ff3454a46a1a27cfcea20ad00 (table default.Table_f8e4d0bbde74426ab975bf7b91029861 [id=a0e3fe57b37a415aa5123ca2199b9968]) successfully deleted
I20260810 11:30:13.141335 26497 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 0df34fc6d67c49569d0de55dc3f6a585
I20260810 11:30:13.143079 26500 master_service.cc:946] ReplaceTablet: received request to replace tablet fc2d129e99f24c018e4f8e43f211171d from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:13.144361 26495 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 2efaf8b45a824e34b7f23037de5eec45
I20260810 11:30:13.146306 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 2efaf8b45a824e34b7f23037de5eec45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:52560
W20260810 11:30:13.149940 26486 consensus_peers.cc:487] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 -> Peer 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125): Couldn't send request to peer 83cc8e39a3b9455f8242a6da6a54c38a. Status: Network error: Client connection negotiation failed: client connection to 127.25.195.254:41125: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260810 11:30:13.152709 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 2efaf8b45a824e34b7f23037de5eec45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:13.156612 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet a9615b1ff3454a46a1a27cfcea20ad00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:13.157653 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_281d7f104c494df79d4a5d26745bfe87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:13.158048 27228 ts_tablet_manager.cc:1428] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.035s user 0.003s sys 0.000s
I20260810 11:30:13.150326 27263 raft_consensus.cc:482] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 11:30:13.158478 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_281d7f104c494df79d4a5d26745bfe87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.158739 27263 raft_consensus.cc:504] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.159768 27263 leader_election.cc:288] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:13.160336 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2efaf8b45a824e34b7f23037de5eec45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2efaf8b45a824e34b7f23037de5eec45 already in progress: creating tablet
I20260810 11:30:13.160918 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_b0a840a981c74798b3af3be3bea54d1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:13.161134 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f05f2fc60d0f43f6a72fca16828f94f9" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:13.161561 26916 raft_consensus.cc:2454] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
W20260810 11:30:13.162421 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0a840a981c74798b3af3be3bea54d1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.162711 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f05f2fc60d0f43f6a72fca16828f94f9" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:13.151121 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 2efaf8b45a824e34b7f23037de5eec45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:13.164232 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_37a55e452a194b859cd0dc01687a3dc3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:13.164498 26991 leader_election.cc:302] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
W20260810 11:30:13.165061 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37a55e452a194b859cd0dc01687a3dc3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.165135 27263 raft_consensus.cc:2781] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:13.165297 27263 raft_consensus.cc:482] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:13.165468 27263 raft_consensus.cc:3037] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:13.167840 26500 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f05f2fc60d0f43f6a72fca16828f94f9 (table default.Table_c6f8501fb26f49688f4c9e7c3cabc233 [id=8d5da0e5fab74127880f199687b0d3eb]). Expected version 3 got 0
I20260810 11:30:13.169322 26500 master_service.cc:946] ReplaceTablet: received request to replace tablet b7a3b877457c4a2489d397f3f864d6b2 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:13.170015 26500 master_service.cc:946] ReplaceTablet: received request to replace tablet 256af4222bb34745ac018dd82a9c4f9b from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:13.170189 27263 raft_consensus.cc:504] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.171911 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f05f2fc60d0f43f6a72fca16828f94f9" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:13.172257 26916 raft_consensus.cc:3037] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:13.174865 26771 raft_consensus.cc:2454] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:13.173094 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_272ea4ef15fc433b9f2a8465bcf865a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:13.177718 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_272ea4ef15fc433b9f2a8465bcf865a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.178669 26916 raft_consensus.cc:2454] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:13.179735 26991 leader_election.cc:302] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:13.179682 26500 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c0eb3404046346ce92f8b3da2cf20095" } new_table_name: "default.Table_1c2bdb997ce049069ebd0136491c2f6f" modify_external_catalogs: true
I20260810 11:30:13.180238 27293 raft_consensus.cc:2781] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:13.181094 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f05f2fc60d0f43f6a72fca16828f94f9" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:13.181430 26769 raft_consensus.cc:3037] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:13.185359 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 2efaf8b45a824e34b7f23037de5eec45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2efaf8b45a824e34b7f23037de5eec45 already in progress: creating tablet
W20260810 11:30:13.186705 26484 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet a9615b1ff3454a46a1a27cfcea20ad00 because the tablet was not found. No further retry: Not found: Tablet not found: a9615b1ff3454a46a1a27cfcea20ad00
W20260810 11:30:13.187345 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 2efaf8b45a824e34b7f23037de5eec45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2efaf8b45a824e34b7f23037de5eec45 already in progress: creating tablet
I20260810 11:30:13.190101 27263 leader_election.cc:288] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:13.196017 26499 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_d4cbe876014f4433b57552ea4db823b6" } modify_external_catalogs: true
I20260810 11:30:13.196424 26499 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_d4cbe876014f4433b57552ea4db823b6" } modify_external_catalogs: true
I20260810 11:30:13.140966 27231 consensus_queue.cc:260] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.201275 27231 ts_tablet_manager.cc:1428] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.066s user 0.004s sys 0.000s
I20260810 11:30:13.202183 26769 raft_consensus.cc:2454] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:13.203580 27228 tablet_bootstrap.cc:492] T 417f48ddea6440a5a86fa05f7e514005 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:13.205677 27222 tablet_bootstrap.cc:492] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:13.205930 27222 ts_tablet_manager.cc:1397] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.613s user 0.051s sys 0.124s
I20260810 11:30:13.206935 27222 raft_consensus.cc:348] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.207242 27222 raft_consensus.cc:374] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.207363 27222 raft_consensus.cc:729] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.207664 27222 consensus_queue.cc:260] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.210052 27222 ts_tablet_manager.cc:1428] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 11:30:13.209451 27293 raft_consensus.cc:686] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:13.211303 27293 consensus_queue.cc:237] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.211665 27222 tablet_bootstrap.cc:492] T 66a7790587ed478b843fa9e997e50893 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:13.216012 27222 tablet_bootstrap.cc:654] T 66a7790587ed478b843fa9e997e50893 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.218801 26769 raft_consensus.cc:1261] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Refusing update from remote peer 482e605580be48cbbacce05a3e61c215: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260810 11:30:13.220343 26991 consensus_peers.cc:487] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:13.220631 27231 tablet_bootstrap.cc:492] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:13.220978 27263 raft_consensus.cc:482] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:13.221271 27263 raft_consensus.cc:504] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.223357 27263 leader_election.cc:288] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:13.223620 27263 consensus_queue.cc:1035] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:13.229718 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1cd64deb8e24c81ba2d4214bb38f5da" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:13.231038 27222 tablet_bootstrap.cc:492] T 66a7790587ed478b843fa9e997e50893 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:13.231426 27222 ts_tablet_manager.cc:1397] T 66a7790587ed478b843fa9e997e50893 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.000s
I20260810 11:30:13.231510 26769 raft_consensus.cc:2454] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:13.232599 26993 leader_election.cc:302] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:13.232791 27222 raft_consensus.cc:348] T 66a7790587ed478b843fa9e997e50893 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.233060 27222 raft_consensus.cc:374] T 66a7790587ed478b843fa9e997e50893 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.233263 27222 raft_consensus.cc:729] T 66a7790587ed478b843fa9e997e50893 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.233687 27222 consensus_queue.cc:260] T 66a7790587ed478b843fa9e997e50893 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.234735 27263 raft_consensus.cc:2781] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:13.235720 27263 raft_consensus.cc:482] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:13.236140 27222 ts_tablet_manager.cc:1428] T 66a7790587ed478b843fa9e997e50893 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 11:30:13.236544 27263 raft_consensus.cc:3037] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:13.238101 26498 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f05f2fc60d0f43f6a72fca16828f94f9 (table default.Table_c6f8501fb26f49688f4c9e7c3cabc233 [id=8d5da0e5fab74127880f199687b0d3eb]). Expected version 3 got 0
I20260810 11:30:13.238245 27222 tablet_bootstrap.cc:492] T c0120575c9fd4b2fb32ca7392db277bf P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:13.239760 26498 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b1cd64deb8e24c81ba2d4214bb38f5da (table default.Table_7e1ff16472f842438c14184ab96741e1 [id=03dca1a3a16e42049c194a46978bbfec]). Expected version 2 got 0
W20260810 11:30:13.240104 26500 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ccef06fa06c4c519d8760fa948d6c8b consensus state has no leader
I20260810 11:30:13.240872 26500 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c6f8501fb26f49688f4c9e7c3cabc233" } modify_external_catalogs: true
I20260810 11:30:13.240854 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_38ce4003d8e84bec8c910d35efb2a64e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:13.241164 26500 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c6f8501fb26f49688f4c9e7c3cabc233" } modify_external_catalogs: true
I20260810 11:30:13.241241 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1cd64deb8e24c81ba2d4214bb38f5da" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:13.241703 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38ce4003d8e84bec8c910d35efb2a64e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.243573 26497 master_service.cc:946] ReplaceTablet: received request to replace tablet c0120575c9fd4b2fb32ca7392db277bf from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:13.244047 27222 tablet_bootstrap.cc:654] T c0120575c9fd4b2fb32ca7392db277bf P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.244279 26497 master_service.cc:946] ReplaceTablet: received request to replace tablet ec788db5b0ca40f1811b6660276d0254 from {username='slave'} at 127.0.0.1:47672
W20260810 11:30:13.245463 26493 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6c5b650bc02f4fa393bada5b54c77f1f consensus state has no leader
W20260810 11:30:13.247813 26991 leader_election.cc:341] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:13.254954 26499 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 949f31fa0c124eefbee695cfc7f50cbe
I20260810 11:30:13.244519 27228 tablet_bootstrap.cc:654] T 417f48ddea6440a5a86fa05f7e514005 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.257273 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 949f31fa0c124eefbee695cfc7f50cbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:13.257823 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 949f31fa0c124eefbee695cfc7f50cbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:52560
W20260810 11:30:13.258666 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 949f31fa0c124eefbee695cfc7f50cbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 949f31fa0c124eefbee695cfc7f50cbe already in progress: creating tablet
I20260810 11:30:13.258889 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet 949f31fa0c124eefbee695cfc7f50cbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:13.259985 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 949f31fa0c124eefbee695cfc7f50cbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 949f31fa0c124eefbee695cfc7f50cbe already in progress: creating tablet
W20260810 11:30:13.259985 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 949f31fa0c124eefbee695cfc7f50cbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 949f31fa0c124eefbee695cfc7f50cbe already in progress: creating tablet
I20260810 11:30:13.262583 27222 tablet_bootstrap.cc:492] T c0120575c9fd4b2fb32ca7392db277bf P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:13.262933 27222 ts_tablet_manager.cc:1397] T c0120575c9fd4b2fb32ca7392db277bf P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.004s
I20260810 11:30:13.264582 27222 raft_consensus.cc:348] T c0120575c9fd4b2fb32ca7392db277bf P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.265080 27222 raft_consensus.cc:374] T c0120575c9fd4b2fb32ca7392db277bf P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.265275 27222 raft_consensus.cc:729] T c0120575c9fd4b2fb32ca7392db277bf P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.266670 26500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet f05f2fc60d0f43f6a72fca16828f94f9
I20260810 11:30:13.266637 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d7e745f05534917a5deecce410722e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 725d2e70e1d441b497d56a278e1de0ad) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:13.267216 27248 tablet_replica.cc:330] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:13.267472 27248 raft_consensus.cc:2229] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:13.268181 27248 pending_rounds.cc:62] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215: Trying to abort 1 pending ops.
I20260810 11:30:13.268414 27248 pending_rounds.cc:68] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936346719629312 op_type: NO_OP noop_request { }
I20260810 11:30:13.268849 27248 raft_consensus.cc:2866] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:13.269055 27248 raft_consensus.cc:2258] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:13.269552 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet f05f2fc60d0f43f6a72fca16828f94f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:13.270049 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet f05f2fc60d0f43f6a72fca16828f94f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:13.270069 27263 raft_consensus.cc:504] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.270614 27223 tablet_replica.cc:330] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:13.270846 27223 raft_consensus.cc:2229] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:13.271044 27221 tablet_replica.cc:330] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:13.271113 27223 raft_consensus.cc:2258] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:13.271234 27263 leader_election.cc:288] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:13.271265 27221 raft_consensus.cc:2229] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:13.271420 27231 tablet_bootstrap.cc:654] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.271522 27221 raft_consensus.cc:2258] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:13.271626 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1cd64deb8e24c81ba2d4214bb38f5da" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:13.271907 26769 raft_consensus.cc:3037] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:13.272336 27221 ts_tablet_manager.cc:1905] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:13.272544 27223 ts_tablet_manager.cc:1905] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:13.276141 26769 raft_consensus.cc:2454] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:13.276849 26993 leader_election.cc:302] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:13.277356 27263 raft_consensus.cc:482] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:13.277650 27263 raft_consensus.cc:504] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.278360 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1cd64deb8e24c81ba2d4214bb38f5da" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:13.279471 26991 leader_election.cc:341] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:13.279834 26993 leader_election.cc:341] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 7edd85afa247429f92d4ed2f7c35ee16
I20260810 11:30:13.280854 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7edd85afa247429f92d4ed2f7c35ee16" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:13.282164 27263 leader_election.cc:288] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:13.282245 26991 leader_election.cc:341] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:13.282402 26991 leader_election.cc:302] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:13.282471 27263 raft_consensus.cc:2781] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:13.282639 27263 raft_consensus.cc:686] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:13.284216 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet f05f2fc60d0f43f6a72fca16828f94f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:13.282974 27263 consensus_queue.cc:237] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.286433 27248 ts_tablet_manager.cc:1905] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:13.289034 27325 raft_consensus.cc:2726] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:13.266443 27222 consensus_queue.cc:260] T c0120575c9fd4b2fb32ca7392db277bf P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.303380 27223 ts_tablet_manager.cc:1918] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:13.303791 27222 ts_tablet_manager.cc:1428] T c0120575c9fd4b2fb32ca7392db277bf P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.041s user 0.003s sys 0.000s
I20260810 11:30:13.305961 27222 tablet_bootstrap.cc:492] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:13.307967 27330 mvcc.cc:205] Tried to move back new op lower bound from 7316936348522954752 to 7316936345670582272. Current Snapshot: MvccSnapshot[applied={T|T < 7316936348522954752}]
I20260810 11:30:13.312130 27342 tablet.cc:1722] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:13.313603 27222 tablet_bootstrap.cc:654] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.319381 27231 tablet_bootstrap.cc:492] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:13.320096 27223 log.cc:1196] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/f05f2fc60d0f43f6a72fca16828f94f9
I20260810 11:30:13.320433 26495 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_bb2f94800564493cbd9ed08e4ea7dc24" } new_table_name: "default.Table_43cc516b2fe54a6fa15f523ffc165a03" modify_external_catalogs: true
I20260810 11:30:13.320801 27223 ts_tablet_manager.cc:1939] T f05f2fc60d0f43f6a72fca16828f94f9 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:13.319595 27231 ts_tablet_manager.cc:1397] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.113s user 0.007s sys 0.007s
I20260810 11:30:13.322404 26499 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_7d9e01b8d13f45e8bf5208d972be99dc" } new_table_name: "default.Table_60e35bdf23f74306a9b5299e927771de" modify_external_catalogs: true
I20260810 11:30:13.322897 27228 tablet_bootstrap.cc:492] T 417f48ddea6440a5a86fa05f7e514005 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:13.323096 27228 ts_tablet_manager.cc:1397] T 417f48ddea6440a5a86fa05f7e514005 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.120s user 0.001s sys 0.014s
I20260810 11:30:13.324203 27228 raft_consensus.cc:348] T 417f48ddea6440a5a86fa05f7e514005 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.318641 27343 tablet.cc:1722] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:13.324849 27228 raft_consensus.cc:374] T 417f48ddea6440a5a86fa05f7e514005 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.324962 27228 raft_consensus.cc:729] T 417f48ddea6440a5a86fa05f7e514005 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.325250 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet f05f2fc60d0f43f6a72fca16828f94f9 (table default.Table_c6f8501fb26f49688f4c9e7c3cabc233 [id=8d5da0e5fab74127880f199687b0d3eb]) successfully deleted
I20260810 11:30:13.325475 27228 consensus_queue.cc:260] T 417f48ddea6440a5a86fa05f7e514005 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.325475 27231 raft_consensus.cc:348] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.324465 27221 ts_tablet_manager.cc:1918] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:13.325785 27221 log.cc:1196] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/f05f2fc60d0f43f6a72fca16828f94f9
I20260810 11:30:13.325806 27231 raft_consensus.cc:374] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.325937 27231 raft_consensus.cc:729] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.326223 27231 consensus_queue.cc:260] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.328325 27231 ts_tablet_manager.cc:1428] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 11:30:13.328217 27221 ts_tablet_manager.cc:1939] T f05f2fc60d0f43f6a72fca16828f94f9 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:13.328811 27231 tablet_bootstrap.cc:492] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:13.328859 27228 ts_tablet_manager.cc:1428] T 417f48ddea6440a5a86fa05f7e514005 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260810 11:30:13.329182 27228 tablet_bootstrap.cc:492] T 201bafec782a4570a556f1c920e84898 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:13.331147 27231 tablet_bootstrap.cc:654] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.332964 27228 tablet_bootstrap.cc:654] T 201bafec782a4570a556f1c920e84898 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.333348 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet f05f2fc60d0f43f6a72fca16828f94f9 (table default.Table_c6f8501fb26f49688f4c9e7c3cabc233 [id=8d5da0e5fab74127880f199687b0d3eb]) successfully deleted
I20260810 11:30:13.339411 26498 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_aa6798d7140e47fd8b1709e531dbbd10" } modify_external_catalogs: true
I20260810 11:30:13.339761 26498 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_aa6798d7140e47fd8b1709e531dbbd10" } modify_external_catalogs: true
I20260810 11:30:13.343343 27228 tablet_bootstrap.cc:492] T 201bafec782a4570a556f1c920e84898 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:13.343636 27228 ts_tablet_manager.cc:1397] T 201bafec782a4570a556f1c920e84898 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.004s
I20260810 11:30:13.344981 27228 raft_consensus.cc:348] T 201bafec782a4570a556f1c920e84898 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.345448 27228 raft_consensus.cc:374] T 201bafec782a4570a556f1c920e84898 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.346477 27228 raft_consensus.cc:729] T 201bafec782a4570a556f1c920e84898 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.346932 27228 consensus_queue.cc:260] T 201bafec782a4570a556f1c920e84898 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.347401 26501 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_b0a840a981c74798b3af3be3bea54d1c" } modify_external_catalogs: true
I20260810 11:30:13.347716 26501 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_b0a840a981c74798b3af3be3bea54d1c" } modify_external_catalogs: true
I20260810 11:30:13.350373 27222 tablet_bootstrap.cc:492] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:13.350580 27222 ts_tablet_manager.cc:1397] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.046s user 0.006s sys 0.001s
I20260810 11:30:13.353399 27222 raft_consensus.cc:348] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.353840 27222 raft_consensus.cc:374] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.353973 27222 raft_consensus.cc:729] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.354794 26493 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_f813dbe6bdc548f993a19d3d38613037" } new_table_name: "default.Table_bd735fb392144c6b97d5678685645108" modify_external_catalogs: true
I20260810 11:30:13.355257 26492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_dcc367d62a8f4e07a9e10fbb2faa27d1" } modify_external_catalogs: true
I20260810 11:30:13.355623 26492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_dcc367d62a8f4e07a9e10fbb2faa27d1" } modify_external_catalogs: true
I20260810 11:30:13.356225 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_20c9bc8bc7c641a7a137e8c36a2a4f93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:13.354313 27222 consensus_queue.cc:260] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:13.357170 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20c9bc8bc7c641a7a137e8c36a2a4f93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.357573 27222 ts_tablet_manager.cc:1428] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260810 11:30:13.358004 27222 tablet_bootstrap.cc:492] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:13.349022 27228 ts_tablet_manager.cc:1428] T 201bafec782a4570a556f1c920e84898 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.005s user 0.003s sys 0.001s
I20260810 11:30:13.359114 27228 tablet_bootstrap.cc:492] T 50e61e835429436d9bdc585b8c7381f6 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:13.363015 27222 tablet_bootstrap.cc:654] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.363415 27231 tablet_bootstrap.cc:492] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:13.363734 27231 ts_tablet_manager.cc:1397] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.035s user 0.011s sys 0.007s
I20260810 11:30:13.365144 27231 raft_consensus.cc:348] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.365682 27231 raft_consensus.cc:374] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.365811 27231 raft_consensus.cc:729] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.366140 27231 consensus_queue.cc:260] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.367179 27228 tablet_bootstrap.cc:654] T 50e61e835429436d9bdc585b8c7381f6 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:13.368666 26495 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2fc76603bf8843dab18c95fdab9a8be0 consensus state has no leader
I20260810 11:30:13.369532 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_ea17bd161fdb4c2c9603590515c75bf4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:13.370656 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea17bd161fdb4c2c9603590515c75bf4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.372933 27231 ts_tablet_manager.cc:1428] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
W20260810 11:30:13.382438 26499 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d722b93fe27f4c08a592bc393046b6bd consensus state has no leader
I20260810 11:30:13.383710 27231 tablet_bootstrap.cc:492] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:13.384620 26499 master_service.cc:946] ReplaceTablet: received request to replace tablet 66a7790587ed478b843fa9e997e50893 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:13.386062 27231 tablet_bootstrap.cc:654] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.387094 26496 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b1cd64deb8e24c81ba2d4214bb38f5da (table default.Table_7e1ff16472f842438c14184ab96741e1 [id=03dca1a3a16e42049c194a46978bbfec]). Expected version 2 got 0
I20260810 11:30:13.390791 26491 master_service.cc:946] ReplaceTablet: received request to replace tablet 7eae49e1c6554ba2ae831831ff4bb45c from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:13.391863 26500 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 566bf0f68c2946a89203472786e82512 (table default.Table_367660e7b3674b518a63fbba74bcca1d [id=a2d890f4b9874411a503888263d07d18]). Expected version 1 got 0
I20260810 11:30:13.392252 26500 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b1cd64deb8e24c81ba2d4214bb38f5da (table default.Table_7e1ff16472f842438c14184ab96741e1 [id=03dca1a3a16e42049c194a46978bbfec]). Expected version 2 got 0
I20260810 11:30:13.395725 27222 tablet_bootstrap.cc:492] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:13.395972 27222 ts_tablet_manager.cc:1397] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.005s
I20260810 11:30:13.398016 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet 66a7790587ed478b843fa9e997e50893 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:13.398828 27222 raft_consensus.cc:348] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.399443 27222 raft_consensus.cc:374] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.399576 27222 raft_consensus.cc:729] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.399919 27222 consensus_queue.cc:260] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.401537 27222 ts_tablet_manager.cc:1428] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260810 11:30:13.401892 27222 tablet_bootstrap.cc:492] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:13.404065 26491 catalog_manager.cc:5495] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:13.404850 27221 tablet_replica.cc:330] T 66a7790587ed478b843fa9e997e50893 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:13.405215 27221 raft_consensus.cc:2229] T 66a7790587ed478b843fa9e997e50893 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:13.405494 27221 raft_consensus.cc:2258] T 66a7790587ed478b843fa9e997e50893 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:13.407958 27228 tablet_bootstrap.cc:492] T 50e61e835429436d9bdc585b8c7381f6 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:13.408170 27228 ts_tablet_manager.cc:1397] T 50e61e835429436d9bdc585b8c7381f6 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.005s
I20260810 11:30:13.408357 27221 ts_tablet_manager.cc:1905] T 66a7790587ed478b843fa9e997e50893 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:13.409451 27231 tablet_bootstrap.cc:492] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:13.409320 27228 raft_consensus.cc:348] T 50e61e835429436d9bdc585b8c7381f6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.409678 27228 raft_consensus.cc:374] T 50e61e835429436d9bdc585b8c7381f6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.409638 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 417f48ddea6440a5a86fa05f7e514005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:13.409768 27228 raft_consensus.cc:729] T 50e61e835429436d9bdc585b8c7381f6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.409462 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet a9615b1ff3454a46a1a27cfcea20ad00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:13.410199 27222 tablet_bootstrap.cc:654] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.410087 27228 consensus_queue.cc:260] T 50e61e835429436d9bdc585b8c7381f6 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.410607 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 417f48ddea6440a5a86fa05f7e514005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:13.410817 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet 201bafec782a4570a556f1c920e84898 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:13.411016 27223 tablet_replica.cc:330] T 417f48ddea6440a5a86fa05f7e514005 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:13.411254 27223 raft_consensus.cc:2229] T 417f48ddea6440a5a86fa05f7e514005 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:13.411499 27223 raft_consensus.cc:2258] T 417f48ddea6440a5a86fa05f7e514005 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:13.411684 27228 ts_tablet_manager.cc:1428] T 50e61e835429436d9bdc585b8c7381f6 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:13.412376 27223 ts_tablet_manager.cc:1905] T 417f48ddea6440a5a86fa05f7e514005 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:13.409716 27231 ts_tablet_manager.cc:1397] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.026s user 0.021s sys 0.000s
I20260810 11:30:13.414513 27231 raft_consensus.cc:348] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.414822 27231 raft_consensus.cc:374] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.414913 27231 raft_consensus.cc:729] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.415004 26500 master_service.cc:946] ReplaceTablet: received request to replace tablet 566bf0f68c2946a89203472786e82512 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:13.415267 27231 consensus_queue.cc:260] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.417073 27228 tablet_bootstrap.cc:492] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:13.417780 27231 ts_tablet_manager.cc:1428] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 11:30:13.419716 27228 tablet_bootstrap.cc:654] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.420344 27020 tablet_service.cc:1514] Processing DeleteTablet for tablet 7edd85afa247429f92d4ed2f7c35ee16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:13.420526 27231 tablet_bootstrap.cc:492] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:13.421159 27263 consensus_queue.cc:1035] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:13.423319 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet 50e61e835429436d9bdc585b8c7381f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:13.429430 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_b0ce306dde7b412c8fa2bda65c94c917"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:13.430522 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0ce306dde7b412c8fa2bda65c94c917 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.431239 27223 ts_tablet_manager.cc:1918] T 417f48ddea6440a5a86fa05f7e514005 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:13.431914 27223 log.cc:1196] T 417f48ddea6440a5a86fa05f7e514005 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/417f48ddea6440a5a86fa05f7e514005
I20260810 11:30:13.432413 27231 tablet_bootstrap.cc:654] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.433142 27223 ts_tablet_manager.cc:1939] T 417f48ddea6440a5a86fa05f7e514005 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:13.437516 27223 tablet_replica.cc:330] T 201bafec782a4570a556f1c920e84898 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:13.437968 27223 raft_consensus.cc:2229] T 201bafec782a4570a556f1c920e84898 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:13.440361 27223 raft_consensus.cc:2258] T 201bafec782a4570a556f1c920e84898 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:13.444448 27223 ts_tablet_manager.cc:1905] T 201bafec782a4570a556f1c920e84898 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:13.445348 26745 tablet_service.cc:1467] Processing CreateTablet for tablet d91a02b22044429fb3e25840c7947a02 (DEFAULT_TABLE table=default.Table_ed278fa8f2db4fe8a3215e71eb2d3f9f [id=0b49f313222c437d921a10d967a953de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.446280 26745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d91a02b22044429fb3e25840c7947a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.449270 27222 tablet_bootstrap.cc:492] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:13.449505 27222 ts_tablet_manager.cc:1397] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.010s
W20260810 11:30:13.450273 26993 consensus_peers.cc:487] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:13.450798 27222 raft_consensus.cc:348] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:13.451258 27222 raft_consensus.cc:374] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.451488 27222 raft_consensus.cc:729] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.452138 27222 consensus_queue.cc:260] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:13.453277 27020 tablet_service.cc:1467] Processing CreateTablet for tablet d91a02b22044429fb3e25840c7947a02 (DEFAULT_TABLE table=default.Table_ed278fa8f2db4fe8a3215e71eb2d3f9f [id=0b49f313222c437d921a10d967a953de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.453536 27228 tablet_bootstrap.cc:492] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:13.453763 27228 ts_tablet_manager.cc:1397] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.009s
I20260810 11:30:13.454008 27020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d91a02b22044429fb3e25840c7947a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.454348 27222 ts_tablet_manager.cc:1428] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260810 11:30:13.454829 27222 tablet_bootstrap.cc:492] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:13.455325 27228 raft_consensus.cc:348] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.455752 27228 raft_consensus.cc:374] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.456152 27228 raft_consensus.cc:729] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.456694 27228 consensus_queue.cc:260] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.459571 27222 tablet_bootstrap.cc:654] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.462683 27228 ts_tablet_manager.cc:1428] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.009s user 0.004s sys 0.001s
I20260810 11:30:13.463281 27228 tablet_bootstrap.cc:492] T 7edd85afa247429f92d4ed2f7c35ee16 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:13.465461 26735 tablet_service.cc:1467] Processing CreateTablet for tablet 31cafb7c691d40a48a40f7d4190c4f8d (DEFAULT_TABLE table=default.Table_891d3f4e3019401fbb1b13496065cb5c [id=7213c582179a43c1b80901a2266e5477]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.466233 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31cafb7c691d40a48a40f7d4190c4f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.466737 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 2917f1ffb5214a80b19810540602df35 (DEFAULT_TABLE table=default.Table_be3e02683a404e28a86de9c55aae7ba8 [id=e34ecb3dff68425b9c53395ce189841b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.467504 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2917f1ffb5214a80b19810540602df35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.469291 27039 tablet_service.cc:1467] Processing CreateTablet for tablet 31cafb7c691d40a48a40f7d4190c4f8d (DEFAULT_TABLE table=default.Table_891d3f4e3019401fbb1b13496065cb5c [id=7213c582179a43c1b80901a2266e5477]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.470050 27039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31cafb7c691d40a48a40f7d4190c4f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.490276 27223 ts_tablet_manager.cc:1918] T 201bafec782a4570a556f1c920e84898 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:13.498386 27228 tablet_bootstrap.cc:654] T 7edd85afa247429f92d4ed2f7c35ee16 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.498654 27223 log.cc:1196] T 201bafec782a4570a556f1c920e84898 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/201bafec782a4570a556f1c920e84898
I20260810 11:30:13.501856 27223 ts_tablet_manager.cc:1939] T 201bafec782a4570a556f1c920e84898 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:13.504324 27223 tablet_replica.cc:330] T 50e61e835429436d9bdc585b8c7381f6 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:13.509996 27228 tablet_bootstrap.cc:492] T 7edd85afa247429f92d4ed2f7c35ee16 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:13.511142 27228 ts_tablet_manager.cc:1397] T 7edd85afa247429f92d4ed2f7c35ee16 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.048s user 0.008s sys 0.000s
I20260810 11:30:13.510483 27223 raft_consensus.cc:2229] T 50e61e835429436d9bdc585b8c7381f6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:13.511581 27223 raft_consensus.cc:2258] T 50e61e835429436d9bdc585b8c7381f6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:13.437160 26491 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b1cd64deb8e24c81ba2d4214bb38f5da (table default.Table_7e1ff16472f842438c14184ab96741e1 [id=03dca1a3a16e42049c194a46978bbfec]). Expected version 2 got 0
I20260810 11:30:13.437685 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 417f48ddea6440a5a86fa05f7e514005 (table default.Table_c43921fb6a024b50b218fad3b85e6904 [id=982ed623ee924e059c884584da03c56a]) successfully deleted
W20260810 11:30:13.512179 26484 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 74509.3us
I20260810 11:30:13.512933 27228 raft_consensus.cc:348] T 7edd85afa247429f92d4ed2f7c35ee16 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.513244 27228 raft_consensus.cc:374] T 7edd85afa247429f92d4ed2f7c35ee16 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.513338 27228 raft_consensus.cc:729] T 7edd85afa247429f92d4ed2f7c35ee16 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.513394 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 201bafec782a4570a556f1c920e84898 (table default.Table_01ba22149a2f482782c70caa4d2244ea [id=31781820c0814fb0bee423b2ce6ae615]) successfully deleted
I20260810 11:30:13.513641 27222 tablet_bootstrap.cc:492] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:13.513650 27228 consensus_queue.cc:260] T 7edd85afa247429f92d4ed2f7c35ee16 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.513864 27222 ts_tablet_manager.cc:1397] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.059s user 0.019s sys 0.024s
I20260810 11:30:13.514343 27228 ts_tablet_manager.cc:1428] T 7edd85afa247429f92d4ed2f7c35ee16 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260810 11:30:13.514768 27228 tablet_bootstrap.cc:492] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:13.515414 27223 ts_tablet_manager.cc:1905] T 50e61e835429436d9bdc585b8c7381f6 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:13.517813 27228 tablet_bootstrap.cc:654] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.520885 27222 raft_consensus.cc:348] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.521430 27222 raft_consensus.cc:374] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.521556 27222 raft_consensus.cc:729] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.521944 27222 consensus_queue.cc:260] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.523084 27222 ts_tablet_manager.cc:1428] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20260810 11:30:13.523582 27222 tablet_bootstrap.cc:492] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:13.524653 27342 tablet.cc:1722] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:13.524905 26501 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 15940cdec03545f9b126199339fbbbea
W20260810 11:30:13.525568 26493 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96cae4eb16c84410926a317af70e44f7 consensus state has no leader
I20260810 11:30:13.526000 26501 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 2c6b3f8626724d12986f388b1ca90b3c (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:13.527354 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_bb3131b0059a44d68866825f94543d0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:13.527781 26497 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_59042145856943e1a20d5bb917f89bd0" } new_table_name: "default.Table_c14fb772c46140adba698987eefe2762" modify_external_catalogs: true
W20260810 11:30:13.528263 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb3131b0059a44d68866825f94543d0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.529498 26498 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 1e0a8513171f4c39b74c08760a139d9e
I20260810 11:30:13.530340 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_16866d33f78041fd9fdfdd14a4daf75e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:13.530982 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16866d33f78041fd9fdfdd14a4daf75e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.537652 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e0a8513171f4c39b74c08760a139d9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:13.538872 27222 tablet_bootstrap.cc:654] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.539721 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e0a8513171f4c39b74c08760a139d9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:13.540668 27223 ts_tablet_manager.cc:1918] T 50e61e835429436d9bdc585b8c7381f6 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:13.541002 27223 log.cc:1196] T 50e61e835429436d9bdc585b8c7381f6 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/50e61e835429436d9bdc585b8c7381f6
I20260810 11:30:13.541590 27223 ts_tablet_manager.cc:1939] T 50e61e835429436d9bdc585b8c7381f6 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:13.545676 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_3c5493f70dc44bab811f7605b20c81b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:13.546474 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c5493f70dc44bab811f7605b20c81b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.547322 26492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 7e3707ae32624f6483866208321eefde
I20260810 11:30:13.551527 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e3707ae32624f6483866208321eefde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:13.554548 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e3707ae32624f6483866208321eefde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:13.560623 27360 tablet.cc:1722] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:13.570781 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_05a7698994184d6bbed238252235f5f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:13.571797 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05a7698994184d6bbed238252235f5f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.573293 26498 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_1c2bdb997ce049069ebd0136491c2f6f" } new_table_name: "default.Table_abbbb80ecbe4491d98912dcdcaab5dd3" modify_external_catalogs: true
W20260810 11:30:13.576099 26497 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6e829d4bffeb4289a54b4d3d7a53c44e consensus state has no leader
I20260810 11:30:13.576617 26497 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c753d94e8f1c4f459963bdfc55366320" } modify_external_catalogs: true
I20260810 11:30:13.576905 26497 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c753d94e8f1c4f459963bdfc55366320" } modify_external_catalogs: true
I20260810 11:30:13.594305 26492 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 2c6b3f8626724d12986f388b1ca90b3c (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:13.594803 26492 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet b1cd64deb8e24c81ba2d4214bb38f5da (table default.Table_7e1ff16472f842438c14184ab96741e1 [id=03dca1a3a16e42049c194a46978bbfec]). Expected version 2 got 0
I20260810 11:30:13.600587 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_5f8ecc7877924d0f9871dd16aaeafdde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:13.601779 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f8ecc7877924d0f9871dd16aaeafdde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.610507 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_547fe3fa37ab46aab94789c556ec37d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:13.611691 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_547fe3fa37ab46aab94789c556ec37d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.614972 27035 tablet_service.cc:1467] Processing CreateTablet for tablet 2917f1ffb5214a80b19810540602df35 (DEFAULT_TABLE table=default.Table_be3e02683a404e28a86de9c55aae7ba8 [id=e34ecb3dff68425b9c53395ce189841b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.615221 26740 tablet_service.cc:1467] Processing CreateTablet for tablet b6a3b1e37ac943e391d54640987136f8 (DEFAULT_TABLE table=default.Table_a88d168f91f6427e898a55cb391840af [id=56dee621acfa4f73b3bd69fefa7cb7e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.615602 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2917f1ffb5214a80b19810540602df35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.615785 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6a3b1e37ac943e391d54640987136f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.621271 26879 tablet_service.cc:1467] Processing CreateTablet for tablet d91a02b22044429fb3e25840c7947a02 (DEFAULT_TABLE table=default.Table_ed278fa8f2db4fe8a3215e71eb2d3f9f [id=0b49f313222c437d921a10d967a953de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.621824 26879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d91a02b22044429fb3e25840c7947a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.635792 26501 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_7e1ff16472f842438c14184ab96741e1" } modify_external_catalogs: true
I20260810 11:30:13.636098 26501 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_7e1ff16472f842438c14184ab96741e1" } modify_external_catalogs: true
W20260810 11:30:13.636322 26498 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ccef06fa06c4c519d8760fa948d6c8b consensus state has no leader
I20260810 11:30:13.636858 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_21f03834771d4035b46d7d400c951408"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:13.637527 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21f03834771d4035b46d7d400c951408 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.639112 26497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 79953795f07845aba3f028741cdcdd9e
I20260810 11:30:13.640478 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 79953795f07845aba3f028741cdcdd9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:13.641340 26497 master_service.cc:946] ReplaceTablet: received request to replace tablet b1cd64deb8e24c81ba2d4214bb38f5da from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:13.642603 26739 tablet_service.cc:1514] Processing DeleteTablet for tablet 79953795f07845aba3f028741cdcdd9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:13.647202 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 31cafb7c691d40a48a40f7d4190c4f8d (DEFAULT_TABLE table=default.Table_891d3f4e3019401fbb1b13496065cb5c [id=7213c582179a43c1b80901a2266e5477]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.648190 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31cafb7c691d40a48a40f7d4190c4f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.650230 27325 raft_consensus.cc:482] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:13.652980 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e3707ae32624f6483866208321eefde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:13.654138 26887 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e0a8513171f4c39b74c08760a139d9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:13.654902 26876 tablet_service.cc:1467] Processing CreateTablet for tablet 2917f1ffb5214a80b19810540602df35 (DEFAULT_TABLE table=default.Table_be3e02683a404e28a86de9c55aae7ba8 [id=e34ecb3dff68425b9c53395ce189841b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.655932 26876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2917f1ffb5214a80b19810540602df35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.655742 26878 tablet_service.cc:1514] Processing DeleteTablet for tablet 7edd85afa247429f92d4ed2f7c35ee16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:13.659011 27223 tablet_replica.cc:330] T 7edd85afa247429f92d4ed2f7c35ee16 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:13.659369 27223 raft_consensus.cc:2229] T 7edd85afa247429f92d4ed2f7c35ee16 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:13.659729 27223 raft_consensus.cc:2258] T 7edd85afa247429f92d4ed2f7c35ee16 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:13.661037 27223 ts_tablet_manager.cc:1905] T 7edd85afa247429f92d4ed2f7c35ee16 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:13.661309 26739 tablet_service.cc:1467] Processing CreateTablet for tablet 5ca5c88585394dba87e201696afa6934 (DEFAULT_TABLE table=default.Table_5845c9677afb47d1af6ddd98bed76886 [id=696fdd9a822c4e40930fc333e3f3d725]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.661844 26739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ca5c88585394dba87e201696afa6934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.663527 26743 tablet_service.cc:1467] Processing CreateTablet for tablet ffeb0373c6124af291336ca9da50c318 (DEFAULT_TABLE table=default.Table_cc55e38123c6426fb73e83da0b48d081 [id=c1ed54f150864132aa31551870ffde82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.664356 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffeb0373c6124af291336ca9da50c318. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:13.669735 26484 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 6c5b650bc02f4fa393bada5b54c77f1f (table default.Table_857806a7841646449e10e93beec175f2 [id=3d8c46d7a15e457a93fd615ad99a4f36], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6c5b650bc02f4fa393bada5b54c77f1f consensus state has no leader
I20260810 11:30:13.674064 27221 ts_tablet_manager.cc:1918] T 66a7790587ed478b843fa9e997e50893 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:13.674823 27221 log.cc:1196] T 66a7790587ed478b843fa9e997e50893 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/66a7790587ed478b843fa9e997e50893
I20260810 11:30:13.678443 27223 ts_tablet_manager.cc:1918] T 7edd85afa247429f92d4ed2f7c35ee16 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:13.681743 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 50e61e835429436d9bdc585b8c7381f6 (table default.Table_96a70f4812ec4dec8208ba26426bf964 [id=4a855b81f02147958d928720286121df]) successfully deleted
W20260810 11:30:13.682469 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7e3707ae32624f6483866208321eefde because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e3707ae32624f6483866208321eefde already in progress: creating tablet
W20260810 11:30:13.682862 26484 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 1e0a8513171f4c39b74c08760a139d9e because the tablet was not found. No further retry: Not found: Tablet not found: 1e0a8513171f4c39b74c08760a139d9e
I20260810 11:30:13.678926 26878 tablet_service.cc:1514] Processing DeleteTablet for tablet 79953795f07845aba3f028741cdcdd9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:13.692006 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 5ca5c88585394dba87e201696afa6934 (DEFAULT_TABLE table=default.Table_5845c9677afb47d1af6ddd98bed76886 [id=696fdd9a822c4e40930fc333e3f3d725]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.699223 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ca5c88585394dba87e201696afa6934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.704739 27223 log.cc:1196] T 7edd85afa247429f92d4ed2f7c35ee16 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/7edd85afa247429f92d4ed2f7c35ee16
I20260810 11:30:13.705935 27223 ts_tablet_manager.cc:1939] T 7edd85afa247429f92d4ed2f7c35ee16 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:13.708218 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 7edd85afa247429f92d4ed2f7c35ee16 (table default.Table_6ded95de14fd42ef926969f573a166c5 [id=6bc27d6198fc4654aa20602a3917569e]) successfully deleted
W20260810 11:30:13.709272 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 79953795f07845aba3f028741cdcdd9e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79953795f07845aba3f028741cdcdd9e already in progress: creating tablet
I20260810 11:30:13.698236 26876 tablet_service.cc:1467] Processing CreateTablet for tablet b6a3b1e37ac943e391d54640987136f8 (DEFAULT_TABLE table=default.Table_a88d168f91f6427e898a55cb391840af [id=56dee621acfa4f73b3bd69fefa7cb7e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.710412 26876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6a3b1e37ac943e391d54640987136f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.720726 27325 raft_consensus.cc:504] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.723136 26879 tablet_service.cc:1467] Processing CreateTablet for tablet ffeb0373c6124af291336ca9da50c318 (DEFAULT_TABLE table=default.Table_cc55e38123c6426fb73e83da0b48d081 [id=c1ed54f150864132aa31551870ffde82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.723729 26879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffeb0373c6124af291336ca9da50c318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.726173 27221 ts_tablet_manager.cc:1939] T 66a7790587ed478b843fa9e997e50893 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:13.723554 27325 leader_election.cc:288] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:13.727500 27293 raft_consensus.cc:482] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:13.728647 27035 tablet_service.cc:1467] Processing CreateTablet for tablet b6a3b1e37ac943e391d54640987136f8 (DEFAULT_TABLE table=default.Table_a88d168f91f6427e898a55cb391840af [id=56dee621acfa4f73b3bd69fefa7cb7e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.729202 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6a3b1e37ac943e391d54640987136f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.732802 27293 raft_consensus.cc:504] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:13.733661 27293 leader_election.cc:288] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:13.735417 26991 leader_election.cc:341] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 417f48ddea6440a5a86fa05f7e514005
I20260810 11:30:13.736840 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 5ca5c88585394dba87e201696afa6934 (DEFAULT_TABLE table=default.Table_5845c9677afb47d1af6ddd98bed76886 [id=696fdd9a822c4e40930fc333e3f3d725]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.736857 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 6e829d4bffeb4289a54b4d3d7a53c44e (DEFAULT_TABLE table=default.Table_c14fb772c46140adba698987eefe2762 [id=9a684007540c48269be762ceb59b40c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.739094 26740 tablet_service.cc:1467] Processing CreateTablet for tablet 7aa16654b7f34f9baf856bf724cece8f (DEFAULT_TABLE table=default.Table_7157cb4b94764bf6ab05e84468872791 [id=e08caac3c4e54a5c9ed82c003898f06e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.740038 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ca5c88585394dba87e201696afa6934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.745044 26500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 566bf0f68c2946a89203472786e82512
I20260810 11:30:13.745783 26500 catalog_manager.cc:6565] ReplaceTablet: tablet 566bf0f68c2946a89203472786e82512 deleted and replaced by tablet 69484fb371d14805a40b9bcebcfa4ab6
I20260810 11:30:13.746132 26500 master_service.cc:946] ReplaceTablet: received request to replace tablet d98948300fe6472295ea53cedb7d386c from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:13.747084 26500 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_f3ada0ff5ab04a808b0572baf1ed9c15" } new_table_name: "default.Table_7466a225b5ae492ab3ac3cf5d74a360f" modify_external_catalogs: true
I20260810 11:30:13.747368 26739 tablet_service.cc:1514] Processing DeleteTablet for tablet 566bf0f68c2946a89203472786e82512 with delete_type TABLET_DATA_DELETED (replaced by tablet 69484fb371d14805a40b9bcebcfa4ab6) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:13.750659 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7aa16654b7f34f9baf856bf724cece8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.752812 26499 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_f5a7bc22bb0b432bb5cee5e3576180fb" } new_table_name: "default.Table_e15e0bcf194a490495cfd17ad551958b" modify_external_catalogs: true
I20260810 11:30:13.753695 26493 master_service.cc:946] ReplaceTablet: received request to replace tablet debc114073e14ec1839c5c4c7c2f1f1e from {username='slave'} at 127.0.0.1:47672
W20260810 11:30:13.761672 26991 leader_election.cc:341] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: a9615b1ff3454a46a1a27cfcea20ad00
I20260810 11:30:13.761868 26498 master_service.cc:946] ReplaceTablet: received request to replace tablet d91a02b22044429fb3e25840c7947a02 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:13.762854 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e829d4bffeb4289a54b4d3d7a53c44e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.762972 26916 raft_consensus.cc:3037] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:13.765075 26739 tablet_service.cc:1467] Processing CreateTablet for tablet bbe34108a7604fa6aa667758be11f569 (DEFAULT_TABLE table=default.Table_5f6a37537c33412a80f2642fb0162da6 [id=bfc3f2f94773444181545d43ecd88190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.766544 26739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbe34108a7604fa6aa667758be11f569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.767812 26501 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet b1cd64deb8e24c81ba2d4214bb38f5da
I20260810 11:30:13.768841 26501 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_367660e7b3674b518a63fbba74bcca1d" } modify_external_catalogs: true
I20260810 11:30:13.769228 26501 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_367660e7b3674b518a63fbba74bcca1d" } modify_external_catalogs: true
I20260810 11:30:13.770673 27027 tablet_service.cc:1467] Processing CreateTablet for tablet 6e829d4bffeb4289a54b4d3d7a53c44e (DEFAULT_TABLE table=default.Table_c14fb772c46140adba698987eefe2762 [id=9a684007540c48269be762ceb59b40c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.772527 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet 566bf0f68c2946a89203472786e82512 with delete_type TABLET_DATA_DELETED (replaced by tablet 69484fb371d14805a40b9bcebcfa4ab6) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:13.773463 27034 tablet_service.cc:1467] Processing CreateTablet for tablet ffeb0373c6124af291336ca9da50c318 (DEFAULT_TABLE table=default.Table_cc55e38123c6426fb73e83da0b48d081 [id=c1ed54f150864132aa31551870ffde82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.774456 27027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e829d4bffeb4289a54b4d3d7a53c44e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.774709 27221 tablet_replica.cc:330] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:13.772290 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_f974a4ceae4649bb9f17115103f554cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:13.774957 27221 raft_consensus.cc:2229] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:13.775257 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f974a4ceae4649bb9f17115103f554cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.775364 27221 raft_consensus.cc:2258] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:13.777120 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet b1cd64deb8e24c81ba2d4214bb38f5da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:13.771876 26993 leader_election.cc:341] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 417f48ddea6440a5a86fa05f7e514005
I20260810 11:30:13.778661 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffeb0373c6124af291336ca9da50c318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.780931 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet b1cd64deb8e24c81ba2d4214bb38f5da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:13.781229 27029 tablet_service.cc:1467] Processing CreateTablet for tablet 7aa16654b7f34f9baf856bf724cece8f (DEFAULT_TABLE table=default.Table_7157cb4b94764bf6ab05e84468872791 [id=e08caac3c4e54a5c9ed82c003898f06e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.782300 27029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7aa16654b7f34f9baf856bf724cece8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.784034 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 66a7790587ed478b843fa9e997e50893 (table default.Table_c051f1f117b04fdd9c1ed11f426ae316 [id=b2754904694140cab5a7a82d31449a70]) successfully deleted
W20260810 11:30:13.784487 26486 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 1e0a8513171f4c39b74c08760a139d9e because the tablet was not found. No further retry: Not found: Tablet not found: 1e0a8513171f4c39b74c08760a139d9e
W20260810 11:30:13.784981 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7e3707ae32624f6483866208321eefde because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e3707ae32624f6483866208321eefde already in progress: creating tablet
W20260810 11:30:13.785308 27194 thread.cc:636] rpc worker (service pool kudu.master.MasterService) Time spent creating pthread: real 0.521s user 0.018s sys 0.050s
W20260810 11:30:13.785571 27194 thread.cc:602] rpc worker (service pool kudu.master.MasterService) Time spent starting thread: real 0.521s user 0.018s sys 0.051s
W20260810 11:30:13.785831 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 79953795f07845aba3f028741cdcdd9e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79953795f07845aba3f028741cdcdd9e already in progress: creating tablet
I20260810 11:30:13.785334 26993 leader_election.cc:302] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
W20260810 11:30:13.786892 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 60426.4us
I20260810 11:30:13.787663 27293 raft_consensus.cc:2726] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:13.787955 26491 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: default.Table_367660e7b3674b518a63fbba74bcca1d [id=a2d890f4b9874411a503888263d07d18] alter complete (version 1)
I20260810 11:30:13.789179 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9615b1ff3454a46a1a27cfcea20ad00" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:13.789543 26491 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_8c84c3aae4ab4d3a9a7bf26d7407722f" } new_table_name: "default.Table_1ff9ed629e8b465e9ac5588ad616105a" modify_external_catalogs: true
I20260810 11:30:13.789721 26771 raft_consensus.cc:2454] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:13.790908 26745 tablet_service.cc:1467] Processing CreateTablet for tablet 1e0a8513171f4c39b74c08760a139d9e (DEFAULT_TABLE table=default.Table_aa6798d7140e47fd8b1709e531dbbd10 [id=c62015a698ae48959d405f34503f5fb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.791577 26745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e0a8513171f4c39b74c08760a139d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.792470 27293 raft_consensus.cc:482] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:13.794906 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 256af4222bb34745ac018dd82a9c4f9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:13.798049 27293 raft_consensus.cc:504] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.799101 27293 leader_election.cc:288] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:13.799386 27024 tablet_service.cc:1514] Processing DeleteTablet for tablet c0120575c9fd4b2fb32ca7392db277bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:13.799856 27025 tablet_service.cc:1467] Processing CreateTablet for tablet bbe34108a7604fa6aa667758be11f569 (DEFAULT_TABLE table=default.Table_5f6a37537c33412a80f2642fb0162da6 [id=bfc3f2f94773444181545d43ecd88190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.800547 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbe34108a7604fa6aa667758be11f569. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:13.802052 26500 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb51618d37ac488fa7e3d23e5f85ec36 has no consensus state
I20260810 11:30:13.802106 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 725d2e70e1d441b497d56a278e1de0ad (DEFAULT_TABLE table=default.Table_59ed990b31964d6080614081ee46a6de [id=6d8fc88a491140548a45c7fbb403bb36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.791688 26771 raft_consensus.cc:1261] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Refusing update from remote peer 482e605580be48cbbacce05a3e61c215: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 11:30:13.798612 27222 tablet_bootstrap.cc:492] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:13.802863 27222 ts_tablet_manager.cc:1397] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.279s user 0.052s sys 0.093s
I20260810 11:30:13.802543 26500 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_22360b2c6a9e46f99bbc036074cb7441" } modify_external_catalogs: true
I20260810 11:30:13.803074 26500 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_22360b2c6a9e46f99bbc036074cb7441" } modify_external_catalogs: true
I20260810 11:30:13.803948 26993 leader_election.cc:302] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:13.804003 27222 raft_consensus.cc:348] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.804304 27222 raft_consensus.cc:374] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.804481 27222 raft_consensus.cc:729] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.804800 27293 raft_consensus.cc:2781] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:13.804824 27222 consensus_queue.cc:260] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.805034 27293 raft_consensus.cc:482] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:13.805668 27293 raft_consensus.cc:3037] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:13.806587 27222 ts_tablet_manager.cc:1428] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 11:30:13.807156 27222 tablet_bootstrap.cc:492] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:13.808075 27024 tablet_service.cc:1467] Processing CreateTablet for tablet 1e0a8513171f4c39b74c08760a139d9e (DEFAULT_TABLE table=default.Table_aa6798d7140e47fd8b1709e531dbbd10 [id=c62015a698ae48959d405f34503f5fb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.808249 26495 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a] alter complete (version 1)
I20260810 11:30:13.808754 27024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e0a8513171f4c39b74c08760a139d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.808907 26495 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_272ea4ef15fc433b9f2a8465bcf865a9" } modify_external_catalogs: true
I20260810 11:30:13.809204 26495 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_272ea4ef15fc433b9f2a8465bcf865a9" } modify_external_catalogs: true
I20260810 11:30:13.810302 27222 tablet_bootstrap.cc:654] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.816537 26493 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet debc114073e14ec1839c5c4c7c2f1f1e
I20260810 11:30:13.817265 26493 catalog_manager.cc:6565] ReplaceTablet: tablet debc114073e14ec1839c5c4c7c2f1f1e deleted and replaced by tablet cb01e54d817c4b0dbcc80f90f82923c0
I20260810 11:30:13.818118 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_e0f398f685ca45afbb6395ac394410dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:13.819162 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0f398f685ca45afbb6395ac394410dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.819693 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "256af4222bb34745ac018dd82a9c4f9b" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:13.820325 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 725d2e70e1d441b497d56a278e1de0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.823525 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet debc114073e14ec1839c5c4c7c2f1f1e with delete_type TABLET_DATA_DELETED (replaced by tablet cb01e54d817c4b0dbcc80f90f82923c0) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:13.825331 26735 tablet_service.cc:1514] Processing DeleteTablet for tablet debc114073e14ec1839c5c4c7c2f1f1e with delete_type TABLET_DATA_DELETED (replaced by tablet cb01e54d817c4b0dbcc80f90f82923c0) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:13.800019 27221 ts_tablet_manager.cc:1905] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:13.826146 27325 consensus_queue.cc:1035] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:13.826756 26499 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0938a2f3688246a2b46978eeb7d5d521 has no consensus state
I20260810 11:30:13.827308 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_edb9387fb3ec47eab19fc13e046c5533"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:13.828255 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_edb9387fb3ec47eab19fc13e046c5533 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.832389 26492 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_20c9bc8bc7c641a7a137e8c36a2a4f93" } new_table_name: "default.Table_0d757328d26e45dba1be7c8a88565727" modify_external_catalogs: true
I20260810 11:30:13.835696 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dabfbd779c5406cb10ecf70f5a142e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:13.837989 27030 tablet_service.cc:1467] Processing CreateTablet for tablet 725d2e70e1d441b497d56a278e1de0ad (DEFAULT_TABLE table=default.Table_59ed990b31964d6080614081ee46a6de [id=6d8fc88a491140548a45c7fbb403bb36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.838635 27030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 725d2e70e1d441b497d56a278e1de0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.850414 26498 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet d91a02b22044429fb3e25840c7947a02
I20260810 11:30:13.851065 26498 catalog_manager.cc:6565] ReplaceTablet: tablet d91a02b22044429fb3e25840c7947a02 deleted and replaced by tablet 6ba5191082814a4f8cf821354416e1d3
I20260810 11:30:13.851666 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_9e41e60880114afb97c4ffb0dbf0aa6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:13.852770 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e41e60880114afb97c4ffb0dbf0aa6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:13.856729 26993 leader_election.cc:341] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:13.836506 26735 tablet_service.cc:1467] Processing CreateTablet for tablet f3884736eec74c8992b8d51b37465875 (DEFAULT_TABLE table=default.Table_9981bbc86a934c98814b8a6164ffd51b [id=5335295210c1486e927e4228ccdb1de0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.859369 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3884736eec74c8992b8d51b37465875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.861191 27038 tablet_service.cc:1467] Processing CreateTablet for tablet f3884736eec74c8992b8d51b37465875 (DEFAULT_TABLE table=default.Table_9981bbc86a934c98814b8a6164ffd51b [id=5335295210c1486e927e4228ccdb1de0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.861822 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3884736eec74c8992b8d51b37465875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.865564 26501 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 69484fb371d14805a40b9bcebcfa4ab6
I20260810 11:30:13.866060 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet d91a02b22044429fb3e25840c7947a02 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ba5191082814a4f8cf821354416e1d3) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:13.866866 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet d91a02b22044429fb3e25840c7947a02 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ba5191082814a4f8cf821354416e1d3) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:13.867075 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_b9bd48d71fac4e03b0d84dcafd4cb4a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:13.867923 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9bd48d71fac4e03b0d84dcafd4cb4a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.870889 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_24bdc44050024c23aa90a182bdcecb50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:13.873458 26497 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_ed278fa8f2db4fe8a3215e71eb2d3f9f" } modify_external_catalogs: true
I20260810 11:30:13.874615 26497 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_ed278fa8f2db4fe8a3215e71eb2d3f9f" } modify_external_catalogs: true
I20260810 11:30:13.875767 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 478c0c39658349c39e3afa1aa1653e82 (DEFAULT_TABLE table=default.Table_38150fc48b7148a8bc17eb85f039d7b3 [id=b54ba03677734f2da90a534a0f5ff58e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:13.874352 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24bdc44050024c23aa90a182bdcecb50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.876379 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 478c0c39658349c39e3afa1aa1653e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.879681 27252 raft_consensus.cc:482] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:13.880041 27252 raft_consensus.cc:504] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.884435 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet c0120575c9fd4b2fb32ca7392db277bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:13.892125 26746 tablet_service.cc:1467] Processing CreateTablet for tablet fbe0a0ab82a147a3b6164904b135d1ab (DEFAULT_TABLE table=default.Table_73605ca3d8ed4b83bf92156282c66625 [id=b52c11bd73cd4d1f8f9dfc32562718a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.889859 26739 tablet_service.cc:1467] Processing CreateTablet for tablet e25ae21cc8cc4749a507fcab5ee225a3 (DEFAULT_TABLE table=default.Table_dc355f349bc9426eb26a69cf93c089cf [id=68a29d5ebf8140198fbf4da3cd974847]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.893286 27231 tablet_bootstrap.cc:492] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:13.893498 27231 ts_tablet_manager.cc:1397] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.475s user 0.046s sys 0.131s
I20260810 11:30:13.893524 27023 tablet_service.cc:1467] Processing CreateTablet for tablet e25ae21cc8cc4749a507fcab5ee225a3 (DEFAULT_TABLE table=default.Table_dc355f349bc9426eb26a69cf93c089cf [id=68a29d5ebf8140198fbf4da3cd974847]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.894047 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet 201bafec782a4570a556f1c920e84898 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:13.894270 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25ae21cc8cc4749a507fcab5ee225a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.894356 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbe0a0ab82a147a3b6164904b135d1ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.894502 27231 raft_consensus.cc:348] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.894809 27231 raft_consensus.cc:374] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.894981 27231 raft_consensus.cc:729] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.895505 26739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25ae21cc8cc4749a507fcab5ee225a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.895344 27231 consensus_queue.cc:260] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.897814 27022 tablet_service.cc:1467] Processing CreateTablet for tablet 478c0c39658349c39e3afa1aa1653e82 (DEFAULT_TABLE table=default.Table_38150fc48b7148a8bc17eb85f039d7b3 [id=b54ba03677734f2da90a534a0f5ff58e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.898366 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 478c0c39658349c39e3afa1aa1653e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.899003 27231 ts_tablet_manager.cc:1428] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260810 11:30:13.899366 27231 tablet_bootstrap.cc:492] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:13.902338 27037 tablet_service.cc:1467] Processing CreateTablet for tablet fbe0a0ab82a147a3b6164904b135d1ab (DEFAULT_TABLE table=default.Table_73605ca3d8ed4b83bf92156282c66625 [id=b52c11bd73cd4d1f8f9dfc32562718a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.904032 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbe0a0ab82a147a3b6164904b135d1ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.904342 27252 leader_election.cc:288] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:13.909314 26876 tablet_service.cc:1467] Processing CreateTablet for tablet 6e829d4bffeb4289a54b4d3d7a53c44e (DEFAULT_TABLE table=default.Table_c14fb772c46140adba698987eefe2762 [id=9a684007540c48269be762ceb59b40c7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:13.910270 26702 leader_election.cc:341] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 201bafec782a4570a556f1c920e84898
I20260810 11:30:13.911966 26876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e829d4bffeb4289a54b4d3d7a53c44e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.922197 27325 raft_consensus.cc:482] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:13.924171 27325 raft_consensus.cc:504] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:13.925288 27325 leader_election.cc:288] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:13.932310 27231 tablet_bootstrap.cc:654] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:13.941015 27221 ts_tablet_manager.cc:1918] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:13.941316 27221 log.cc:1196] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/566bf0f68c2946a89203472786e82512
I20260810 11:30:13.942068 27221 ts_tablet_manager.cc:1939] T 566bf0f68c2946a89203472786e82512 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:13.944136 27221 tablet_replica.cc:330] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:13.955094 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 566bf0f68c2946a89203472786e82512 with delete_type TABLET_DATA_DELETED (replaced by tablet 69484fb371d14805a40b9bcebcfa4ab6) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:13.957428 26878 tablet_service.cc:1467] Processing CreateTablet for tablet 7aa16654b7f34f9baf856bf724cece8f (DEFAULT_TABLE table=default.Table_7157cb4b94764bf6ab05e84468872791 [id=e08caac3c4e54a5c9ed82c003898f06e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.959347 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7aa16654b7f34f9baf856bf724cece8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.961342 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0120575c9fd4b2fb32ca7392db277bf" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:13.961504 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet b1cd64deb8e24c81ba2d4214bb38f5da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:13.961707 26769 raft_consensus.cc:2454] T c0120575c9fd4b2fb32ca7392db277bf P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:13.964811 27223 tablet_replica.cc:330] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700: stopping tablet replica
W20260810 11:30:13.965924 26700 leader_election.cc:341] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 201bafec782a4570a556f1c920e84898
I20260810 11:30:13.966123 26700 leader_election.cc:302] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:13.966611 27252 raft_consensus.cc:2726] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:13.974824 26894 tablet_service.cc:1467] Processing CreateTablet for tablet f3884736eec74c8992b8d51b37465875 (DEFAULT_TABLE table=default.Table_9981bbc86a934c98814b8a6164ffd51b [id=5335295210c1486e927e4228ccdb1de0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.975203 26890 tablet_service.cc:1514] Processing DeleteTablet for tablet d91a02b22044429fb3e25840c7947a02 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ba5191082814a4f8cf821354416e1d3) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:13.975737 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet debc114073e14ec1839c5c4c7c2f1f1e with delete_type TABLET_DATA_DELETED (replaced by tablet cb01e54d817c4b0dbcc80f90f82923c0) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:13.976907 26887 tablet_service.cc:1467] Processing CreateTablet for tablet 1e0a8513171f4c39b74c08760a139d9e (DEFAULT_TABLE table=default.Table_aa6798d7140e47fd8b1709e531dbbd10 [id=c62015a698ae48959d405f34503f5fb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.977389 26877 tablet_service.cc:1467] Processing CreateTablet for tablet 725d2e70e1d441b497d56a278e1de0ad (DEFAULT_TABLE table=default.Table_59ed990b31964d6080614081ee46a6de [id=6d8fc88a491140548a45c7fbb403bb36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.978142 26890 tablet_service.cc:1467] Processing CreateTablet for tablet e25ae21cc8cc4749a507fcab5ee225a3 (DEFAULT_TABLE table=default.Table_dc355f349bc9426eb26a69cf93c089cf [id=68a29d5ebf8140198fbf4da3cd974847]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.978473 26883 tablet_service.cc:1467] Processing CreateTablet for tablet bbe34108a7604fa6aa667758be11f569 (DEFAULT_TABLE table=default.Table_5f6a37537c33412a80f2642fb0162da6 [id=bfc3f2f94773444181545d43ecd88190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:13.965339 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "256af4222bb34745ac018dd82a9c4f9b" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:13.969285 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0120575c9fd4b2fb32ca7392db277bf" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:13.980497 26887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e0a8513171f4c39b74c08760a139d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:13.981737 26993 leader_election.cc:302] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:13.984042 26500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 3ff4e19071fc435fbae4490799325e37
I20260810 11:30:13.984848 26495 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 96d359f306304dfc96dab696c3d160eb
I20260810 11:30:13.985886 27222 tablet_bootstrap.cc:492] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:13.986332 27222 ts_tablet_manager.cc:1397] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.179s user 0.012s sys 0.035s
I20260810 11:30:13.987229 26495 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_857806a7841646449e10e93beec175f2" } new_table_name: "default.Table_c03b9743d9e8475dbb617d058873deae" modify_external_catalogs: true
I20260810 11:30:13.989676 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_21a675494284471eaf3ea50b31b833d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:13.990487 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21a675494284471eaf3ea50b31b833d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.992686 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_9eee8b010360415faceef1c43fea61d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:13.989576 27222 raft_consensus.cc:348] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:13.993510 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9eee8b010360415faceef1c43fea61d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:13.993937 27222 raft_consensus.cc:374] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:13.994952 27222 raft_consensus.cc:729] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:13.997606 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ff4e19071fc435fbae4490799325e37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.004005 26888 tablet_service.cc:1467] Processing CreateTablet for tablet 478c0c39658349c39e3afa1aa1653e82 (DEFAULT_TABLE table=default.Table_38150fc48b7148a8bc17eb85f039d7b3 [id=b54ba03677734f2da90a534a0f5ff58e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.002087 27222 consensus_queue.cc:260] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.007791 27222 ts_tablet_manager.cc:1428] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.021s user 0.004s sys 0.001s
I20260810 11:30:14.009424 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_23889fedecbf43c09cf2ab7717d5801b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:14.010344 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23889fedecbf43c09cf2ab7717d5801b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.011415 27222 tablet_bootstrap.cc:492] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:14.016788 26889 tablet_service.cc:1467] Processing CreateTablet for tablet fbe0a0ab82a147a3b6164904b135d1ab (DEFAULT_TABLE table=default.Table_73605ca3d8ed4b83bf92156282c66625 [id=b52c11bd73cd4d1f8f9dfc32562718a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.017140 27222 tablet_bootstrap.cc:654] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:14.017654 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3884736eec74c8992b8d51b37465875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.022183 26877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 725d2e70e1d441b497d56a278e1de0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.022547 26890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25ae21cc8cc4749a507fcab5ee225a3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:14.025363 26487 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.252:34489, user_credentials={real_user=slave}} blocked reactor thread for 44227us
I20260810 11:30:14.035991 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ff4e19071fc435fbae4490799325e37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:14.036698 27222 tablet_bootstrap.cc:492] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:14.036932 27222 ts_tablet_manager.cc:1397] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.026s user 0.007s sys 0.001s
I20260810 11:30:14.038357 27222 raft_consensus.cc:348] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.038838 27222 raft_consensus.cc:374] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:14.038959 27222 raft_consensus.cc:729] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:14.039348 27222 consensus_queue.cc:260] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.040416 27252 raft_consensus.cc:482] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:14.040627 27252 raft_consensus.cc:504] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.041352 27252 leader_election.cc:288] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:14.042227 27222 ts_tablet_manager.cc:1428] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260810 11:30:14.042676 27222 tablet_bootstrap.cc:492] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:14.046227 27222 tablet_bootstrap.cc:654] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:14.048766 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbe34108a7604fa6aa667758be11f569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.050109 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbe0a0ab82a147a3b6164904b135d1ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.051008 27228 tablet_bootstrap.cc:492] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:14.058795 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc2d129e99f24c018e4f8e43f211171d" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:14.059909 26700 leader_election.cc:341] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:14.063025 27228 ts_tablet_manager.cc:1397] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.537s user 0.120s sys 0.138s
I20260810 11:30:14.063418 27222 tablet_bootstrap.cc:492] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:14.063563 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 478c0c39658349c39e3afa1aa1653e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.063916 27222 ts_tablet_manager.cc:1397] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.005s
I20260810 11:30:14.064270 26916 raft_consensus.cc:1261] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Refusing update from remote peer 482e605580be48cbbacce05a3e61c215: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 11:30:14.066488 27222 raft_consensus.cc:348] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.067047 27222 raft_consensus.cc:374] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:14.067243 27222 raft_consensus.cc:729] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:14.067750 27222 consensus_queue.cc:260] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.069199 27222 ts_tablet_manager.cc:1428] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 11:30:14.070367 27222 tablet_bootstrap.cc:492] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:14.071590 26991 leader_election.cc:341] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:14.073764 27222 tablet_bootstrap.cc:654] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:14.074807 27020 tablet_service.cc:1514] Processing DeleteTablet for tablet 2efaf8b45a824e34b7f23037de5eec45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:14.078703 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc2d129e99f24c018e4f8e43f211171d" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:14.079649 27325 raft_consensus.cc:2781] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:14.079933 26991 leader_election.cc:302] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
W20260810 11:30:14.080791 26702 leader_election.cc:341] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:14.081099 26702 leader_election.cc:302] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:14.081087 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ff4e19071fc435fbae4490799325e37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:14.081634 27252 raft_consensus.cc:2726] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:14.082500 27223 raft_consensus.cc:2229] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:14.098868 27222 tablet_bootstrap.cc:492] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:14.099278 27222 ts_tablet_manager.cc:1397] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.004s
I20260810 11:30:14.100878 27222 raft_consensus.cc:348] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.106244 27325 raft_consensus.cc:482] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:14.106961 27223 raft_consensus.cc:2258] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:14.109150 27228 raft_consensus.cc:348] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.109691 27228 raft_consensus.cc:374] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:14.109841 27228 raft_consensus.cc:729] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:14.110157 27228 consensus_queue.cc:260] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.115540 27223 ts_tablet_manager.cc:1905] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:14.131219 27222 raft_consensus.cc:374] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:14.131235 27252 raft_consensus.cc:482] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:14.131471 27222 raft_consensus.cc:729] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:14.131606 27252 raft_consensus.cc:504] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.131788 27222 consensus_queue.cc:260] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.132510 27252 leader_election.cc:288] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:14.132758 27252 raft_consensus.cc:482] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:14.132927 27252 raft_consensus.cc:504] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.133571 27252 leader_election.cc:288] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:14.145391 27222 ts_tablet_manager.cc:1428] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.046s user 0.005s sys 0.001s
I20260810 11:30:14.145884 27222 tablet_bootstrap.cc:492] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:14.150249 27386 raft_consensus.cc:482] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:14.151144 27386 raft_consensus.cc:504] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.154529 27386 leader_election.cc:288] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:14.157734 27222 tablet_bootstrap.cc:654] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:14.167639 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c6b3f8626724d12986f388b1ca90b3c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:14.167798 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2732660f8964feeb5c03365df065a54" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:14.169799 26700 leader_election.cc:341] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:14.170121 26700 leader_election.cc:341] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 2d7e745f05534917a5deecce410722e6
I20260810 11:30:14.169981 27293 raft_consensus.cc:504] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:14.170683 27248 ts_tablet_manager.cc:1918] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:14.169981 27325 raft_consensus.cc:3037] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:14.171837 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9615b1ff3454a46a1a27cfcea20ad00" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:14.172290 26769 raft_consensus.cc:3037] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:14.176096 26769 raft_consensus.cc:2454] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:14.181126 27221 raft_consensus.cc:2229] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:14.181980 27221 pending_rounds.cc:62] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d: Trying to abort 2 pending ops.
I20260810 11:30:14.182257 27221 pending_rounds.cc:68] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7316936350749241344 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "b1cd64deb8e24c81ba2d4214bb38f5da" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 2 new_table_name: "default.Table_7e1ff16472f842438c14184ab96741e1" dest_uuid: "482e605580be48cbbacce05a3e61c215" new_extra_config { } }
I20260810 11:30:14.183068 27221 pending_rounds.cc:68] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936348865183744 op_type: NO_OP noop_request { }
I20260810 11:30:14.183378 27221 raft_consensus.cc:2866] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:14.183643 27221 raft_consensus.cc:2258] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:14.185202 27222 tablet_bootstrap.cc:492] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:14.185429 27222 ts_tablet_manager.cc:1397] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.040s user 0.001s sys 0.005s
W20260810 11:30:14.185372 27371 consensus_queue.cc:1159] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "443ec871f1ed4232b932ecfb0b18510d" status { last_received { term: 1 index: 2 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 2 } }
I20260810 11:30:14.186587 27222 raft_consensus.cc:348] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.186960 27222 raft_consensus.cc:374] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:14.187062 27222 raft_consensus.cc:729] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:14.187397 27222 consensus_queue.cc:260] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.191558 27222 ts_tablet_manager.cc:1428] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260810 11:30:14.191747 27221 ts_tablet_manager.cc:1905] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:14.193006 27222 tablet_bootstrap.cc:492] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:14.196305 27222 tablet_bootstrap.cc:654] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:14.200925 26491 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 23d8ce485cb84495a6e964b6d5977f0d has no consensus state
I20260810 11:30:14.201524 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_37a55e452a194b859cd0dc01687a3dc3" } modify_external_catalogs: true
I20260810 11:30:14.201820 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_37a55e452a194b859cd0dc01687a3dc3" } modify_external_catalogs: true
I20260810 11:30:14.203758 27221 ts_tablet_manager.cc:1918] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:14.204068 27221 log.cc:1196] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/b1cd64deb8e24c81ba2d4214bb38f5da
I20260810 11:30:14.204105 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_3589a7a0eef1470eb486279bcefa6c63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:14.204996 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3589a7a0eef1470eb486279bcefa6c63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.205133 27221 ts_tablet_manager.cc:1939] T b1cd64deb8e24c81ba2d4214bb38f5da P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:14.206869 26496 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_9843e1f7503944a89021499a57571a86" } new_table_name: "default.Table_e26ee7fd08774003a73e09650378c808" modify_external_catalogs: true
I20260810 11:30:14.208254 26497 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 6ba5191082814a4f8cf821354416e1d3
W20260810 11:30:14.211083 26492 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 587c6ce242c0411b886404a0df03b1bb has no consensus state
I20260810 11:30:14.212870 26497 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_9981bbc86a934c98814b8a6164ffd51b" } new_table_name: "default.Table_8ffade5d9484424f9788cd43e1163be6" modify_external_catalogs: true
I20260810 11:30:14.213078 27221 tablet_replica.cc:330] T c0120575c9fd4b2fb32ca7392db277bf P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:14.213338 27221 raft_consensus.cc:2229] T c0120575c9fd4b2fb32ca7392db277bf P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:14.213570 27221 raft_consensus.cc:2258] T c0120575c9fd4b2fb32ca7392db277bf P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:14.214296 27221 ts_tablet_manager.cc:1905] T c0120575c9fd4b2fb32ca7392db277bf P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:14.216015 26492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_38ce4003d8e84bec8c910d35efb2a64e" } modify_external_catalogs: true
I20260810 11:30:14.216305 26492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_38ce4003d8e84bec8c910d35efb2a64e" } modify_external_catalogs: true
I20260810 11:30:14.219235 26498 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 2c6b3f8626724d12986f388b1ca90b3c (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:14.222407 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_8350154cfe4b460294a98889a1869fb8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:14.223197 27222 tablet_bootstrap.cc:492] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:14.223412 27222 ts_tablet_manager.cc:1397] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.031s user 0.009s sys 0.005s
I20260810 11:30:14.223812 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet b1cd64deb8e24c81ba2d4214bb38f5da (table default.Table_7e1ff16472f842438c14184ab96741e1 [id=03dca1a3a16e42049c194a46978bbfec]) successfully deleted
W20260810 11:30:14.224094 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet debc114073e14ec1839c5c4c7c2f1f1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet debc114073e14ec1839c5c4c7c2f1f1e already in progress: creating tablet
I20260810 11:30:14.224159 26739 tablet_service.cc:1514] Processing DeleteTablet for tablet 952fc4eb5e5c4d9597f4b6eee860ab3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.224278 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet a9615b1ff3454a46a1a27cfcea20ad00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.224586 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d7e745f05534917a5deecce410722e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 725d2e70e1d441b497d56a278e1de0ad) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.225243 26499 master_service.cc:946] ReplaceTablet: received request to replace tablet debc114073e14ec1839c5c4c7c2f1f1e from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:14.226037 26499 master_service.cc:946] ReplaceTablet: received request to replace tablet 66908164ff2a4ee5b55da6158699e0c6 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:14.226465 26499 master_service.cc:946] ReplaceTablet: received request to replace tablet 952fc4eb5e5c4d9597f4b6eee860ab3a from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:14.226676 27222 raft_consensus.cc:348] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.227056 27222 raft_consensus.cc:374] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 11:30:14.227115 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8350154cfe4b460294a98889a1869fb8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.227209 27222 raft_consensus.cc:729] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:14.227588 27222 consensus_queue.cc:260] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.232967 27222 ts_tablet_manager.cc:1428] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.009s user 0.002s sys 0.003s
I20260810 11:30:14.234185 27222 tablet_bootstrap.cc:492] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:14.239331 27222 tablet_bootstrap.cc:654] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:14.242897 27221 ts_tablet_manager.cc:1918] T c0120575c9fd4b2fb32ca7392db277bf P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:14.246881 27293 leader_election.cc:288] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:14.247596 27221 log.cc:1196] T c0120575c9fd4b2fb32ca7392db277bf P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/c0120575c9fd4b2fb32ca7392db277bf
I20260810 11:30:14.248647 27221 ts_tablet_manager.cc:1939] T c0120575c9fd4b2fb32ca7392db277bf P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:14.247084 26993 leader_election.cc:302] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:14.250031 27248 log.cc:1196] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/2d7e745f05534917a5deecce410722e6
I20260810 11:30:14.250181 27222 tablet_bootstrap.cc:492] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:14.250536 27222 ts_tablet_manager.cc:1397] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.001s
I20260810 11:30:14.252774 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet c0120575c9fd4b2fb32ca7392db277bf (table default.Table_8e3537dc1b294128b70896bf5501c85e [id=91a6a06504b24b8892a26d1ec11da667]) successfully deleted
I20260810 11:30:14.253067 27222 raft_consensus.cc:348] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.253499 27222 raft_consensus.cc:374] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:14.253676 27222 raft_consensus.cc:729] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:14.253841 27221 tablet_replica.cc:330] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:14.254030 27222 consensus_queue.cc:260] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.254781 27221 raft_consensus.cc:2229] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:14.256848 27221 raft_consensus.cc:2258] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:14.258569 27222 ts_tablet_manager.cc:1428] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260810 11:30:14.260830 27222 tablet_bootstrap.cc:492] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:14.261919 27221 ts_tablet_manager.cc:1905] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:14.267181 27222 tablet_bootstrap.cc:654] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:14.278663 27221 ts_tablet_manager.cc:1918] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:14.284404 27293 raft_consensus.cc:2726] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:14.283751 27222 tablet_bootstrap.cc:492] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:14.285957 27221 log.cc:1196] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/201bafec782a4570a556f1c920e84898
I20260810 11:30:14.286020 27222 ts_tablet_manager.cc:1397] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.008s
I20260810 11:30:14.286770 27221 ts_tablet_manager.cc:1939] T 201bafec782a4570a556f1c920e84898 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:14.287919 27222 raft_consensus.cc:348] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.288178 27389 raft_consensus.cc:2781] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:14.288260 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 201bafec782a4570a556f1c920e84898 (table default.Table_01ba22149a2f482782c70caa4d2244ea [id=31781820c0814fb0bee423b2ce6ae615]) successfully deleted
I20260810 11:30:14.288368 27222 raft_consensus.cc:374] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:14.288390 27389 raft_consensus.cc:686] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:14.288757 27389 consensus_queue.cc:237] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:14.289497 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 3ff4e19071fc435fbae4490799325e37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ff4e19071fc435fbae4490799325e37 already in progress: creating tablet
W20260810 11:30:14.295827 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 72791.9us
W20260810 11:30:14.302805 26388 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 154762us
W20260810 11:30:14.304318 26496 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a28849649c704f2fbdec1aced9ce01b1 consensus state has no leader
I20260810 11:30:14.306684 27222 raft_consensus.cc:729] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:14.306712 27221 tablet_replica.cc:330] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:14.307296 27221 raft_consensus.cc:2229] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:14.307222 27222 consensus_queue.cc:260] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.307749 27221 raft_consensus.cc:2258] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:14.307963 27222 ts_tablet_manager.cc:1428] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.022s user 0.000s sys 0.003s
I20260810 11:30:14.308276 27222 tablet_bootstrap.cc:492] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:14.309001 27221 ts_tablet_manager.cc:1905] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:14.311528 27222 tablet_bootstrap.cc:654] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:14.311520 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet e2732660f8964feeb5c03365df065a54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.312650 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet fc2d129e99f24c018e4f8e43f211171d with delete_type TABLET_DATA_DELETED (replaced by tablet 478c0c39658349c39e3afa1aa1653e82) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.313779 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dabfbd779c5406cb10ecf70f5a142e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.314853 26491 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 93f7de08779842f4811a6ea69c5d3764
I20260810 11:30:14.315388 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_dc355f349bc9426eb26a69cf93c089cf" } modify_external_catalogs: true
I20260810 11:30:14.316399 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_dc355f349bc9426eb26a69cf93c089cf" } modify_external_catalogs: true
W20260810 11:30:14.322782 26495 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6c5b650bc02f4fa393bada5b54c77f1f consensus state has no leader
I20260810 11:30:14.323436 26493 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_d297e25211404611a6ba6a454c9dd5fd" } modify_external_catalogs: true
I20260810 11:30:14.323746 26493 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_d297e25211404611a6ba6a454c9dd5fd" } modify_external_catalogs: true
I20260810 11:30:14.328208 27222 tablet_bootstrap.cc:492] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:14.328548 27222 ts_tablet_manager.cc:1397] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.003s
I20260810 11:30:14.328970 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_79d9e439271348b78d91981da7521fdb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:14.330147 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79d9e439271348b78d91981da7521fdb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.330042 27222 raft_consensus.cc:348] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.330722 27222 raft_consensus.cc:374] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:14.330942 27222 raft_consensus.cc:729] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:14.331449 27222 consensus_queue.cc:260] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.332645 27222 ts_tablet_manager.cc:1428] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 11:30:14.333141 27222 tablet_bootstrap.cc:492] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:14.333977 26497 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f3884736eec74c8992b8d51b37465875 consensus state has no leader
I20260810 11:30:14.335036 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_a6922b81d56f4bf3b5231cc9ada8cb27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:14.335909 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6922b81d56f4bf3b5231cc9ada8cb27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.338218 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 256af4222bb34745ac018dd82a9c4f9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.340880 27222 tablet_bootstrap.cc:654] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:14.340945 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 2efaf8b45a824e34b7f23037de5eec45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.354380 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet d98948300fe6472295ea53cedb7d386c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:14.355736 26993 consensus_peers.cc:487] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 566bf0f68c2946a89203472786e82512. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:14.356242 27248 ts_tablet_manager.cc:1939] T 2d7e745f05534917a5deecce410722e6 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
W20260810 11:30:14.361830 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 44826.4us
I20260810 11:30:14.384622 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 85) took 1100 ms. Trace:
I20260810 11:30:14.385057 27248 rpcz_store.cc:276] 0810 11:30:13.256819 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:13.259464 (+ 2645us) service_pool.cc:227] Handling call
0810 11:30:13.267008 (+ 7544us) ts_tablet_manager.cc:1145] Deleting tablet 2d7e745f05534917a5deecce410722e6
0810 11:30:13.267034 (+ 26us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:13.647422 (+380388us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:14.103661 (+456239us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:14.356978 (+253317us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":57}
W20260810 11:30:14.388525 26993 consensus_peers.cc:487] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1cd64deb8e24c81ba2d4214bb38f5da. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:14.389475 27231 tablet_bootstrap.cc:492] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:14.393183 27231 ts_tablet_manager.cc:1397] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.490s user 0.041s sys 0.103s
I20260810 11:30:14.394238 27221 ts_tablet_manager.cc:1918] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:14.394411 27221 log.cc:1196] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/952fc4eb5e5c4d9597f4b6eee860ab3a
I20260810 11:30:14.394922 27221 ts_tablet_manager.cc:1939] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:14.395066 27222 tablet_bootstrap.cc:492] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:14.395524 27248 tablet_replica.cc:330] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:14.395583 27222 ts_tablet_manager.cc:1397] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.063s user 0.014s sys 0.007s
I20260810 11:30:14.396250 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 952fc4eb5e5c4d9597f4b6eee860ab3a (table default.Table_45031e01640c41469cf6724429b043b7 [id=f7a8dbb4151a4e41b8f0c985a5f80149]) successfully deleted
I20260810 11:30:14.396925 27222 raft_consensus.cc:348] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.397325 27222 raft_consensus.cc:374] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:14.397481 27222 raft_consensus.cc:729] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:14.398041 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c6b3f8626724d12986f388b1ca90b3c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:14.397948 27231 raft_consensus.cc:348] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.396821 27325 raft_consensus.cc:504] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.399658 27248 raft_consensus.cc:2229] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:14.400017 27222 consensus_queue.cc:260] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.400693 27221 tablet_replica.cc:330] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:14.401341 27231 raft_consensus.cc:374] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:14.401903 26702 leader_election.cc:302] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:14.401525 27221 raft_consensus.cc:2229] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:14.401242 27222 ts_tablet_manager.cc:1428] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260810 11:30:14.402822 27386 raft_consensus.cc:2726] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:14.402992 27222 tablet_bootstrap.cc:492] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:14.404201 27385 raft_consensus.cc:482] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:14.410449 27231 raft_consensus.cc:729] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:14.410899 27383 raft_consensus.cc:482] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:14.411101 27383 raft_consensus.cc:504] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:14.413574 26993 leader_election.cc:341] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: c0120575c9fd4b2fb32ca7392db277bf
I20260810 11:30:14.414634 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dabfbd779c5406cb10ecf70f5a142e7" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:14.414988 26771 raft_consensus.cc:2454] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:14.415927 27221 raft_consensus.cc:2258] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:14.416898 27221 ts_tablet_manager.cc:1905] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:14.406955 27385 raft_consensus.cc:504] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.419214 26500 master_service.cc:946] ReplaceTablet: received request to replace tablet a28849649c704f2fbdec1aced9ce01b1 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:14.422719 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 2d7e745f05534917a5deecce410722e6 (table default.Table_59ed990b31964d6080614081ee46a6de [id=6d8fc88a491140548a45c7fbb403bb36]) successfully deleted
I20260810 11:30:14.423710 27248 pending_rounds.cc:62] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215: Trying to abort 1 pending ops.
I20260810 11:30:14.417587 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2732660f8964feeb5c03365df065a54" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:14.425176 26993 leader_election.cc:302] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:14.425751 27231 consensus_queue.cc:260] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.426728 27248 pending_rounds.cc:68] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936348517736448 op_type: NO_OP noop_request { }
I20260810 11:30:14.430233 27390 raft_consensus.cc:2781] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:14.430433 27390 raft_consensus.cc:482] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:14.430842 27390 raft_consensus.cc:3037] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:14.431761 27325 leader_election.cc:288] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:14.438726 27228 ts_tablet_manager.cc:1428] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.324s user 0.026s sys 0.089s
I20260810 11:30:14.439126 27385 leader_election.cc:288] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:14.441640 27222 tablet_bootstrap.cc:654] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:14.448011 27223 ts_tablet_manager.cc:1918] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:14.453055 27228 tablet_bootstrap.cc:492] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:14.460006 27223 log.cc:1196] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/b1cd64deb8e24c81ba2d4214bb38f5da
I20260810 11:30:14.436679 27390 raft_consensus.cc:504] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.462205 27223 ts_tablet_manager.cc:1939] T b1cd64deb8e24c81ba2d4214bb38f5da P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:14.467095 27248 raft_consensus.cc:2866] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:14.468405 27383 leader_election.cc:288] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:14.468745 27248 raft_consensus.cc:2258] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:14.469049 26991 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 356668us
I20260810 11:30:14.470793 27390 leader_election.cc:288] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:14.470613 27221 ts_tablet_manager.cc:1918] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 11:30:14.470481 27030 consensus_meta.cc:287] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215: Time spent flushing consensus metadata: real 0.608s user 0.007s sys 0.001s
I20260810 11:30:14.471575 27221 log.cc:1196] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/a9615b1ff3454a46a1a27cfcea20ad00
W20260810 11:30:14.471997 26991 leader_election.cc:341] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:14.473305 27248 ts_tablet_manager.cc:1905] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:14.474539 27221 ts_tablet_manager.cc:1939] T a9615b1ff3454a46a1a27cfcea20ad00 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:14.479290 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dabfbd779c5406cb10ecf70f5a142e7" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:14.480285 27228 tablet_bootstrap.cc:654] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:14.480851 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0120575c9fd4b2fb32ca7392db277bf" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:14.481695 27221 tablet_replica.cc:330] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:14.482925 27221 raft_consensus.cc:2229] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:14.483665 27390 consensus_queue.cc:1035] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:14.484402 27221 raft_consensus.cc:2258] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:14.487087 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dabfbd779c5406cb10ecf70f5a142e7" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:14.489918 27221 ts_tablet_manager.cc:1905] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:14.495638 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dabfbd779c5406cb10ecf70f5a142e7" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:14.496933 27231 ts_tablet_manager.cc:1428] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.103s user 0.003s sys 0.005s
I20260810 11:30:14.498073 27231 tablet_bootstrap.cc:492] T 6c5b650bc02f4fa393bada5b54c77f1f P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:14.500324 26771 raft_consensus.cc:3037] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:14.505069 26771 raft_consensus.cc:2454] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:14.507161 27228 tablet_bootstrap.cc:492] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:14.480927 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet a9615b1ff3454a46a1a27cfcea20ad00 (table default.Table_f8e4d0bbde74426ab975bf7b91029861 [id=a0e3fe57b37a415aa5123ca2199b9968]) successfully deleted
I20260810 11:30:14.507555 27228 ts_tablet_manager.cc:1397] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.067s user 0.005s sys 0.001s
W20260810 11:30:14.507972 26485 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 87973us
I20260810 11:30:14.508610 27228 raft_consensus.cc:348] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.509239 26496 master_service.cc:946] ReplaceTablet: received request to replace tablet 7e3707ae32624f6483866208321eefde from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:14.509621 27228 raft_consensus.cc:374] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:14.509755 27228 raft_consensus.cc:729] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:14.510039 27228 consensus_queue.cc:260] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.511250 27228 ts_tablet_manager.cc:1428] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 11:30:14.512404 27228 tablet_bootstrap.cc:492] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:14.463070 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet b1cd64deb8e24c81ba2d4214bb38f5da (table default.Table_7e1ff16472f842438c14184ab96741e1 [id=03dca1a3a16e42049c194a46978bbfec]) successfully deleted
W20260810 11:30:14.513616 26484 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 50604.6us
I20260810 11:30:14.514374 27228 tablet_bootstrap.cc:654] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:14.514622 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet debc114073e14ec1839c5c4c7c2f1f1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet debc114073e14ec1839c5c4c7c2f1f1e already in progress: creating tablet
W20260810 11:30:14.514935 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 3ff4e19071fc435fbae4490799325e37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ff4e19071fc435fbae4490799325e37 already in progress: creating tablet
W20260810 11:30:14.509003 26849 leader_election.cc:341] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 566bf0f68c2946a89203472786e82512
I20260810 11:30:14.522686 27221 ts_tablet_manager.cc:1918] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:14.524197 27221 log.cc:1196] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/2d7e745f05534917a5deecce410722e6
I20260810 11:30:14.525092 27221 ts_tablet_manager.cc:1939] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:14.525475 27231 tablet_bootstrap.cc:654] T 6c5b650bc02f4fa393bada5b54c77f1f P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:14.525522 26993 leader_election.cc:302] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:14.526068 27390 raft_consensus.cc:2781] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:14.526168 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 2d7e745f05534917a5deecce410722e6 (table default.Table_59ed990b31964d6080614081ee46a6de [id=6d8fc88a491140548a45c7fbb403bb36]) successfully deleted
I20260810 11:30:14.526265 27221 tablet_replica.cc:330] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:14.526337 27390 raft_consensus.cc:686] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:14.526578 27221 raft_consensus.cc:2229] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:14.526903 27221 raft_consensus.cc:2258] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:14.526841 27390 consensus_queue.cc:237] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:14.527348 26702 leader_election.cc:341] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 2d7e745f05534917a5deecce410722e6
I20260810 11:30:14.527516 26702 leader_election.cc:302] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
W20260810 11:30:14.527776 26702 raft_consensus.cc:2670] T 2d7e745f05534917a5deecce410722e6 P 443ec871f1ed4232b932ecfb0b18510d: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 11:30:14.528981 26702 leader_election.cc:341] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:14.529182 26702 leader_election.cc:302] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
W20260810 11:30:14.529455 26702 raft_consensus.cc:2670] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 11:30:14.529397 26496 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_73605ca3d8ed4b83bf92156282c66625" } new_table_name: "default.Table_d1e2aab042904f65803b1033aea22315" modify_external_catalogs: true
I20260810 11:30:14.530462 27221 ts_tablet_manager.cc:1905] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:14.531883 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_c6cf8c999ed14a31aff5a1de22594c1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:14.532675 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6cf8c999ed14a31aff5a1de22594c1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:14.538671 26991 leader_election.cc:341] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: a9615b1ff3454a46a1a27cfcea20ad00
W20260810 11:30:14.539312 26991 leader_election.cc:341] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:14.539674 26991 leader_election.cc:341] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:14.539831 26991 leader_election.cc:302] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
W20260810 11:30:14.540215 26991 leader_election.cc:341] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:14.541842 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 566bf0f68c2946a89203472786e82512 with delete_type TABLET_DATA_DELETED (replaced by tablet 69484fb371d14805a40b9bcebcfa4ab6) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:14.542222 27223 tablet_replica.cc:330] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:14.542460 27223 raft_consensus.cc:2229] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:14.542775 27223 raft_consensus.cc:2258] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:14.543566 27223 ts_tablet_manager.cc:1905] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:14.543779 26771 raft_consensus.cc:3037] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:14.549194 27383 raft_consensus.cc:2726] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260810 11:30:14.549959 26991 consensus_peers.cc:487] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1cd64deb8e24c81ba2d4214bb38f5da. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:14.553575 27405 tablet.cc:1722] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:14.554950 27228 tablet_bootstrap.cc:492] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:14.561036 27228 ts_tablet_manager.cc:1397] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.049s user 0.006s sys 0.003s
I20260810 11:30:14.562811 27222 tablet_bootstrap.cc:492] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:14.563428 27221 ts_tablet_manager.cc:1918] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:14.563877 27221 log.cc:1196] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/e2732660f8964feeb5c03365df065a54
I20260810 11:30:14.564505 27221 ts_tablet_manager.cc:1939] T e2732660f8964feeb5c03365df065a54 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:14.564893 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "566bf0f68c2946a89203472786e82512" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:14.565212 27228 raft_consensus.cc:348] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.565702 27228 raft_consensus.cc:374] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:14.565809 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet e2732660f8964feeb5c03365df065a54 (table default.Table_c2c10310e09d44fdae1c00c7997c03f1 [id=8ef1221306af485aa67dabbcd7079139]) successfully deleted
I20260810 11:30:14.565922 27228 raft_consensus.cc:729] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:14.566388 27221 tablet_replica.cc:330] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:14.566484 27228 consensus_queue.cc:260] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.566699 27221 raft_consensus.cc:2229] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:14.563476 27222 ts_tablet_manager.cc:1397] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.160s user 0.009s sys 0.013s
I20260810 11:30:14.566987 27221 raft_consensus.cc:2258] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:14.568027 27222 raft_consensus.cc:348] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.568480 27222 raft_consensus.cc:374] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:14.568645 27222 raft_consensus.cc:729] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:14.569018 27222 consensus_queue.cc:260] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.571395 27222 ts_tablet_manager.cc:1428] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 11:30:14.571763 27222 tablet_bootstrap.cc:492] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:14.572300 27248 ts_tablet_manager.cc:1918] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:14.574302 26498 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 6c5b650bc02f4fa393bada5b54c77f1f (table default.Table_c03b9743d9e8475dbb617d058873deae [id=3d8c46d7a15e457a93fd615ad99a4f36]). Expected version 3 got 0
I20260810 11:30:14.562528 27223 ts_tablet_manager.cc:1918] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:14.575003 27223 log.cc:1196] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/566bf0f68c2946a89203472786e82512
W20260810 11:30:14.575291 26496 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fbe0a0ab82a147a3b6164904b135d1ab consensus state has no leader
I20260810 11:30:14.575660 27223 ts_tablet_manager.cc:1939] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:14.578238 27228 ts_tablet_manager.cc:1428] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260810 11:30:14.578819 27228 tablet_bootstrap.cc:492] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:14.578903 26495 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_16866d33f78041fd9fdfdd14a4daf75e" } modify_external_catalogs: true
I20260810 11:30:14.579195 26495 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_16866d33f78041fd9fdfdd14a4daf75e" } modify_external_catalogs: true
I20260810 11:30:14.580914 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_61f0895109db4fec904812266ff49d81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:14.581761 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_105371a3c4b44933b4181df1297f6139"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:14.582700 27248 log.cc:1196] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/f05f2fc60d0f43f6a72fca16828f94f9
W20260810 11:30:14.581770 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61f0895109db4fec904812266ff49d81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.584040 26848 leader_election.cc:302] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
W20260810 11:30:14.584465 26848 raft_consensus.cc:2670] T 566bf0f68c2946a89203472786e82512 P b6079090b1124d84aa4477974bb53700: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 11:30:14.585386 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet debc114073e14ec1839c5c4c7c2f1f1e with delete_type TABLET_DATA_DELETED (replaced by tablet cb01e54d817c4b0dbcc80f90f82923c0) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.586836 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet 97d586d35ff144a681ad52756f4be2b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:14.591517 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_105371a3c4b44933b4181df1297f6139 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.592985 27228 tablet_bootstrap.cc:654] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:14.596081 27221 ts_tablet_manager.cc:1905] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:14.596774 27387 raft_consensus.cc:482] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:14.597513 27248 ts_tablet_manager.cc:1939] T f05f2fc60d0f43f6a72fca16828f94f9 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:14.597184 27387 raft_consensus.cc:504] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.598192 27387 leader_election.cc:288] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:14.596774 27222 tablet_bootstrap.cc:654] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:14.598719 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 87) took 1314 ms. Trace:
I20260810 11:30:14.598929 27248 rpcz_store.cc:276] 0810 11:30:13.283913 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:13.283983 (+ 70us) service_pool.cc:227] Handling call
0810 11:30:14.388895 (+1104912us) ts_tablet_manager.cc:1145] Deleting tablet f05f2fc60d0f43f6a72fca16828f94f9
0810 11:30:14.388913 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:14.549558 (+160645us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:14.572164 (+ 22606us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:14.598604 (+ 26440us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1104526}
I20260810 11:30:14.599244 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2efaf8b45a824e34b7f23037de5eec45" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:14.599973 27385 raft_consensus.cc:482] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:14.600158 27385 raft_consensus.cc:504] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.600776 27385 leader_election.cc:288] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:14.600809 26700 leader_election.cc:341] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:14.602336 26849 leader_election.cc:341] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 66a7790587ed478b843fa9e997e50893
I20260810 11:30:14.602996 27222 tablet_bootstrap.cc:492] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:14.603199 27222 ts_tablet_manager.cc:1397] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.004s
I20260810 11:30:14.604251 27222 raft_consensus.cc:348] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:14.607362 26848 leader_election.cc:341] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 66a7790587ed478b843fa9e997e50893
I20260810 11:30:14.607637 26848 leader_election.cc:302] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:14.608148 27385 raft_consensus.cc:2726] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:14.611268 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2efaf8b45a824e34b7f23037de5eec45" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:14.611466 27228 tablet_bootstrap.cc:492] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:14.611591 27060 raft_consensus.cc:2454] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:14.611675 27228 ts_tablet_manager.cc:1397] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.000s
I20260810 11:30:14.612663 27228 raft_consensus.cc:348] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.613157 26702 leader_election.cc:302] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:14.613595 27387 raft_consensus.cc:2781] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:14.613858 27387 raft_consensus.cc:482] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:14.613982 27387 raft_consensus.cc:3037] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:14.614128 27231 tablet_bootstrap.cc:492] T 6c5b650bc02f4fa393bada5b54c77f1f P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:14.614298 27231 ts_tablet_manager.cc:1397] T 6c5b650bc02f4fa393bada5b54c77f1f P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.117s user 0.005s sys 0.005s
I20260810 11:30:14.614603 27248 tablet_replica.cc:330] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:14.616217 27228 raft_consensus.cc:374] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:14.616674 27228 raft_consensus.cc:729] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:14.617264 27228 consensus_queue.cc:260] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.619450 27231 raft_consensus.cc:348] T 6c5b650bc02f4fa393bada5b54c77f1f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.619973 27231 raft_consensus.cc:374] T 6c5b650bc02f4fa393bada5b54c77f1f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:14.620432 27231 raft_consensus.cc:729] T 6c5b650bc02f4fa393bada5b54c77f1f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:14.620478 27228 ts_tablet_manager.cc:1428] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260810 11:30:14.621438 27248 raft_consensus.cc:2229] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:14.621833 27248 raft_consensus.cc:2258] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:14.623498 27228 tablet_bootstrap.cc:492] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:14.620852 27231 consensus_queue.cc:260] T 6c5b650bc02f4fa393bada5b54c77f1f P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.626374 26498 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_ccb396a7af014ac09a7c63585995ec26" } new_table_name: "default.Table_486a807b011648dc85baba92958a368a" modify_external_catalogs: true
I20260810 11:30:14.628829 27228 tablet_bootstrap.cc:654] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:14.628829 26492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 43e42cc642544f779bb79cee7479c4f4
I20260810 11:30:14.623237 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 566bf0f68c2946a89203472786e82512 (table default.Table_367660e7b3674b518a63fbba74bcca1d [id=a2d890f4b9874411a503888263d07d18]) successfully deleted
I20260810 11:30:14.628939 27231 ts_tablet_manager.cc:1428] T 6c5b650bc02f4fa393bada5b54c77f1f P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
W20260810 11:30:14.628991 26484 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 45415.9us
I20260810 11:30:14.629871 26495 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 4b15cc8669b549a2b4461dccd66a0c5a
I20260810 11:30:14.630838 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_10b1b7ecd6ab43dfab0e6a29facddaf7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:14.631479 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10b1b7ecd6ab43dfab0e6a29facddaf7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.632247 27248 ts_tablet_manager.cc:1905] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:14.632791 27231 tablet_bootstrap.cc:492] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:14.630440 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 3ddb6e67c316416681074e454ab9b01e (DEFAULT_TABLE table=default.Table_3c5493f70dc44bab811f7605b20c81b7 [id=755202f095f04307a11ce87087df835c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.635396 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ddb6e67c316416681074e454ab9b01e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.635970 26888 tablet_service.cc:1467] Processing CreateTablet for tablet 08f6636df13548c49f35e1808a87c1f5 (DEFAULT_TABLE table=default.Table_ea17bd161fdb4c2c9603590515c75bf4 [id=66896ad6c415489da386ea5ab2702ad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.636497 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08f6636df13548c49f35e1808a87c1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.630730 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 66a7790587ed478b843fa9e997e50893 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:14.630978 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 43e42cc642544f779bb79cee7479c4f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:14.636861 27223 tablet_replica.cc:330] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:14.634250 26887 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b15cc8669b549a2b4461dccd66a0c5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:14.637406 27223 raft_consensus.cc:2229] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:14.640007 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 60d56e162b4b41e2867ac845e524aca4 (DEFAULT_TABLE table=default.Table_4d9bc84fc41e4b87ac2f6432852e5d61 [id=9b708c86ff534253961e7c29909eb1bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.643378 27231 tablet_bootstrap.cc:654] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:14.645081 27222 raft_consensus.cc:374] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:14.647172 26745 tablet_service.cc:1467] Processing CreateTablet for tablet 3ddb6e67c316416681074e454ab9b01e (DEFAULT_TABLE table=default.Table_3c5493f70dc44bab811f7605b20c81b7 [id=755202f095f04307a11ce87087df835c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.648209 26746 tablet_service.cc:1467] Processing CreateTablet for tablet 08f6636df13548c49f35e1808a87c1f5 (DEFAULT_TABLE table=default.Table_ea17bd161fdb4c2c9603590515c75bf4 [id=66896ad6c415489da386ea5ab2702ad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.648891 26734 tablet_service.cc:1467] Processing CreateTablet for tablet 5adcec593b8c4d40997c8911e9f77c85 (DEFAULT_TABLE table=default.Table_bb3131b0059a44d68866825f94543d0f [id=8de05bfacc2e40dda2832803fa5b69d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.650056 27222 raft_consensus.cc:729] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:14.650413 27222 consensus_queue.cc:260] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.650851 27037 tablet_service.cc:1467] Processing CreateTablet for tablet 08f6636df13548c49f35e1808a87c1f5 (DEFAULT_TABLE table=default.Table_ea17bd161fdb4c2c9603590515c75bf4 [id=66896ad6c415489da386ea5ab2702ad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.650995 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet f05f2fc60d0f43f6a72fca16828f94f9 (table default.Table_c6f8501fb26f49688f4c9e7c3cabc233 [id=8d5da0e5fab74127880f199687b0d3eb]) successfully deleted
I20260810 11:30:14.651221 26745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ddb6e67c316416681074e454ab9b01e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.651451 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08f6636df13548c49f35e1808a87c1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.651523 27030 tablet_service.cc:1467] Processing CreateTablet for tablet 3ddb6e67c316416681074e454ab9b01e (DEFAULT_TABLE table=default.Table_3c5493f70dc44bab811f7605b20c81b7 [id=755202f095f04307a11ce87087df835c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.651943 27030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ddb6e67c316416681074e454ab9b01e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.652701 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 43e42cc642544f779bb79cee7479c4f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.653013 26739 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b15cc8669b549a2b4461dccd66a0c5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.653434 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5adcec593b8c4d40997c8911e9f77c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.656055 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 43e42cc642544f779bb79cee7479c4f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:14.656387 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b15cc8669b549a2b4461dccd66a0c5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:14.656889 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08f6636df13548c49f35e1808a87c1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.656976 27023 tablet_service.cc:1467] Processing CreateTablet for tablet 4b15cc8669b549a2b4461dccd66a0c5a (DEFAULT_TABLE table=default.Table_16866d33f78041fd9fdfdd14a4daf75e [id=3ed241516c2f474c818b0b4e77ae4bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.657444 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b15cc8669b549a2b4461dccd66a0c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.661736 27035 tablet_service.cc:1467] Processing CreateTablet for tablet 60d56e162b4b41e2867ac845e524aca4 (DEFAULT_TABLE table=default.Table_4d9bc84fc41e4b87ac2f6432852e5d61 [id=9b708c86ff534253961e7c29909eb1bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.662209 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60d56e162b4b41e2867ac845e524aca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.664657 27221 ts_tablet_manager.cc:1918] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:14.664863 27221 log.cc:1196] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/fc2d129e99f24c018e4f8e43f211171d
I20260810 11:30:14.664939 27025 tablet_service.cc:1467] Processing CreateTablet for tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e (DEFAULT_TABLE table=default.Table_b0ce306dde7b412c8fa2bda65c94c917 [id=b1d90eb4a63941fd83313166eed533dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.665382 27221 ts_tablet_manager.cc:1939] T fc2d129e99f24c018e4f8e43f211171d P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:14.665439 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.666442 27221 tablet_replica.cc:330] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:14.666677 27221 raft_consensus.cc:2229] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:14.666884 27221 raft_consensus.cc:2258] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:14.667490 27221 ts_tablet_manager.cc:1905] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:14.667445 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_66e65dd65397474eb930c06f62324822"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:14.668236 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66e65dd65397474eb930c06f62324822 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.669142 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 9311943eebaa4824bde96b4cb09f1e2c (DEFAULT_TABLE table=default.Table_547fe3fa37ab46aab94789c556ec37d7 [id=7413e4ae5b8b4ccd904917ec2adbf8f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.669651 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9311943eebaa4824bde96b4cb09f1e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.671604 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_1862cecf49a0499eabbbfba587daf808"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:14.672370 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1862cecf49a0499eabbbfba587daf808 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.672992 27024 tablet_service.cc:1467] Processing CreateTablet for tablet eed0e2bead85466ca99cfb34e155a391 (DEFAULT_TABLE table=default.Table_21f03834771d4035b46d7d400c951408 [id=d5f9b9e6462d44fe91ee6944c4fc8743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.673472 27024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed0e2bead85466ca99cfb34e155a391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.677315 26500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet a28849649c704f2fbdec1aced9ce01b1
I20260810 11:30:14.677907 26500 catalog_manager.cc:6565] ReplaceTablet: tablet a28849649c704f2fbdec1aced9ce01b1 deleted and replaced by tablet eb9394f9ca2c44de93354e23973cf902
I20260810 11:30:14.661157 27038 tablet_service.cc:1467] Processing CreateTablet for tablet 5adcec593b8c4d40997c8911e9f77c85 (DEFAULT_TABLE table=default.Table_bb3131b0059a44d68866825f94543d0f [id=8de05bfacc2e40dda2832803fa5b69d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.679399 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5adcec593b8c4d40997c8911e9f77c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.680130 26500 master_service.cc:946] ReplaceTablet: received request to replace tablet 2c6b3f8626724d12986f388b1ca90b3c from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:14.681887 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 60d56e162b4b41e2867ac845e524aca4 (DEFAULT_TABLE table=default.Table_4d9bc84fc41e4b87ac2f6432852e5d61 [id=9b708c86ff534253961e7c29909eb1bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.683318 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60d56e162b4b41e2867ac845e524aca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.684648 27022 tablet_service.cc:1467] Processing CreateTablet for tablet fdbe21b4f124411988dd35a0b864f868 (DEFAULT_TABLE table=default.Table_281d7f104c494df79d4a5d26745bfe87 [id=8163ad85405f4f18bb06706c5d66fb57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.684998 26501 master_service.cc:946] ReplaceTablet: received request to replace tablet db5adccd80a04e328e13793b461c38b1 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:14.685288 27029 tablet_service.cc:1467] Processing CreateTablet for tablet a7a2cb1d2e8e40f58144908e34438d53 (DEFAULT_TABLE table=default.Table_05a7698994184d6bbed238252235f5f8 [id=7d1bf48b16db41a0a41a092bb07b8753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.685559 27034 tablet_service.cc:1467] Processing CreateTablet for tablet 23d8ce485cb84495a6e964b6d5977f0d (DEFAULT_TABLE table=default.Table_1ff9ed629e8b465e9ac5588ad616105a [id=75fe62ca5f6448c38b7f9f683cb932b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.685679 26501 master_service.cc:946] ReplaceTablet: received request to replace tablet 2fc76603bf8843dab18c95fdab9a8be0 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:14.685983 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdbe21b4f124411988dd35a0b864f868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.686422 27020 tablet_service.cc:1467] Processing CreateTablet for tablet eb51618d37ac488fa7e3d23e5f85ec36 (DEFAULT_TABLE table=default.Table_7466a225b5ae492ab3ac3cf5d74a360f [id=696bbe0dbb864163b77ab537e2700f7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.686483 26740 tablet_service.cc:1467] Processing CreateTablet for tablet 9311943eebaa4824bde96b4cb09f1e2c (DEFAULT_TABLE table=default.Table_547fe3fa37ab46aab94789c556ec37d7 [id=7413e4ae5b8b4ccd904917ec2adbf8f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.686753 27386 raft_consensus.cc:482] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:14.686954 27020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb51618d37ac488fa7e3d23e5f85ec36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.686956 27386 raft_consensus.cc:504] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.688452 27386 leader_election.cc:288] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:14.688771 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d8ce485cb84495a6e964b6d5977f0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.689396 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e (DEFAULT_TABLE table=default.Table_b0ce306dde7b412c8fa2bda65c94c917 [id=b1d90eb4a63941fd83313166eed533dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.690127 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.690800 27029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7a2cb1d2e8e40f58144908e34438d53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.691668 26735 tablet_service.cc:1467] Processing CreateTablet for tablet 4b15cc8669b549a2b4461dccd66a0c5a (DEFAULT_TABLE table=default.Table_16866d33f78041fd9fdfdd14a4daf75e [id=3ed241516c2f474c818b0b4e77ae4bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.696404 26742 tablet_service.cc:1467] Processing CreateTablet for tablet 23d8ce485cb84495a6e964b6d5977f0d (DEFAULT_TABLE table=default.Table_1ff9ed629e8b465e9ac5588ad616105a [id=75fe62ca5f6448c38b7f9f683cb932b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.697467 26738 tablet_service.cc:1467] Processing CreateTablet for tablet a7a2cb1d2e8e40f58144908e34438d53 (DEFAULT_TABLE table=default.Table_05a7698994184d6bbed238252235f5f8 [id=7d1bf48b16db41a0a41a092bb07b8753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.698019 26744 tablet_service.cc:1467] Processing CreateTablet for tablet fdbe21b4f124411988dd35a0b864f868 (DEFAULT_TABLE table=default.Table_281d7f104c494df79d4a5d26745bfe87 [id=8163ad85405f4f18bb06706c5d66fb57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.698859 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet fc2d129e99f24c018e4f8e43f211171d (table default.Table_38150fc48b7148a8bc17eb85f039d7b3 [id=b54ba03677734f2da90a534a0f5ff58e]) successfully deleted
I20260810 11:30:14.699751 26739 tablet_service.cc:1467] Processing CreateTablet for tablet 02ff6a9bc02441ddb7f307d6b3df31bd (DEFAULT_TABLE table=default.Table_5f8ecc7877924d0f9871dd16aaeafdde [id=e1ca02b3f3f94632843632a15fc19245]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.700172 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9311943eebaa4824bde96b4cb09f1e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.701319 26496 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_43cc516b2fe54a6fa15f523ffc165a03" } new_table_name: "default.Table_3403e0aa460b41f3ade41237a10b4119" modify_external_catalogs: true
W20260810 11:30:14.703028 26484 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 96cae4eb16c84410926a317af70e44f7 (table default.Table_bd735fb392144c6b97d5678685645108 [id=b471e1c958484bbc95c4cbb4c79bea91], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 96cae4eb16c84410926a317af70e44f7 consensus state has no leader
I20260810 11:30:14.702947 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ccef06fa06c4c519d8760fa948d6c8b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:14.703111 26498 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd3575197c464c7fb51f9592831959bb consensus state has no leader
I20260810 11:30:14.703481 26498 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_9e41e60880114afb97c4ffb0dbf0aa6b" } new_table_name: "default.Table_c43e3d237aaf451cb24c817b76bbba8a" modify_external_catalogs: true
W20260810 11:30:14.704282 26702 leader_election.cc:341] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:14.704599 26738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7a2cb1d2e8e40f58144908e34438d53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.705194 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet e25ae21cc8cc4749a507fcab5ee225a3
I20260810 11:30:14.705895 27039 tablet_service.cc:1467] Processing CreateTablet for tablet cb01e54d817c4b0dbcc80f90f82923c0 (DEFAULT_TABLE table=default.Table_14fdf4f2b306464d848549d724acb47e [id=49171f94f6254f3f8e02643ee05e6e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.706202 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_891d3f4e3019401fbb1b13496065cb5c" } modify_external_catalogs: true
I20260810 11:30:14.706442 27039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb01e54d817c4b0dbcc80f90f82923c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.706465 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_891d3f4e3019401fbb1b13496065cb5c" } modify_external_catalogs: true
I20260810 11:30:14.707806 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 0938a2f3688246a2b46978eeb7d5d521 (DEFAULT_TABLE table=default.Table_e15e0bcf194a490495cfd17ad551958b [id=45a883ca6cbe441bb7fffa52c88f423d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.709205 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_061b7dfbcc074ad6a0d99d49113a354f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:14.710170 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_061b7dfbcc074ad6a0d99d49113a354f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.710558 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdbe21b4f124411988dd35a0b864f868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.710737 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0938a2f3688246a2b46978eeb7d5d521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.712538 27387 raft_consensus.cc:504] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.713810 26739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02ff6a9bc02441ddb7f307d6b3df31bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.714895 27387 leader_election.cc:288] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:14.722021 26495 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_79d9e439271348b78d91981da7521fdb" } new_table_name: "default.Table_cbf7fb0f0585465a9be24fa7e70d68d2" modify_external_catalogs: true
I20260810 11:30:14.723415 27223 raft_consensus.cc:2258] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:14.723546 27027 tablet_service.cc:1514] Processing DeleteTablet for tablet a28849649c704f2fbdec1aced9ce01b1 with delete_type TABLET_DATA_DELETED (replaced by tablet eb9394f9ca2c44de93354e23973cf902) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:14.725209 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d8ce485cb84495a6e964b6d5977f0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.729869 26493 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet d729baae40a64e6e8c23e6870f230afb
I20260810 11:30:14.730747 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2efaf8b45a824e34b7f23037de5eec45" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:14.731742 27060 raft_consensus.cc:3037] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:14.731527 27037 tablet_service.cc:1467] Processing CreateTablet for tablet 02ff6a9bc02441ddb7f307d6b3df31bd (DEFAULT_TABLE table=default.Table_5f8ecc7877924d0f9871dd16aaeafdde [id=e1ca02b3f3f94632843632a15fc19245]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.733527 26887 tablet_service.cc:1467] Processing CreateTablet for tablet 4b15cc8669b549a2b4461dccd66a0c5a (DEFAULT_TABLE table=default.Table_16866d33f78041fd9fdfdd14a4daf75e [id=3ed241516c2f474c818b0b4e77ae4bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.735388 26890 tablet_service.cc:1467] Processing CreateTablet for tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e (DEFAULT_TABLE table=default.Table_b0ce306dde7b412c8fa2bda65c94c917 [id=b1d90eb4a63941fd83313166eed533dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.736326 27223 ts_tablet_manager.cc:1905] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:14.736505 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60d56e162b4b41e2867ac845e524aca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.736364 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_be173a149b464952b17280eb1fe40667"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:14.736857 26890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:14.737040 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be173a149b464952b17280eb1fe40667 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.738642 26501 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 2fc76603bf8843dab18c95fdab9a8be0
I20260810 11:30:14.734978 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 5adcec593b8c4d40997c8911e9f77c85 (DEFAULT_TABLE table=default.Table_bb3131b0059a44d68866825f94543d0f [id=8de05bfacc2e40dda2832803fa5b69d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.739252 26501 catalog_manager.cc:6565] ReplaceTablet: tablet 2fc76603bf8843dab18c95fdab9a8be0 deleted and replaced by tablet 2ffc2c43885841d2a6a4cce52eaf7129
I20260810 11:30:14.740099 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_7429a35104ec4048afb265a7bf71f5b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:14.740896 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7429a35104ec4048afb265a7bf71f5b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.741098 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet a28849649c704f2fbdec1aced9ce01b1 with delete_type TABLET_DATA_DELETED (replaced by tablet eb9394f9ca2c44de93354e23973cf902) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.741577 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ccef06fa06c4c519d8760fa948d6c8b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:14.742020 26879 tablet_service.cc:1467] Processing CreateTablet for tablet eed0e2bead85466ca99cfb34e155a391 (DEFAULT_TABLE table=default.Table_21f03834771d4035b46d7d400c951408 [id=d5f9b9e6462d44fe91ee6944c4fc8743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.742040 26745 tablet_service.cc:1467] Processing CreateTablet for tablet eed0e2bead85466ca99cfb34e155a391 (DEFAULT_TABLE table=default.Table_21f03834771d4035b46d7d400c951408 [id=d5f9b9e6462d44fe91ee6944c4fc8743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.743013 26877 tablet_service.cc:1467] Processing CreateTablet for tablet 9311943eebaa4824bde96b4cb09f1e2c (DEFAULT_TABLE table=default.Table_547fe3fa37ab46aab94789c556ec37d7 [id=7413e4ae5b8b4ccd904917ec2adbf8f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.743590 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_057f1bf3995143138dd2954a212a480b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:14.744179 26887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b15cc8669b549a2b4461dccd66a0c5a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:14.744666 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_057f1bf3995143138dd2954a212a480b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.747364 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5adcec593b8c4d40997c8911e9f77c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.747587 26876 tablet_service.cc:1467] Processing CreateTablet for tablet 02ff6a9bc02441ddb7f307d6b3df31bd (DEFAULT_TABLE table=default.Table_5f8ecc7877924d0f9871dd16aaeafdde [id=e1ca02b3f3f94632843632a15fc19245]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.745865 26746 tablet_service.cc:1467] Processing CreateTablet for tablet eb51618d37ac488fa7e3d23e5f85ec36 (DEFAULT_TABLE table=default.Table_7466a225b5ae492ab3ac3cf5d74a360f [id=696bbe0dbb864163b77ab537e2700f7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.748265 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b15cc8669b549a2b4461dccd66a0c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.749279 26876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02ff6a9bc02441ddb7f307d6b3df31bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.750290 26877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9311943eebaa4824bde96b4cb09f1e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.751634 26879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed0e2bead85466ca99cfb34e155a391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.752635 26878 tablet_service.cc:1467] Processing CreateTablet for tablet fdbe21b4f124411988dd35a0b864f868 (DEFAULT_TABLE table=default.Table_281d7f104c494df79d4a5d26745bfe87 [id=8163ad85405f4f18bb06706c5d66fb57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.754190 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdbe21b4f124411988dd35a0b864f868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.757261 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb51618d37ac488fa7e3d23e5f85ec36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.757593 27222 ts_tablet_manager.cc:1428] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.154s user 0.000s sys 0.008s
I20260810 11:30:14.758038 27222 tablet_bootstrap.cc:492] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:14.760614 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02ff6a9bc02441ddb7f307d6b3df31bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.761001 27038 tablet_service.cc:1467] Processing CreateTablet for tablet 587c6ce242c0411b886404a0df03b1bb (DEFAULT_TABLE table=default.Table_0d757328d26e45dba1be7c8a88565727 [id=1ae6d36bfe0e427a9a996dff3cdccc91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.761576 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 587c6ce242c0411b886404a0df03b1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.770466 26892 tablet_service.cc:1467] Processing CreateTablet for tablet eb51618d37ac488fa7e3d23e5f85ec36 (DEFAULT_TABLE table=default.Table_7466a225b5ae492ab3ac3cf5d74a360f [id=696bbe0dbb864163b77ab537e2700f7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.768493 27027 tablet_service.cc:1514] Processing DeleteTablet for tablet e25ae21cc8cc4749a507fcab5ee225a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:14.774787 26892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb51618d37ac488fa7e3d23e5f85ec36. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:14.778277 26496 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2ffc2c43885841d2a6a4cce52eaf7129 has no consensus state
W20260810 11:30:14.780999 26498 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f2b555f18c1e485d9af7b08f98543c80 has no consensus state
I20260810 11:30:14.781046 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet a28849649c704f2fbdec1aced9ce01b1 with delete_type TABLET_DATA_DELETED (replaced by tablet eb9394f9ca2c44de93354e23973cf902) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:14.781714 26885 tablet_service.cc:1467] Processing CreateTablet for tablet 23d8ce485cb84495a6e964b6d5977f0d (DEFAULT_TABLE table=default.Table_1ff9ed629e8b465e9ac5588ad616105a [id=75fe62ca5f6448c38b7f9f683cb932b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.784014 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d8ce485cb84495a6e964b6d5977f0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.787274 26734 tablet_service.cc:1467] Processing CreateTablet for tablet cb01e54d817c4b0dbcc80f90f82923c0 (DEFAULT_TABLE table=default.Table_14fdf4f2b306464d848549d724acb47e [id=49171f94f6254f3f8e02643ee05e6e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.787497 26500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 2c6b3f8626724d12986f388b1ca90b3c
I20260810 11:30:14.788311 26881 tablet_service.cc:1467] Processing CreateTablet for tablet a7a2cb1d2e8e40f58144908e34438d53 (DEFAULT_TABLE table=default.Table_05a7698994184d6bbed238252235f5f8 [id=7d1bf48b16db41a0a41a092bb07b8753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.788902 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7a2cb1d2e8e40f58144908e34438d53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.789206 26500 catalog_manager.cc:6565] ReplaceTablet: tablet 2c6b3f8626724d12986f388b1ca90b3c deleted and replaced by tablet e8dc3dece9d84d47a638707d10de6fd4
I20260810 11:30:14.790140 26745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed0e2bead85466ca99cfb34e155a391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.791170 26501 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 6c5b650bc02f4fa393bada5b54c77f1f (table default.Table_c03b9743d9e8475dbb617d058873deae [id=3d8c46d7a15e457a93fd615ad99a4f36]). Expected version 3 got 0
I20260810 11:30:14.796072 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb01e54d817c4b0dbcc80f90f82923c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.793679 27434 raft_consensus.cc:482] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 11:30:14.797430 26700 leader_election.cc:341] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:14.797818 27387 raft_consensus.cc:482] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:14.803686 27222 tablet_bootstrap.cc:654] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:14.814144 26882 tablet_service.cc:1514] Processing DeleteTablet for tablet c0120575c9fd4b2fb32ca7392db277bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:14.813370 27434 raft_consensus.cc:504] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.816464 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 31cafb7c691d40a48a40f7d4190c4f8d
I20260810 11:30:14.817255 27385 raft_consensus.cc:482] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:14.817668 27434 leader_election.cc:288] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:14.815847 26700 leader_election.cc:302] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:14.798025 27387 raft_consensus.cc:504] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.822882 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet 31cafb7c691d40a48a40f7d4190c4f8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:35790
W20260810 11:30:14.824975 26486 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.254:41125, user_credentials={real_user=slave}} blocked reactor thread for 50456.4us
I20260810 11:30:14.825584 27385 raft_consensus.cc:504] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.826431 27385 leader_election.cc:288] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:14.826782 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2efaf8b45a824e34b7f23037de5eec45" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:14.828702 27387 leader_election.cc:288] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:14.833820 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet a8197318b04a470791dd639742547fce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:10 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:14.836783 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet 607b055f8ced4372800adf5817b46e0b with delete_type TABLET_DATA_DELETED (replaced by tablet e25ae21cc8cc4749a507fcab5ee225a3) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:14.825681 27021 tablet_service.cc:1467] Processing CreateTablet for tablet cd3575197c464c7fb51f9592831959bb (DEFAULT_TABLE table=default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.845043 27025 tablet_service.cc:1467] Processing CreateTablet for tablet 43e42cc642544f779bb79cee7479c4f4 (DEFAULT_TABLE table=default.Table_38ce4003d8e84bec8c910d35efb2a64e [id=9a87e462e8834e0ab7d9a8ae87f06e09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.845211 27434 raft_consensus.cc:2726] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:14.846093 27027 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c6b3f8626724d12986f388b1ca90b3c with delete_type TABLET_DATA_DELETED (replaced by tablet e8dc3dece9d84d47a638707d10de6fd4) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:14.846784 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0120575c9fd4b2fb32ca7392db277bf" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:14.847164 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd3575197c464c7fb51f9592831959bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.849267 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43e42cc642544f779bb79cee7479c4f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.845781 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fc76603bf8843dab18c95fdab9a8be0 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ffc2c43885841d2a6a4cce52eaf7129) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:14.851400 27061 raft_consensus.cc:2379] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
I20260810 11:30:14.853082 26738 tablet_service.cc:1467] Processing CreateTablet for tablet 587c6ce242c0411b886404a0df03b1bb (DEFAULT_TABLE table=default.Table_0d757328d26e45dba1be7c8a88565727 [id=1ae6d36bfe0e427a9a996dff3cdccc91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.853839 26738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 587c6ce242c0411b886404a0df03b1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.854420 26882 tablet_service.cc:1467] Processing CreateTablet for tablet cb01e54d817c4b0dbcc80f90f82923c0 (DEFAULT_TABLE table=default.Table_14fdf4f2b306464d848549d724acb47e [id=49171f94f6254f3f8e02643ee05e6e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.854899 26882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb01e54d817c4b0dbcc80f90f82923c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.858129 26880 tablet_service.cc:1514] Processing DeleteTablet for tablet e25ae21cc8cc4749a507fcab5ee225a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:14.858752 26491 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_281d7f104c494df79d4a5d26745bfe87" } new_table_name: "default.Table_45c04b6c4bae413795c491f49f2b4bcd" modify_external_catalogs: true
I20260810 11:30:14.858686 26501 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_66e65dd65397474eb930c06f62324822" } modify_external_catalogs: true
I20260810 11:30:14.861073 26501 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_66e65dd65397474eb930c06f62324822" } modify_external_catalogs: true
I20260810 11:30:14.861853 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 0938a2f3688246a2b46978eeb7d5d521 (DEFAULT_TABLE table=default.Table_e15e0bcf194a490495cfd17ad551958b [id=45a883ca6cbe441bb7fffa52c88f423d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.859153 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet e25ae21cc8cc4749a507fcab5ee225a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.865661 26741 tablet_service.cc:1467] Processing CreateTablet for tablet 43e42cc642544f779bb79cee7479c4f4 (DEFAULT_TABLE table=default.Table_38ce4003d8e84bec8c910d35efb2a64e [id=9a87e462e8834e0ab7d9a8ae87f06e09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.866304 26741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43e42cc642544f779bb79cee7479c4f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.868043 26893 tablet_service.cc:1467] Processing CreateTablet for tablet 0938a2f3688246a2b46978eeb7d5d521 (DEFAULT_TABLE table=default.Table_e15e0bcf194a490495cfd17ad551958b [id=45a883ca6cbe441bb7fffa52c88f423d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:14.871115 26849 leader_election.cc:341] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: c0120575c9fd4b2fb32ca7392db277bf
I20260810 11:30:14.873584 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0938a2f3688246a2b46978eeb7d5d521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.870011 27060 raft_consensus.cc:2454] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:14.878916 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_3fa15e611b874bf787b51bdd990bac12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:14.880081 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fa15e611b874bf787b51bdd990bac12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.880878 26498 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_7466a225b5ae492ab3ac3cf5d74a360f" } modify_external_catalogs: true
I20260810 11:30:14.881117 26498 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_7466a225b5ae492ab3ac3cf5d74a360f" } modify_external_catalogs: true
I20260810 11:30:14.881107 26702 leader_election.cc:302] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:14.846421 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "256af4222bb34745ac018dd82a9c4f9b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:14.891888 27434 raft_consensus.cc:2781] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:14.892163 27434 raft_consensus.cc:686] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:14.892831 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0938a2f3688246a2b46978eeb7d5d521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.881443 26748 tablet_service.cc:1467] Processing CreateTablet for tablet cd3575197c464c7fb51f9592831959bb (DEFAULT_TABLE table=default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.894341 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_126d22557d424ec99a65925d97b5722a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:14.895071 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_126d22557d424ec99a65925d97b5722a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:14.895447 26700 leader_election.cc:341] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:14.895479 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet d729baae40a64e6e8c23e6870f230afb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.895866 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c6b3f8626724d12986f388b1ca90b3c with delete_type TABLET_DATA_DELETED (replaced by tablet e8dc3dece9d84d47a638707d10de6fd4) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.896104 26747 tablet_service.cc:1514] Processing DeleteTablet for tablet 31cafb7c691d40a48a40f7d4190c4f8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.873359 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c5b650bc02f4fa393bada5b54c77f1f" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:14.896981 27058 raft_consensus.cc:2454] T 6c5b650bc02f4fa393bada5b54c77f1f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:14.897336 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet d729baae40a64e6e8c23e6870f230afb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:14.897637 27248 ts_tablet_manager.cc:1918] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:14.900267 27248 log.cc:1196] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/417f48ddea6440a5a86fa05f7e514005
I20260810 11:30:14.900919 27248 ts_tablet_manager.cc:1939] T 417f48ddea6440a5a86fa05f7e514005 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:14.901081 26702 leader_election.cc:302] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:14.894526 27059 raft_consensus.cc:2454] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:14.902173 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 88) took 1493 ms. Trace:
I20260810 11:30:14.902711 26702 leader_election.cc:302] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:14.903214 27386 raft_consensus.cc:2781] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:14.903419 27386 raft_consensus.cc:482] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:14.903685 27386 raft_consensus.cc:3037] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:14.904609 27387 raft_consensus.cc:2781] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:14.905337 27387 raft_consensus.cc:482] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:14.905522 27387 raft_consensus.cc:3037] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:14.908835 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd3575197c464c7fb51f9592831959bb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:14.912076 26495 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a87f6835f0dc4ad4b3a23b297726100d has no consensus state
W20260810 11:30:14.912467 26491 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fdbe21b4f124411988dd35a0b864f868 consensus state has no leader
I20260810 11:30:14.912722 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fc76603bf8843dab18c95fdab9a8be0 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ffc2c43885841d2a6a4cce52eaf7129) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.912668 27434 consensus_queue.cc:237] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.924108 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_3403e0aa460b41f3ade41237a10b4119" } modify_external_catalogs: true
I20260810 11:30:14.924369 26495 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_14fdf4f2b306464d848549d724acb47e" } new_table_name: "default.Table_7bb952472de04323b2d5dfcc6ced359e" modify_external_catalogs: true
I20260810 11:30:14.924647 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_3403e0aa460b41f3ade41237a10b4119" } modify_external_catalogs: true
I20260810 11:30:14.926409 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_05e208843c2f40e6adbf28e17b7156cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:14.927202 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05e208843c2f40e6adbf28e17b7156cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.928990 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_f5acadd3f7ff49d4883a695e2348164f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:14.929804 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5acadd3f7ff49d4883a695e2348164f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.933789 27221 ts_tablet_manager.cc:1918] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:14.933878 26501 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet a0beb2fb8c294b6dbe14f13f42e53499
I20260810 11:30:14.934397 26498 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet eb51618d37ac488fa7e3d23e5f85ec36
I20260810 11:30:14.937553 26496 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_1ff9ed629e8b465e9ac5588ad616105a" } modify_external_catalogs: true
I20260810 11:30:14.937870 26496 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_1ff9ed629e8b465e9ac5588ad616105a" } modify_external_catalogs: true
I20260810 11:30:14.940546 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_ad62ebe50ede4d7d96922bac3e954f9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:14.939267 26848 leader_election.cc:302] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
W20260810 11:30:14.941434 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad62ebe50ede4d7d96922bac3e954f9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.941593 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_e930e7d079ef4035bde1d9a4ef134d62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:14.942026 26883 tablet_service.cc:1467] Processing CreateTablet for tablet cd3575197c464c7fb51f9592831959bb (DEFAULT_TABLE table=default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:14.942080 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 88930.8us
W20260810 11:30:14.942351 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e930e7d079ef4035bde1d9a4ef134d62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:14.943127 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd3575197c464c7fb51f9592831959bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.944069 27387 raft_consensus.cc:504] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:14.944994 27387 leader_election.cc:288] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:14.946583 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "256af4222bb34745ac018dd82a9c4f9b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:14.947152 27385 raft_consensus.cc:3037] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:14.949697 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "256af4222bb34745ac018dd82a9c4f9b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:14.949774 26880 tablet_service.cc:1467] Processing CreateTablet for tablet 587c6ce242c0411b886404a0df03b1bb (DEFAULT_TABLE table=default.Table_0d757328d26e45dba1be7c8a88565727 [id=1ae6d36bfe0e427a9a996dff3cdccc91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.950001 27059 raft_consensus.cc:3037] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:14.951833 27442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.195.254:41125 every 8 connection(s)
I20260810 11:30:14.952816 27194 rpc_server.cc:307] RPC server started. Bound to: 127.25.195.254:41125
I20260810 11:30:14.953461 27248 rpcz_store.cc:276] 0810 11:30:13.408684 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:13.409531 (+ 847us) service_pool.cc:227] Handling call
0810 11:30:14.599435 (+1189904us) ts_tablet_manager.cc:1145] Deleting tablet 417f48ddea6440a5a86fa05f7e514005
0810 11:30:14.599447 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:14.709907 (+110460us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:14.879862 (+169955us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:14.902128 (+ 22266us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1189605}
I20260810 11:30:14.954732 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 417f48ddea6440a5a86fa05f7e514005 (table default.Table_c43921fb6a024b50b218fad3b85e6904 [id=982ed623ee924e059c884584da03c56a]) successfully deleted
I20260810 11:30:14.959434 27194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-0/data/info.pb
I20260810 11:30:14.959731 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet eb51618d37ac488fa7e3d23e5f85ec36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:14.962059 26383 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu as pid 27194
I20260810 11:30:14.962551 27248 tablet_replica.cc:330] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:14.966735 26495 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cb01e54d817c4b0dbcc80f90f82923c0 consensus state has no leader
I20260810 11:30:14.968606 27221 log.cc:1196] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/3dabfbd779c5406cb10ecf70f5a142e7
I20260810 11:30:14.942034 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c5b650bc02f4fa393bada5b54c77f1f" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:14.974990 26735 tablet_service.cc:1514] Processing DeleteTablet for tablet eb51618d37ac488fa7e3d23e5f85ec36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:14.979806 27221 ts_tablet_manager.cc:1939] T 3dabfbd779c5406cb10ecf70f5a142e7 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:14.981062 26740 tablet_service.cc:1467] Processing CreateTablet for tablet 70f6017d4d01463398cb347779dacf90 (DEFAULT_TABLE table=default.Table_24bdc44050024c23aa90a182bdcecb50 [id=4ea7ee58aac74fba84dbbcc009017421]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.981751 26495 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_3589a7a0eef1470eb486279bcefa6c63" } new_table_name: "default.Table_0d77c6da3c8349c9ad3caa2147b81827" modify_external_catalogs: true
I20260810 11:30:14.984223 27231 tablet_bootstrap.cc:492] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:14.985257 26880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 587c6ce242c0411b886404a0df03b1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.983788 26746 tablet_service.cc:1467] Processing CreateTablet for tablet 750950c424184d08bf6777774db3a0b2 (DEFAULT_TABLE table=default.Table_9eee8b010360415faceef1c43fea61d9 [id=41dfd71fd24040a392812bca04e2baf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.985791 26747 tablet_service.cc:1467] Processing CreateTablet for tablet f2b555f18c1e485d9af7b08f98543c80 (DEFAULT_TABLE table=default.Table_c43e3d237aaf451cb24c817b76bbba8a [id=610cb6c79be54cf3a757b9eefa3cb94b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.986078 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 524c8d37d3964e368695d182883b0bd5 (DEFAULT_TABLE table=default.Table_61f0895109db4fec904812266ff49d81 [id=052fbe3da03d4ebca9347725f5dbe3ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.986449 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70f6017d4d01463398cb347779dacf90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:14.986661 26501 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_3fa15e611b874bf787b51bdd990bac12" } new_table_name: "default.Table_359f619c6e054a89898040e2f0d379c3" modify_external_catalogs: true
I20260810 11:30:14.988643 27059 raft_consensus.cc:2454] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:14.988957 27030 tablet_service.cc:1467] Processing CreateTablet for tablet 0118ff9d21924aefa8c6c32977c10453 (DEFAULT_TABLE table=default.Table_105371a3c4b44933b4181df1297f6139 [id=737e0806636e4c8ca0307a46408cbdec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.990031 26891 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c6b3f8626724d12986f388b1ca90b3c with delete_type TABLET_DATA_DELETED (replaced by tablet e8dc3dece9d84d47a638707d10de6fd4) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:14.990257 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet d729baae40a64e6e8c23e6870f230afb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:14.994117 26884 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fc76603bf8843dab18c95fdab9a8be0 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ffc2c43885841d2a6a4cce52eaf7129) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:14.994393 27228 tablet_bootstrap.cc:492] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:14.995930 26888 tablet_service.cc:1467] Processing CreateTablet for tablet 43e42cc642544f779bb79cee7479c4f4 (DEFAULT_TABLE table=default.Table_38ce4003d8e84bec8c910d35efb2a64e [id=9a87e462e8834e0ab7d9a8ae87f06e09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:14.998914 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "256af4222bb34745ac018dd82a9c4f9b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:14.995066 27228 ts_tablet_manager.cc:1397] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.373s user 0.009s sys 0.005s
I20260810 11:30:14.986289 26742 tablet_service.cc:1467] Processing CreateTablet for tablet 2126d95992e549b7b2b3e662b0d39a36 (DEFAULT_TABLE table=default.Table_21a675494284471eaf3ea50b31b833d7 [id=46a8ee2948c04311b0d3c1a5174d08dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.006006 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 0118ff9d21924aefa8c6c32977c10453 (DEFAULT_TABLE table=default.Table_105371a3c4b44933b4181df1297f6139 [id=737e0806636e4c8ca0307a46408cbdec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.006434 27221 tablet_replica.cc:330] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:15.006665 27221 raft_consensus.cc:2229] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:15.007210 26891 tablet_service.cc:1514] Processing DeleteTablet for tablet eb51618d37ac488fa7e3d23e5f85ec36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:15.011615 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 0033d61d07d84262a98b0ebc54bd7960 (DEFAULT_TABLE table=default.Table_c6cf8c999ed14a31aff5a1de22594c1f [id=0e600e92a46f45629433aa68978a93d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.012081 27221 raft_consensus.cc:2258] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:15.013180 27024 tablet_service.cc:1467] Processing CreateTablet for tablet 70f6017d4d01463398cb347779dacf90 (DEFAULT_TABLE table=default.Table_24bdc44050024c23aa90a182bdcecb50 [id=4ea7ee58aac74fba84dbbcc009017421]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.013890 27023 tablet_service.cc:1467] Processing CreateTablet for tablet 524c8d37d3964e368695d182883b0bd5 (DEFAULT_TABLE table=default.Table_61f0895109db4fec904812266ff49d81 [id=052fbe3da03d4ebca9347725f5dbe3ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.014228 27035 tablet_service.cc:1467] Processing CreateTablet for tablet 8a1e2e624fff4692a22e29b293cd82d6 (DEFAULT_TABLE table=default.Table_f974a4ceae4649bb9f17115103f554cd [id=8c06eb3e2a9245af8c8e8eb250215e0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.014518 27034 tablet_service.cc:1467] Processing CreateTablet for tablet bd6b328baa2346afbbe9f513ae4db3df (DEFAULT_TABLE table=default.Table_e0f398f685ca45afbb6395ac394410dc [id=f87826dabbbc4330a602412d9e802be6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.014897 27027 tablet_service.cc:1467] Processing CreateTablet for tablet a87f6835f0dc4ad4b3a23b297726100d (DEFAULT_TABLE table=default.Table_cbf7fb0f0585465a9be24fa7e70d68d2 [id=82041e96f8de4fae85baf690bbbfc7a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.015177 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43e42cc642544f779bb79cee7479c4f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.015998 27029 tablet_service.cc:1467] Processing CreateTablet for tablet a18cb43b4dc04a1290a6bade7ac1f3cf (DEFAULT_TABLE table=default.Table_edb9387fb3ec47eab19fc13e046c5533 [id=5e2dc70c9ac641cb91652fe29c4c5e7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.019721 26499 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_bd735fb392144c6b97d5678685645108" } modify_external_catalogs: true
I20260810 11:30:15.020018 26499 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_bd735fb392144c6b97d5678685645108" } modify_external_catalogs: true
I20260810 11:30:15.021826 27033 tablet_service.cc:1467] Processing CreateTablet for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (DEFAULT_TABLE table=default.Table_a6922b81d56f4bf3b5231cc9ada8cb27 [id=ac09591d93074ce49c66162021f26b05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.022516 27385 raft_consensus.cc:2726] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:15.026332 27026 tablet_service.cc:1467] Processing CreateTablet for tablet 1a83391804894d268d0e603f4feb1745 (DEFAULT_TABLE table=default.Table_8350154cfe4b460294a98889a1869fb8 [id=d74c35e9ac524f3798c37c9b6a422a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.029762 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 31cafb7c691d40a48a40f7d4190c4f8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:15.030210 26702 leader_election.cc:302] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:15.030349 26886 tablet_service.cc:1467] Processing CreateTablet for tablet 2126d95992e549b7b2b3e662b0d39a36 (DEFAULT_TABLE table=default.Table_21a675494284471eaf3ea50b31b833d7 [id=46a8ee2948c04311b0d3c1a5174d08dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.030987 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 0118ff9d21924aefa8c6c32977c10453 (DEFAULT_TABLE table=default.Table_105371a3c4b44933b4181df1297f6139 [id=737e0806636e4c8ca0307a46408cbdec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.034793 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 3dabfbd779c5406cb10ecf70f5a142e7 (table default.Table_2511fda0071847d1a412482192a6bbb4 [id=66cb5c83b5894c1a9bc02e9019921428]) successfully deleted
W20260810 11:30:15.034879 26700 leader_election.cc:341] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:15.035681 26743 tablet_service.cc:1467] Processing CreateTablet for tablet a87f6835f0dc4ad4b3a23b297726100d (DEFAULT_TABLE table=default.Table_cbf7fb0f0585465a9be24fa7e70d68d2 [id=82041e96f8de4fae85baf690bbbfc7a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.035934 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2126d95992e549b7b2b3e662b0d39a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.036451 27221 ts_tablet_manager.cc:1905] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:15.037241 26884 tablet_service.cc:1467] Processing CreateTablet for tablet 8798892eb4604ee8ac9c95e64dbb14e9 (DEFAULT_TABLE table=default.Table_3589a7a0eef1470eb486279bcefa6c63 [id=24870bec311f44e4a3a3afa3599437be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.037832 26734 tablet_service.cc:1467] Processing CreateTablet for tablet 8798892eb4604ee8ac9c95e64dbb14e9 (DEFAULT_TABLE table=default.Table_3589a7a0eef1470eb486279bcefa6c63 [id=24870bec311f44e4a3a3afa3599437be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.042183 26745 tablet_service.cc:1467] Processing CreateTablet for tablet 8a1e2e624fff4692a22e29b293cd82d6 (DEFAULT_TABLE table=default.Table_f974a4ceae4649bb9f17115103f554cd [id=8c06eb3e2a9245af8c8e8eb250215e0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.043231 26735 tablet_service.cc:1467] Processing CreateTablet for tablet 0033d61d07d84262a98b0ebc54bd7960 (DEFAULT_TABLE table=default.Table_c6cf8c999ed14a31aff5a1de22594c1f [id=0e600e92a46f45629433aa68978a93d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.044273 26747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2b555f18c1e485d9af7b08f98543c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.049110 27248 raft_consensus.cc:2229] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:15.049355 27030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0118ff9d21924aefa8c6c32977c10453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.049767 27248 pending_rounds.cc:62] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215: Trying to abort 1 pending ops.
I20260810 11:30:15.049891 27248 pending_rounds.cc:68] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936352930242560 op_type: NO_OP noop_request { }
I20260810 11:30:15.050091 27248 raft_consensus.cc:2866] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:15.050309 27248 raft_consensus.cc:2258] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:15.051754 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd6b328baa2346afbbe9f513ae4db3df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.052940 27027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a87f6835f0dc4ad4b3a23b297726100d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:15.053015 26700 leader_election.cc:341] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:15.053622 26702 raft_consensus.cc:2670] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 11:30:15.054706 26729 tablet_service.cc:1467] Processing CreateTablet for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (DEFAULT_TABLE table=default.Table_a6922b81d56f4bf3b5231cc9ada8cb27 [id=ac09591d93074ce49c66162021f26b05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.055878 27029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a18cb43b4dc04a1290a6bade7ac1f3cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.057647 27024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70f6017d4d01463398cb347779dacf90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.049806 27386 raft_consensus.cc:504] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:15.056197 26700 leader_election.cc:341] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:15.060091 27026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a83391804894d268d0e603f4feb1745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.060797 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a1e2e624fff4692a22e29b293cd82d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.061672 27248 ts_tablet_manager.cc:1905] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:15.060387 26731 tablet_service.cc:1467] Processing CreateTablet for tablet eb9394f9ca2c44de93354e23973cf902 (DEFAULT_TABLE table=default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.062947 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2126d95992e549b7b2b3e662b0d39a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.064201 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 524c8d37d3964e368695d182883b0bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.064707 27033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c715bdcff8c4cdabfddf871f6fdc388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.065866 26884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8798892eb4604ee8ac9c95e64dbb14e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.057490 26733 tablet_service.cc:1467] Processing CreateTablet for tablet a18cb43b4dc04a1290a6bade7ac1f3cf (DEFAULT_TABLE table=default.Table_edb9387fb3ec47eab19fc13e046c5533 [id=5e2dc70c9ac641cb91652fe29c4c5e7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.068704 26732 tablet_service.cc:1467] Processing CreateTablet for tablet 4c595e0892634348b64418ae9dbbd4c2 (DEFAULT_TABLE table=default.Table_10b1b7ecd6ab43dfab0e6a29facddaf7 [id=ad429e3004674df1a8535523c4718f62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.069347 26730 tablet_service.cc:1467] Processing CreateTablet for tablet a3406dc345e3429fb4bce5a59643b686 (DEFAULT_TABLE table=default.Table_b9bd48d71fac4e03b0d84dcafd4cb4a5 [id=0db7b6eb26f8438caf57a129ba2c81fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.073506 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0033d61d07d84262a98b0ebc54bd7960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.074002 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 524c8d37d3964e368695d182883b0bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.074527 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 750950c424184d08bf6777774db3a0b2 (DEFAULT_TABLE table=default.Table_9eee8b010360415faceef1c43fea61d9 [id=41dfd71fd24040a392812bca04e2baf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.074759 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0118ff9d21924aefa8c6c32977c10453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.075078 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 750950c424184d08bf6777774db3a0b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.076783 26729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c715bdcff8c4cdabfddf871f6fdc388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.076730 27038 tablet_service.cc:1467] Processing CreateTablet for tablet 4c595e0892634348b64418ae9dbbd4c2 (DEFAULT_TABLE table=default.Table_10b1b7ecd6ab43dfab0e6a29facddaf7 [id=ad429e3004674df1a8535523c4718f62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.077580 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c595e0892634348b64418ae9dbbd4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.078855 27022 tablet_service.cc:1467] Processing CreateTablet for tablet eb9394f9ca2c44de93354e23973cf902 (DEFAULT_TABLE table=default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.079319 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb9394f9ca2c44de93354e23973cf902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.080045 27032 tablet_service.cc:1467] Processing CreateTablet for tablet a3406dc345e3429fb4bce5a59643b686 (DEFAULT_TABLE table=default.Table_b9bd48d71fac4e03b0d84dcafd4cb4a5 [id=0db7b6eb26f8438caf57a129ba2c81fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.075095 27231 ts_tablet_manager.cc:1397] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.352s user 0.036s sys 0.027s
I20260810 11:30:15.080896 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a87f6835f0dc4ad4b3a23b297726100d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.081513 27032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3406dc345e3429fb4bce5a59643b686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.081790 27231 raft_consensus.cc:348] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.082083 27231 raft_consensus.cc:374] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:15.082171 27231 raft_consensus.cc:729] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:15.082404 26891 tablet_service.cc:1467] Processing CreateTablet for tablet 0033d61d07d84262a98b0ebc54bd7960 (DEFAULT_TABLE table=default.Table_c6cf8c999ed14a31aff5a1de22594c1f [id=0e600e92a46f45629433aa68978a93d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.082633 27039 tablet_service.cc:1467] Processing CreateTablet for tablet 2126d95992e549b7b2b3e662b0d39a36 (DEFAULT_TABLE table=default.Table_21a675494284471eaf3ea50b31b833d7 [id=46a8ee2948c04311b0d3c1a5174d08dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.083174 27039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2126d95992e549b7b2b3e662b0d39a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.083873 27231 consensus_queue.cc:260] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.084965 27036 tablet_service.cc:1467] Processing CreateTablet for tablet bb0357271cfd46478867a3cc0660bcdc (DEFAULT_TABLE table=default.Table_23889fedecbf43c09cf2ab7717d5801b [id=ea4def2ac652452aaca61214b2d04cc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.085743 27231 ts_tablet_manager.cc:1428] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260810 11:30:15.085806 27036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb0357271cfd46478867a3cc0660bcdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.086740 27025 tablet_service.cc:1467] Processing CreateTablet for tablet 8798892eb4604ee8ac9c95e64dbb14e9 (DEFAULT_TABLE table=default.Table_3589a7a0eef1470eb486279bcefa6c63 [id=24870bec311f44e4a3a3afa3599437be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.087116 26878 tablet_service.cc:1467] Processing CreateTablet for tablet 750950c424184d08bf6777774db3a0b2 (DEFAULT_TABLE table=default.Table_9eee8b010360415faceef1c43fea61d9 [id=41dfd71fd24040a392812bca04e2baf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.087314 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8798892eb4604ee8ac9c95e64dbb14e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.087999 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 750950c424184d08bf6777774db3a0b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.088255 27231 tablet_bootstrap.cc:492] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:15.088438 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c5b650bc02f4fa393bada5b54c77f1f" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:15.089486 27059 raft_consensus.cc:3037] T 6c5b650bc02f4fa393bada5b54c77f1f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:15.092293 26745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a1e2e624fff4692a22e29b293cd82d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.100770 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8798892eb4604ee8ac9c95e64dbb14e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.101472 26877 tablet_service.cc:1467] Processing CreateTablet for tablet 70f6017d4d01463398cb347779dacf90 (DEFAULT_TABLE table=default.Table_24bdc44050024c23aa90a182bdcecb50 [id=4ea7ee58aac74fba84dbbcc009017421]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.078593 27020 tablet_service.cc:1467] Processing CreateTablet for tablet f2b555f18c1e485d9af7b08f98543c80 (DEFAULT_TABLE table=default.Table_c43e3d237aaf451cb24c817b76bbba8a [id=610cb6c79be54cf3a757b9eefa3cb94b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.102406 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c5b650bc02f4fa393bada5b54c77f1f" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:15.102730 27020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2b555f18c1e485d9af7b08f98543c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.109050 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0118ff9d21924aefa8c6c32977c10453. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:15.110246 26700 leader_election.cc:341] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:15.115134 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_4ce8a3965b484cdb8c1f9b7d7e318755"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:15.115430 26748 tablet_service.cc:1467] Processing CreateTablet for tablet bd6b328baa2346afbbe9f513ae4db3df (DEFAULT_TABLE table=default.Table_e0f398f685ca45afbb6395ac394410dc [id=f87826dabbbc4330a602412d9e802be6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.115900 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd6b328baa2346afbbe9f513ae4db3df. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:15.116206 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ce8a3965b484cdb8c1f9b7d7e318755 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.125000 26891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0033d61d07d84262a98b0ebc54bd7960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.133350 27385 raft_consensus.cc:482] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:15.133987 26491 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 2ffc2c43885841d2a6a4cce52eaf7129
I20260810 11:30:15.134756 26491 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_66b8d163284b4347b99dea499ed256fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:15.135001 27434 raft_consensus.cc:482] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 11:30:15.135479 26491 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66b8d163284b4347b99dea499ed256fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.135478 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0033d61d07d84262a98b0ebc54bd7960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.136832 27386 leader_election.cc:288] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:15.137276 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_6f7ae1749f224614a4fdaa33b125864d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:15.137923 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f7ae1749f224614a4fdaa33b125864d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.159807 27390 raft_consensus.cc:482] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:15.164271 27390 raft_consensus.cc:504] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.173542 27390 leader_election.cc:288] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:15.176620 26730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3406dc345e3429fb4bce5a59643b686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.177462 27434 raft_consensus.cc:504] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.180316 27446 tablet.cc:1722] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:15.184151 26733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a18cb43b4dc04a1290a6bade7ac1f3cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.190675 27386 raft_consensus.cc:482] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:15.195287 27059 raft_consensus.cc:2454] T 6c5b650bc02f4fa393bada5b54c77f1f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:15.197384 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d98948300fe6472295ea53cedb7d386c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:15.198360 27390 raft_consensus.cc:482] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:15.198336 26702 leader_election.cc:302] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:15.199155 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 750950c424184d08bf6777774db3a0b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.199805 26885 tablet_service.cc:1467] Processing CreateTablet for tablet f2b555f18c1e485d9af7b08f98543c80 (DEFAULT_TABLE table=default.Table_c43e3d237aaf451cb24c817b76bbba8a [id=610cb6c79be54cf3a757b9eefa3cb94b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.199898 27434 leader_election.cc:288] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:15.197043 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "debc114073e14ec1839c5c4c7c2f1f1e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:15.202162 26702 leader_election.cc:341] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:15.202574 26731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb9394f9ca2c44de93354e23973cf902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.175701 27385 raft_consensus.cc:504] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.205312 27231 tablet_bootstrap.cc:654] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:15.197631 27386 raft_consensus.cc:504] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.206923 27248 ts_tablet_manager.cc:1918] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:15.207095 27248 log.cc:1196] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/a9615b1ff3454a46a1a27cfcea20ad00
I20260810 11:30:15.176117 27228 raft_consensus.cc:348] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.212148 27387 raft_consensus.cc:2781] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:15.215641 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "debc114073e14ec1839c5c4c7c2f1f1e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:15.227102 26877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70f6017d4d01463398cb347779dacf90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.239805 27228 raft_consensus.cc:374] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:15.249440 27222 tablet_bootstrap.cc:492] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:15.259915 27434 raft_consensus.cc:482] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:15.266053 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c595e0892634348b64418ae9dbbd4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.254313 26739 tablet_service.cc:1467] Processing CreateTablet for tablet bb0357271cfd46478867a3cc0660bcdc (DEFAULT_TABLE table=default.Table_23889fedecbf43c09cf2ab7717d5801b [id=ea4def2ac652452aaca61214b2d04cc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.287621 26894 tablet_service.cc:1467] Processing CreateTablet for tablet bd6b328baa2346afbbe9f513ae4db3df (DEFAULT_TABLE table=default.Table_e0f398f685ca45afbb6395ac394410dc [id=f87826dabbbc4330a602412d9e802be6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.281529 26890 tablet_service.cc:1467] Processing CreateTablet for tablet 524c8d37d3964e368695d182883b0bd5 (DEFAULT_TABLE table=default.Table_61f0895109db4fec904812266ff49d81 [id=052fbe3da03d4ebca9347725f5dbe3ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.297271 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2b555f18c1e485d9af7b08f98543c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.304975 27228 raft_consensus.cc:729] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:15.304980 26738 tablet_service.cc:1467] Processing CreateTablet for tablet 1a83391804894d268d0e603f4feb1745 (DEFAULT_TABLE table=default.Table_8350154cfe4b460294a98889a1869fb8 [id=d74c35e9ac524f3798c37c9b6a422a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.291404 27434 raft_consensus.cc:504] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.316526 26738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a83391804894d268d0e603f4feb1745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.317550 26771 raft_consensus.cc:2454] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
W20260810 11:30:15.334887 26501 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 592be61b7e524941931264125b33d92c has no consensus state
I20260810 11:30:15.335397 26496 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 23d8ce485cb84495a6e964b6d5977f0d
I20260810 11:30:15.336179 26500 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_8350154cfe4b460294a98889a1869fb8" } new_table_name: "default.Table_ba69d247bec24bee8ac90108c17d70cd" modify_external_catalogs: true
I20260810 11:30:15.336455 26496 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5845c9677afb47d1af6ddd98bed76886" } new_table_name: "default.Table_5895dc74894a4711bf78dd8b259cfc40" modify_external_catalogs: true
W20260810 11:30:15.336988 26495 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8798892eb4604ee8ac9c95e64dbb14e9 consensus state has no leader
I20260810 11:30:15.337447 26495 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_edb9387fb3ec47eab19fc13e046c5533" } modify_external_catalogs: true
I20260810 11:30:15.337700 26495 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_edb9387fb3ec47eab19fc13e046c5533" } modify_external_catalogs: true
I20260810 11:30:15.338024 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_63ffd347d32d42dd8cc4f722268cd009"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:15.338745 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63ffd347d32d42dd8cc4f722268cd009 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.340184 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_b7e6c83a5d5340b5b960f65b82d4939a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:15.341099 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7e6c83a5d5340b5b960f65b82d4939a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.343439 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_a5fcf59dae954757a15883ee4da1bf29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:15.344233 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5fcf59dae954757a15883ee4da1bf29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.344758 26499 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 96cae4eb16c84410926a317af70e44f7
I20260810 11:30:15.346429 26499 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_cc55e38123c6426fb73e83da0b48d081" } modify_external_catalogs: true
I20260810 11:30:15.346798 26499 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_cc55e38123c6426fb73e83da0b48d081" } modify_external_catalogs: true
I20260810 11:30:15.353359 27386 leader_election.cc:288] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:15.358570 27385 leader_election.cc:288] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:15.362476 27222 ts_tablet_manager.cc:1397] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.492s user 0.009s sys 0.013s
I20260810 11:30:15.363382 26890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 524c8d37d3964e368695d182883b0bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.363982 27223 ts_tablet_manager.cc:1918] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:15.369431 27228 consensus_queue.cc:260] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.372400 26493 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_21f03834771d4035b46d7d400c951408" } new_table_name: "default.Table_8e3a55f57e5e45dba23c641cb84c631a" modify_external_catalogs: true
I20260810 11:30:15.374366 27223 log.cc:1196] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/66a7790587ed478b843fa9e997e50893
I20260810 11:30:15.375159 26822 heartbeater.cc:347] Connected to a master server at 127.25.195.254:41125
I20260810 11:30:15.372499 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_23889fedecbf43c09cf2ab7717d5801b" } modify_external_catalogs: true
I20260810 11:30:15.376487 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_23889fedecbf43c09cf2ab7717d5801b" } modify_external_catalogs: true
I20260810 11:30:15.383186 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 96cae4eb16c84410926a317af70e44f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:15.387248 27434 leader_election.cc:288] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:15.389915 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d8ce485cb84495a6e964b6d5977f0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:15.391309 26991 leader_election.cc:341] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:15.386287 26889 tablet_service.cc:1467] Processing CreateTablet for tablet a18cb43b4dc04a1290a6bade7ac1f3cf (DEFAULT_TABLE table=default.Table_edb9387fb3ec47eab19fc13e046c5533 [id=5e2dc70c9ac641cb91652fe29c4c5e7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.391228 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97d586d35ff144a681ad52756f4be2b6" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:15.400728 26879 tablet_service.cc:1467] Processing CreateTablet for tablet 8a1e2e624fff4692a22e29b293cd82d6 (DEFAULT_TABLE table=default.Table_f974a4ceae4649bb9f17115103f554cd [id=8c06eb3e2a9245af8c8e8eb250215e0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.407370 26739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb0357271cfd46478867a3cc0660bcdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.416610 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd6b328baa2346afbbe9f513ae4db3df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.423543 27223 ts_tablet_manager.cc:1939] T 66a7790587ed478b843fa9e997e50893 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:15.432060 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 66a7790587ed478b843fa9e997e50893 (table default.Table_c051f1f117b04fdd9c1ed11f426ae316 [id=b2754904694140cab5a7a82d31449a70]) successfully deleted
I20260810 11:30:15.435065 27222 raft_consensus.cc:348] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:15.435564 26484 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 43e42cc642544f779bb79cee7479c4f4 because the tablet was not found. No further retry: Not found: Tablet not found: 43e42cc642544f779bb79cee7479c4f4
I20260810 11:30:15.435981 27222 raft_consensus.cc:374] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:15.436086 27222 raft_consensus.cc:729] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:15.433241 26887 tablet_service.cc:1467] Processing CreateTablet for tablet a87f6835f0dc4ad4b3a23b297726100d (DEFAULT_TABLE table=default.Table_cbf7fb0f0585465a9be24fa7e70d68d2 [id=82041e96f8de4fae85baf690bbbfc7a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.437018 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a18cb43b4dc04a1290a6bade7ac1f3cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.437331 27222 consensus_queue.cc:260] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.443186 27221 ts_tablet_manager.cc:1918] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:15.452997 27228 ts_tablet_manager.cc:1428] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.387s user 0.003s sys 0.001s
I20260810 11:30:15.458530 27222 ts_tablet_manager.cc:1428] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.076s user 0.001s sys 0.002s
W20260810 11:30:15.462203 26991 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 61873us
I20260810 11:30:15.462616 27248 ts_tablet_manager.cc:1939] T a9615b1ff3454a46a1a27cfcea20ad00 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
W20260810 11:30:15.462707 27194 thread.cc:636] init [worker] (thread pool) Time spent creating pthread: real 0.502s user 0.096s sys 0.115s
W20260810 11:30:15.462880 27194 thread.cc:602] init [worker] (thread pool) Time spent starting thread: real 0.503s user 0.096s sys 0.115s
I20260810 11:30:15.463357 27222 tablet_bootstrap.cc:492] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:15.466809 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e2c9112462f442e8de5b4a944cfdc6b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:15.467306 27026 tablet_service.cc:1514] Processing DeleteTablet for tablet 96cae4eb16c84410926a317af70e44f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:15.390882 27390 raft_consensus.cc:504] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.470078 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d8ce485cb84495a6e964b6d5977f0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:15.472599 27390 leader_election.cc:288] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:15.475365 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 89) took 2059 ms. Trace:
I20260810 11:30:15.476522 27248 rpcz_store.cc:276] 0810 11:30:13.408873 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:13.409270 (+ 397us) service_pool.cc:227] Handling call
0810 11:30:14.954048 (+1544778us) ts_tablet_manager.cc:1145] Deleting tablet a9615b1ff3454a46a1a27cfcea20ad00
0810 11:30:14.954075 (+ 27us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:15.071734 (+117659us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:15.206238 (+134504us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:15.468340 (+262102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1544072}
I20260810 11:30:15.477057 27248 tablet_replica.cc:330] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:15.478385 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet a9615b1ff3454a46a1a27cfcea20ad00 (table default.Table_f8e4d0bbde74426ab975bf7b91029861 [id=a0e3fe57b37a415aa5123ca2199b9968]) successfully deleted
I20260810 11:30:15.478598 27221 log.cc:1196] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/256af4222bb34745ac018dd82a9c4f9b
I20260810 11:30:15.478996 27248 raft_consensus.cc:2229] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:15.479228 27248 raft_consensus.cc:2258] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:15.481787 26495 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet a18cb43b4dc04a1290a6bade7ac1f3cf
I20260810 11:30:15.482667 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_c7ba8db7c9b742cdb3cfbb476dec5ace"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:15.483502 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7ba8db7c9b742cdb3cfbb476dec5ace in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.483683 26501 master_service.cc:946] ReplaceTablet: received request to replace tablet 96cae4eb16c84410926a317af70e44f7 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:15.486094 26492 master_service.cc:946] ReplaceTablet: received request to replace tablet f3c6bd6803c245b7bb3d78423de482b6 from {username='slave'} at 127.0.0.1:47672
W20260810 11:30:15.487375 26496 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ca5c88585394dba87e201696afa6934 consensus state has no leader
W20260810 11:30:15.488464 26493 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eed0e2bead85466ca99cfb34e155a391 consensus state has no leader
I20260810 11:30:15.489478 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet bb0357271cfd46478867a3cc0660bcdc
I20260810 11:30:15.492110 26499 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet ffeb0373c6124af291336ca9da50c318
W20260810 11:30:15.492862 26500 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1a83391804894d268d0e603f4feb1745 consensus state has no leader
W20260810 11:30:15.500478 26702 leader_election.cc:341] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:15.503453 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet bb0357271cfd46478867a3cc0660bcdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:15.504238 27248 ts_tablet_manager.cc:1905] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:15.505250 26497 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3ccef06fa06c4c519d8760fa948d6c8b (table default.Table_abbbb80ecbe4491d98912dcdcaab5dd3 [id=ba999b4084c84b2f8e0313b96849b169]). Expected version 4 got 0
W20260810 11:30:15.513411 26702 leader_election.cc:341] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:15.516294 27028 tablet_service.cc:1467] Processing CreateTablet for tablet f85c0767ad164075b87ba672cafafb47 (DEFAULT_TABLE table=default.Table_1862cecf49a0499eabbbfba587daf808 [id=6e4c5823f76c4b78bcbfacf90251ddfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.516906 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f85c0767ad164075b87ba672cafafb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.520299 27026 tablet_service.cc:1467] Processing CreateTablet for tablet 7cd4f555b5d840c182a31b3c94da9619 (DEFAULT_TABLE table=default.Table_061b7dfbcc074ad6a0d99d49113a354f [id=0186ddbf3c144b4e86ae21cbdac555d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.521018 27026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cd4f555b5d840c182a31b3c94da9619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.525821 27027 tablet_service.cc:1514] Processing DeleteTablet for tablet ffeb0373c6124af291336ca9da50c318 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:15.526829 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (DEFAULT_TABLE table=default.Table_7429a35104ec4048afb265a7bf71f5b2 [id=ca04b6aa3fda4a89989d4a84d03bb15a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.527489 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet a18cb43b4dc04a1290a6bade7ac1f3cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:15.527961 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 983916da755d4d14b7a3d43bb7cbc9c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.528887 27029 tablet_service.cc:1467] Processing CreateTablet for tablet 2801709d53614916abac370f7ae5e913 (DEFAULT_TABLE table=default.Table_be173a149b464952b17280eb1fe40667 [id=53a6520ad3b04ffe88477fd07c159add]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.530665 27029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2801709d53614916abac370f7ae5e913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.534224 27035 tablet_service.cc:1467] Processing CreateTablet for tablet 83631b421a614796bdf76335f1437e00 (DEFAULT_TABLE table=default.Table_126d22557d424ec99a65925d97b5722a [id=0bcc4778f70e44b8952915c4ba9d6ed8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.538098 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 592be61b7e524941931264125b33d92c (DEFAULT_TABLE table=default.Table_359f619c6e054a89898040e2f0d379c3 [id=1c6a2d6a4fa2472a9aff02fecc10077a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.539431 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_a87ac76268094e76aafcb7a2766c0f1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:15.540127 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a87ac76268094e76aafcb7a2766c0f1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.540544 27387 raft_consensus.cc:686] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:15.541229 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 592be61b7e524941931264125b33d92c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.541673 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_fb8c5684b00a41eebe3f5b088bcbee33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:15.542264 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb8c5684b00a41eebe3f5b088bcbee33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.543674 26495 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_be3e02683a404e28a86de9c55aae7ba8" } new_table_name: "default.Table_164710e7832448d58f926e94ed5c17ec" modify_external_catalogs: true
I20260810 11:30:15.544654 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83631b421a614796bdf76335f1437e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.545869 26500 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_38150fc48b7148a8bc17eb85f039d7b3" } modify_external_catalogs: true
I20260810 11:30:15.546106 26500 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_38150fc48b7148a8bc17eb85f039d7b3" } modify_external_catalogs: true
I20260810 11:30:15.553628 27228 tablet_bootstrap.cc:492] T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:15.554579 26499 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_1862cecf49a0499eabbbfba587daf808" } new_table_name: "default.Table_d60616018b65409fa0540ea766980b11" modify_external_catalogs: true
I20260810 11:30:15.557709 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_dfd9941b72e749a7b7e7bc153705cfec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:15.559883 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfd9941b72e749a7b7e7bc153705cfec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.561404 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5763dcd0b2ae40b4945a6966bfd23099" } modify_external_catalogs: true
I20260810 11:30:15.561764 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5763dcd0b2ae40b4945a6966bfd23099" } modify_external_catalogs: true
W20260810 11:30:15.566046 26495 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2917f1ffb5214a80b19810540602df35 consensus state has no leader
W20260810 11:30:15.566115 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 392774us
I20260810 11:30:15.567600 26500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 478c0c39658349c39e3afa1aa1653e82
I20260810 11:30:15.570700 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_07ad990413b541f5b90b5f0f813635d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:15.572175 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07ad990413b541f5b90b5f0f813635d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.573793 26500 master_service.cc:946] ReplaceTablet: received request to replace tablet f3c6bd6803c245b7bb3d78423de482b6 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:15.577256 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_35bebbfa863b4eafa72471a4b6325d2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:15.577564 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_733cd3d375dd4cf9b1297c9395073c3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:15.578184 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_733cd3d375dd4cf9b1297c9395073c3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.579255 27020 tablet_service.cc:1467] Processing CreateTablet for tablet cb6805a5dd264939850ea2cd9a850a1f (DEFAULT_TABLE table=default.Table_057f1bf3995143138dd2954a212a480b [id=2db59831074f4dd2b4603d6f8215b1d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.580050 27020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb6805a5dd264939850ea2cd9a850a1f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:15.580330 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35bebbfa863b4eafa72471a4b6325d2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.581640 27027 tablet_service.cc:1467] Processing CreateTablet for tablet e8dc3dece9d84d47a638707d10de6fd4 (DEFAULT_TABLE table=default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.582712 27032 tablet_service.cc:1467] Processing CreateTablet for tablet 592be61b7e524941931264125b33d92c (DEFAULT_TABLE table=default.Table_359f619c6e054a89898040e2f0d379c3 [id=1c6a2d6a4fa2472a9aff02fecc10077a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.583284 27032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 592be61b7e524941931264125b33d92c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:15.584683 26499 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f85c0767ad164075b87ba672cafafb47 consensus state has no leader
I20260810 11:30:15.587548 27027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8dc3dece9d84d47a638707d10de6fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.590763 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 478c0c39658349c39e3afa1aa1653e82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:15.591461 27033 tablet_service.cc:1467] Processing CreateTablet for tablet ac4b1821ac30452cbe7a8f844d9b37e5 (DEFAULT_TABLE table=default.Table_63ffd347d32d42dd8cc4f722268cd009 [id=bbde7d0c0eb543e79e48a60205aa8079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.591909 27022 tablet_service.cc:1467] Processing CreateTablet for tablet 603fe104b7ab485eab6b225a58bddc1c (DEFAULT_TABLE table=default.Table_a5fcf59dae954757a15883ee4da1bf29 [id=758863f16efe460e90394a491cad8914]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.593137 27033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac4b1821ac30452cbe7a8f844d9b37e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.599225 27030 tablet_service.cc:1467] Processing CreateTablet for tablet b9195690e00b4f3cb3d5076dcca3519c (DEFAULT_TABLE table=default.Table_6f7ae1749f224614a4fdaa33b125864d [id=339298a1ea1747d59a035a6a3cadfb30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.599980 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 603fe104b7ab485eab6b225a58bddc1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.600447 27030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9195690e00b4f3cb3d5076dcca3519c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.601257 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 31888ddeafe14738b818016a9c0a4ad3
I20260810 11:30:15.610483 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 31888ddeafe14738b818016a9c0a4ad3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:15.611512 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet a18cb43b4dc04a1290a6bade7ac1f3cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:15.613026 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet 607b055f8ced4372800adf5817b46e0b with delete_type TABLET_DATA_DELETED (replaced by tablet e25ae21cc8cc4749a507fcab5ee225a3) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:15.614228 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "607b055f8ced4372800adf5817b46e0b" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:15.615453 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (DEFAULT_TABLE table=default.Table_7429a35104ec4048afb265a7bf71f5b2 [id=ca04b6aa3fda4a89989d4a84d03bb15a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.616098 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 983916da755d4d14b7a3d43bb7cbc9c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.617671 26747 tablet_service.cc:1467] Processing CreateTablet for tablet 7cd4f555b5d840c182a31b3c94da9619 (DEFAULT_TABLE table=default.Table_061b7dfbcc074ad6a0d99d49113a354f [id=0186ddbf3c144b4e86ae21cbdac555d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.618304 26746 tablet_service.cc:1467] Processing CreateTablet for tablet f85c0767ad164075b87ba672cafafb47 (DEFAULT_TABLE table=default.Table_1862cecf49a0499eabbbfba587daf808 [id=6e4c5823f76c4b78bcbfacf90251ddfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.619679 26741 tablet_service.cc:1467] Processing CreateTablet for tablet 83631b421a614796bdf76335f1437e00 (DEFAULT_TABLE table=default.Table_126d22557d424ec99a65925d97b5722a [id=0bcc4778f70e44b8952915c4ba9d6ed8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.620393 26730 tablet_service.cc:1467] Processing CreateTablet for tablet cb6805a5dd264939850ea2cd9a850a1f (DEFAULT_TABLE table=default.Table_057f1bf3995143138dd2954a212a480b [id=2db59831074f4dd2b4603d6f8215b1d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.620540 27028 tablet_service.cc:1467] Processing CreateTablet for tablet a8a65a0e8b1f4e4b8d9a82059b766cda (DEFAULT_TABLE table=default.Table_ad62ebe50ede4d7d96922bac3e954f9e [id=a9ff451e18b54994abfa288ecac98560]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.621428 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8a65a0e8b1f4e4b8d9a82059b766cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.621438 26745 tablet_service.cc:1467] Processing CreateTablet for tablet dc2506b72a624cb388059efc326abbc1 (DEFAULT_TABLE table=default.Table_b7e6c83a5d5340b5b960f65b82d4939a [id=553f87ed39f148aba3be0a6fcd13e25d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.621937 26993 leader_election.cc:302] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:15.621991 27036 tablet_service.cc:1467] Processing CreateTablet for tablet 83992214ba314d3fa674e00d8eaddec6 (DEFAULT_TABLE table=default.Table_c7ba8db7c9b742cdb3cfbb476dec5ace [id=52440110b86442d3a04f71c44dc8d655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.622449 27036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83992214ba314d3fa674e00d8eaddec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.623109 26740 tablet_service.cc:1467] Processing CreateTablet for tablet 2801709d53614916abac370f7ae5e913 (DEFAULT_TABLE table=default.Table_be173a149b464952b17280eb1fe40667 [id=53a6520ad3b04ffe88477fd07c159add]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.628345 27387 consensus_queue.cc:237] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.629796 27465 raft_consensus.cc:2781] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:15.629956 27465 raft_consensus.cc:482] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:15.630692 27465 raft_consensus.cc:3037] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:15.631672 27460 raft_consensus.cc:482] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:15.635129 27221 ts_tablet_manager.cc:1939] T 256af4222bb34745ac018dd82a9c4f9b P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:15.635969 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 127) took 1298 ms. Trace:
I20260810 11:30:15.636503 26734 tablet_service.cc:1467] Processing CreateTablet for tablet e8dc3dece9d84d47a638707d10de6fd4 (DEFAULT_TABLE table=default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.638443 26742 tablet_service.cc:1467] Processing CreateTablet for tablet 91b6078efadf496fb252f725bdf56b02 (DEFAULT_TABLE table=default.Table_f5acadd3f7ff49d4883a695e2348164f [id=02cec75d98d0411ba2eb17ae8f083f00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.639436 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet ffeb0373c6124af291336ca9da50c318 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:15.640295 26733 tablet_service.cc:1467] Processing CreateTablet for tablet ac4b1821ac30452cbe7a8f844d9b37e5 (DEFAULT_TABLE table=default.Table_63ffd347d32d42dd8cc4f722268cd009 [id=bbde7d0c0eb543e79e48a60205aa8079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.640969 26747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cd4f555b5d840c182a31b3c94da9619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.643065 26729 tablet_service.cc:1467] Processing CreateTablet for tablet 83992214ba314d3fa674e00d8eaddec6 (DEFAULT_TABLE table=default.Table_c7ba8db7c9b742cdb3cfbb476dec5ace [id=52440110b86442d3a04f71c44dc8d655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.644404 26729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83992214ba314d3fa674e00d8eaddec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.645964 27038 tablet_service.cc:1467] Processing CreateTablet for tablet 91b6078efadf496fb252f725bdf56b02 (DEFAULT_TABLE table=default.Table_f5acadd3f7ff49d4883a695e2348164f [id=02cec75d98d0411ba2eb17ae8f083f00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.646461 26730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb6805a5dd264939850ea2cd9a850a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.646526 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91b6078efadf496fb252f725bdf56b02. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:15.627102 26876 consensus_meta.cc:287] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700: Time spent flushing consensus metadata: real 0.539s user 0.005s sys 0.002s
I20260810 11:30:15.648309 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f85c0767ad164075b87ba672cafafb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.650035 27231 tablet_bootstrap.cc:492] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:15.650372 26745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc2506b72a624cb388059efc326abbc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.650625 27231 ts_tablet_manager.cc:1397] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.562s user 0.013s sys 0.019s
I20260810 11:30:15.652190 26741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83631b421a614796bdf76335f1437e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.654098 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2801709d53614916abac370f7ae5e913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.655009 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8dc3dece9d84d47a638707d10de6fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.656013 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91b6078efadf496fb252f725bdf56b02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.657626 26733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac4b1821ac30452cbe7a8f844d9b37e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.657590 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "607b055f8ced4372800adf5817b46e0b" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:15.663734 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d98948300fe6472295ea53cedb7d386c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:15.663800 27221 rpcz_store.cc:276] 0810 11:30:14.337852 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.337909 (+ 57us) service_pool.cc:227] Handling call
0810 11:30:14.982003 (+644094us) ts_tablet_manager.cc:1145] Deleting tablet 256af4222bb34745ac018dd82a9c4f9b
0810 11:30:14.982023 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:15.120283 (+138260us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:15.441095 (+320812us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:15.635913 (+194818us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":643532}
I20260810 11:30:15.665937 27221 tablet_replica.cc:330] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:15.666221 26879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a1e2e624fff4692a22e29b293cd82d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.666509 27221 raft_consensus.cc:2229] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:15.666711 26880 tablet_service.cc:1467] Processing CreateTablet for tablet 4c595e0892634348b64418ae9dbbd4c2 (DEFAULT_TABLE table=default.Table_10b1b7ecd6ab43dfab0e6a29facddaf7 [id=ad429e3004674df1a8535523c4718f62]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:15.668803 26700 leader_election.cc:341] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:15.668824 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 256af4222bb34745ac018dd82a9c4f9b (table default.Table_5c1990a7c1d64a6eb801c2a2ae958db8 [id=3332dd1574f04ec1a34468ad5908602b]) successfully deleted
I20260810 11:30:15.669014 26700 leader_election.cc:302] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:15.669394 27434 raft_consensus.cc:2726] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:15.669171 26744 tablet_service.cc:1467] Processing CreateTablet for tablet b9195690e00b4f3cb3d5076dcca3519c (DEFAULT_TABLE table=default.Table_6f7ae1749f224614a4fdaa33b125864d [id=339298a1ea1747d59a035a6a3cadfb30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.670262 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9195690e00b4f3cb3d5076dcca3519c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.668033 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97d586d35ff144a681ad52756f4be2b6" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:15.672755 27222 tablet_bootstrap.cc:654] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:15.675094 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet bb0357271cfd46478867a3cc0660bcdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:15.675455 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 478c0c39658349c39e3afa1aa1653e82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:15.675719 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 31888ddeafe14738b818016a9c0a4ad3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:15.676450 26887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a87f6835f0dc4ad4b3a23b297726100d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.677014 26748 tablet_service.cc:1467] Processing CreateTablet for tablet a8a65a0e8b1f4e4b8d9a82059b766cda (DEFAULT_TABLE table=default.Table_ad62ebe50ede4d7d96922bac3e954f9e [id=a9ff451e18b54994abfa288ecac98560]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.678907 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8a65a0e8b1f4e4b8d9a82059b766cda. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:15.682492 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 4b15cc8669b549a2b4461dccd66a0c5a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b15cc8669b549a2b4461dccd66a0c5a already in progress: creating tablet
W20260810 11:30:15.683072 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet a28849649c704f2fbdec1aced9ce01b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a28849649c704f2fbdec1aced9ce01b1 already in progress: creating tablet
W20260810 11:30:15.684216 26849 leader_election.cc:341] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: a8197318b04a470791dd639742547fce
W20260810 11:30:15.684870 26700 leader_election.cc:341] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:15.685083 26700 leader_election.cc:302] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:15.685665 27434 raft_consensus.cc:2726] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:15.691855 26881 tablet_service.cc:1467] Processing CreateTablet for tablet eb9394f9ca2c44de93354e23973cf902 (DEFAULT_TABLE table=default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.694113 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_635ef5268ea1426bb6578ba498e616e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:15.694748 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_7c178d343d8246599a00f6d1c602a818"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:15.695104 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_635ef5268ea1426bb6578ba498e616e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:15.695538 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c178d343d8246599a00f6d1c602a818 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.697032 27223 tablet_replica.cc:330] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:15.697265 26880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c595e0892634348b64418ae9dbbd4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.697829 26495 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_d1e2aab042904f65803b1033aea22315" } new_table_name: "default.Table_61d778388656489cb2e7fe8312b8ac6e" modify_external_catalogs: true
I20260810 11:30:15.699503 26491 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c43e3d237aaf451cb24c817b76bbba8a" } new_table_name: "default.Table_f83bc0d49a5446278b9f4394d96e900c" modify_external_catalogs: true
I20260810 11:30:15.701330 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_daa63098f93c4c00bf673114c127e69f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:15.702679 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_daa63098f93c4c00bf673114c127e69f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.703940 26496 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_05a7698994184d6bbed238252235f5f8" } modify_external_catalogs: true
I20260810 11:30:15.704160 26496 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_05a7698994184d6bbed238252235f5f8" } modify_external_catalogs: true
I20260810 11:30:15.705518 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_fb7b13261243442c9c4d8749871c1d1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:15.707027 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb7b13261243442c9c4d8749871c1d1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.715131 26878 tablet_service.cc:1467] Processing CreateTablet for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (DEFAULT_TABLE table=default.Table_a6922b81d56f4bf3b5231cc9ada8cb27 [id=ac09591d93074ce49c66162021f26b05]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:15.715992 26495 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fbe0a0ab82a147a3b6164904b135d1ab consensus state has no leader
I20260810 11:30:15.686765 26883 tablet_service.cc:1467] Processing CreateTablet for tablet a3406dc345e3429fb4bce5a59643b686 (DEFAULT_TABLE table=default.Table_b9bd48d71fac4e03b0d84dcafd4cb4a5 [id=0db7b6eb26f8438caf57a129ba2c81fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.719312 27223 raft_consensus.cc:2229] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:15.719774 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e2c9112462f442e8de5b4a944cfdc6b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:15.720219 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb9394f9ca2c44de93354e23973cf902. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:15.723193 26700 leader_election.cc:341] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:15.723495 26700 leader_election.cc:302] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:15.723866 27434 raft_consensus.cc:2726] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:15.724225 26499 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_be173a149b464952b17280eb1fe40667" } modify_external_catalogs: true
I20260810 11:30:15.724505 26499 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_be173a149b464952b17280eb1fe40667" } modify_external_catalogs: true
W20260810 11:30:15.725229 26491 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f2b555f18c1e485d9af7b08f98543c80 consensus state has no leader
I20260810 11:30:15.730634 26498 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_d60616018b65409fa0540ea766980b11" } new_table_name: "default.Table_3000f6230869484ea058b888473e135f" modify_external_catalogs: true
W20260810 11:30:15.735196 26892 consensus_meta.cc:287] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700: Time spent flushing consensus metadata: real 0.541s user 0.003s sys 0.004s
I20260810 11:30:15.753639 26876 tablet_service.cc:1467] Processing CreateTablet for tablet bb0357271cfd46478867a3cc0660bcdc (DEFAULT_TABLE table=default.Table_23889fedecbf43c09cf2ab7717d5801b [id=ea4def2ac652452aaca61214b2d04cc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.757232 27223 raft_consensus.cc:2258] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:15.758543 26491 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_0ca6793e2c374e8d8d93872a0b2283d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:15.759531 26491 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ca6793e2c374e8d8d93872a0b2283d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.631969 27460 raft_consensus.cc:504] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.765815 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c715bdcff8c4cdabfddf871f6fdc388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.766304 27460 leader_election.cc:288] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:15.766763 26771 raft_consensus.cc:2454] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
W20260810 11:30:15.767522 26886 consensus_meta.cc:287] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700: Time spent flushing consensus metadata: real 0.505s user 0.007s sys 0.000s
I20260810 11:30:15.768424 27223 ts_tablet_manager.cc:1905] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:15.769425 26892 tablet_service.cc:1467] Processing CreateTablet for tablet 1a83391804894d268d0e603f4feb1745 (DEFAULT_TABLE table=default.Table_8350154cfe4b460294a98889a1869fb8 [id=d74c35e9ac524f3798c37c9b6a422a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.773299 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3406dc345e3429fb4bce5a59643b686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.774962 26735 tablet_service.cc:1467] Processing CreateTablet for tablet ff9b649e43a9456fa51cf3330290bb91 (DEFAULT_TABLE table=default.Table_4ce8a3965b484cdb8c1f9b7d7e318755 [id=1ef3626d71d5408692ce0f62d2d5eca1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.775513 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff9b649e43a9456fa51cf3330290bb91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.776721 26876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb0357271cfd46478867a3cc0660bcdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.778228 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "607b055f8ced4372800adf5817b46e0b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:15.780997 26700 leader_election.cc:341] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:15.781021 26495 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_8ffade5d9484424f9788cd43e1163be6" } new_table_name: "default.Table_b6c6809bdbac4c2d86853a11b84b872e" modify_external_catalogs: true
I20260810 11:30:15.781997 26497 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c6cf8c999ed14a31aff5a1de22594c1f" } modify_external_catalogs: true
I20260810 11:30:15.782279 26497 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c6cf8c999ed14a31aff5a1de22594c1f" } modify_external_catalogs: true
I20260810 11:30:15.782179 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_e7f8305a313f47b0a219cb6a9cb15049"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:15.782873 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7f8305a313f47b0a219cb6a9cb15049 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.787287 26729 tablet_service.cc:1467] Processing CreateTablet for tablet fc023d51790042ce978eb53a2979e29c (DEFAULT_TABLE table=default.Table_66b8d163284b4347b99dea499ed256fc [id=304e1529f45d4d3c8799a22009066ce5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.787775 26729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc023d51790042ce978eb53a2979e29c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.789242 26731 tablet_service.cc:1467] Processing CreateTablet for tablet 834c9c99ec424bb39e8a003e9204b2bc (DEFAULT_TABLE table=default.Table_e930e7d079ef4035bde1d9a4ef134d62 [id=ad637cef46ef40eeb3182153bcd52f6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.789803 26731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 834c9c99ec424bb39e8a003e9204b2bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:15.792073 26882 consensus_meta.cc:287] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700: Time spent flushing consensus metadata: real 0.572s user 0.004s sys 0.002s
W20260810 11:30:15.794353 26487 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet fbe0a0ab82a147a3b6164904b135d1ab (table default.Table_61d778388656489cb2e7fe8312b8ac6e [id=b52c11bd73cd4d1f8f9dfc32562718a2], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet fbe0a0ab82a147a3b6164904b135d1ab consensus state has no leader
I20260810 11:30:15.796407 26501 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_e15e0bcf194a490495cfd17ad551958b" } modify_external_catalogs: true
I20260810 11:30:15.796799 26501 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_e15e0bcf194a490495cfd17ad551958b" } modify_external_catalogs: true
W20260810 11:30:15.797799 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 67689.2us
W20260810 11:30:15.798823 26848 leader_election.cc:341] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: a8197318b04a470791dd639742547fce
I20260810 11:30:15.799041 26848 leader_election.cc:302] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:15.799575 27385 raft_consensus.cc:2726] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:15.805018 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 603fe104b7ab485eab6b225a58bddc1c (DEFAULT_TABLE table=default.Table_a5fcf59dae954757a15883ee4da1bf29 [id=758863f16efe460e90394a491cad8914]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:15.803472 26991 leader_election.cc:341] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:15.805989 26822 heartbeater.cc:347] Connected to a master server at 127.25.195.254:41125
I20260810 11:30:15.806380 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 603fe104b7ab485eab6b225a58bddc1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.806454 26964 heartbeater.cc:347] Connected to a master server at 127.25.195.254:41125
I20260810 11:30:15.806574 27231 raft_consensus.cc:348] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.806833 27231 raft_consensus.cc:374] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:15.807574 27231 raft_consensus.cc:729] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:15.807890 27231 consensus_queue.cc:260] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.796478 26732 tablet_service.cc:1467] Processing CreateTablet for tablet 00c4599256684f5dbc745c9283f31a08 (DEFAULT_TABLE table=default.Table_05e208843c2f40e6adbf28e17b7156cd [id=855a2f7a37c84ade8be77e7c0ba17a14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.808399 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c4599256684f5dbc745c9283f31a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.808374 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "607b055f8ced4372800adf5817b46e0b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:15.807264 27025 tablet_service.cc:1467] Processing CreateTablet for tablet dc2506b72a624cb388059efc326abbc1 (DEFAULT_TABLE table=default.Table_b7e6c83a5d5340b5b960f65b82d4939a [id=553f87ed39f148aba3be0a6fcd13e25d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.809567 27059 raft_consensus.cc:2454] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
W20260810 11:30:15.820765 26991 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 146506us
I20260810 11:30:15.821856 27221 pending_rounds.cc:62] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d: Trying to abort 1 pending ops.
I20260810 11:30:15.822057 27221 pending_rounds.cc:68] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936355536515072 op_type: NO_OP noop_request { }
I20260810 11:30:15.822347 27221 raft_consensus.cc:2866] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:15.822638 27221 raft_consensus.cc:2258] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:15.826068 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc2506b72a624cb388059efc326abbc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.827028 27228 tablet_bootstrap.cc:654] T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:15.829105 27034 tablet_service.cc:1467] Processing CreateTablet for tablet ff9b649e43a9456fa51cf3330290bb91 (DEFAULT_TABLE table=default.Table_4ce8a3965b484cdb8c1f9b7d7e318755 [id=1ef3626d71d5408692ce0f62d2d5eca1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.829617 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff9b649e43a9456fa51cf3330290bb91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.842540 27024 tablet_service.cc:1467] Processing CreateTablet for tablet 00c4599256684f5dbc745c9283f31a08 (DEFAULT_TABLE table=default.Table_05e208843c2f40e6adbf28e17b7156cd [id=855a2f7a37c84ade8be77e7c0ba17a14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.843113 27023 tablet_service.cc:1467] Processing CreateTablet for tablet 834c9c99ec424bb39e8a003e9204b2bc (DEFAULT_TABLE table=default.Table_e930e7d079ef4035bde1d9a4ef134d62 [id=ad637cef46ef40eeb3182153bcd52f6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.845124 26702 leader_election.cc:302] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:15.848740 26496 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet a7a2cb1d2e8e40f58144908e34438d53
I20260810 11:30:15.849642 26496 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_a6922b81d56f4bf3b5231cc9ada8cb27" } new_table_name: "default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935" modify_external_catalogs: true
I20260810 11:30:15.853827 27386 raft_consensus.cc:2781] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:15.854018 27386 raft_consensus.cc:482] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:15.854116 27386 raft_consensus.cc:3037] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:15.858966 27386 raft_consensus.cc:504] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.860390 27386 leader_election.cc:288] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:15.862407 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d8ce485cb84495a6e964b6d5977f0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:15.862802 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet a18cb43b4dc04a1290a6bade7ac1f3cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:15.863467 26884 tablet_service.cc:1514] Processing DeleteTablet for tablet 96cae4eb16c84410926a317af70e44f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:15.863365 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet e2732660f8964feeb5c03365df065a54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:15.864292 26882 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 132) took 1033 ms. Trace:
I20260810 11:30:15.864929 27231 ts_tablet_manager.cc:1428] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.189s user 0.001s sys 0.002s
I20260810 11:30:15.865502 27231 tablet_bootstrap.cc:492] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:15.867287 26877 tablet_service.cc:1467] Processing CreateTablet for tablet 7cd4f555b5d840c182a31b3c94da9619 (DEFAULT_TABLE table=default.Table_061b7dfbcc074ad6a0d99d49113a354f [id=0186ddbf3c144b4e86ae21cbdac555d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.874538 26893 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 133) took 1027 ms. Trace:
I20260810 11:30:15.874904 27026 tablet_service.cc:1467] Processing CreateTablet for tablet fc023d51790042ce978eb53a2979e29c (DEFAULT_TABLE table=default.Table_66b8d163284b4347b99dea499ed256fc [id=304e1529f45d4d3c8799a22009066ce5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.875551 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 834c9c99ec424bb39e8a003e9204b2bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.877521 26885 tablet_service.cc:1467] Processing CreateTablet for tablet f85c0767ad164075b87ba672cafafb47 (DEFAULT_TABLE table=default.Table_1862cecf49a0499eabbbfba587daf808 [id=6e4c5823f76c4b78bcbfacf90251ddfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.874312 26886 tablet_service.cc:1467] Processing CreateTablet for tablet 83631b421a614796bdf76335f1437e00 (DEFAULT_TABLE table=default.Table_126d22557d424ec99a65925d97b5722a [id=0bcc4778f70e44b8952915c4ba9d6ed8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.878046 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 2801709d53614916abac370f7ae5e913 (DEFAULT_TABLE table=default.Table_be173a149b464952b17280eb1fe40667 [id=53a6520ad3b04ffe88477fd07c159add]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.880973 27024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c4599256684f5dbc745c9283f31a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.883502 26892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a83391804894d268d0e603f4feb1745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.883488 27221 ts_tablet_manager.cc:1905] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:15.882249 26882 rpcz_store.cc:276] 0810 11:30:14.830354 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.830473 (+ 119us) service_pool.cc:227] Handling call
0810 11:30:14.854684 (+ 24211us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:14.854713 (+ 29us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:15.220028 (+365315us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:15.792238 (+572210us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:15.864249 (+ 72011us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:15.889082 27026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc023d51790042ce978eb53a2979e29c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.889254 26884 tablet_service.cc:1514] Processing DeleteTablet for tablet bb0357271cfd46478867a3cc0660bcdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:15.890027 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet a7a2cb1d2e8e40f58144908e34438d53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:15.890511 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "607b055f8ced4372800adf5817b46e0b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:15.893966 27059 raft_consensus.cc:3037] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:15.895180 26891 tablet_service.cc:1514] Processing DeleteTablet for tablet ffeb0373c6124af291336ca9da50c318 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:15.900014 26877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cd4f555b5d840c182a31b3c94da9619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.903699 26891 tablet_service.cc:1467] Processing CreateTablet for tablet 592be61b7e524941931264125b33d92c (DEFAULT_TABLE table=default.Table_359f619c6e054a89898040e2f0d379c3 [id=1c6a2d6a4fa2472a9aff02fecc10077a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.907014 26891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 592be61b7e524941931264125b33d92c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.909670 27059 raft_consensus.cc:2454] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:15.905591 26888 tablet_service.cc:1467] Processing CreateTablet for tablet cb6805a5dd264939850ea2cd9a850a1f (DEFAULT_TABLE table=default.Table_057f1bf3995143138dd2954a212a480b [id=2db59831074f4dd2b4603d6f8215b1d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.912385 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f85c0767ad164075b87ba672cafafb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.913903 26702 leader_election.cc:302] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:15.909634 26884 tablet_service.cc:1467] Processing CreateTablet for tablet e8dc3dece9d84d47a638707d10de6fd4 (DEFAULT_TABLE table=default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.897240 26893 rpcz_store.cc:276] 0810 11:30:14.838125 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.838278 (+ 153us) service_pool.cc:227] Handling call
0810 11:30:14.868447 (+ 30169us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:14.868491 (+ 44us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:15.362293 (+493802us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:15.854394 (+492101us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:15.865411 (+ 11017us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:15.914830 27386 raft_consensus.cc:2781] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:15.915071 27386 raft_consensus.cc:686] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:15.915747 27386 consensus_queue.cc:237] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.922037 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83631b421a614796bdf76335f1437e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.925892 26884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8dc3dece9d84d47a638707d10de6fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.934978 27465 raft_consensus.cc:504] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:15.935843 26893 tablet_service.cc:1467] Processing CreateTablet for tablet 83992214ba314d3fa674e00d8eaddec6 (DEFAULT_TABLE table=default.Table_c7ba8db7c9b742cdb3cfbb476dec5ace [id=52440110b86442d3a04f71c44dc8d655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.947391 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "debc114073e14ec1839c5c4c7c2f1f1e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:15.946830 26882 tablet_service.cc:1467] Processing CreateTablet for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (DEFAULT_TABLE table=default.Table_7429a35104ec4048afb265a7bf71f5b2 [id=ca04b6aa3fda4a89989d4a84d03bb15a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:15.948447 26991 leader_election.cc:341] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:15.949838 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb6805a5dd264939850ea2cd9a850a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.958364 27450 sys_catalog.cc:263] Verifying existing consensus state
I20260810 11:30:15.958503 27222 tablet_bootstrap.cc:492] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:15.959118 26880 tablet_service.cc:1467] Processing CreateTablet for tablet dc2506b72a624cb388059efc326abbc1 (DEFAULT_TABLE table=default.Table_b7e6c83a5d5340b5b960f65b82d4939a [id=553f87ed39f148aba3be0a6fcd13e25d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.959679 27222 ts_tablet_manager.cc:1397] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.498s user 0.015s sys 0.020s
I20260810 11:30:15.960987 27222 raft_consensus.cc:348] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:15.961328 27222 raft_consensus.cc:374] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:15.961529 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83992214ba314d3fa674e00d8eaddec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.961594 27222 raft_consensus.cc:729] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:15.961923 27222 consensus_queue.cc:260] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:15.962669 27222 ts_tablet_manager.cc:1428] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 11:30:15.963066 27222 tablet_bootstrap.cc:492] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:15.966212 27222 tablet_bootstrap.cc:654] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:15.969592 27222 tablet_bootstrap.cc:492] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:15.969790 27222 ts_tablet_manager.cc:1397] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260810 11:30:15.970858 27222 raft_consensus.cc:348] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:15.971283 27222 raft_consensus.cc:374] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:15.971374 27222 raft_consensus.cc:729] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:15.977705 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 603fe104b7ab485eab6b225a58bddc1c (DEFAULT_TABLE table=default.Table_a5fcf59dae954757a15883ee4da1bf29 [id=758863f16efe460e90394a491cad8914]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:15.971753 27222 consensus_queue.cc:260] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:15.978790 27222 ts_tablet_manager.cc:1428] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260810 11:30:15.982918 27222 tablet_bootstrap.cc:492] T 2fc76603bf8843dab18c95fdab9a8be0 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:15.985913 27221 ts_tablet_manager.cc:1918] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:15.986234 27221 log.cc:1196] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/2efaf8b45a824e34b7f23037de5eec45
I20260810 11:30:15.987021 27221 ts_tablet_manager.cc:1939] T 2efaf8b45a824e34b7f23037de5eec45 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:15.987212 26493 master_service.cc:946] ReplaceTablet: received request to replace tablet e25ae21cc8cc4749a507fcab5ee225a3 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:15.988121 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_538c35ba9808453e870597b4257cefaa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:15.988893 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_538c35ba9808453e870597b4257cefaa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:15.990360 27222 tablet_bootstrap.cc:654] T 2fc76603bf8843dab18c95fdab9a8be0 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:15.990773 26498 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f85c0767ad164075b87ba672cafafb47 consensus state has no leader
I20260810 11:30:15.991210 26498 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_057f1bf3995143138dd2954a212a480b" } modify_external_catalogs: true
I20260810 11:30:15.991492 26498 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_057f1bf3995143138dd2954a212a480b" } modify_external_catalogs: true
I20260810 11:30:16.015354 27033 tablet_service.cc:1514] Processing DeleteTablet for tablet a7a2cb1d2e8e40f58144908e34438d53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:16.016733 27465 leader_election.cc:288] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:15.983664 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2801709d53614916abac370f7ae5e913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.018168 27386 raft_consensus.cc:482] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:16.019479 27231 tablet_bootstrap.cc:654] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:16.020340 26882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 983916da755d4d14b7a3d43bb7cbc9c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.020742 26880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc2506b72a624cb388059efc326abbc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:15.994590 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "607b055f8ced4372800adf5817b46e0b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:16.017565 27223 ts_tablet_manager.cc:1918] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:16.028950 27386 raft_consensus.cc:504] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:16.029918 27386 leader_election.cc:288] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:16.030699 26700 leader_election.cc:341] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:16.040388 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 128) took 1662 ms. Trace:
I20260810 11:30:16.048228 27450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Bootstrap starting.
I20260810 11:30:16.046535 27221 rpcz_store.cc:276] 0810 11:30:14.339227 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.339279 (+ 52us) service_pool.cc:227] Handling call
0810 11:30:15.665762 (+1326483us) ts_tablet_manager.cc:1145] Deleting tablet 2efaf8b45a824e34b7f23037de5eec45
0810 11:30:15.665782 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:15.930922 (+265140us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:15.985592 (+ 54670us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.001497 (+ 15905us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1324642}
I20260810 11:30:16.054313 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 2efaf8b45a824e34b7f23037de5eec45 (table default.Table_a006976247434094b81729d5aa32d9f7 [id=bf77960e83134a008f3e19008893a6e1]) successfully deleted
I20260810 11:30:16.056826 27221 tablet_replica.cc:330] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:16.065635 27221 raft_consensus.cc:2229] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:16.067010 27248 ts_tablet_manager.cc:1918] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:16.068430 27221 raft_consensus.cc:2258] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:16.071820 27222 tablet_bootstrap.cc:492] T 2fc76603bf8843dab18c95fdab9a8be0 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:16.072111 27222 ts_tablet_manager.cc:1397] T 2fc76603bf8843dab18c95fdab9a8be0 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.089s user 0.009s sys 0.024s
I20260810 11:30:16.073385 27222 raft_consensus.cc:348] T 2fc76603bf8843dab18c95fdab9a8be0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.074777 27222 raft_consensus.cc:374] T 2fc76603bf8843dab18c95fdab9a8be0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:16.075371 27221 ts_tablet_manager.cc:1905] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:16.076721 27222 raft_consensus.cc:729] T 2fc76603bf8843dab18c95fdab9a8be0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:16.077585 27222 consensus_queue.cc:260] T 2fc76603bf8843dab18c95fdab9a8be0 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.081085 27222 ts_tablet_manager.cc:1428] T 2fc76603bf8843dab18c95fdab9a8be0 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260810 11:30:16.081822 27222 tablet_bootstrap.cc:492] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:16.083546 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b754dc2568849deafc7a8dc6d81924c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:16.084856 26702 leader_election.cc:341] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:16.085180 27385 raft_consensus.cc:482] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:16.085367 27385 raft_consensus.cc:504] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:16.086081 27385 leader_election.cc:288] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:16.089576 27248 log.cc:1196] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/7edd85afa247429f92d4ed2f7c35ee16
I20260810 11:30:16.090178 27248 ts_tablet_manager.cc:1939] T 7edd85afa247429f92d4ed2f7c35ee16 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:16.091984 27222 tablet_bootstrap.cc:654] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:16.092679 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 90) took 2682 ms. Trace:
I20260810 11:30:16.092896 27248 rpcz_store.cc:276] 0810 11:30:13.409040 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:13.416392 (+ 7352us) service_pool.cc:227] Handling call
0810 11:30:15.476969 (+2060577us) ts_tablet_manager.cc:1145] Deleting tablet 7edd85afa247429f92d4ed2f7c35ee16
0810 11:30:15.476984 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:15.900068 (+423084us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.066864 (+166796us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.091235 (+ 24371us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2056475}
I20260810 11:30:16.094010 26993 leader_election.cc:302] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:16.094758 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 7edd85afa247429f92d4ed2f7c35ee16 (table default.Table_6ded95de14fd42ef926969f573a166c5 [id=6bc27d6198fc4654aa20602a3917569e]) successfully deleted
W20260810 11:30:16.095942 26849 leader_election.cc:341] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: e2732660f8964feeb5c03365df065a54
I20260810 11:30:16.108968 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 95) took 2559 ms. Trace:
I20260810 11:30:16.109277 27465 raft_consensus.cc:2741] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260810 11:30:16.110049 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 92452.3us
W20260810 11:30:16.111367 26992 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.560s user 0.068s sys 0.144s
W20260810 11:30:16.111635 26992 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.560s user 0.068s sys 0.144s
I20260810 11:30:16.112032 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2732660f8964feeb5c03365df065a54" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:16.112830 27111 heartbeater.cc:347] Connected to a master server at 127.25.195.254:41125
I20260810 11:30:16.113070 27111 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
W20260810 11:30:16.116922 26848 leader_election.cc:341] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:16.117204 26848 leader_election.cc:302] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:16.117080 27248 rpcz_store.cc:276] 0810 11:30:13.534543 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:13.539600 (+ 5057us) service_pool.cc:227] Handling call
0810 11:30:16.093744 (+2554144us) ts_tablet_manager.cc:1145] Deleting tablet 1e0a8513171f4c39b74c08760a139d9e
0810 11:30:16.093761 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.093953 (+ 192us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2553866}
I20260810 11:30:16.117879 27385 raft_consensus.cc:2726] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:16.118321 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 1e0a8513171f4c39b74c08760a139d9e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e0a8513171f4c39b74c08760a139d9e already in progress: creating tablet
I20260810 11:30:16.119046 27223 log.cc:1196] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/c0120575c9fd4b2fb32ca7392db277bf
I20260810 11:30:16.120365 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 96) took 2569 ms. Trace:
I20260810 11:30:16.120540 27248 rpcz_store.cc:276] 0810 11:30:13.551245 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:13.551334 (+ 89us) service_pool.cc:227] Handling call
0810 11:30:16.119833 (+2568499us) ts_tablet_manager.cc:1145] Deleting tablet 7e3707ae32624f6483866208321eefde
0810 11:30:16.119963 (+ 130us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.120230 (+ 267us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2568061}
I20260810 11:30:16.121447 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 603fe104b7ab485eab6b225a58bddc1c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:16.121773 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7e3707ae32624f6483866208321eefde because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e3707ae32624f6483866208321eefde already in progress: creating tablet
I20260810 11:30:16.124212 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 478c0c39658349c39e3afa1aa1653e82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:16.129856 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b754dc2568849deafc7a8dc6d81924c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:16.133177 26496 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6c715bdcff8c4cdabfddf871f6fdc388 consensus state has no leader
W20260810 11:30:16.133441 26495 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f3884736eec74c8992b8d51b37465875 consensus state has no leader
I20260810 11:30:16.137485 26500 catalog_manager.cc:5495] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:16.138190 26500 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 6c5b650bc02f4fa393bada5b54c77f1f (table default.Table_c03b9743d9e8475dbb617d058873deae [id=3d8c46d7a15e457a93fd615ad99a4f36]). Expected version 3 got 0
I20260810 11:30:16.145721 27024 tablet_service.cc:1467] Processing CreateTablet for tablet 3851d39aeb3142938a5ac558ab438c21 (DEFAULT_TABLE table=default.Table_07ad990413b541f5b90b5f0f813635d3 [id=b6d04667c02048fda37c47346472dba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.146490 27024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3851d39aeb3142938a5ac558ab438c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.150825 27450 log.cc:824] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Log is configured to *not* fsync() on all Append() calls
I20260810 11:30:16.162993 27034 tablet_service.cc:1467] Processing CreateTablet for tablet 0713f4f14a284050a7774a70ab974f30 (DEFAULT_TABLE table=default.Table_a87ac76268094e76aafcb7a2766c0f1e [id=730b858701d54c73a1456c3821d069e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.165395 27024 tablet_service.cc:1467] Processing CreateTablet for tablet fccc21cfc1ce4eb586f03276ec6e987f (DEFAULT_TABLE table=default.Table_fb8c5684b00a41eebe3f5b088bcbee33 [id=e22f19a993564e53b1cc76633f25f505]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.165756 27023 tablet_service.cc:1467] Processing CreateTablet for tablet 720ef9404cb44551aaf39687f0cf94c9 (DEFAULT_TABLE table=default.Table_dfd9941b72e749a7b7e7bc153705cfec [id=63a4145d875d40dc95b606df4380204e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.163671 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 44d5e146eeec4fe0be33c1c169d32e68 (DEFAULT_TABLE table=default.Table_733cd3d375dd4cf9b1297c9395073c3c [id=9b6492211433453495bdb14155a56a85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.173422 27024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fccc21cfc1ce4eb586f03276ec6e987f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.183719 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0713f4f14a284050a7774a70ab974f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.191334 27111 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:16.191393 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 720ef9404cb44551aaf39687f0cf94c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.192288 27022 tablet_service.cc:1467] Processing CreateTablet for tablet d512c335e340437fa32f2dc16dca6812 (DEFAULT_TABLE table=default.Table_35bebbfa863b4eafa72471a4b6325d2d [id=09e6c654505c448389915f4b634188b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.196786 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44d5e146eeec4fe0be33c1c169d32e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.197387 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d512c335e340437fa32f2dc16dca6812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.205596 27231 tablet_bootstrap.cc:492] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:16.205883 27231 ts_tablet_manager.cc:1397] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.340s user 0.002s sys 0.007s
I20260810 11:30:16.207322 27231 raft_consensus.cc:348] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:16.207734 27231 raft_consensus.cc:374] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:16.207854 27231 raft_consensus.cc:729] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:16.208175 27231 consensus_queue.cc:260] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:16.209611 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 99) took 2569 ms. Trace:
I20260810 11:30:16.209795 27248 rpcz_store.cc:276] 0810 11:30:13.640239 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:13.640309 (+ 70us) service_pool.cc:227] Handling call
0810 11:30:16.209338 (+2569029us) ts_tablet_manager.cc:1145] Deleting tablet 79953795f07845aba3f028741cdcdd9e
0810 11:30:16.209367 (+ 29us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.209522 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2568648}
I20260810 11:30:16.210373 27248 tablet_replica.cc:330] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:16.210632 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 79953795f07845aba3f028741cdcdd9e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79953795f07845aba3f028741cdcdd9e already in progress: creating tablet
W20260810 11:30:16.210958 26700 leader_election.cc:341] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:16.216748 27231 ts_tablet_manager.cc:1428] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260810 11:30:16.217320 27231 tablet_bootstrap.cc:492] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:16.221726 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_2d72673d9e86472ca07d3c7d36f51108"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:16.222707 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d72673d9e86472ca07d3c7d36f51108 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:16.222810 26700 leader_election.cc:302] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:16.224067 27386 raft_consensus.cc:2726] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:16.224918 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_fd64c13d7a514c7285b42e1c91a63cdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:16.225852 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd64c13d7a514c7285b42e1c91a63cdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:16.229240 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_4e27e43aa8d9444ca022be053fcd700e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:16.230091 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e27e43aa8d9444ca022be053fcd700e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:16.233211 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "debc114073e14ec1839c5c4c7c2f1f1e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
W20260810 11:30:16.228886 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 92808.9us
I20260810 11:30:16.233534 26765 raft_consensus.cc:3037] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:16.235285 26993 consensus_peers.cc:487] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3dabfbd779c5406cb10ecf70f5a142e7. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:16.241842 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 720ef9404cb44551aaf39687f0cf94c9 (DEFAULT_TABLE table=default.Table_dfd9941b72e749a7b7e7bc153705cfec [id=63a4145d875d40dc95b606df4380204e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.243201 26748 tablet_service.cc:1467] Processing CreateTablet for tablet d512c335e340437fa32f2dc16dca6812 (DEFAULT_TABLE table=default.Table_35bebbfa863b4eafa72471a4b6325d2d [id=09e6c654505c448389915f4b634188b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.250378 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 44d5e146eeec4fe0be33c1c169d32e68 (DEFAULT_TABLE table=default.Table_733cd3d375dd4cf9b1297c9395073c3c [id=9b6492211433453495bdb14155a56a85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.129370 26879 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 152) took 1019 ms. Trace:
I20260810 11:30:16.252462 26876 tablet_service.cc:1467] Processing CreateTablet for tablet b9195690e00b4f3cb3d5076dcca3519c (DEFAULT_TABLE table=default.Table_6f7ae1749f224614a4fdaa33b125864d [id=339298a1ea1747d59a035a6a3cadfb30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.255676 26731 tablet_service.cc:1467] Processing CreateTablet for tablet 3851d39aeb3142938a5ac558ab438c21 (DEFAULT_TABLE table=default.Table_07ad990413b541f5b90b5f0f813635d3 [id=b6d04667c02048fda37c47346472dba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.256667 26729 tablet_service.cc:1467] Processing CreateTablet for tablet fccc21cfc1ce4eb586f03276ec6e987f (DEFAULT_TABLE table=default.Table_fb8c5684b00a41eebe3f5b088bcbee33 [id=e22f19a993564e53b1cc76633f25f505]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.256433 26732 tablet_service.cc:1467] Processing CreateTablet for tablet 0713f4f14a284050a7774a70ab974f30 (DEFAULT_TABLE table=default.Table_a87ac76268094e76aafcb7a2766c0f1e [id=730b858701d54c73a1456c3821d069e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.257484 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 720ef9404cb44551aaf39687f0cf94c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.258142 26765 raft_consensus.cc:2454] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:16.258826 27228 tablet_bootstrap.cc:492] T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:16.258920 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d512c335e340437fa32f2dc16dca6812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.259166 26890 tablet_service.cc:1467] Processing CreateTablet for tablet ac4b1821ac30452cbe7a8f844d9b37e5 (DEFAULT_TABLE table=default.Table_63ffd347d32d42dd8cc4f722268cd009 [id=bbde7d0c0eb543e79e48a60205aa8079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.262537 26731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3851d39aeb3142938a5ac558ab438c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.262737 27221 ts_tablet_manager.cc:1918] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:16.263908 26729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fccc21cfc1ce4eb586f03276ec6e987f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.264633 27221 log.cc:1196] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/d98948300fe6472295ea53cedb7d386c
I20260810 11:30:16.264649 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0713f4f14a284050a7774a70ab974f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.265578 26876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9195690e00b4f3cb3d5076dcca3519c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.264724 26887 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 153) took 1019 ms. Trace:
I20260810 11:30:16.266453 26887 rpcz_store.cc:276] 0810 11:30:15.103272 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.325637 (+222365us) service_pool.cc:227] Handling call
0810 11:30:15.629577 (+303940us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:15.629606 (+ 29us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:15.902593 (+272987us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.121316 (+218723us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:16.122860 (+ 1544us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:16.267096 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 91b6078efadf496fb252f725bdf56b02 (DEFAULT_TABLE table=default.Table_f5acadd3f7ff49d4883a695e2348164f [id=02cec75d98d0411ba2eb17ae8f083f00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.268699 26879 rpcz_store.cc:276] 0810 11:30:15.103128 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.255515 (+152387us) service_pool.cc:227] Handling call
0810 11:30:15.401261 (+145746us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:15.401345 (+ 84us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:15.939111 (+537766us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.122304 (+183193us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:16.122432 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:16.269865 26887 tablet_service.cc:1467] Processing CreateTablet for tablet a8a65a0e8b1f4e4b8d9a82059b766cda (DEFAULT_TABLE table=default.Table_ad62ebe50ede4d7d96922bac3e954f9e [id=a9ff451e18b54994abfa288ecac98560]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.270673 26895 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 143) took 1130 ms. Trace:
I20260810 11:30:16.276120 26499 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 2801709d53614916abac370f7ae5e913
I20260810 11:30:16.279691 26493 master_service.cc:946] ReplaceTablet: received request to replace tablet ffeb0373c6124af291336ca9da50c318 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:16.281306 26993 leader_election.cc:302] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:16.285461 27465 raft_consensus.cc:2781] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:16.286588 27248 raft_consensus.cc:2229] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:16.287935 27111 heartbeater.cc:347] Connected to a master server at 127.25.195.254:41125
I20260810 11:30:16.288170 27111 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:16.291282 27465 raft_consensus.cc:686] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:16.292770 27026 tablet_service.cc:1514] Processing DeleteTablet for tablet 2801709d53614916abac370f7ae5e913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:16.300637 27465 consensus_queue.cc:237] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:16.307117 27231 tablet_bootstrap.cc:654] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:16.308000 27248 raft_consensus.cc:2258] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:16.308647 27450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=14 ignored=0} inserts{seen=23 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260810 11:30:16.309751 27450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Bootstrap complete.
I20260810 11:30:16.312357 27248 ts_tablet_manager.cc:1905] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:16.324508 26890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac4b1821ac30452cbe7a8f844d9b37e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.325838 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 31888ddeafe14738b818016a9c0a4ad3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:16.326419 26889 tablet_service.cc:1467] Processing CreateTablet for tablet fc023d51790042ce978eb53a2979e29c (DEFAULT_TABLE table=default.Table_66b8d163284b4347b99dea499ed256fc [id=304e1529f45d4d3c8799a22009066ce5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.326891 27228 ts_tablet_manager.cc:1397] T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.706s user 0.026s sys 0.068s
I20260810 11:30:16.328167 27228 raft_consensus.cc:348] T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:16.328449 27228 raft_consensus.cc:374] T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:16.328547 27228 raft_consensus.cc:729] T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:16.270367 27222 tablet_bootstrap.cc:492] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:16.328914 27228 consensus_queue.cc:260] T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:16.329064 27222 ts_tablet_manager.cc:1397] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.247s user 0.028s sys 0.045s
I20260810 11:30:16.329553 27228 ts_tablet_manager.cc:1428] T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 11:30:16.329950 27228 tablet_bootstrap.cc:492] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:16.330451 27223 ts_tablet_manager.cc:1939] T c0120575c9fd4b2fb32ca7392db277bf P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:16.330279 27222 raft_consensus.cc:348] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.330701 27222 raft_consensus.cc:374] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:16.330960 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 131) took 1534 ms. Trace:
I20260810 11:30:16.330907 27222 raft_consensus.cc:729] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:16.331147 27223 rpcz_store.cc:276] 0810 11:30:14.796908 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.796994 (+ 86us) service_pool.cc:227] Handling call
0810 11:30:15.655519 (+858525us) ts_tablet_manager.cc:1145] Deleting tablet c0120575c9fd4b2fb32ca7392db277bf
0810 11:30:15.655539 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:15.784938 (+129399us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.000513 (+215575us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.330911 (+330398us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":841145}
I20260810 11:30:16.331845 27223 tablet_replica.cc:330] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:16.332160 27223 raft_consensus.cc:2229] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:16.332357 27223 raft_consensus.cc:2258] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:16.329365 27450 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:16.333050 27223 ts_tablet_manager.cc:1905] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:16.332422 27222 consensus_queue.cc:260] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.333710 26497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 0033d61d07d84262a98b0ebc54bd7960
I20260810 11:30:16.334823 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_a3ca31166a6348f68da88913588098df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:16.335156 26500 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_3c5493f70dc44bab811f7605b20c81b7" } new_table_name: "default.Table_7c78d2fb5de4496795d089bc825027e6" modify_external_catalogs: true
W20260810 11:30:16.335575 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3ca31166a6348f68da88913588098df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:16.338033 26465 master_runner.cc:186] Error getting master registration for 127.25.195.254:41125: OK, instance_id { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" instance_seqno: 1786361414379548 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 11:30:16.338038 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_64f83258168749f88b4697bfee40bc2f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:16.338379 26465 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 11:30:16.338773 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64f83258168749f88b4697bfee40bc2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:16.281008 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet 2801709d53614916abac370f7ae5e913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:16.335227 26491 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c03b9743d9e8475dbb617d058873deae" } new_table_name: "default.Table_0541fad2df4246c69ea4c710c167a284" modify_external_catalogs: true
I20260810 11:30:16.341500 26493 master_service.cc:946] ReplaceTablet: received request to replace tablet e2732660f8964feeb5c03365df065a54 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:16.342175 26493 master_service.cc:946] ReplaceTablet: received request to replace tablet 5adcec593b8c4d40997c8911e9f77c85 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:16.318128 27386 raft_consensus.cc:482] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:16.325662 27221 ts_tablet_manager.cc:1939] T d98948300fe6472295ea53cedb7d386c P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:16.343132 27386 raft_consensus.cc:504] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:16.344226 27386 leader_election.cc:288] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:16.302300 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44d5e146eeec4fe0be33c1c169d32e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.344735 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 129) took 1991 ms. Trace:
I20260810 11:30:16.345042 27221 rpcz_store.cc:276] 0810 11:30:14.353161 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.353993 (+ 832us) service_pool.cc:227] Handling call
0810 11:30:16.055681 (+1701688us) ts_tablet_manager.cc:1145] Deleting tablet d98948300fe6472295ea53cedb7d386c
0810 11:30:16.055868 (+ 187us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.216876 (+161008us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.262507 (+ 45631us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.344609 (+ 82102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1700833}
I20260810 11:30:16.346030 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet d98948300fe6472295ea53cedb7d386c (table default.Table_642d4dc06a4a436ea666abb1ae5e6f7f [id=e3215507fa424c3d9fce745d5b906536]) successfully deleted
I20260810 11:30:16.346668 27221 tablet_replica.cc:330] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:16.347133 27221 raft_consensus.cc:2229] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:16.347522 27221 raft_consensus.cc:2258] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:16.348654 27450 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83cc8e39a3b9455f8242a6da6a54c38a, State: Initialized, Role: FOLLOWER
I20260810 11:30:16.349831 26964 heartbeater.cc:347] Connected to a master server at 127.25.195.254:41125
I20260810 11:30:16.350138 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79953795f07845aba3f028741cdcdd9e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:16.349567 27450 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 1.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:16.350786 26895 rpcz_store.cc:276] 0810 11:30:14.991319 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.991441 (+ 122us) service_pool.cc:227] Handling call
0810 11:30:15.031522 (+ 40081us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:15.031558 (+ 36us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:15.934093 (+902535us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.039104 (+105011us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:16.121370 (+ 82266us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:16.352265 27222 ts_tablet_manager.cc:1428] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.023s user 0.003s sys 0.001s
I20260810 11:30:16.338881 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 2efaf8b45a824e34b7f23037de5eec45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:16.339447 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e2c9112462f442e8de5b4a944cfdc6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:16.339669 26731 tablet_service.cc:1514] Processing DeleteTablet for tablet 0033d61d07d84262a98b0ebc54bd7960 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:16.354914 27221 ts_tablet_manager.cc:1905] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:16.355877 27222 tablet_bootstrap.cc:492] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:16.352844 26700 leader_election.cc:341] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:16.355448 26879 tablet_service.cc:1467] Processing CreateTablet for tablet ff9b649e43a9456fa51cf3330290bb91 (DEFAULT_TABLE table=default.Table_4ce8a3965b484cdb8c1f9b7d7e318755 [id=1ef3626d71d5408692ce0f62d2d5eca1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.365278 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 834c9c99ec424bb39e8a003e9204b2bc (DEFAULT_TABLE table=default.Table_e930e7d079ef4035bde1d9a4ef134d62 [id=ad637cef46ef40eeb3182153bcd52f6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.374727 26912 raft_consensus.cc:3037] T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:16.381007 26887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8a65a0e8b1f4e4b8d9a82059b766cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.382223 27222 tablet_bootstrap.cc:654] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:16.382360 27026 tablet_service.cc:1514] Processing DeleteTablet for tablet 0033d61d07d84262a98b0ebc54bd7960 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:16.338464 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 79953795f07845aba3f028741cdcdd9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:16.390244 27450 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 11:30:16.393355 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet c0120575c9fd4b2fb32ca7392db277bf (table default.Table_8e3537dc1b294128b70896bf5501c85e [id=91a6a06504b24b8892a26d1ec11da667]) successfully deleted
I20260810 11:30:16.395128 26892 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 160) took 1275 ms. Trace:
I20260810 11:30:16.399888 26878 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 158) took 1295 ms. Trace:
I20260810 11:30:16.400720 26879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff9b649e43a9456fa51cf3330290bb91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.398057 27487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:16.409399 27024 tablet_service.cc:1514] Processing DeleteTablet for tablet d98948300fe6472295ea53cedb7d386c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:16.411042 26878 rpcz_store.cc:276] 0810 11:30:15.104635 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.665650 (+561015us) service_pool.cc:227] Handling call
0810 11:30:15.715551 (+ 49901us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:15.715592 (+ 41us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:16.014201 (+298609us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.399558 (+385357us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:16.399793 (+ 235us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:16.412057 26878 tablet_service.cc:1467] Processing CreateTablet for tablet 00c4599256684f5dbc745c9283f31a08 (DEFAULT_TABLE table=default.Table_05e208843c2f40e6adbf28e17b7156cd [id=855a2f7a37c84ade8be77e7c0ba17a14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.413189 26892 rpcz_store.cc:276] 0810 11:30:15.104912 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.742885 (+637973us) service_pool.cc:227] Handling call
0810 11:30:15.859687 (+116802us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:15.859716 (+ 29us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:15.991516 (+131800us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.370074 (+378558us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:16.380738 (+ 10664us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:16.413932 26892 tablet_service.cc:1514] Processing DeleteTablet for tablet a7a2cb1d2e8e40f58144908e34438d53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:16.414633 26892 tablet_service.cc:1467] Processing CreateTablet for tablet 3851d39aeb3142938a5ac558ab438c21 (DEFAULT_TABLE table=default.Table_07ad990413b541f5b90b5f0f813635d3 [id=b6d04667c02048fda37c47346472dba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.418607 26888 tablet_service.cc:1467] Processing CreateTablet for tablet 44d5e146eeec4fe0be33c1c169d32e68 (DEFAULT_TABLE table=default.Table_733cd3d375dd4cf9b1297c9395073c3c [id=9b6492211433453495bdb14155a56a85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.432425 27487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:16.434710 27386 raft_consensus.cc:482] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:16.434983 27386 raft_consensus.cc:504] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.435243 27379 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:16.436040 27386 leader_election.cc:288] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:16.436774 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79953795f07845aba3f028741cdcdd9e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:16.438215 26702 leader_election.cc:341] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:16.438432 26702 leader_election.cc:302] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:16.439781 27386 raft_consensus.cc:2726] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:16.444772 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3c6bd6803c245b7bb3d78423de482b6" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:16.445842 26702 leader_election.cc:341] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:16.458559 27221 ts_tablet_manager.cc:1918] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:16.458817 27221 log.cc:1196] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/debc114073e14ec1839c5c4c7c2f1f1e
I20260810 11:30:16.459457 27111 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:16.464056 27221 ts_tablet_manager.cc:1939] T debc114073e14ec1839c5c4c7c2f1f1e P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:16.465327 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 130) took 1880 ms. Trace:
I20260810 11:30:16.465687 27221 rpcz_store.cc:276] 0810 11:30:14.585046 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.585280 (+ 234us) service_pool.cc:227] Handling call
0810 11:30:16.346505 (+1761225us) ts_tablet_manager.cc:1145] Deleting tablet debc114073e14ec1839c5c4c7c2f1f1e
0810 11:30:16.346520 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.401432 (+ 54912us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.436919 (+ 35487us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.465267 (+ 28348us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1760920}
I20260810 11:30:16.466490 27221 tablet_replica.cc:330] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:16.466434 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet debc114073e14ec1839c5c4c7c2f1f1e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]) successfully deleted
I20260810 11:30:16.466822 27221 raft_consensus.cc:2229] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:16.467145 27221 raft_consensus.cc:2258] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:16.468075 27221 ts_tablet_manager.cc:1905] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:16.493192 27465 consensus_queue.cc:1035] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:16.496855 27221 ts_tablet_manager.cc:1918] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:16.497617 27221 log.cc:1196] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/97d586d35ff144a681ad52756f4be2b6
I20260810 11:30:16.504024 27221 ts_tablet_manager.cc:1939] T 97d586d35ff144a681ad52756f4be2b6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:16.505702 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 131) took 1920 ms. Trace:
I20260810 11:30:16.506042 27221 rpcz_store.cc:276] 0810 11:30:14.585212 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.585617 (+ 405us) service_pool.cc:227] Handling call
0810 11:30:16.466376 (+1880759us) ts_tablet_manager.cc:1145] Deleting tablet 97d586d35ff144a681ad52756f4be2b6
0810 11:30:16.466391 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.485366 (+ 18975us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.496124 (+ 10758us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.505600 (+ 9476us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1879364}
I20260810 11:30:16.506902 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 97d586d35ff144a681ad52756f4be2b6 (table default.Table_1515258cce7d473aa7c53c67c527ff8b [id=5051d9c6d4b8419fbc5e34fbcfe62e7e]) successfully deleted
I20260810 11:30:16.507263 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 133) took 1861 ms. Trace:
I20260810 11:30:16.507468 27221 rpcz_store.cc:276] 0810 11:30:14.646171 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.647695 (+ 1524us) service_pool.cc:227] Handling call
0810 11:30:16.506861 (+1859166us) ts_tablet_manager.cc:1145] Deleting tablet 43e42cc642544f779bb79cee7479c4f4
0810 11:30:16.506878 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.507131 (+ 253us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1853972}
W20260810 11:30:16.508440 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 43e42cc642544f779bb79cee7479c4f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43e42cc642544f779bb79cee7479c4f4 already in progress: creating tablet
I20260810 11:30:16.508636 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 134) took 1862 ms. Trace:
I20260810 11:30:16.508767 27221 rpcz_store.cc:276] 0810 11:30:14.646267 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.647781 (+ 1514us) service_pool.cc:227] Handling call
0810 11:30:16.508356 (+1860575us) ts_tablet_manager.cc:1145] Deleting tablet 4b15cc8669b549a2b4461dccd66a0c5a
0810 11:30:16.508371 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.508514 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1855214}
W20260810 11:30:16.509363 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 4b15cc8669b549a2b4461dccd66a0c5a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b15cc8669b549a2b4461dccd66a0c5a already in progress: creating tablet
I20260810 11:30:16.509492 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 146) took 1793 ms. Trace:
I20260810 11:30:16.509604 27221 rpcz_store.cc:276] 0810 11:30:14.715973 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.716455 (+ 482us) service_pool.cc:227] Handling call
0810 11:30:16.509265 (+1792810us) ts_tablet_manager.cc:1145] Deleting tablet a28849649c704f2fbdec1aced9ce01b1
0810 11:30:16.509277 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.509417 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1767862}
W20260810 11:30:16.510636 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet a28849649c704f2fbdec1aced9ce01b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a28849649c704f2fbdec1aced9ce01b1 already in progress: creating tablet
I20260810 11:30:16.511233 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 149) took 1676 ms. Trace:
I20260810 11:30:16.511600 27221 rpcz_store.cc:276] 0810 11:30:14.834312 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.844524 (+ 10212us) service_pool.cc:227] Handling call
0810 11:30:16.510619 (+1666095us) ts_tablet_manager.cc:1145] Deleting tablet e25ae21cc8cc4749a507fcab5ee225a3
0810 11:30:16.510642 (+ 23us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.511056 (+ 414us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1647272}
W20260810 11:30:16.512466 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet e25ae21cc8cc4749a507fcab5ee225a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e25ae21cc8cc4749a507fcab5ee225a3 already in progress: creating tablet
I20260810 11:30:16.512739 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 154) took 1634 ms. Trace:
I20260810 11:30:16.512930 27221 rpcz_store.cc:276] 0810 11:30:14.878442 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.878754 (+ 312us) service_pool.cc:227] Handling call
0810 11:30:16.512315 (+1633561us) ts_tablet_manager.cc:1145] Deleting tablet d729baae40a64e6e8c23e6870f230afb
0810 11:30:16.512329 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.512666 (+ 337us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1616648}
W20260810 11:30:16.513672 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet d729baae40a64e6e8c23e6870f230afb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d729baae40a64e6e8c23e6870f230afb already in progress: creating tablet
I20260810 11:30:16.513758 27221 tablet_replica.cc:330] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:16.514216 27221 raft_consensus.cc:2229] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:16.514748 27221 raft_consensus.cc:2258] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:16.515836 27221 ts_tablet_manager.cc:1905] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:16.439620 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3c6bd6803c245b7bb3d78423de482b6" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:16.456640 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91b6078efadf496fb252f725bdf56b02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.478919 26886 tablet_service.cc:1467] Processing CreateTablet for tablet 0713f4f14a284050a7774a70ab974f30 (DEFAULT_TABLE table=default.Table_a87ac76268094e76aafcb7a2766c0f1e [id=730b858701d54c73a1456c3821d069e2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:16.481772 26884 consensus_meta.cc:287] T e8dc3dece9d84d47a638707d10de6fd4 P b6079090b1124d84aa4477974bb53700: Time spent flushing consensus metadata: real 0.529s user 0.003s sys 0.003s
W20260810 11:30:16.518064 26700 leader_election.cc:341] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:16.518409 26700 leader_election.cc:302] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:16.499513 26877 tablet_service.cc:1467] Processing CreateTablet for tablet fccc21cfc1ce4eb586f03276ec6e987f (DEFAULT_TABLE table=default.Table_fb8c5684b00a41eebe3f5b088bcbee33 [id=e22f19a993564e53b1cc76633f25f505]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.500069 26885 tablet_service.cc:1467] Processing CreateTablet for tablet 720ef9404cb44551aaf39687f0cf94c9 (DEFAULT_TABLE table=default.Table_dfd9941b72e749a7b7e7bc153705cfec [id=63a4145d875d40dc95b606df4380204e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.519094 27386 raft_consensus.cc:2726] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:16.529461 26891 consensus_meta.cc:287] T 592be61b7e524941931264125b33d92c P b6079090b1124d84aa4477974bb53700: Time spent flushing consensus metadata: real 0.521s user 0.006s sys 0.000s
I20260810 11:30:16.530763 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc023d51790042ce978eb53a2979e29c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.532545 27221 ts_tablet_manager.cc:1918] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:16.532939 27221 log.cc:1196] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/2c6b3f8626724d12986f388b1ca90b3c
I20260810 11:30:16.533655 27221 ts_tablet_manager.cc:1939] T 2c6b3f8626724d12986f388b1ca90b3c P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:16.534978 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 156) took 1643 ms. Trace:
I20260810 11:30:16.535239 27221 rpcz_store.cc:276] 0810 11:30:14.892022 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.892853 (+ 831us) service_pool.cc:227] Handling call
0810 11:30:16.513629 (+1620776us) ts_tablet_manager.cc:1145] Deleting tablet 2c6b3f8626724d12986f388b1ca90b3c
0810 11:30:16.513643 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.522570 (+ 8927us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.532334 (+ 9764us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.534910 (+ 2576us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1617588}
I20260810 11:30:16.536219 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 157) took 1644 ms. Trace:
I20260810 11:30:16.536396 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 2c6b3f8626724d12986f388b1ca90b3c (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]) successfully deleted
I20260810 11:30:16.536430 27221 rpcz_store.cc:276] 0810 11:30:14.892196 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.892891 (+ 695us) service_pool.cc:227] Handling call
0810 11:30:16.536017 (+1643126us) ts_tablet_manager.cc:1145] Deleting tablet 31cafb7c691d40a48a40f7d4190c4f8d
0810 11:30:16.536033 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.536178 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1639795}
I20260810 11:30:16.536931 27221 tablet_replica.cc:330] T 2fc76603bf8843dab18c95fdab9a8be0 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
W20260810 11:30:16.537070 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 31cafb7c691d40a48a40f7d4190c4f8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31cafb7c691d40a48a40f7d4190c4f8d already in progress: creating tablet
I20260810 11:30:16.537243 27221 raft_consensus.cc:2229] T 2fc76603bf8843dab18c95fdab9a8be0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:16.537498 27221 raft_consensus.cc:2258] T 2fc76603bf8843dab18c95fdab9a8be0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:16.538240 26884 tablet_service.cc:1514] Processing DeleteTablet for tablet 2801709d53614916abac370f7ae5e913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:16.538760 26884 tablet_service.cc:1514] Processing DeleteTablet for tablet 0033d61d07d84262a98b0ebc54bd7960 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:16.539048 27221 ts_tablet_manager.cc:1905] T 2fc76603bf8843dab18c95fdab9a8be0 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:16.539182 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 834c9c99ec424bb39e8a003e9204b2bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.541090 26877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fccc21cfc1ce4eb586f03276ec6e987f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.546016 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 720ef9404cb44551aaf39687f0cf94c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.549664 27221 ts_tablet_manager.cc:1918] T 2fc76603bf8843dab18c95fdab9a8be0 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:16.550541 27111 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:16.553294 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0713f4f14a284050a7774a70ab974f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.554771 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c4599256684f5dbc745c9283f31a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.555756 26892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3851d39aeb3142938a5ac558ab438c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.558102 27221 log.cc:1196] T 2fc76603bf8843dab18c95fdab9a8be0 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/2fc76603bf8843dab18c95fdab9a8be0
I20260810 11:30:16.558765 27221 ts_tablet_manager.cc:1939] T 2fc76603bf8843dab18c95fdab9a8be0 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:16.559914 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 155) took 1678 ms. Trace:
I20260810 11:30:16.560117 27221 rpcz_store.cc:276] 0810 11:30:14.881695 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.882252 (+ 557us) service_pool.cc:227] Handling call
0810 11:30:16.536779 (+1654527us) ts_tablet_manager.cc:1145] Deleting tablet 2fc76603bf8843dab18c95fdab9a8be0
0810 11:30:16.536793 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.544182 (+ 7389us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.549453 (+ 5271us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.559841 (+ 10388us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1623370}
W20260810 11:30:16.566116 26500 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ddb6e67c316416681074e454ab9b01e consensus state has no leader
I20260810 11:30:16.571368 26492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_e930e7d079ef4035bde1d9a4ef134d62" } modify_external_catalogs: true
I20260810 11:30:16.571818 26492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_e930e7d079ef4035bde1d9a4ef134d62" } modify_external_catalogs: true
I20260810 11:30:16.571933 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_f33a13096a144e538af2795c149abdcd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:16.572764 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f33a13096a144e538af2795c149abdcd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:16.575353 26498 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet cb6805a5dd264939850ea2cd9a850a1f
I20260810 11:30:16.577049 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_835cdd4f3794466d808449e2e17bb15a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:16.577703 26493 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 5adcec593b8c4d40997c8911e9f77c85
W20260810 11:30:16.577781 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_835cdd4f3794466d808449e2e17bb15a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:16.576483 26498 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c14fb772c46140adba698987eefe2762" } new_table_name: "default.Table_bc30a24ee0374aab9a63a052bc05d81b" modify_external_catalogs: true
I20260810 11:30:16.579828 26493 catalog_manager.cc:6565] ReplaceTablet: tablet 5adcec593b8c4d40997c8911e9f77c85 deleted and replaced by tablet 10e6c41db71a4146840f06c5b7412d9c
I20260810 11:30:16.580129 26493 master_service.cc:946] ReplaceTablet: received request to replace tablet f3884736eec74c8992b8d51b37465875 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:16.580507 26495 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_35bebbfa863b4eafa72471a4b6325d2d" } new_table_name: "default.Table_9b4f87cb356f4d98a42e3315907a2c68" modify_external_catalogs: true
I20260810 11:30:16.581610 26501 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 0938a2f3688246a2b46978eeb7d5d521
I20260810 11:30:16.582265 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_c32d1cb0b9e744fbacbd00c8736fad21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:16.582995 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c32d1cb0b9e744fbacbd00c8736fad21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:16.583284 26501 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_07ad990413b541f5b90b5f0f813635d3" } modify_external_catalogs: true
I20260810 11:30:16.583544 26501 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_07ad990413b541f5b90b5f0f813635d3" } modify_external_catalogs: true
I20260810 11:30:16.586194 26491 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_b487cad441b24b01a9f452bc934ba2f9" } new_table_name: "default.Table_ace165519d4f4967aba430a52d996643" modify_external_catalogs: true
I20260810 11:30:16.587302 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet cb6805a5dd264939850ea2cd9a850a1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:16.587684 27024 tablet_service.cc:1514] Processing DeleteTablet for tablet 5adcec593b8c4d40997c8911e9f77c85 with delete_type TABLET_DATA_DELETED (replaced by tablet 10e6c41db71a4146840f06c5b7412d9c) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:16.592965 27466 raft_consensus.cc:482] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:16.593063 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 158) took 1616 ms. Trace:
I20260810 11:30:16.593240 27221 rpcz_store.cc:276] 0810 11:30:14.944761 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.946899 (+ 2138us) service_pool.cc:227] Handling call
0810 11:30:16.561233 (+1614334us) ts_tablet_manager.cc:1145] Deleting tablet eb51618d37ac488fa7e3d23e5f85ec36
0810 11:30:16.561246 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.561386 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1585921}
I20260810 11:30:16.593231 27466 raft_consensus.cc:504] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:16.594437 27466 leader_election.cc:288] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:16.596951 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 178) took 1234 ms. Trace:
I20260810 11:30:16.597177 27221 rpcz_store.cc:276] 0810 11:30:15.359326 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.359434 (+ 108us) service_pool.cc:227] Handling call
0810 11:30:16.593637 (+1234203us) ts_tablet_manager.cc:1145] Deleting tablet 96cae4eb16c84410926a317af70e44f7
0810 11:30:16.593655 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.593803 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1210219}
I20260810 11:30:16.597900 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 177) took 1241 ms. Trace:
I20260810 11:30:16.598033 27221 rpcz_store.cc:276] 0810 11:30:15.356526 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.359042 (+ 2516us) service_pool.cc:227] Handling call
0810 11:30:16.597509 (+1238467us) ts_tablet_manager.cc:1145] Deleting tablet 23d8ce485cb84495a6e964b6d5977f0d
0810 11:30:16.597519 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.597658 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1207252}
I20260810 11:30:16.598574 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 179) took 1063 ms. Trace:
I20260810 11:30:16.598747 27221 rpcz_store.cc:276] 0810 11:30:15.535579 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.536131 (+ 552us) service_pool.cc:227] Handling call
0810 11:30:16.598365 (+1062234us) ts_tablet_manager.cc:1145] Deleting tablet a18cb43b4dc04a1290a6bade7ac1f3cf
0810 11:30:16.598377 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.598488 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":986470}
I20260810 11:30:16.599069 27221 tablet_replica.cc:330] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
W20260810 11:30:16.599231 26993 leader_election.cc:341] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: d98948300fe6472295ea53cedb7d386c
I20260810 11:30:16.599310 27221 raft_consensus.cc:2229] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:16.599717 27221 pending_rounds.cc:62] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d: Trying to abort 1 pending ops.
I20260810 11:30:16.599666 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b754dc2568849deafc7a8dc6d81924c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:16.599809 27221 pending_rounds.cc:68] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936359598395392 op_type: NO_OP noop_request { }
I20260810 11:30:16.600018 27221 raft_consensus.cc:2866] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260810 11:30:16.600112 26993 consensus_peers.cc:487] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c6b3f8626724d12986f388b1ca90b3c. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:16.600174 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fc76603bf8843dab18c95fdab9a8be0 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ffc2c43885841d2a6a4cce52eaf7129) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:16.600222 27221 raft_consensus.cc:2258] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:16.600467 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet fc2d129e99f24c018e4f8e43f211171d with delete_type TABLET_DATA_DELETED (replaced by tablet 478c0c39658349c39e3afa1aa1653e82) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:16.600459 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 0938a2f3688246a2b46978eeb7d5d521 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:16.600577 26731 tablet_service.cc:1514] Processing DeleteTablet for tablet cb6805a5dd264939850ea2cd9a850a1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:16.600865 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet f3c6bd6803c245b7bb3d78423de482b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:16.600951 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet eb51618d37ac488fa7e3d23e5f85ec36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb51618d37ac488fa7e3d23e5f85ec36 already in progress: creating tablet
I20260810 11:30:16.601104 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e3707ae32624f6483866208321eefde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:16.601346 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 96cae4eb16c84410926a317af70e44f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96cae4eb16c84410926a317af70e44f7 already in progress: creating tablet
W20260810 11:30:16.601626 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 23d8ce485cb84495a6e964b6d5977f0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23d8ce485cb84495a6e964b6d5977f0d already in progress: creating tablet
W20260810 11:30:16.601898 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet a18cb43b4dc04a1290a6bade7ac1f3cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a18cb43b4dc04a1290a6bade7ac1f3cf already in progress: creating tablet
I20260810 11:30:16.602286 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet 5adcec593b8c4d40997c8911e9f77c85 with delete_type TABLET_DATA_DELETED (replaced by tablet 10e6c41db71a4146840f06c5b7412d9c) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:16.609511 27248 ts_tablet_manager.cc:1918] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:16.577802 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_393d03f5197d43b6977bf48bd7818a0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:16.610982 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_393d03f5197d43b6977bf48bd7818a0e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:16.613296 27221 ts_tablet_manager.cc:1905] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:16.614857 27026 tablet_service.cc:1514] Processing DeleteTablet for tablet 0938a2f3688246a2b46978eeb7d5d521 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:16.616380 27248 log.cc:1196] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/566bf0f68c2946a89203472786e82512
I20260810 11:30:16.618242 27231 tablet_bootstrap.cc:492] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:16.618597 27231 ts_tablet_manager.cc:1397] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.401s user 0.007s sys 0.004s
I20260810 11:30:16.616958 26541 master_runner.cc:186] Error getting master registration for 127.25.195.254:41125: OK, instance_id { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" instance_seqno: 1786361414379548 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 11:30:16.619589 26541 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 11:30:16.620124 27231 raft_consensus.cc:348] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:16.620605 27231 raft_consensus.cc:374] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:16.620795 27231 raft_consensus.cc:729] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:16.621227 27231 consensus_queue.cc:260] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:16.622305 27231 ts_tablet_manager.cc:1428] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 11:30:16.622754 27111 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:16.622845 27231 tablet_bootstrap.cc:492] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:16.629371 27248 ts_tablet_manager.cc:1939] T 566bf0f68c2946a89203472786e82512 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:16.630920 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 105) took 2868 ms. Trace:
I20260810 11:30:16.637086 26891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 174) took 1006 ms. Trace:
I20260810 11:30:16.637322 26891 rpcz_store.cc:276] 0810 11:30:15.551421 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.896083 (+344662us) service_pool.cc:227] Handling call
0810 11:30:15.904365 (+ 8282us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:15.904412 (+ 47us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:15.975993 (+ 71581us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.557727 (+581734us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:16.557914 (+ 187us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260810 11:30:16.638141 26700 consensus_peers.cc:487] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:16.638720 27248 rpcz_store.cc:276] 0810 11:30:13.762834 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:13.763310 (+ 476us) service_pool.cc:227] Handling call
0810 11:30:16.210226 (+2446916us) ts_tablet_manager.cc:1145] Deleting tablet 566bf0f68c2946a89203472786e82512
0810 11:30:16.210241 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.447322 (+237081us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.609203 (+161881us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.630829 (+ 21626us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2437476}
I20260810 11:30:16.639969 27248 tablet_replica.cc:330] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:16.640810 27222 tablet_bootstrap.cc:492] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:16.641049 27222 ts_tablet_manager.cc:1397] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.286s user 0.037s sys 0.038s
I20260810 11:30:16.641407 27379 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 2 FOLLOWER]: Refusing update from remote peer c40c76e125b44de181b88b7f63a566f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 1 index: 16. (index mismatch)
I20260810 11:30:16.641878 26882 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 172) took 1090 ms. Trace:
I20260810 11:30:16.642241 26893 tablet_service.cc:1467] Processing CreateTablet for tablet d512c335e340437fa32f2dc16dca6812 (DEFAULT_TABLE table=default.Table_35bebbfa863b4eafa72471a4b6325d2d [id=09e6c654505c448389915f4b634188b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.642197 27222 raft_consensus.cc:348] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.642457 27222 raft_consensus.cc:374] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:16.642608 27222 raft_consensus.cc:729] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:16.642921 27222 consensus_queue.cc:260] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.644495 27222 ts_tablet_manager.cc:1428] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 11:30:16.644901 27222 tablet_bootstrap.cc:492] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:16.646142 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44d5e146eeec4fe0be33c1c169d32e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.647142 26882 rpcz_store.cc:276] 0810 11:30:15.551226 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.886175 (+334949us) service_pool.cc:227] Handling call
0810 11:30:15.948455 (+ 62280us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:15.948486 (+ 31us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:16.396108 (+447622us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.641657 (+245549us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:16.641823 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:16.647559 27222 tablet_bootstrap.cc:654] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:16.647603 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d98948300fe6472295ea53cedb7d386c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:16.649994 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d512c335e340437fa32f2dc16dca6812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.652002 26891 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dabfbd779c5406cb10ecf70f5a142e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:16.652727 27248 raft_consensus.cc:2229] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:16.652752 26891 tablet_service.cc:1514] Processing DeleteTablet for tablet cb6805a5dd264939850ea2cd9a850a1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:16.653339 27221 ts_tablet_manager.cc:1918] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:16.654143 26891 tablet_service.cc:1514] Processing DeleteTablet for tablet 5adcec593b8c4d40997c8911e9f77c85 with delete_type TABLET_DATA_DELETED (replaced by tablet 10e6c41db71a4146840f06c5b7412d9c) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:16.657495 27221 log.cc:1196] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/607b055f8ced4372800adf5817b46e0b
W20260810 11:30:16.653065 26991 leader_election.cc:341] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:16.658260 27221 ts_tablet_manager.cc:1939] T 607b055f8ced4372800adf5817b46e0b P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:16.659699 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 183) took 1121 ms. Trace:
I20260810 11:30:16.659857 26891 tablet_service.cc:1514] Processing DeleteTablet for tablet 0938a2f3688246a2b46978eeb7d5d521 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:16.659945 27221 rpcz_store.cc:276] 0810 11:30:15.536825 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.539064 (+ 2239us) service_pool.cc:227] Handling call
0810 11:30:16.598968 (+1059904us) ts_tablet_manager.cc:1145] Deleting tablet 607b055f8ced4372800adf5817b46e0b
0810 11:30:16.598981 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.622522 (+ 23541us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.638617 (+ 16095us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.658661 (+ 20044us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":985667}
I20260810 11:30:16.661407 27228 tablet_bootstrap.cc:654] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:16.664678 27222 tablet_bootstrap.cc:492] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:16.665071 27222 ts_tablet_manager.cc:1397] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.002s
I20260810 11:30:16.666100 27222 raft_consensus.cc:348] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.666483 27222 raft_consensus.cc:374] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:16.666615 27222 raft_consensus.cc:729] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:16.666659 26991 leader_election.cc:302] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:16.665210 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 181) took 1128 ms. Trace:
I20260810 11:30:16.667557 27221 rpcz_store.cc:276] 0810 11:30:15.536552 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.539139 (+ 2587us) service_pool.cc:227] Handling call
0810 11:30:16.660858 (+1121719us) ts_tablet_manager.cc:1145] Deleting tablet ffeb0373c6124af291336ca9da50c318
0810 11:30:16.660876 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.664993 (+ 4117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1021096}
I20260810 11:30:16.668038 27058 raft_consensus.cc:1261] T 6c5b650bc02f4fa393bada5b54c77f1f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Refusing update from remote peer 443ec871f1ed4232b932ecfb0b18510d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 11:30:16.668335 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 180) took 1131 ms. Trace:
I20260810 11:30:16.668476 27221 rpcz_store.cc:276] 0810 11:30:15.536410 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.674934 (+138524us) service_pool.cc:227] Handling call
0810 11:30:16.668152 (+993218us) ts_tablet_manager.cc:1145] Deleting tablet bb0357271cfd46478867a3cc0660bcdc
0810 11:30:16.668165 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.668275 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":992864}
I20260810 11:30:16.669147 27386 consensus_queue.cc:1035] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:16.669803 27464 raft_consensus.cc:2726] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:16.669018 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 195) took 1058 ms. Trace:
I20260810 11:30:16.670258 27221 rpcz_store.cc:276] 0810 11:30:15.610899 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.675319 (+ 64420us) service_pool.cc:227] Handling call
0810 11:30:16.668810 (+993491us) ts_tablet_manager.cc:1145] Deleting tablet 478c0c39658349c39e3afa1aa1653e82
0810 11:30:16.668821 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.668956 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":993205}
I20260810 11:30:16.670966 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 198) took 1059 ms. Trace:
I20260810 11:30:16.671135 27221 rpcz_store.cc:276] 0810 11:30:15.611204 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.675624 (+ 64420us) service_pool.cc:227] Handling call
0810 11:30:16.670756 (+995132us) ts_tablet_manager.cc:1145] Deleting tablet 31888ddeafe14738b818016a9c0a4ad3
0810 11:30:16.670765 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.670900 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":994767}
I20260810 11:30:16.671999 27221 tablet_replica.cc:330] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:16.672436 27221 raft_consensus.cc:2229] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:16.672859 27221 raft_consensus.cc:2258] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:16.673710 27221 ts_tablet_manager.cc:1905] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:16.669353 27222 consensus_queue.cc:260] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.677712 27222 ts_tablet_manager.cc:1428] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260810 11:30:16.678323 27222 tablet_bootstrap.cc:492] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:16.680321 27222 tablet_bootstrap.cc:654] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:16.684353 27248 raft_consensus.cc:2258] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:16.686637 26822 heartbeater.cc:347] Connected to a master server at 127.25.195.254:41125
I20260810 11:30:16.693877 27111 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:16.694113 27231 tablet_bootstrap.cc:654] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:16.694366 27222 tablet_bootstrap.cc:492] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:16.694551 27222 ts_tablet_manager.cc:1397] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.001s
I20260810 11:30:16.695513 27222 raft_consensus.cc:348] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.696358 27248 ts_tablet_manager.cc:1905] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:16.702597 27222 raft_consensus.cc:374] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:16.703130 27222 raft_consensus.cc:729] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:16.703892 27222 consensus_queue.cc:260] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.706528 27222 ts_tablet_manager.cc:1428] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.012s user 0.002s sys 0.002s
I20260810 11:30:16.707909 27222 tablet_bootstrap.cc:492] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:16.711143 27222 tablet_bootstrap.cc:654] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:16.725476 27221 ts_tablet_manager.cc:1918] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:16.726158 27221 log.cc:1196] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/2e2c9112462f442e8de5b4a944cfdc6b
I20260810 11:30:16.726799 27221 ts_tablet_manager.cc:1939] T 2e2c9112462f442e8de5b4a944cfdc6b P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:16.729319 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 607b055f8ced4372800adf5817b46e0b (table default.Table_dc355f349bc9426eb26a69cf93c089cf [id=68a29d5ebf8140198fbf4da3cd974847]) successfully deleted
W20260810 11:30:16.729601 26486 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 68909.4us
W20260810 11:30:16.730511 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ffeb0373c6124af291336ca9da50c318 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffeb0373c6124af291336ca9da50c318 already in progress: creating tablet
W20260810 11:30:16.730830 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet bb0357271cfd46478867a3cc0660bcdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb0357271cfd46478867a3cc0660bcdc already in progress: creating tablet
W20260810 11:30:16.731577 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 478c0c39658349c39e3afa1aa1653e82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 478c0c39658349c39e3afa1aa1653e82 already in progress: creating tablet
W20260810 11:30:16.731912 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 31888ddeafe14738b818016a9c0a4ad3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31888ddeafe14738b818016a9c0a4ad3 already in progress: creating tablet
W20260810 11:30:16.734310 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet a7a2cb1d2e8e40f58144908e34438d53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7a2cb1d2e8e40f58144908e34438d53 already in progress: creating tablet
I20260810 11:30:16.734460 27221 tablet_replica.cc:330] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
W20260810 11:30:16.734661 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2801709d53614916abac370f7ae5e913 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2801709d53614916abac370f7ae5e913 already in progress: creating tablet
I20260810 11:30:16.734757 27221 raft_consensus.cc:2229] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:16.735059 27221 raft_consensus.cc:2258] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:16.736209 27221 ts_tablet_manager.cc:1905] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:16.737841 26486 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2efaf8b45a824e34b7f23037de5eec45 because the tablet was not found. No further retry: Not found: Tablet not found: 2efaf8b45a824e34b7f23037de5eec45
I20260810 11:30:16.738212 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 2e2c9112462f442e8de5b4a944cfdc6b (table default.Table_bc8bc2c9015443fb865751881638284b [id=3d0ee62af94a45ebb75470e84997368f]) successfully deleted
I20260810 11:30:16.739980 27222 tablet_bootstrap.cc:492] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:16.740471 27222 ts_tablet_manager.cc:1397] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.003s
I20260810 11:30:16.742295 27222 raft_consensus.cc:348] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.742815 27222 raft_consensus.cc:374] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:16.742990 27222 raft_consensus.cc:729] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
W20260810 11:30:16.745185 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 0033d61d07d84262a98b0ebc54bd7960 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0033d61d07d84262a98b0ebc54bd7960 already in progress: creating tablet
I20260810 11:30:16.745759 27222 consensus_queue.cc:260] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.750106 26492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 834c9c99ec424bb39e8a003e9204b2bc
I20260810 11:30:16.755172 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_fabd7780b9224b7993ad4321be6f92e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:16.756147 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fabd7780b9224b7993ad4321be6f92e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:16.757092 26498 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6e829d4bffeb4289a54b4d3d7a53c44e consensus state has no leader
I20260810 11:30:16.757707 26492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_547fe3fa37ab46aab94789c556ec37d7" } modify_external_catalogs: true
W20260810 11:30:16.758244 26495 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d512c335e340437fa32f2dc16dca6812 consensus state has no leader
I20260810 11:30:16.758574 26495 master_service.cc:946] ReplaceTablet: received request to replace tablet 478c0c39658349c39e3afa1aa1653e82 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:16.759130 26492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_547fe3fa37ab46aab94789c556ec37d7" } modify_external_catalogs: true
I20260810 11:30:16.759234 26493 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet f3884736eec74c8992b8d51b37465875
I20260810 11:30:16.759658 26493 catalog_manager.cc:6565] ReplaceTablet: tablet f3884736eec74c8992b8d51b37465875 deleted and replaced by tablet 1f64d4b9320c4cb39f57573d781a47d3
I20260810 11:30:16.760643 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet 949f31fa0c124eefbee695cfc7f50cbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:16.764969 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet 834c9c99ec424bb39e8a003e9204b2bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:16.760056 26491 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7bd67ebf23694ae7b0ede6c5d1a06f88 consensus state has no leader
I20260810 11:30:16.769683 26498 master_service.cc:946] ReplaceTablet: received request to replace tablet 60d56e162b4b41e2867ac845e524aca4 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:16.779682 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_146776d44301462096eb098adde86d0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:16.780627 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_146776d44301462096eb098adde86d0e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:16.783371 26879 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 184) took 1027 ms. Trace:
I20260810 11:30:16.786317 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_e4551e8a102f4eb580426519fca21df9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:16.787153 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4551e8a102f4eb580426519fca21df9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:16.787420 27386 raft_consensus.cc:482] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:16.787700 27386 raft_consensus.cc:504] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.766158 26894 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 168) took 1187 ms. Trace:
I20260810 11:30:16.788800 27386 leader_election.cc:288] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:16.786926 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_b2c244ee13d14619b9f1eac6ab1aba2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:16.789845 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2c244ee13d14619b9f1eac6ab1aba2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:16.798959 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet f3884736eec74c8992b8d51b37465875 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f64d4b9320c4cb39f57573d781a47d3) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:16.797557 26491 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_7c78d2fb5de4496795d089bc825027e6" } new_table_name: "default.Table_1e1ca07e9c824349af23675b66b77321" modify_external_catalogs: true
I20260810 11:30:16.800437 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet ec788db5b0ca40f1811b6660276d0254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:16.802075 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet 66908164ff2a4ee5b55da6158699e0c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:16.803303 26486 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 2917f1ffb5214a80b19810540602df35 (table default.Table_164710e7832448d58f926e94ed5c17ec [id=e34ecb3dff68425b9c53395ce189841b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2917f1ffb5214a80b19810540602df35 consensus state has no leader
I20260810 11:30:16.808984 27222 ts_tablet_manager.cc:1428] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.068s user 0.001s sys 0.002s
I20260810 11:30:16.809406 27222 tablet_bootstrap.cc:492] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:16.825026 27386 raft_consensus.cc:482] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:16.825343 27386 raft_consensus.cc:504] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.826068 27386 leader_election.cc:288] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:16.832235 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d14091e1c111438bac8bcf3d36123d80" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:16.833106 26700 leader_election.cc:341] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:16.834843 26876 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 180) took 1081 ms. Trace:
I20260810 11:30:16.835877 26891 tablet_service.cc:1514] Processing DeleteTablet for tablet 834c9c99ec424bb39e8a003e9204b2bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:16.839064 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet f3884736eec74c8992b8d51b37465875 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f64d4b9320c4cb39f57573d781a47d3) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:16.839092 27222 tablet_bootstrap.cc:654] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:16.840164 26880 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 176) took 1224 ms. Trace:
I20260810 11:30:16.840405 26880 rpcz_store.cc:276] 0810 11:30:15.551644 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.937117 (+385473us) service_pool.cc:227] Handling call
0810 11:30:15.959439 (+ 22322us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:15.959472 (+ 33us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:16.497358 (+537886us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.775651 (+278293us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:16.775895 (+ 244us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:16.841043 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949f31fa0c124eefbee695cfc7f50cbe" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:16.840298 27464 raft_consensus.cc:482] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:16.835647 26876 rpcz_store.cc:276] 0810 11:30:15.683901 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.030886 (+346985us) service_pool.cc:227] Handling call
0810 11:30:16.255656 (+224770us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:16.255690 (+ 34us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:16.471516 (+215826us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.758875 (+287359us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:16.764871 (+ 5996us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:16.842355 27464 raft_consensus.cc:504] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:16.843158 27464 leader_election.cc:288] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:16.844952 26993 leader_election.cc:341] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: fc2d129e99f24c018e4f8e43f211171d
I20260810 11:30:16.845185 27026 tablet_service.cc:1514] Processing DeleteTablet for tablet 834c9c99ec424bb39e8a003e9204b2bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:16.845961 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d14091e1c111438bac8bcf3d36123d80" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:16.846549 27026 tablet_service.cc:1514] Processing DeleteTablet for tablet f3884736eec74c8992b8d51b37465875 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f64d4b9320c4cb39f57573d781a47d3) from {username='slave'} at 127.0.0.1:35790
W20260810 11:30:16.847034 26702 leader_election.cc:341] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:16.847682 26702 leader_election.cc:341] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:16.847834 26702 leader_election.cc:302] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:16.848197 27386 raft_consensus.cc:2726] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:16.853561 26894 rpcz_store.cc:276] 0810 11:30:15.550797 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.864782 (+313985us) service_pool.cc:227] Handling call
0810 11:30:15.880270 (+ 15488us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:15.880307 (+ 37us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:16.374251 (+493944us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.737540 (+363289us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:16.737762 (+ 222us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:16.855206 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc2d129e99f24c018e4f8e43f211171d" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:16.856117 26991 leader_election.cc:341] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:16.856334 26991 leader_election.cc:302] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:16.856979 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949f31fa0c124eefbee695cfc7f50cbe" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:16.857970 27464 raft_consensus.cc:2726] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:16.857976 26700 leader_election.cc:341] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:16.858274 26700 leader_election.cc:302] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:16.858776 27386 raft_consensus.cc:2726] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:16.859061 26879 rpcz_store.cc:276] 0810 11:30:15.756168 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.269021 (+512853us) service_pool.cc:227] Handling call
0810 11:30:16.366483 (+ 97462us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:16.378901 (+ 12418us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:16.679703 (+300802us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.782981 (+103278us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:16.783249 (+ 268us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:16.860252 26890 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 178) took 1135 ms. Trace:
I20260810 11:30:16.861783 26890 rpcz_store.cc:276] 0810 11:30:15.660088 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.030362 (+370274us) service_pool.cc:227] Handling call
0810 11:30:16.261849 (+231487us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:16.261904 (+ 55us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:16.557412 (+295508us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.795011 (+237599us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:16.795289 (+ 278us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:16.862370 27228 tablet_bootstrap.cc:492] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:16.862627 27228 ts_tablet_manager.cc:1397] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.533s user 0.034s sys 0.028s
I20260810 11:30:16.865592 26881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 177) took 1240 ms. Trace:
I20260810 11:30:16.865401 27221 ts_tablet_manager.cc:1918] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:16.867694 27221 log.cc:1196] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/79953795f07845aba3f028741cdcdd9e
I20260810 11:30:16.865932 26881 rpcz_store.cc:276] 0810 11:30:15.551735 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.977276 (+425541us) service_pool.cc:227] Handling call
0810 11:30:16.017911 (+ 40635us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:16.017950 (+ 39us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:16.385201 (+367251us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.791742 (+406541us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:16.791967 (+ 225us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:16.871508 27222 tablet_bootstrap.cc:492] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:16.871896 27222 ts_tablet_manager.cc:1397] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.063s user 0.004s sys 0.004s
I20260810 11:30:16.873185 27221 ts_tablet_manager.cc:1939] T 79953795f07845aba3f028741cdcdd9e P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:16.874794 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 79953795f07845aba3f028741cdcdd9e (table default.Table_c753d94e8f1c4f459963bdfc55366320 [id=ec470484b1bf4e62917f36ce46438d3a]) successfully deleted
I20260810 11:30:16.874285 27222 raft_consensus.cc:348] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.876184 27222 raft_consensus.cc:374] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:16.876538 26499 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_0d77c6da3c8349c9ad3caa2147b81827" } modify_external_catalogs: true
I20260810 11:30:16.876653 27228 raft_consensus.cc:348] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:16.877076 26499 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_0d77c6da3c8349c9ad3caa2147b81827" } modify_external_catalogs: true
I20260810 11:30:16.877231 27228 raft_consensus.cc:374] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:16.880470 27228 raft_consensus.cc:729] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:16.880949 27228 consensus_queue.cc:260] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:16.883945 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_3d15fcde44db49a7ba17fd166381299f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:16.884793 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d15fcde44db49a7ba17fd166381299f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:16.886319 27223 ts_tablet_manager.cc:1918] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:16.886795 26496 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_126d22557d424ec99a65925d97b5722a" } new_table_name: "default.Table_8a28aa37fbf54c2386ba06d398603c62" modify_external_catalogs: true
I20260810 11:30:16.888023 26497 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_a87ac76268094e76aafcb7a2766c0f1e" } modify_external_catalogs: true
I20260810 11:30:16.884824 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_2a7d8b62f0814dcb99b674089d4fd0c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:16.895720 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a7d8b62f0814dcb99b674089d4fd0c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:16.899569 26497 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_a87ac76268094e76aafcb7a2766c0f1e" } modify_external_catalogs: true
W20260810 11:30:16.900403 26491 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ddb6e67c316416681074e454ab9b01e consensus state has no leader
I20260810 11:30:16.901345 26500 master_service.cc:946] ReplaceTablet: received request to replace tablet eb9394f9ca2c44de93354e23973cf902 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:16.904404 26879 tablet_service.cc:1467] Processing CreateTablet for tablet 318d5b8453fe4c438d0fa32cb91c409e (DEFAULT_TABLE table=default.Table_0ca6793e2c374e8d8d93872a0b2283d6 [id=ae0e3b2d14964558848b1a00a6ddc2c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.906945 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 64818ca5827e41d99428903ddb8688d9 (DEFAULT_TABLE table=default.Table_fb7b13261243442c9c4d8749871c1d1a [id=926b5b59f3fc4de6baeac9dbfdeed8f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.907886 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64818ca5827e41d99428903ddb8688d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.908470 27026 tablet_service.cc:1467] Processing CreateTablet for tablet 94bcb1739e5144559201479b82c07941 (DEFAULT_TABLE table=default.Table_e7f8305a313f47b0a219cb6a9cb15049 [id=329af78463204d2da90569d268b49eb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.908788 27223 log.cc:1196] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/a8197318b04a470791dd639742547fce
I20260810 11:30:16.909793 27026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94bcb1739e5144559201479b82c07941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.910970 26895 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 186) took 1049 ms. Trace:
I20260810 11:30:16.911238 26895 rpcz_store.cc:276] 0810 11:30:15.839070 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.351038 (+511968us) service_pool.cc:227] Handling call
0810 11:30:16.379188 (+ 28150us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:16.379216 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:16.729431 (+350215us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.888337 (+158906us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:16.888614 (+ 277us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:16.912631 27379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49114 (request call id 1) took 1170 ms. Trace:
I20260810 11:30:16.914654 26748 tablet_service.cc:1467] Processing CreateTablet for tablet f7ada1df82eb44ecb9a6c615b5410e6f (DEFAULT_TABLE table=default.Table_635ef5268ea1426bb6578ba498e616e3 [id=fef997439a4346d2a9c6f2a4277ede5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.914831 27487 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:16.915400 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 318d5b8453fe4c438d0fa32cb91c409e (DEFAULT_TABLE table=default.Table_0ca6793e2c374e8d8d93872a0b2283d6 [id=ae0e3b2d14964558848b1a00a6ddc2c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.915342 27487 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:16.917583 26731 tablet_service.cc:1467] Processing CreateTablet for tablet 39beb126ac324842b7e387c46bcb4099 (DEFAULT_TABLE table=default.Table_daa63098f93c4c00bf673114c127e69f [id=933ce361d9e941d0ae10caa20a0d96ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.917956 26729 tablet_service.cc:1467] Processing CreateTablet for tablet 94bcb1739e5144559201479b82c07941 (DEFAULT_TABLE table=default.Table_e7f8305a313f47b0a219cb6a9cb15049 [id=329af78463204d2da90569d268b49eb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.918212 26746 tablet_service.cc:1467] Processing CreateTablet for tablet 37cecd4266eb47669e7fd5cfeb847adc (DEFAULT_TABLE table=default.Table_7c178d343d8246599a00f6d1c602a818 [id=0e39402016b54f588ea123ee4ea9788a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.918432 26740 tablet_service.cc:1467] Processing CreateTablet for tablet 64818ca5827e41d99428903ddb8688d9 (DEFAULT_TABLE table=default.Table_fb7b13261243442c9c4d8749871c1d1a [id=926b5b59f3fc4de6baeac9dbfdeed8f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.919057 27222 raft_consensus.cc:729] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:16.919735 27222 consensus_queue.cc:260] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.926960 27222 ts_tablet_manager.cc:1428] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.054s user 0.000s sys 0.004s
I20260810 11:30:16.928699 27228 ts_tablet_manager.cc:1428] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.020s user 0.004s sys 0.000s
I20260810 11:30:16.934224 27487 leader_election.cc:288] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
I20260810 11:30:16.939777 26887 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 183) took 1162 ms. Trace:
I20260810 11:30:16.940227 26887 rpcz_store.cc:276] 0810 11:30:15.752507 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.266837 (+514330us) service_pool.cc:227] Handling call
0810 11:30:16.270152 (+ 3315us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:16.270177 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:16.857699 (+587522us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.914065 (+ 56366us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:16.914322 (+ 257us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:16.940831 26894 tablet_service.cc:1467] Processing CreateTablet for tablet f7ada1df82eb44ecb9a6c615b5410e6f (DEFAULT_TABLE table=default.Table_635ef5268ea1426bb6578ba498e616e3 [id=fef997439a4346d2a9c6f2a4277ede5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.943502 27221 tablet_replica.cc:330] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:16.946259 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ada1df82eb44ecb9a6c615b5410e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.947638 26878 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 187) took 1108 ms. Trace:
I20260810 11:30:16.949736 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 318d5b8453fe4c438d0fa32cb91c409e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.952286 26731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39beb126ac324842b7e387c46bcb4099. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.953451 26729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94bcb1739e5144559201479b82c07941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.953840 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37cecd4266eb47669e7fd5cfeb847adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.955158 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64818ca5827e41d99428903ddb8688d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.958844 27223 ts_tablet_manager.cc:1939] T a8197318b04a470791dd639742547fce P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:16.959987 27228 tablet_bootstrap.cc:492] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:16.964434 27386 raft_consensus.cc:482] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:16.964720 27386 raft_consensus.cc:504] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:16.965693 27386 leader_election.cc:288] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:16.967922 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3707ae32624f6483866208321eefde" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:16.968982 26700 leader_election.cc:341] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:16.973276 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 94bcb1739e5144559201479b82c07941 (DEFAULT_TABLE table=default.Table_e7f8305a313f47b0a219cb6a9cb15049 [id=329af78463204d2da90569d268b49eb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.974413 26890 tablet_service.cc:1467] Processing CreateTablet for tablet 64818ca5827e41d99428903ddb8688d9 (DEFAULT_TABLE table=default.Table_fb7b13261243442c9c4d8749871c1d1a [id=926b5b59f3fc4de6baeac9dbfdeed8f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.975036 26879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 318d5b8453fe4c438d0fa32cb91c409e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.980897 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94bcb1739e5144559201479b82c07941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.985098 26890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64818ca5827e41d99428903ddb8688d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.988862 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 37cecd4266eb47669e7fd5cfeb847adc (DEFAULT_TABLE table=default.Table_7c178d343d8246599a00f6d1c602a818 [id=0e39402016b54f588ea123ee4ea9788a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:16.989529 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37cecd4266eb47669e7fd5cfeb847adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.992945 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ada1df82eb44ecb9a6c615b5410e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.012624 27222 tablet_bootstrap.cc:492] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:17.013253 27494 log.cc:924] Time spent T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700: Append to log took a long time: real 0.098s user 0.000s sys 0.001s
I20260810 11:30:17.014459 26887 tablet_service.cc:1467] Processing CreateTablet for tablet 39beb126ac324842b7e387c46bcb4099 (DEFAULT_TABLE table=default.Table_daa63098f93c4c00bf673114c127e69f [id=933ce361d9e941d0ae10caa20a0d96ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.015619 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 130) took 2174 ms. Trace:
I20260810 11:30:17.015816 27223 rpcz_store.cc:276] 0810 11:30:14.790451 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.790598 (+ 147us) service_pool.cc:227] Handling call
0810 11:30:16.331771 (+1541173us) ts_tablet_manager.cc:1145] Deleting tablet a8197318b04a470791dd639742547fce
0810 11:30:16.331781 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:16.657555 (+325774us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.886141 (+228586us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.964437 (+ 78296us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1497738}
I20260810 11:30:17.016794 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 134) took 2174 ms. Trace:
I20260810 11:30:17.016949 27223 rpcz_store.cc:276] 0810 11:30:14.842309 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.842375 (+ 66us) service_pool.cc:227] Handling call
0810 11:30:17.016331 (+2173956us) ts_tablet_manager.cc:1145] Deleting tablet e25ae21cc8cc4749a507fcab5ee225a3
0810 11:30:17.016350 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.016681 (+ 331us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2157981}
I20260810 11:30:17.017362 27223 tablet_replica.cc:330] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:17.017624 27223 raft_consensus.cc:2229] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:17.018024 27223 raft_consensus.cc:2258] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:17.018953 27223 ts_tablet_manager.cc:1905] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:17.019752 26887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39beb126ac324842b7e387c46bcb4099. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:16.913051 27379 rpcz_store.cc:276] 0810 11:30:15.741950 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.742046 (+ 96us) service_pool.cc:227] Handling call
0810 11:30:16.390487 (+648441us) raft_consensus.cc:1457] Updating replica for 276 ops
0810 11:30:16.641908 (+251421us) raft_consensus.cc:1683] Filling consensus response to leader.
0810 11:30:16.650786 (+ 8878us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f55f1bc400f 00007f55f1bbfee9 00007f55f5766a6c 00007f55f0051fa6 00007f55f0051cd5 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f 00007f55ed1e8378
0810 11:30:16.912260 (+261474us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":18140032}
I20260810 11:30:17.022342 27221 raft_consensus.cc:2229] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:17.028669 26883 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 181) took 1242 ms. Trace:
I20260810 11:30:17.029074 26883 rpcz_store.cc:276] 0810 11:30:15.722957 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.038893 (+315936us) service_pool.cc:227] Handling call
0810 11:30:16.269436 (+230543us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:16.269471 (+ 35us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:16.850946 (+581475us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.964187 (+113241us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:16.965063 (+ 876us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:17.029839 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3707ae32624f6483866208321eefde" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:17.033016 26702 leader_election.cc:341] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:17.033205 26702 leader_election.cc:302] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:17.033720 27386 raft_consensus.cc:2726] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:17.033738 26878 rpcz_store.cc:276] 0810 11:30:15.839204 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.411585 (+572381us) service_pool.cc:227] Handling call
0810 11:30:16.412682 (+ 1097us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:16.412720 (+ 38us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:16.874255 (+461535us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:16.947248 (+ 72993us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:16.947581 (+ 333us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:17.034209 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet a8197318b04a470791dd639742547fce (table default.Table_b609612a64d045b086440c601c257f30 [id=9b210311762a4c07bde13fd8ec4d7568]) successfully deleted
W20260810 11:30:17.034632 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet e25ae21cc8cc4749a507fcab5ee225a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e25ae21cc8cc4749a507fcab5ee225a3 already in progress: creating tablet
I20260810 11:30:17.043533 27228 tablet_bootstrap.cc:654] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:17.030779 27022 tablet_service.cc:1467] Processing CreateTablet for tablet 37cecd4266eb47669e7fd5cfeb847adc (DEFAULT_TABLE table=default.Table_7c178d343d8246599a00f6d1c602a818 [id=0e39402016b54f588ea123ee4ea9788a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.031076 27034 tablet_service.cc:1467] Processing CreateTablet for tablet 39beb126ac324842b7e387c46bcb4099 (DEFAULT_TABLE table=default.Table_daa63098f93c4c00bf673114c127e69f [id=933ce361d9e941d0ae10caa20a0d96ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.031311 27024 tablet_service.cc:1467] Processing CreateTablet for tablet f7ada1df82eb44ecb9a6c615b5410e6f (DEFAULT_TABLE table=default.Table_635ef5268ea1426bb6578ba498e616e3 [id=fef997439a4346d2a9c6f2a4277ede5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.052696 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_538c35ba9808453e870597b4257cefaa" } modify_external_catalogs: true
I20260810 11:30:17.053121 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_538c35ba9808453e870597b4257cefaa" } modify_external_catalogs: true
I20260810 11:30:17.056097 27024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ada1df82eb44ecb9a6c615b5410e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.057003 26878 tablet_service.cc:1514] Processing DeleteTablet for tablet debc114073e14ec1839c5c4c7c2f1f1e with delete_type TABLET_DATA_DELETED (replaced by tablet cb01e54d817c4b0dbcc80f90f82923c0) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:17.057166 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39beb126ac324842b7e387c46bcb4099. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.081522 27023 tablet_service.cc:1467] Processing CreateTablet for tablet 318d5b8453fe4c438d0fa32cb91c409e (DEFAULT_TABLE table=default.Table_0ca6793e2c374e8d8d93872a0b2283d6 [id=ae0e3b2d14964558848b1a00a6ddc2c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.083523 27386 raft_consensus.cc:482] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:17.083774 27386 raft_consensus.cc:504] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:17.084776 27386 leader_election.cc:288] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:17.085949 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eae49e1c6554ba2ae831831ff4bb45c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:17.086679 26700 leader_election.cc:341] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:17.088675 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37cecd4266eb47669e7fd5cfeb847adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.093179 27386 raft_consensus.cc:482] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:17.093494 27386 raft_consensus.cc:504] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:17.096349 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 318d5b8453fe4c438d0fa32cb91c409e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.096939 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66908164ff2a4ee5b55da6158699e0c6" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:17.097711 26700 leader_election.cc:341] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:17.097857 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eae49e1c6554ba2ae831831ff4bb45c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:17.098161 27386 leader_election.cc:288] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:17.100535 26702 leader_election.cc:341] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:17.100798 26702 leader_election.cc:302] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:17.101140 27386 raft_consensus.cc:2726] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:17.102070 27228 tablet_bootstrap.cc:492] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:17.102484 27228 ts_tablet_manager.cc:1397] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.173s user 0.003s sys 0.006s
I20260810 11:30:17.103965 27228 raft_consensus.cc:348] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.104480 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66908164ff2a4ee5b55da6158699e0c6" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:17.105374 26702 leader_election.cc:341] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:17.105609 26702 leader_election.cc:302] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:17.105893 27386 raft_consensus.cc:2726] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:17.124949 27228 raft_consensus.cc:374] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:17.125224 27228 raft_consensus.cc:729] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:17.125491 27231 tablet_bootstrap.cc:492] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:17.125726 27231 ts_tablet_manager.cc:1397] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.503s user 0.022s sys 0.020s
I20260810 11:30:17.125710 27228 consensus_queue.cc:260] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.126610 27231 raft_consensus.cc:348] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.128677 27228 ts_tablet_manager.cc:1428] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.026s user 0.001s sys 0.002s
I20260810 11:30:17.137481 27228 tablet_bootstrap.cc:492] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:17.138814 27221 raft_consensus.cc:2258] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:17.150110 27221 ts_tablet_manager.cc:1905] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:17.134333 27223 ts_tablet_manager.cc:1918] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:17.149173 27483 consensus_queue.cc:1037] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.002s
I20260810 11:30:17.151104 27223 log.cc:1196] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/2c6b3f8626724d12986f388b1ca90b3c
I20260810 11:30:17.152029 27223 ts_tablet_manager.cc:1939] T 2c6b3f8626724d12986f388b1ca90b3c P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:17.152815 27222 tablet_bootstrap.cc:700] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d: Time spent opening tablet: real 0.119s user 0.000s sys 0.001s
I20260810 11:30:17.153278 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 140) took 2201 ms. Trace:
I20260810 11:30:17.154603 27223 rpcz_store.cc:276] 0810 11:30:14.951638 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.951816 (+ 178us) service_pool.cc:227] Handling call
0810 11:30:17.017259 (+2065443us) ts_tablet_manager.cc:1145] Deleting tablet 2c6b3f8626724d12986f388b1ca90b3c
0810 11:30:17.017275 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.106155 (+ 88880us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:17.134121 (+ 27966us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:17.153234 (+ 19113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2027035}
I20260810 11:30:17.154336 27228 tablet_bootstrap.cc:654] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:17.155433 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 2c6b3f8626724d12986f388b1ca90b3c (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]) successfully deleted
I20260810 11:30:17.157490 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 138) took 2214 ms. Trace:
I20260810 11:30:17.157750 27223 rpcz_store.cc:276] 0810 11:30:14.943157 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.943218 (+ 61us) service_pool.cc:227] Handling call
0810 11:30:17.157266 (+2214048us) ts_tablet_manager.cc:1145] Deleting tablet d729baae40a64e6e8c23e6870f230afb
0810 11:30:17.157282 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.157443 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2166892}
W20260810 11:30:17.158761 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet d729baae40a64e6e8c23e6870f230afb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d729baae40a64e6e8c23e6870f230afb already in progress: creating tablet
I20260810 11:30:17.158841 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 139) took 2210 ms. Trace:
I20260810 11:30:17.158975 27223 rpcz_store.cc:276] 0810 11:30:14.948890 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.949028 (+ 138us) service_pool.cc:227] Handling call
0810 11:30:17.158692 (+2209664us) ts_tablet_manager.cc:1145] Deleting tablet 2fc76603bf8843dab18c95fdab9a8be0
0810 11:30:17.158703 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.158808 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2164374}
I20260810 11:30:17.159192 27222 tablet_bootstrap.cc:654] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:17.160252 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 142) took 2169 ms. Trace:
I20260810 11:30:17.160468 27223 rpcz_store.cc:276] 0810 11:30:14.991194 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.991697 (+ 503us) service_pool.cc:227] Handling call
0810 11:30:17.159994 (+2168297us) ts_tablet_manager.cc:1145] Deleting tablet eb51618d37ac488fa7e3d23e5f85ec36
0810 11:30:17.160013 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.160182 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2152579}
I20260810 11:30:17.161369 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 141) took 2170 ms. Trace:
W20260810 11:30:17.161276 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet eb51618d37ac488fa7e3d23e5f85ec36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb51618d37ac488fa7e3d23e5f85ec36 already in progress: creating tablet
I20260810 11:30:17.161742 27223 rpcz_store.cc:276] 0810 11:30:14.991012 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.991478 (+ 466us) service_pool.cc:227] Handling call
0810 11:30:17.161169 (+2169691us) ts_tablet_manager.cc:1145] Deleting tablet 31cafb7c691d40a48a40f7d4190c4f8d
0810 11:30:17.161181 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.161331 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2131169}
W20260810 11:30:17.168339 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 31cafb7c691d40a48a40f7d4190c4f8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31cafb7c691d40a48a40f7d4190c4f8d already in progress: creating tablet
I20260810 11:30:17.168663 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 161) took 1789 ms. Trace:
I20260810 11:30:17.170070 27223 rpcz_store.cc:276] 0810 11:30:15.379416 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.859122 (+479706us) service_pool.cc:227] Handling call
0810 11:30:17.168388 (+1309266us) ts_tablet_manager.cc:1145] Deleting tablet 23d8ce485cb84495a6e964b6d5977f0d
0810 11:30:17.168404 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.168551 (+ 147us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1305765}
W20260810 11:30:17.171243 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 23d8ce485cb84495a6e964b6d5977f0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23d8ce485cb84495a6e964b6d5977f0d already in progress: creating tablet
I20260810 11:30:17.171998 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 163) took 1621 ms. Trace:
I20260810 11:30:17.172701 27223 rpcz_store.cc:276] 0810 11:30:15.550277 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.862643 (+312366us) service_pool.cc:227] Handling call
0810 11:30:17.171771 (+1309128us) ts_tablet_manager.cc:1145] Deleting tablet a18cb43b4dc04a1290a6bade7ac1f3cf
0810 11:30:17.171786 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.171947 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1308812}
I20260810 11:30:17.174722 27231 raft_consensus.cc:374] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:17.174860 27231 raft_consensus.cc:729] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:17.175232 27231 consensus_queue.cc:260] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.176134 27231 ts_tablet_manager.cc:1428] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.050s user 0.001s sys 0.001s
I20260810 11:30:17.181885 27231 tablet_bootstrap.cc:492] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
W20260810 11:30:17.196992 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet a18cb43b4dc04a1290a6bade7ac1f3cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a18cb43b4dc04a1290a6bade7ac1f3cf already in progress: creating tablet
I20260810 11:30:17.198457 27228 tablet_bootstrap.cc:492] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:17.199240 27228 ts_tablet_manager.cc:1397] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.062s user 0.001s sys 0.008s
I20260810 11:30:17.200830 26498 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 60d56e162b4b41e2867ac845e524aca4
I20260810 11:30:17.200901 27228 raft_consensus.cc:348] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.202174 27228 raft_consensus.cc:374] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:17.202236 26498 catalog_manager.cc:6565] ReplaceTablet: tablet 60d56e162b4b41e2867ac845e524aca4 deleted and replaced by tablet 10210204d5ff4e5e97c98fd255f674a5
I20260810 11:30:17.202716 27228 raft_consensus.cc:729] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:17.202416 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 162) took 1806 ms. Trace:
I20260810 11:30:17.203356 27223 rpcz_store.cc:276] 0810 11:30:15.395592 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.860283 (+464691us) service_pool.cc:227] Handling call
0810 11:30:17.201781 (+1341498us) ts_tablet_manager.cc:1145] Deleting tablet 96cae4eb16c84410926a317af70e44f7
0810 11:30:17.201805 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.202010 (+ 205us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1338190}
I20260810 11:30:17.204905 26492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 9311943eebaa4824bde96b4cb09f1e2c
I20260810 11:30:17.206159 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet 9311943eebaa4824bde96b4cb09f1e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:17.207039 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_eecd0244ecc849339f452f38db67c973"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:17.207218 27228 consensus_queue.cc:260] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:17.207828 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eecd0244ecc849339f452f38db67c973 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:17.209350 27223 tablet_replica.cc:330] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:17.209367 26493 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_b0ce306dde7b412c8fa2bda65c94c917" } new_table_name: "default.Table_9b714db8cc714c0999f926e8182ca6e4" modify_external_catalogs: true
I20260810 11:30:17.209903 27223 raft_consensus.cc:2229] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:17.211762 26496 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 83631b421a614796bdf76335f1437e00 consensus state has no leader
I20260810 11:30:17.213136 26500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet eb9394f9ca2c44de93354e23973cf902
I20260810 11:30:17.213701 26500 catalog_manager.cc:6565] ReplaceTablet: tablet eb9394f9ca2c44de93354e23973cf902 deleted and replaced by tablet db59523b71224370bf5fce6b56592f71
I20260810 11:30:17.214167 26500 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_164710e7832448d58f926e94ed5c17ec" } new_table_name: "default.Table_fa1a8ca288074aa495b826ea794186bb" modify_external_catalogs: true
W20260810 11:30:17.216159 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 96cae4eb16c84410926a317af70e44f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96cae4eb16c84410926a317af70e44f7 already in progress: creating tablet
I20260810 11:30:17.217664 26887 tablet_service.cc:1514] Processing DeleteTablet for tablet 60d56e162b4b41e2867ac845e524aca4 with delete_type TABLET_DATA_DELETED (replaced by tablet 10210204d5ff4e5e97c98fd255f674a5) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:17.218138 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 9311943eebaa4824bde96b4cb09f1e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:17.218688 26890 tablet_service.cc:1514] Processing DeleteTablet for tablet eb9394f9ca2c44de93354e23973cf902 with delete_type TABLET_DATA_DELETED (replaced by tablet db59523b71224370bf5fce6b56592f71) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:17.220139 27228 ts_tablet_manager.cc:1428] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.020s user 0.003s sys 0.000s
I20260810 11:30:17.220497 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet eb9394f9ca2c44de93354e23973cf902 with delete_type TABLET_DATA_DELETED (replaced by tablet db59523b71224370bf5fce6b56592f71) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:17.220886 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_a8f81228863444c590a0b549f6a1b48c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:17.221597 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8f81228863444c590a0b549f6a1b48c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:17.223176 26499 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 8798892eb4604ee8ac9c95e64dbb14e9
I20260810 11:30:17.223981 26501 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 3851d39aeb3142938a5ac558ab438c21
I20260810 11:30:17.224359 27223 raft_consensus.cc:2258] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:17.225592 27223 ts_tablet_manager.cc:1905] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:17.226756 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_57b6151125a144fcb6230ee986bff7ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:17.227391 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57b6151125a144fcb6230ee986bff7ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:17.228890 26590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" candidate_term: 3 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361" is_pre_election: true
I20260810 11:30:17.212335 26496 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_daa63098f93c4c00bf673114c127e69f" } new_table_name: "default.Table_1528f143d0414238812c27c83d4ea987" modify_external_catalogs: true
I20260810 11:30:17.232924 26501 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 6c5b650bc02f4fa393bada5b54c77f1f (table default.Table_0541fad2df4246c69ea4c710c167a284 [id=3d8c46d7a15e457a93fd615ad99a4f36]). Expected version 4 got 0
I20260810 11:30:17.234282 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_ad3534a46309483687ef9dd9471f1008"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:17.235026 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad3534a46309483687ef9dd9471f1008 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:17.228402 27228 tablet_bootstrap.cc:492] T 952fc4eb5e5c4d9597f4b6eee860ab3a P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:17.230763 26890 tablet_service.cc:1514] Processing DeleteTablet for tablet 8798892eb4604ee8ac9c95e64dbb14e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:17.231082 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 3851d39aeb3142938a5ac558ab438c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:17.238526 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 607b055f8ced4372800adf5817b46e0b with delete_type TABLET_DATA_DELETED (replaced by tablet e25ae21cc8cc4749a507fcab5ee225a3) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:17.239091 27386 raft_consensus.cc:482] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:17.239450 27386 raft_consensus.cc:504] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:17.240880 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec788db5b0ca40f1811b6660276d0254" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:17.241734 26700 leader_election.cc:341] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:17.241984 26498 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 6c5b650bc02f4fa393bada5b54c77f1f (table default.Table_0541fad2df4246c69ea4c710c167a284 [id=3d8c46d7a15e457a93fd615ad99a4f36]). Expected version 4 got 0
I20260810 11:30:17.242040 27386 leader_election.cc:288] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:17.242471 27228 tablet_bootstrap.cc:654] T 952fc4eb5e5c4d9597f4b6eee860ab3a P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:17.245110 26498 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 6c5b650bc02f4fa393bada5b54c77f1f (table default.Table_0541fad2df4246c69ea4c710c167a284 [id=3d8c46d7a15e457a93fd615ad99a4f36]). Expected version 4 got 0
I20260810 11:30:17.246697 26498 master_service.cc:946] ReplaceTablet: received request to replace tablet 43e42cc642544f779bb79cee7479c4f4 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:17.247715 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet 3851d39aeb3142938a5ac558ab438c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:17.248210 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 8798892eb4604ee8ac9c95e64dbb14e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:17.248996 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_1c6221759f954488a1e7df4252c2a6ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:17.250705 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 60d56e162b4b41e2867ac845e524aca4 with delete_type TABLET_DATA_DELETED (replaced by tablet 10210204d5ff4e5e97c98fd255f674a5) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:17.254434 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c6221759f954488a1e7df4252c2a6ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:17.251911 26487 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.252:34489, user_credentials={real_user=slave}} blocked reactor thread for 58033.8us
I20260810 11:30:17.263088 27385 raft_consensus.cc:482] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:17.263366 27385 raft_consensus.cc:504] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:17.266232 26849 leader_election.cc:341] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: debc114073e14ec1839c5c4c7c2f1f1e
I20260810 11:30:17.266760 27385 leader_election.cc:288] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:17.268639 27222 tablet_bootstrap.cc:492] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:17.268987 27222 ts_tablet_manager.cc:1397] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.262s user 0.000s sys 0.007s
I20260810 11:30:17.277522 27528 tablet.cc:1722] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 11:30:17.280872 27464 raft_consensus.cc:482] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:17.282373 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 3851d39aeb3142938a5ac558ab438c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:17.282871 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet 8798892eb4604ee8ac9c95e64dbb14e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:17.283138 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet eb9394f9ca2c44de93354e23973cf902 with delete_type TABLET_DATA_DELETED (replaced by tablet db59523b71224370bf5fce6b56592f71) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:17.283489 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "debc114073e14ec1839c5c4c7c2f1f1e" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:17.284458 26848 leader_election.cc:302] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:17.285218 27385 raft_consensus.cc:2726] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:17.270458 27222 raft_consensus.cc:348] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:17.286324 27222 raft_consensus.cc:374] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:17.286844 27222 raft_consensus.cc:729] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:17.287030 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 9311943eebaa4824bde96b4cb09f1e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:17.287452 27222 consensus_queue.cc:260] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:17.288798 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet 952fc4eb5e5c4d9597f4b6eee860ab3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:17.289022 27111 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:17.291091 27024 tablet_service.cc:1514] Processing DeleteTablet for tablet 60d56e162b4b41e2867ac845e524aca4 with delete_type TABLET_DATA_DELETED (replaced by tablet 10210204d5ff4e5e97c98fd255f674a5) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:17.292786 27223 ts_tablet_manager.cc:1918] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:17.292889 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec788db5b0ca40f1811b6660276d0254" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:17.293399 27464 raft_consensus.cc:504] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.294842 27228 tablet_bootstrap.cc:492] T 952fc4eb5e5c4d9597f4b6eee860ab3a P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:17.294968 27464 leader_election.cc:288] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:17.295265 27228 ts_tablet_manager.cc:1397] T 952fc4eb5e5c4d9597f4b6eee860ab3a P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.067s user 0.001s sys 0.009s
I20260810 11:30:17.295161 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "952fc4eb5e5c4d9597f4b6eee860ab3a" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:17.295929 26991 leader_election.cc:341] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:17.295550 26702 leader_election.cc:341] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:17.296701 26702 leader_election.cc:302] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:17.296521 27228 raft_consensus.cc:348] T 952fc4eb5e5c4d9597f4b6eee860ab3a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.296962 27228 raft_consensus.cc:374] T 952fc4eb5e5c4d9597f4b6eee860ab3a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:17.297075 27228 raft_consensus.cc:729] T 952fc4eb5e5c4d9597f4b6eee860ab3a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:17.297533 27228 consensus_queue.cc:260] T 952fc4eb5e5c4d9597f4b6eee860ab3a P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.299681 27228 ts_tablet_manager.cc:1428] T 952fc4eb5e5c4d9597f4b6eee860ab3a P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260810 11:30:17.300580 27228 tablet_bootstrap.cc:492] T 7e3707ae32624f6483866208321eefde P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:17.302587 27526 raft_consensus.cc:2726] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:17.300022 27223 log.cc:1196] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/e2732660f8964feeb5c03365df065a54
I20260810 11:30:17.304632 27223 ts_tablet_manager.cc:1939] T e2732660f8964feeb5c03365df065a54 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:17.305035 26964 heartbeater.cc:347] Connected to a master server at 127.25.195.254:41125
I20260810 11:30:17.306051 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 164) took 1755 ms. Trace:
I20260810 11:30:17.306231 27223 rpcz_store.cc:276] 0810 11:30:15.550395 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.862975 (+312580us) service_pool.cc:227] Handling call
0810 11:30:17.206936 (+1343961us) ts_tablet_manager.cc:1145] Deleting tablet e2732660f8964feeb5c03365df065a54
0810 11:30:17.206960 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.247516 (+ 40556us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:17.292599 (+ 45083us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:17.305951 (+ 13352us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10399,"tablet-delete.queue_time_us":1342714}
I20260810 11:30:17.307108 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet e2732660f8964feeb5c03365df065a54 (table default.Table_c2c10310e09d44fdae1c00c7997c03f1 [id=8ef1221306af485aa67dabbcd7079139]) successfully deleted
W20260810 11:30:17.310606 26993 consensus_peers.cc:487] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: debc114073e14ec1839c5c4c7c2f1f1e. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:17.310703 27222 ts_tablet_manager.cc:1428] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.041s user 0.000s sys 0.004s
W20260810 11:30:17.312983 26993 leader_election.cc:341] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 952fc4eb5e5c4d9597f4b6eee860ab3a
I20260810 11:30:17.313210 26993 leader_election.cc:302] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:17.314689 27464 raft_consensus.cc:2726] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:17.318112 26493 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e consensus state has no leader
I20260810 11:30:17.318939 27228 tablet_bootstrap.cc:654] T 7e3707ae32624f6483866208321eefde P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:17.319806 27222 tablet_bootstrap.cc:492] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:17.320894 26500 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2917f1ffb5214a80b19810540602df35 consensus state has no leader
I20260810 11:30:17.320823 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 165) took 1770 ms. Trace:
I20260810 11:30:17.321027 27223 rpcz_store.cc:276] 0810 11:30:15.550489 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.863606 (+313117us) service_pool.cc:227] Handling call
0810 11:30:17.320524 (+1456918us) ts_tablet_manager.cc:1145] Deleting tablet bb0357271cfd46478867a3cc0660bcdc
0810 11:30:17.320541 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.320745 (+ 204us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1431085}
W20260810 11:30:17.321832 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet bb0357271cfd46478867a3cc0660bcdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb0357271cfd46478867a3cc0660bcdc already in progress: creating tablet
I20260810 11:30:17.322628 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 166) took 1771 ms. Trace:
I20260810 11:30:17.322654 26500 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_bc30a24ee0374aab9a63a052bc05d81b" } new_table_name: "default.Table_3425866f9a834dd48a943c7dc9e41827" modify_external_catalogs: true
I20260810 11:30:17.322777 27223 rpcz_store.cc:276] 0810 11:30:15.550614 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.863998 (+313384us) service_pool.cc:227] Handling call
0810 11:30:17.322261 (+1458263us) ts_tablet_manager.cc:1145] Deleting tablet ffeb0373c6124af291336ca9da50c318
0810 11:30:17.322324 (+ 63us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.322476 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1426885}
I20260810 11:30:17.323828 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 179) took 1640 ms. Trace:
I20260810 11:30:17.323967 27223 rpcz_store.cc:276] 0810 11:30:15.682955 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.038419 (+355464us) service_pool.cc:227] Handling call
0810 11:30:17.323264 (+1284845us) ts_tablet_manager.cc:1145] Deleting tablet 478c0c39658349c39e3afa1aa1653e82
0810 11:30:17.323279 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.323393 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1198846}
I20260810 11:30:17.324627 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 182) took 1589 ms. Trace:
I20260810 11:30:17.324749 27223 rpcz_store.cc:276] 0810 11:30:15.734818 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.124445 (+389627us) service_pool.cc:227] Handling call
0810 11:30:17.324419 (+1199974us) ts_tablet_manager.cc:1145] Deleting tablet 31888ddeafe14738b818016a9c0a4ad3
0810 11:30:17.324433 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.324539 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":998403}
I20260810 11:30:17.324735 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_638a44c47a3b410ba563ae4fcf03e6a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:17.325397 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 188) took 1473 ms. Trace:
I20260810 11:30:17.325531 27223 rpcz_store.cc:276] 0810 11:30:15.853329 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.413779 (+560450us) service_pool.cc:227] Handling call
0810 11:30:17.325190 (+911411us) ts_tablet_manager.cc:1145] Deleting tablet a7a2cb1d2e8e40f58144908e34438d53
0810 11:30:17.325204 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.325323 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":910983}
I20260810 11:30:17.326820 27223 tablet_replica.cc:330] T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
W20260810 11:30:17.326892 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ffeb0373c6124af291336ca9da50c318 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffeb0373c6124af291336ca9da50c318 already in progress: creating tablet
W20260810 11:30:17.327200 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 478c0c39658349c39e3afa1aa1653e82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 478c0c39658349c39e3afa1aa1653e82 already in progress: creating tablet
W20260810 11:30:17.327418 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 31888ddeafe14738b818016a9c0a4ad3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31888ddeafe14738b818016a9c0a4ad3 already in progress: creating tablet
I20260810 11:30:17.327250 27223 raft_consensus.cc:2229] T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:17.327675 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet a7a2cb1d2e8e40f58144908e34438d53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7a2cb1d2e8e40f58144908e34438d53 already in progress: creating tablet
I20260810 11:30:17.327991 27223 raft_consensus.cc:2258] T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:17.327903 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 2801709d53614916abac370f7ae5e913 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2801709d53614916abac370f7ae5e913 already in progress: creating tablet
I20260810 11:30:17.328985 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 952fc4eb5e5c4d9597f4b6eee860ab3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:17.329921 27223 ts_tablet_manager.cc:1905] T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:17.331108 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 0033d61d07d84262a98b0ebc54bd7960 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0033d61d07d84262a98b0ebc54bd7960 already in progress: creating tablet
I20260810 11:30:17.334797 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_3fd59f07e4ee4f54bce7829aec4cf4c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:17.336365 27222 tablet_bootstrap.cc:654] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:17.331200 27228 tablet_bootstrap.cc:492] T 7e3707ae32624f6483866208321eefde P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:17.336910 27228 ts_tablet_manager.cc:1397] T 7e3707ae32624f6483866208321eefde P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.001s
I20260810 11:30:17.337816 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 7eae49e1c6554ba2ae831831ff4bb45c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:17.338231 27024 tablet_service.cc:1514] Processing DeleteTablet for tablet 79953795f07845aba3f028741cdcdd9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:17.338370 27228 raft_consensus.cc:348] T 7e3707ae32624f6483866208321eefde P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:17.338876 27228 raft_consensus.cc:374] T 7e3707ae32624f6483866208321eefde P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 11:30:17.335476 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_638a44c47a3b410ba563ae4fcf03e6a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:17.339219 27228 raft_consensus.cc:729] T 7e3707ae32624f6483866208321eefde P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:17.339725 27228 consensus_queue.cc:260] T 7e3707ae32624f6483866208321eefde P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:17.343627 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fd59f07e4ee4f54bce7829aec4cf4c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:17.343652 27228 ts_tablet_manager.cc:1428] T 7e3707ae32624f6483866208321eefde P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
I20260810 11:30:17.346225 27228 tablet_bootstrap.cc:492] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:17.349144 27228 tablet_bootstrap.cc:654] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:17.350358 27385 raft_consensus.cc:482] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:17.350548 27385 raft_consensus.cc:504] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.351503 27385 leader_election.cc:288] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:17.352363 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "607b055f8ced4372800adf5817b46e0b" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:17.352775 27059 raft_consensus.cc:2379] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:17.354287 27248 ts_tablet_manager.cc:1918] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:17.354506 27248 log.cc:1196] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/b1cd64deb8e24c81ba2d4214bb38f5da
I20260810 11:30:17.355075 27248 ts_tablet_manager.cc:1939] T b1cd64deb8e24c81ba2d4214bb38f5da P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
W20260810 11:30:17.355873 26849 leader_election.cc:341] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 607b055f8ced4372800adf5817b46e0b
I20260810 11:30:17.356048 26849 leader_election.cc:302] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:17.356686 27385 raft_consensus.cc:3037] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:17.364938 26496 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 39beb126ac324842b7e387c46bcb4099 consensus state has no leader
I20260810 11:30:17.365801 26492 master_service.cc:946] ReplaceTablet: received request to replace tablet 7aa16654b7f34f9baf856bf724cece8f from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:17.366423 27385 raft_consensus.cc:2726] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:17.366478 26501 master_service.cc:946] ReplaceTablet: received request to replace tablet 60d56e162b4b41e2867ac845e524aca4 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:17.371676 27223 ts_tablet_manager.cc:1918] T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:17.373086 27223 log.cc:1196] T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/3dabfbd779c5406cb10ecf70f5a142e7
I20260810 11:30:17.373835 27223 ts_tablet_manager.cc:1939] T 3dabfbd779c5406cb10ecf70f5a142e7 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:17.373731 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_bd17aa8dfcdf4c09b68660896911a2ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:17.374467 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd17aa8dfcdf4c09b68660896911a2ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:17.377825 26748 tablet_service.cc:1467] Processing CreateTablet for tablet d4873fe8318040a2b7e021708a875f43 (DEFAULT_TABLE table=default.Table_f33a13096a144e538af2795c149abdcd [id=60ce1267de814f218c27ac084a08a26a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.378378 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4873fe8318040a2b7e021708a875f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.379560 27228 tablet_bootstrap.cc:492] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:17.380111 27228 ts_tablet_manager.cc:1397] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.034s user 0.000s sys 0.007s
I20260810 11:30:17.381349 27228 raft_consensus.cc:348] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.381649 27228 raft_consensus.cc:374] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:17.381745 27228 raft_consensus.cc:729] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:17.381793 26740 tablet_service.cc:1467] Processing CreateTablet for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 (DEFAULT_TABLE table=default.Table_4e27e43aa8d9444ca022be053fcd700e [id=b6297673b9854cf79ae182f5f51ebd36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.382296 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.382167 27228 consensus_queue.cc:260] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.385289 26732 tablet_service.cc:1467] Processing CreateTablet for tablet 9079c8fec89043be9d0040a3728e93f4 (DEFAULT_TABLE table=default.Table_fabd7780b9224b7993ad4321be6f92e2 [id=c9c81bc9d6dc48c89ba4cc51ca4f8bd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.386013 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9079c8fec89043be9d0040a3728e93f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.386083 27228 ts_tablet_manager.cc:1428] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260810 11:30:17.386549 27228 tablet_bootstrap.cc:492] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:17.387804 27385 raft_consensus.cc:482] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:17.388067 27385 raft_consensus.cc:504] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.388978 27385 leader_election.cc:288] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:17.389091 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 10e6c41db71a4146840f06c5b7412d9c (DEFAULT_TABLE table=default.Table_bb3131b0059a44d68866825f94543d0f [id=8de05bfacc2e40dda2832803fa5b69d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.389485 27228 tablet_bootstrap.cc:654] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:17.389669 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10e6c41db71a4146840f06c5b7412d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.390882 27223 tablet_replica.cc:330] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:17.392450 27223 raft_consensus.cc:2229] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:17.392750 27223 raft_consensus.cc:2258] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:17.393082 26735 tablet_service.cc:1467] Processing CreateTablet for tablet 1f64d4b9320c4cb39f57573d781a47d3 (DEFAULT_TABLE table=default.Table_b6c6809bdbac4c2d86853a11b84b872e [id=5335295210c1486e927e4228ccdb1de0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.393646 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f64d4b9320c4cb39f57573d781a47d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.393838 27223 ts_tablet_manager.cc:1905] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:17.397066 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 460a679219cb4a7f9aecfec58a98238b (DEFAULT_TABLE table=default.Table_64f83258168749f88b4697bfee40bc2f [id=458cd8860fa448759ff4f5ee12c77599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.397737 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 460a679219cb4a7f9aecfec58a98238b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.401206 26733 tablet_service.cc:1467] Processing CreateTablet for tablet 9744f59d7e49430e91080f56f3342038 (DEFAULT_TABLE table=default.Table_835cdd4f3794466d808449e2e17bb15a [id=a483de6ef1fc453b93e3f183e9c15dd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.401923 26733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9744f59d7e49430e91080f56f3342038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.404578 27223 ts_tablet_manager.cc:1918] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:17.405836 26742 tablet_service.cc:1467] Processing CreateTablet for tablet 4b5a7f67ec5b48c2b5a510add0282a76 (DEFAULT_TABLE table=default.Table_393d03f5197d43b6977bf48bd7818a0e [id=bc7f10791af946e5957625fb1f912c4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.406450 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b5a7f67ec5b48c2b5a510add0282a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.407051 27228 tablet_bootstrap.cc:492] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:17.407250 27228 ts_tablet_manager.cc:1397] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.001s
I20260810 11:30:17.408320 27228 raft_consensus.cc:348] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.408671 27228 raft_consensus.cc:374] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:17.408999 27228 raft_consensus.cc:729] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:17.409247 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c (DEFAULT_TABLE table=default.Table_2d72673d9e86472ca07d3c7d36f51108 [id=7f2c916845a443209bff1b685821499f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.409781 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.409525 27228 consensus_queue.cc:260] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.410794 27228 ts_tablet_manager.cc:1428] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 11:30:17.411331 27228 tablet_bootstrap.cc:492] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:17.413947 26734 tablet_service.cc:1467] Processing CreateTablet for tablet b4a37afa17d04e3181e7513ac8d23c24 (DEFAULT_TABLE table=default.Table_146776d44301462096eb098adde86d0e [id=77e0fa171ab74850a2119422513f0b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.414287 27223 log.cc:1196] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/debc114073e14ec1839c5c4c7c2f1f1e
I20260810 11:30:17.414649 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4a37afa17d04e3181e7513ac8d23c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.415043 27223 ts_tablet_manager.cc:1939] T debc114073e14ec1839c5c4c7c2f1f1e P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:17.416749 27228 tablet_bootstrap.cc:654] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:17.422788 26501 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_63ffd347d32d42dd8cc4f722268cd009" } new_table_name: "default.Table_64b627b42e6747c1b2023d393c3738b5" modify_external_catalogs: true
I20260810 11:30:17.427217 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 9e329b95fc8e41c3967079896294942a (DEFAULT_TABLE table=default.Table_e4551e8a102f4eb580426519fca21df9 [id=b206753d4f4142be82ee28150226bd53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.428982 26890 tablet_service.cc:1467] Processing CreateTablet for tablet d4873fe8318040a2b7e021708a875f43 (DEFAULT_TABLE table=default.Table_f33a13096a144e538af2795c149abdcd [id=60ce1267de814f218c27ac084a08a26a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.430104 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 3dabfbd779c5406cb10ecf70f5a142e7 (table default.Table_2511fda0071847d1a412482192a6bbb4 [id=66cb5c83b5894c1a9bc02e9019921428]) successfully deleted
I20260810 11:30:17.430446 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e329b95fc8e41c3967079896294942a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:17.431367 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet cb6805a5dd264939850ea2cd9a850a1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb6805a5dd264939850ea2cd9a850a1f already in progress: creating tablet
W20260810 11:30:17.431735 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 5adcec593b8c4d40997c8911e9f77c85 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5adcec593b8c4d40997c8911e9f77c85 already in progress: creating tablet
W20260810 11:30:17.433115 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 0938a2f3688246a2b46978eeb7d5d521 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0938a2f3688246a2b46978eeb7d5d521 already in progress: creating tablet
I20260810 11:30:17.436754 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e3707ae32624f6483866208321eefde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:17.437489 26887 tablet_service.cc:1467] Processing CreateTablet for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 (DEFAULT_TABLE table=default.Table_4e27e43aa8d9444ca022be053fcd700e [id=b6297673b9854cf79ae182f5f51ebd36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.438134 26890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4873fe8318040a2b7e021708a875f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.438702 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c5b650bc02f4fa393bada5b54c77f1f" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:17.439404 26729 tablet_service.cc:1467] Processing CreateTablet for tablet 2634beb347714fc7a2e05865adb34a22 (DEFAULT_TABLE table=default.Table_538c35ba9808453e870597b4257cefaa [id=e74be4ed04f542bda950d5f318b74c65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.439963 26729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2634beb347714fc7a2e05865adb34a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.444789 26887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.461375 26746 tablet_service.cc:1467] Processing CreateTablet for tablet 9e329b95fc8e41c3967079896294942a (DEFAULT_TABLE table=default.Table_e4551e8a102f4eb580426519fca21df9 [id=b206753d4f4142be82ee28150226bd53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.462065 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e329b95fc8e41c3967079896294942a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.462922 26895 tablet_service.cc:1467] Processing CreateTablet for tablet c62ae41d2dd74eedbe252c4de70fbe1e (DEFAULT_TABLE table=default.Table_a3ca31166a6348f68da88913588098df [id=5c8a2cbef71f4c9fb038a49e1ca7f704]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:17.464697 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 834c9c99ec424bb39e8a003e9204b2bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 834c9c99ec424bb39e8a003e9204b2bc already in progress: creating tablet
W20260810 11:30:17.465247 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet f3884736eec74c8992b8d51b37465875 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3884736eec74c8992b8d51b37465875 already in progress: creating tablet
I20260810 11:30:17.465560 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet debc114073e14ec1839c5c4c7c2f1f1e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]) successfully deleted
W20260810 11:30:17.465965 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 60d56e162b4b41e2867ac845e524aca4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60d56e162b4b41e2867ac845e524aca4 already in progress: creating tablet
I20260810 11:30:17.465065 26879 tablet_service.cc:1467] Processing CreateTablet for tablet 2634beb347714fc7a2e05865adb34a22 (DEFAULT_TABLE table=default.Table_538c35ba9808453e870597b4257cefaa [id=e74be4ed04f542bda950d5f318b74c65]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:17.466316 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 9311943eebaa4824bde96b4cb09f1e2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9311943eebaa4824bde96b4cb09f1e2c already in progress: creating tablet
W20260810 11:30:17.466723 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet eb9394f9ca2c44de93354e23973cf902 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb9394f9ca2c44de93354e23973cf902 already in progress: creating tablet
I20260810 11:30:17.466869 26877 tablet_service.cc:1467] Processing CreateTablet for tablet 460a679219cb4a7f9aecfec58a98238b (DEFAULT_TABLE table=default.Table_64f83258168749f88b4697bfee40bc2f [id=458cd8860fa448759ff4f5ee12c77599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.467288 26885 tablet_service.cc:1467] Processing CreateTablet for tablet 9744f59d7e49430e91080f56f3342038 (DEFAULT_TABLE table=default.Table_835cdd4f3794466d808449e2e17bb15a [id=a483de6ef1fc453b93e3f183e9c15dd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.462078 26886 tablet_service.cc:1467] Processing CreateTablet for tablet 4b5a7f67ec5b48c2b5a510add0282a76 (DEFAULT_TABLE table=default.Table_393d03f5197d43b6977bf48bd7818a0e [id=bc7f10791af946e5957625fb1f912c4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.467162 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 34ed8c9efa634fc7b091b1bb6bc6d452 (DEFAULT_TABLE table=default.Table_fd64c13d7a514c7285b42e1c91a63cdf [id=7c8348b49b664bee8d8243efb2cdbb79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.468865 26892 tablet_service.cc:1467] Processing CreateTablet for tablet 7d3406f12d9c492cbd0d86fa7a57de82 (DEFAULT_TABLE table=default.Table_c32d1cb0b9e744fbacbd00c8736fad21 [id=f54b49f28880453aa7bc67b9c36a219b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.469563 26731 tablet_service.cc:1467] Processing CreateTablet for tablet 34ed8c9efa634fc7b091b1bb6bc6d452 (DEFAULT_TABLE table=default.Table_fd64c13d7a514c7285b42e1c91a63cdf [id=7c8348b49b664bee8d8243efb2cdbb79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.470191 26731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34ed8c9efa634fc7b091b1bb6bc6d452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.471549 26876 tablet_service.cc:1467] Processing CreateTablet for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c (DEFAULT_TABLE table=default.Table_2d72673d9e86472ca07d3c7d36f51108 [id=7f2c916845a443209bff1b685821499f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.471905 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 10e6c41db71a4146840f06c5b7412d9c (DEFAULT_TABLE table=default.Table_bb3131b0059a44d68866825f94543d0f [id=8de05bfacc2e40dda2832803fa5b69d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.473028 27223 tablet_replica.cc:330] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:17.472954 26878 tablet_service.cc:1467] Processing CreateTablet for tablet 9079c8fec89043be9d0040a3728e93f4 (DEFAULT_TABLE table=default.Table_fabd7780b9224b7993ad4321be6f92e2 [id=c9c81bc9d6dc48c89ba4cc51ca4f8bd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.473690 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c62ae41d2dd74eedbe252c4de70fbe1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.474005 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9744f59d7e49430e91080f56f3342038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.474291 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b5a7f67ec5b48c2b5a510add0282a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.470803 26880 tablet_service.cc:1467] Processing CreateTablet for tablet b4a37afa17d04e3181e7513ac8d23c24 (DEFAULT_TABLE table=default.Table_146776d44301462096eb098adde86d0e [id=77e0fa171ab74850a2119422513f0b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.474627 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34ed8c9efa634fc7b091b1bb6bc6d452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.475028 26893 tablet_service.cc:1467] Processing CreateTablet for tablet 1f64d4b9320c4cb39f57573d781a47d3 (DEFAULT_TABLE table=default.Table_b6c6809bdbac4c2d86853a11b84b872e [id=5335295210c1486e927e4228ccdb1de0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.477762 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f64d4b9320c4cb39f57573d781a47d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.475921 27223 raft_consensus.cc:2229] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:17.482044 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10e6c41db71a4146840f06c5b7412d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.483975 26880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4a37afa17d04e3181e7513ac8d23c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.484282 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9079c8fec89043be9d0040a3728e93f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.484692 27223 raft_consensus.cc:2258] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:17.484753 26736 tablet_service.cc:1467] Processing CreateTablet for tablet c62ae41d2dd74eedbe252c4de70fbe1e (DEFAULT_TABLE table=default.Table_a3ca31166a6348f68da88913588098df [id=5c8a2cbef71f4c9fb038a49e1ca7f704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.485178 26892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d3406f12d9c492cbd0d86fa7a57de82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.485447 26876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:17.489393 27243 kernel_stack_watchdog.cc:198] Thread 27450 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 385ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f55e99af980 (unknown) at ??:0
@ 0x8a5e57 __sanitizer::internal_sched_yield() at ??:?
@ 0x81ec1d __interceptor_pthread_create at ??:?
@ 0x7f55e66c9bfb kudu::Thread::StartThread() at ??:0
@ 0x9da5bc kudu::Thread::Create() at ??:?
@ 0x7f55f94a0aaa kudu::master::AutoLeaderRebalancerTask::Init() at ??:0
@ 0x7f55f94c7364 kudu::master::CatalogManager::Init() at ??:0
@ 0x7f55f96653ef kudu::master::Master::InitCatalogManager() at ??:0
@ 0x7f55f9664d58 kudu::master::Master::InitCatalogManagerTask() at ??:0
@ 0x7f55f9671040 kudu::master::Master::StartAsync()::$_0::operator()() at ??:0
@ 0x7f55f9670e69 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f55e66ec345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f55e66ef91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f55e66ef799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260810 11:30:17.491046 27223 ts_tablet_manager.cc:1905] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:17.492039 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c62ae41d2dd74eedbe252c4de70fbe1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.499168 26877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 460a679219cb4a7f9aecfec58a98238b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.507431 26879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2634beb347714fc7a2e05865adb34a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.518312 27228 tablet_bootstrap.cc:492] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:17.518652 27228 ts_tablet_manager.cc:1397] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.107s user 0.006s sys 0.002s
I20260810 11:30:17.553085 27228 raft_consensus.cc:348] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.570621 27228 raft_consensus.cc:374] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:17.543800 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 2634beb347714fc7a2e05865adb34a22
I20260810 11:30:17.574076 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_b9bd48d71fac4e03b0d84dcafd4cb4a5" } modify_external_catalogs: true
I20260810 11:30:17.574317 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_b9bd48d71fac4e03b0d84dcafd4cb4a5" } modify_external_catalogs: true
I20260810 11:30:17.545557 26495 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5895dc74894a4711bf78dd8b259cfc40" } modify_external_catalogs: true
I20260810 11:30:17.574874 26495 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5895dc74894a4711bf78dd8b259cfc40" } modify_external_catalogs: true
W20260810 11:30:17.551512 26500 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6e829d4bffeb4289a54b4d3d7a53c44e consensus state has no leader
I20260810 11:30:17.556492 26497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 0713f4f14a284050a7774a70ab974f30
I20260810 11:30:17.576088 26497 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_2d72673d9e86472ca07d3c7d36f51108" } modify_external_catalogs: true
I20260810 11:30:17.576345 26497 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_2d72673d9e86472ca07d3c7d36f51108" } modify_external_catalogs: true
I20260810 11:30:17.577463 26500 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_7c36df9513654205b604d1a8a1d7c2ca" } new_table_name: "default.Table_15f8b33002864cd2872dc2a70e613456" modify_external_catalogs: true
I20260810 11:30:17.577862 27228 raft_consensus.cc:729] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:17.557703 26492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 7aa16654b7f34f9baf856bf724cece8f
I20260810 11:30:17.579069 26492 catalog_manager.cc:6565] ReplaceTablet: tablet 7aa16654b7f34f9baf856bf724cece8f deleted and replaced by tablet 760aeada57464892ae3b9013a761c509
I20260810 11:30:17.579514 26492 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_ba69d247bec24bee8ac90108c17d70cd" } new_table_name: "default.Table_9329d33b857541719c3852e79fdc14b6" modify_external_catalogs: true
I20260810 11:30:17.563119 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_6f7fdd85630648659dcfe3b52e5ab365"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:17.582063 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f7fdd85630648659dcfe3b52e5ab365 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:17.564508 26499 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: default.Table_0541fad2df4246c69ea4c710c167a284 [id=3d8c46d7a15e457a93fd615ad99a4f36] alter complete (version 4)
W20260810 11:30:17.564966 26501 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac4b1821ac30452cbe7a8f844d9b37e5 consensus state has no leader
W20260810 11:30:17.584892 27286 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.25.195.253:34547 for RPC RequestConsensusVote timed out after 0.663s (ON_OUTBOUND_QUEUE)
I20260810 11:30:17.585325 26501 master_service.cc:946] ReplaceTablet: received request to replace tablet 1e0a8513171f4c39b74c08760a139d9e from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:17.586257 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_49be430f1e8f475482b54850772c0430"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:17.586942 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49be430f1e8f475482b54850772c0430 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:17.588405 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_75fb2f1be80a464396d0245dbd1e5139"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:17.589349 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75fb2f1be80a464396d0245dbd1e5139 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:17.597314 27228 consensus_queue.cc:260] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.598166 27228 ts_tablet_manager.cc:1428] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.079s user 0.004s sys 0.000s
I20260810 11:30:17.600381 27228 tablet_bootstrap.cc:492] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:17.613734 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet b7a3b877457c4a2489d397f3f864d6b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:17.614058 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet 2634beb347714fc7a2e05865adb34a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:17.614293 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 0713f4f14a284050a7774a70ab974f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:17.568013 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_2d72d964c7c54d639c11a02fc168152a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:17.614497 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aa16654b7f34f9baf856bf724cece8f with delete_type TABLET_DATA_DELETED (replaced by tablet 760aeada57464892ae3b9013a761c509) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:17.615003 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d72d964c7c54d639c11a02fc168152a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:17.617131 26484 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 150464us
W20260810 11:30:17.617440 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 8798892eb4604ee8ac9c95e64dbb14e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8798892eb4604ee8ac9c95e64dbb14e9 already in progress: creating tablet
W20260810 11:30:17.617652 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 3851d39aeb3142938a5ac558ab438c21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3851d39aeb3142938a5ac558ab438c21 already in progress: creating tablet
I20260810 11:30:17.418223 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c5b650bc02f4fa393bada5b54c77f1f" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:17.621908 26498 master_service.cc:946] ReplaceTablet: received request to replace tablet 70f6017d4d01463398cb347779dacf90 from {username='slave'} at 127.0.0.1:47672
W20260810 11:30:17.445462 26991 consensus_peers.cc:487] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: debc114073e14ec1839c5c4c7c2f1f1e. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:17.446040 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 34ed8c9efa634fc7b091b1bb6bc6d452 (DEFAULT_TABLE table=default.Table_fd64c13d7a514c7285b42e1c91a63cdf [id=7c8348b49b664bee8d8243efb2cdbb79]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:17.622264 26991 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 176845us
I20260810 11:30:17.622558 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34ed8c9efa634fc7b091b1bb6bc6d452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.623060 26848 leader_election.cc:302] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:17.446745 27027 tablet_service.cc:1467] Processing CreateTablet for tablet 9079c8fec89043be9d0040a3728e93f4 (DEFAULT_TABLE table=default.Table_fabd7780b9224b7993ad4321be6f92e2 [id=c9c81bc9d6dc48c89ba4cc51ca4f8bd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.624886 27027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9079c8fec89043be9d0040a3728e93f4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:17.628094 26991 consensus_peers.cc:487] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c6b3f8626724d12986f388b1ca90b3c. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:17.447516 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 10e6c41db71a4146840f06c5b7412d9c (DEFAULT_TABLE table=default.Table_bb3131b0059a44d68866825f94543d0f [id=8de05bfacc2e40dda2832803fa5b69d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.628894 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10e6c41db71a4146840f06c5b7412d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.630637 27385 raft_consensus.cc:2726] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:17.448342 27026 tablet_service.cc:1467] Processing CreateTablet for tablet 2634beb347714fc7a2e05865adb34a22 (DEFAULT_TABLE table=default.Table_538c35ba9808453e870597b4257cefaa [id=e74be4ed04f542bda950d5f318b74c65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.633523 27026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2634beb347714fc7a2e05865adb34a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.448858 27022 tablet_service.cc:1467] Processing CreateTablet for tablet c62ae41d2dd74eedbe252c4de70fbe1e (DEFAULT_TABLE table=default.Table_a3ca31166a6348f68da88913588098df [id=5c8a2cbef71f4c9fb038a49e1ca7f704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.449220 27036 tablet_service.cc:1467] Processing CreateTablet for tablet 1f64d4b9320c4cb39f57573d781a47d3 (DEFAULT_TABLE table=default.Table_b6c6809bdbac4c2d86853a11b84b872e [id=5335295210c1486e927e4228ccdb1de0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.636994 27036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f64d4b9320c4cb39f57573d781a47d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.640841 27228 tablet_bootstrap.cc:654] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:17.449795 27030 tablet_service.cc:1467] Processing CreateTablet for tablet 460a679219cb4a7f9aecfec58a98238b (DEFAULT_TABLE table=default.Table_64f83258168749f88b4697bfee40bc2f [id=458cd8860fa448759ff4f5ee12c77599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.641300 27223 ts_tablet_manager.cc:1918] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:17.641683 27030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 460a679219cb4a7f9aecfec58a98238b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.450440 27033 tablet_service.cc:1467] Processing CreateTablet for tablet 9744f59d7e49430e91080f56f3342038 (DEFAULT_TABLE table=default.Table_835cdd4f3794466d808449e2e17bb15a [id=a483de6ef1fc453b93e3f183e9c15dd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.644936 27033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9744f59d7e49430e91080f56f3342038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.645748 27223 log.cc:1196] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/607b055f8ced4372800adf5817b46e0b
I20260810 11:30:17.451035 27035 tablet_service.cc:1467] Processing CreateTablet for tablet 4b5a7f67ec5b48c2b5a510add0282a76 (DEFAULT_TABLE table=default.Table_393d03f5197d43b6977bf48bd7818a0e [id=bc7f10791af946e5957625fb1f912c4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.648912 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b5a7f67ec5b48c2b5a510add0282a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.649736 27223 ts_tablet_manager.cc:1939] T 607b055f8ced4372800adf5817b46e0b P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:17.650475 27223 tablet_replica.cc:330] T 952fc4eb5e5c4d9597f4b6eee860ab3a P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:17.651278 27223 raft_consensus.cc:2229] T 952fc4eb5e5c4d9597f4b6eee860ab3a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:17.651502 27223 raft_consensus.cc:2258] T 952fc4eb5e5c4d9597f4b6eee860ab3a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:17.451834 27038 tablet_service.cc:1467] Processing CreateTablet for tablet 7d3406f12d9c492cbd0d86fa7a57de82 (DEFAULT_TABLE table=default.Table_c32d1cb0b9e744fbacbd00c8736fad21 [id=f54b49f28880453aa7bc67b9c36a219b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.652959 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d3406f12d9c492cbd0d86fa7a57de82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.454046 27025 tablet_service.cc:1467] Processing CreateTablet for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c (DEFAULT_TABLE table=default.Table_2d72673d9e86472ca07d3c7d36f51108 [id=7f2c916845a443209bff1b685821499f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.657151 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.658212 27223 ts_tablet_manager.cc:1905] T 952fc4eb5e5c4d9597f4b6eee860ab3a P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:17.455507 27032 tablet_service.cc:1467] Processing CreateTablet for tablet b4a37afa17d04e3181e7513ac8d23c24 (DEFAULT_TABLE table=default.Table_146776d44301462096eb098adde86d0e [id=77e0fa171ab74850a2119422513f0b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.661229 27032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4a37afa17d04e3181e7513ac8d23c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.673115 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c62ae41d2dd74eedbe252c4de70fbe1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.456039 27023 tablet_service.cc:1467] Processing CreateTablet for tablet d4873fe8318040a2b7e021708a875f43 (DEFAULT_TABLE table=default.Table_f33a13096a144e538af2795c149abdcd [id=60ce1267de814f218c27ac084a08a26a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.679193 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4873fe8318040a2b7e021708a875f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.456434 27034 tablet_service.cc:1467] Processing CreateTablet for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 (DEFAULT_TABLE table=default.Table_4e27e43aa8d9444ca022be053fcd700e [id=b6297673b9854cf79ae182f5f51ebd36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.456959 27024 tablet_service.cc:1467] Processing CreateTablet for tablet 9e329b95fc8e41c3967079896294942a (DEFAULT_TABLE table=default.Table_e4551e8a102f4eb580426519fca21df9 [id=b206753d4f4142be82ee28150226bd53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.495571 27464 raft_consensus.cc:482] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:17.609963 27020 tablet_service.cc:1514] Processing DeleteTablet for tablet 2634beb347714fc7a2e05865adb34a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:17.610445 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 0713f4f14a284050a7774a70ab974f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:17.610797 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aa16654b7f34f9baf856bf724cece8f with delete_type TABLET_DATA_DELETED (replaced by tablet 760aeada57464892ae3b9013a761c509) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:17.682997 27464 raft_consensus.cc:504] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.684893 27464 leader_election.cc:288] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:17.685006 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79953795f07845aba3f028741cdcdd9e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:17.685752 26991 leader_election.cc:341] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:17.687527 26993 leader_election.cc:341] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 79953795f07845aba3f028741cdcdd9e
I20260810 11:30:17.687664 26993 leader_election.cc:302] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:17.687754 27223 ts_tablet_manager.cc:1918] T 952fc4eb5e5c4d9597f4b6eee860ab3a P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:17.687978 27223 log.cc:1196] T 952fc4eb5e5c4d9597f4b6eee860ab3a P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/952fc4eb5e5c4d9597f4b6eee860ab3a
I20260810 11:30:17.688205 27464 raft_consensus.cc:2726] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:17.688531 27223 ts_tablet_manager.cc:1939] T 952fc4eb5e5c4d9597f4b6eee860ab3a P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:17.691200 27228 tablet_bootstrap.cc:492] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:17.691366 27228 ts_tablet_manager.cc:1397] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.092s user 0.006s sys 0.015s
I20260810 11:30:17.692135 27228 raft_consensus.cc:348] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.692397 27228 raft_consensus.cc:374] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:17.692516 27228 raft_consensus.cc:729] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:17.692523 27526 raft_consensus.cc:482] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:17.692770 27228 consensus_queue.cc:260] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.692765 27526 raft_consensus.cc:504] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:17.693444 27228 ts_tablet_manager.cc:1428] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 11:30:17.693480 27526 leader_election.cc:288] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:17.693720 27228 tablet_bootstrap.cc:492] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:17.694932 26912 raft_consensus.cc:3037] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:17.695920 27228 tablet_bootstrap.cc:654] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:17.696663 27223 tablet_replica.cc:330] T 7e3707ae32624f6483866208321eefde P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:17.696950 27223 raft_consensus.cc:2229] T 7e3707ae32624f6483866208321eefde P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:17.697686 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7a3b877457c4a2489d397f3f864d6b2" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:17.699997 26700 leader_election.cc:341] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:17.711459 27223 raft_consensus.cc:2258] T 7e3707ae32624f6483866208321eefde P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:17.713006 27223 ts_tablet_manager.cc:1905] T 7e3707ae32624f6483866208321eefde P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:17.719767 27228 tablet_bootstrap.cc:492] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:17.719956 27228 ts_tablet_manager.cc:1397] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.003s
I20260810 11:30:17.720857 27228 raft_consensus.cc:348] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:17.721168 27228 raft_consensus.cc:374] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:17.721256 27228 raft_consensus.cc:729] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:17.721625 27228 consensus_queue.cc:260] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:17.722355 27228 ts_tablet_manager.cc:1428] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:17.722730 27228 tablet_bootstrap.cc:492] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:17.724735 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.724818 27228 tablet_bootstrap.cc:654] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:17.728641 27024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e329b95fc8e41c3967079896294942a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.735781 27223 ts_tablet_manager.cc:1918] T 7e3707ae32624f6483866208321eefde P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:17.737814 27223 log.cc:1196] T 7e3707ae32624f6483866208321eefde P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/7e3707ae32624f6483866208321eefde
I20260810 11:30:17.741732 27223 ts_tablet_manager.cc:1939] T 7e3707ae32624f6483866208321eefde P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
W20260810 11:30:17.785092 26492 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1a83391804894d268d0e603f4feb1745 consensus state has no leader
I20260810 11:30:17.785617 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_5ffe87ce66134f859f413c9a6ec537b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:17.786375 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ffe87ce66134f859f413c9a6ec537b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:17.788295 26496 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_61f0895109db4fec904812266ff49d81" } new_table_name: "default.Table_c051b544f1954fc48687f0316471ebd4" modify_external_catalogs: true
I20260810 11:30:17.801340 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7a3b877457c4a2489d397f3f864d6b2" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:17.803376 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 107) took 3992 ms. Trace:
W20260810 11:30:17.809520 26702 leader_election.cc:341] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:17.809796 26702 leader_election.cc:302] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:17.809234 27231 tablet_bootstrap.cc:700] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215: Time spent opening tablet: real 0.156s user 0.000s sys 0.000s
I20260810 11:30:17.815465 26733 tablet_service.cc:1467] Processing CreateTablet for tablet a835d30ef9fc474ab927bb119a95d83c (DEFAULT_TABLE table=default.Table_eecd0244ecc849339f452f38db67c973 [id=41d3dec833b54d1e855194862cb1726b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.819310 26734 tablet_service.cc:1467] Processing CreateTablet for tablet db59523b71224370bf5fce6b56592f71 (DEFAULT_TABLE table=default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.821050 26748 tablet_service.cc:1467] Processing CreateTablet for tablet 0d7a07e844984b88ab81610cb95bf21e (DEFAULT_TABLE table=default.Table_b2c244ee13d14619b9f1eac6ab1aba2a [id=afa11e2df47a4a739727c8d834e24b84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.821851 26732 tablet_service.cc:1467] Processing CreateTablet for tablet 88268e3571884ac88c1a617ce74499f3 (DEFAULT_TABLE table=default.Table_ad3534a46309483687ef9dd9471f1008 [id=0f9e142b43214fa8b2e362c54fabcb42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.822395 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 10210204d5ff4e5e97c98fd255f674a5 (DEFAULT_TABLE table=default.Table_4d9bc84fc41e4b87ac2f6432852e5d61 [id=9b708c86ff534253961e7c29909eb1bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.804040 27248 rpcz_store.cc:276] 0810 11:30:13.779828 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:13.779914 (+ 86us) service_pool.cc:227] Handling call
0810 11:30:16.639810 (+2859896us) ts_tablet_manager.cc:1145] Deleting tablet b1cd64deb8e24c81ba2d4214bb38f5da
0810 11:30:16.639830 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.055867 (+416037us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:17.354109 (+298242us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:17.772446 (+418337us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2858663}
I20260810 11:30:17.822793 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 7e78fb1bf0534deca5cc5a603fd77592 (DEFAULT_TABLE table=default.Table_3d15fcde44db49a7ba17fd166381299f [id=e88ac45e937f49b2a8be4256d1a7279e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.824275 27248 tablet_replica.cc:330] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:17.824259 26742 tablet_service.cc:1467] Processing CreateTablet for tablet 81f24c84cdd945b78f39f24015eb1e43 (DEFAULT_TABLE table=default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.825161 27248 raft_consensus.cc:2229] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:17.826306 26733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a835d30ef9fc474ab927bb119a95d83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.826587 27248 raft_consensus.cc:2258] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:17.827775 27385 raft_consensus.cc:482] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:17.827788 27527 raft_consensus.cc:2726] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:17.828054 27385 raft_consensus.cc:504] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.829099 27385 leader_election.cc:288] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:17.831086 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10210204d5ff4e5e97c98fd255f674a5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:17.831104 26849 leader_election.cc:341] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 97d586d35ff144a681ad52756f4be2b6
W20260810 11:30:17.832384 26486 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 1a83391804894d268d0e603f4feb1745 (table default.Table_9329d33b857541719c3852e79fdc14b6 [id=d74c35e9ac524f3798c37c9b6a422a82], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1a83391804894d268d0e603f4feb1745 consensus state has no leader
I20260810 11:30:17.832661 26729 tablet_service.cc:1467] Processing CreateTablet for tablet d1d0d55b526749059470504a27887b22 (DEFAULT_TABLE table=default.Table_57b6151125a144fcb6230ee986bff7ee [id=62f404c62e4040fc801f70cafddf9d95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.830814 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97d586d35ff144a681ad52756f4be2b6" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:17.834455 26848 leader_election.cc:341] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:17.834502 27231 tablet_bootstrap.cc:654] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:17.834681 26848 leader_election.cc:302] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:17.835260 27385 raft_consensus.cc:2726] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:17.856761 27248 ts_tablet_manager.cc:1905] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:17.876389 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e78fb1bf0534deca5cc5a603fd77592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.882486 27231 tablet_bootstrap.cc:492] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:17.882907 27231 ts_tablet_manager.cc:1397] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.701s user 0.004s sys 0.004s
I20260810 11:30:17.882997 26729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1d0d55b526749059470504a27887b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.884131 27231 raft_consensus.cc:348] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.884424 27231 raft_consensus.cc:374] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:17.884536 27231 raft_consensus.cc:729] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:17.885376 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88268e3571884ac88c1a617ce74499f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.885457 27231 consensus_queue.cc:260] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.891259 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d7a07e844984b88ab81610cb95bf21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.892235 27231 ts_tablet_manager.cc:1428] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.009s user 0.003s sys 0.001s
I20260810 11:30:17.892779 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81f24c84cdd945b78f39f24015eb1e43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.896813 27231 tablet_bootstrap.cc:492] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:17.901041 27385 raft_consensus.cc:482] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:17.901360 27385 raft_consensus.cc:504] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.902294 27385 leader_election.cc:288] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:17.903498 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc2d129e99f24c018e4f8e43f211171d" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:17.903900 27059 raft_consensus.cc:2454] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:17.904644 26848 leader_election.cc:302] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:17.905457 27385 raft_consensus.cc:2781] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:17.905632 27385 raft_consensus.cc:482] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:17.905835 27385 raft_consensus.cc:3037] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:17.907563 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db59523b71224370bf5fce6b56592f71. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:17.910924 27243 kernel_stack_watchdog.cc:198] Thread 27450 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 693ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f55e99af980 (unknown) at ??:0
@ 0x8a5e57 __sanitizer::internal_sched_yield() at ??:?
@ 0x81ec1d __interceptor_pthread_create at ??:?
@ 0x7f55e66c9bfb kudu::Thread::StartThread() at ??:0
@ 0x9da5bc kudu::Thread::Create() at ??:?
@ 0x7f55f94a0aaa kudu::master::AutoLeaderRebalancerTask::Init() at ??:0
@ 0x7f55f94c7364 kudu::master::CatalogManager::Init() at ??:0
@ 0x7f55f96653ef kudu::master::Master::InitCatalogManager() at ??:0
@ 0x7f55f9664d58 kudu::master::Master::InitCatalogManagerTask() at ??:0
@ 0x7f55f9671040 kudu::master::Master::StartAsync()::$_0::operator()() at ??:0
@ 0x7f55f9670e69 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f55e66ec345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f55e66ef91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f55e66ef799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260810 11:30:17.911710 27385 raft_consensus.cc:504] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:17.913297 27385 leader_election.cc:288] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:17.913628 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc2d129e99f24c018e4f8e43f211171d" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:17.913862 27059 raft_consensus.cc:3037] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:17.916939 27059 raft_consensus.cc:2454] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:17.917438 26848 leader_election.cc:302] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:17.917922 27385 raft_consensus.cc:2781] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:17.919389 27385 raft_consensus.cc:686] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:17.920095 27385 consensus_queue.cc:237] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:17.920950 26849 leader_election.cc:341] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: fc2d129e99f24c018e4f8e43f211171d
W20260810 11:30:17.921370 26849 leader_election.cc:341] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: fc2d129e99f24c018e4f8e43f211171d
I20260810 11:30:17.928112 26735 tablet_service.cc:1467] Processing CreateTablet for tablet b200bdb394d3439b86fff48494be8e3d (DEFAULT_TABLE table=default.Table_2a7d8b62f0814dcb99b674089d4fd0c7 [id=b88e11526dbd42c2a6b51fcc1cf731d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.930714 27231 tablet_bootstrap.cc:654] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:17.937180 27024 tablet_service.cc:1467] Processing CreateTablet for tablet a835d30ef9fc474ab927bb119a95d83c (DEFAULT_TABLE table=default.Table_eecd0244ecc849339f452f38db67c973 [id=41d3dec833b54d1e855194862cb1726b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.937855 27024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a835d30ef9fc474ab927bb119a95d83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.940388 27027 tablet_service.cc:1467] Processing CreateTablet for tablet db59523b71224370bf5fce6b56592f71 (DEFAULT_TABLE table=default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.940502 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet b1cd64deb8e24c81ba2d4214bb38f5da (table default.Table_7e1ff16472f842438c14184ab96741e1 [id=03dca1a3a16e42049c194a46978bbfec]) successfully deleted
I20260810 11:30:17.940874 27027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db59523b71224370bf5fce6b56592f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.945339 27022 tablet_service.cc:1467] Processing CreateTablet for tablet 81f24c84cdd945b78f39f24015eb1e43 (DEFAULT_TABLE table=default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.945852 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81f24c84cdd945b78f39f24015eb1e43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.948980 27034 tablet_service.cc:1467] Processing CreateTablet for tablet 0d7a07e844984b88ab81610cb95bf21e (DEFAULT_TABLE table=default.Table_b2c244ee13d14619b9f1eac6ab1aba2a [id=afa11e2df47a4a739727c8d834e24b84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.949416 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d7a07e844984b88ab81610cb95bf21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.950877 26740 tablet_service.cc:1467] Processing CreateTablet for tablet 7d3406f12d9c492cbd0d86fa7a57de82 (DEFAULT_TABLE table=default.Table_c32d1cb0b9e744fbacbd00c8736fad21 [id=f54b49f28880453aa7bc67b9c36a219b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:17.951725 26484 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 175135us
I20260810 11:30:17.952230 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 607b055f8ced4372800adf5817b46e0b (table default.Table_dc355f349bc9426eb26a69cf93c089cf [id=68a29d5ebf8140198fbf4da3cd974847]) successfully deleted
I20260810 11:30:17.952715 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 952fc4eb5e5c4d9597f4b6eee860ab3a (table default.Table_45031e01640c41469cf6724429b043b7 [id=f7a8dbb4151a4e41b8f0c985a5f80149]) successfully deleted
I20260810 11:30:17.952898 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 7e3707ae32624f6483866208321eefde (table default.Table_dcc367d62a8f4e07a9e10fbb2faa27d1 [id=742f385d32c24e459b83a90971ad60ed]) successfully deleted
W20260810 11:30:17.961014 26500 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 23637a02b6464e17aa2a69ea5cc4ddfe consensus state has no leader
W20260810 11:30:17.997298 27450 thread.cc:636] auto-leader-rebalancer (catalog manager) Time spent creating pthread: real 1.000s user 0.179s sys 0.299s
W20260810 11:30:18.168172 27450 thread.cc:602] auto-leader-rebalancer (catalog manager) Time spent starting thread: real 1.171s user 0.179s sys 0.299s
I20260810 11:30:18.108214 27487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c40c76e125b44de181b88b7f63a566f7. Latest consensus state: current_term: 2 leader_uuid: "c40c76e125b44de181b88b7f63a566f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:18.168488 27487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:18.121003 27554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "c40c76e125b44de181b88b7f63a566f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:18.168730 27554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:17.962651 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b200bdb394d3439b86fff48494be8e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.171187 26742 tablet_service.cc:1467] Processing CreateTablet for tablet a3079a68c1c74b64bf13877bd0ee68c3 (DEFAULT_TABLE table=default.Table_638a44c47a3b410ba563ae4fcf03e6a0 [id=59cbbd4c63d6417c807a18d47211fcbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.171708 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3079a68c1c74b64bf13877bd0ee68c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.961362 26500 master_service.cc:946] ReplaceTablet: received request to replace tablet d98948300fe6472295ea53cedb7d386c from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:17.995826 26511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" candidate_term: 3 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "c40c76e125b44de181b88b7f63a566f7" is_pre_election: true
I20260810 11:30:18.116145 26497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 7ff5b980ce4e41d7a6e1ca0e740b739c
I20260810 11:30:18.173182 27286 leader_election.cc:302] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83cc8e39a3b9455f8242a6da6a54c38a; no voters: ac259bcf213a4aa297d1d8e73b262361, c40c76e125b44de181b88b7f63a566f7
I20260810 11:30:18.173945 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_6ab452637eba400386dddb52dbb3eedd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:18.174624 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ab452637eba400386dddb52dbb3eedd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:18.175210 26500 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 6c5b650bc02f4fa393bada5b54c77f1f (table default.Table_0541fad2df4246c69ea4c710c167a284 [id=3d8c46d7a15e457a93fd615ad99a4f36]). Expected version 4 got 0
I20260810 11:30:18.175401 26500 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3ccef06fa06c4c519d8760fa948d6c8b (table default.Table_abbbb80ecbe4491d98912dcdcaab5dd3 [id=ba999b4084c84b2f8e0313b96849b169]). Expected version 4 got 0
I20260810 11:30:18.117851 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet a3406dc345e3429fb4bce5a59643b686
I20260810 11:30:17.953006 27026 tablet_service.cc:1467] Processing CreateTablet for tablet d1d0d55b526749059470504a27887b22 (DEFAULT_TABLE table=default.Table_57b6151125a144fcb6230ee986bff7ee [id=62f404c62e4040fc801f70cafddf9d95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.176395 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_ea17bd161fdb4c2c9603590515c75bf4" } modify_external_catalogs: true
I20260810 11:30:18.176700 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_ea17bd161fdb4c2c9603590515c75bf4" } modify_external_catalogs: true
I20260810 11:30:18.177198 27026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1d0d55b526749059470504a27887b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.118394 26495 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 5ca5c88585394dba87e201696afa6934
I20260810 11:30:18.178416 26495 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_4ce8a3965b484cdb8c1f9b7d7e318755" } modify_external_catalogs: true
I20260810 11:30:18.178733 26495 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_4ce8a3965b484cdb8c1f9b7d7e318755" } modify_external_catalogs: true
I20260810 11:30:17.953902 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet 2634beb347714fc7a2e05865adb34a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:18.119875 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_ba61129cdf35481dbf06effd223949f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:17.954898 26886 tablet_service.cc:1467] Processing CreateTablet for tablet 81f24c84cdd945b78f39f24015eb1e43 (DEFAULT_TABLE table=default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:18.181037 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba61129cdf35481dbf06effd223949f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:18.181088 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81f24c84cdd945b78f39f24015eb1e43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.181165 26879 tablet_service.cc:1467] Processing CreateTablet for tablet a3079a68c1c74b64bf13877bd0ee68c3 (DEFAULT_TABLE table=default.Table_638a44c47a3b410ba563ae4fcf03e6a0 [id=59cbbd4c63d6417c807a18d47211fcbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.181582 26879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3079a68c1c74b64bf13877bd0ee68c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.122282 26501 master_service.cc:946] ReplaceTablet: received request to replace tablet f2b555f18c1e485d9af7b08f98543c80 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:18.122591 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_09ff2cfcae6d4c1b96479fd190b3c084"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:18.184064 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09ff2cfcae6d4c1b96479fd190b3c084 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:17.955449 26876 tablet_service.cc:1467] Processing CreateTablet for tablet b200bdb394d3439b86fff48494be8e3d (DEFAULT_TABLE table=default.Table_2a7d8b62f0814dcb99b674089d4fd0c7 [id=b88e11526dbd42c2a6b51fcc1cf731d3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:18.137400 26496 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 524c8d37d3964e368695d182883b0bd5 consensus state has no leader
I20260810 11:30:18.185259 26876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b200bdb394d3439b86fff48494be8e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.060858 27566 tablet.cc:1717] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d: Skipping requested alter to schema version 4, tablet already version 4
I20260810 11:30:18.185868 26496 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_0bbe57bacdf5461d82b017f0a97edab1" } new_table_name: "default.Table_f7aaec87f80f4f5f92f5e00a9effebcc" modify_external_catalogs: true
I20260810 11:30:18.186815 27566 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:39688 (request call id 224) took 1440 ms. Trace:
I20260810 11:30:18.137943 26498 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 70f6017d4d01463398cb347779dacf90
I20260810 11:30:18.187487 26498 catalog_manager.cc:6565] ReplaceTablet: tablet 70f6017d4d01463398cb347779dacf90 deleted and replaced by tablet 110b5acc36bd4d6bba13735e5daec75f
I20260810 11:30:18.186968 27566 rpcz_store.cc:276] 0810 11:30:16.746323 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.746400 (+ 77us) service_pool.cc:227] Handling call
0810 11:30:18.186772 (+1440372us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:16.747003 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0810 11:30:16.747141 (+ 138us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 11:30:17.338547 (+591406us) alter_schema_op.cc:65] Acquired schema lock
0810 11:30:17.338558 (+ 11us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0810 11:30:17.338614 (+ 56us) alter_schema_op.cc:126] START. Timestamp: 1786361417338556
0810 11:30:17.338617 (+ 3us) op_driver.cc:331] REPLICATION: starting
0810 11:30:17.338841 (+ 224us) log.cc:842] Serialized 173 byte log entry
0810 11:30:18.038799 (+699958us) op_driver.cc:444] REPLICATION: finished
0810 11:30:18.059871 (+ 21072us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0810 11:30:18.186628 (+126757us) log.cc:842] Serialized 94 byte log entry
0810 11:30:18.186711 (+ 83us) alter_schema_op.cc:71] Released schema lock
0810 11:30:18.186715 (+ 4us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":20941,"prepare.queue_time_us":104,"prepare.run_cpu_time_us":27235,"prepare.run_wall_time_us":592018,"raft.queue_time_us":55,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":700148,"thread_start_us":33496,"threads_started":1}]]}
I20260810 11:30:18.187856 26498 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_7429a35104ec4048afb265a7bf71f5b2" } new_table_name: "default.Table_5fea8f0dcb4f4400a7011477a2780476" modify_external_catalogs: true
I20260810 11:30:17.953562 27038 tablet_service.cc:1467] Processing CreateTablet for tablet b200bdb394d3439b86fff48494be8e3d (DEFAULT_TABLE table=default.Table_2a7d8b62f0814dcb99b674089d4fd0c7 [id=b88e11526dbd42c2a6b51fcc1cf731d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.189055 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b200bdb394d3439b86fff48494be8e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.189273 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:18.189566 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet a3406dc345e3429fb4bce5a59643b686 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:18.149290 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_5a4c04e087c3490fae87a17247850531"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:18.168952 27289 sys_catalog.cc:455] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "c40c76e125b44de181b88b7f63a566f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:18.190754 27289 sys_catalog.cc:458] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: This master's current role is: LEADER
W20260810 11:30:18.191130 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a4c04e087c3490fae87a17247850531 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:17.955621 26880 tablet_service.cc:1514] Processing DeleteTablet for tablet 0713f4f14a284050a7774a70ab974f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:17.955856 26877 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aa16654b7f34f9baf856bf724cece8f with delete_type TABLET_DATA_DELETED (replaced by tablet 760aeada57464892ae3b9013a761c509) from {username='slave'} at 127.0.0.1:52560
W20260810 11:30:18.132227 26731 consensus_meta.cc:287] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 443ec871f1ed4232b932ecfb0b18510d: Time spent flushing consensus metadata: real 0.563s user 0.004s sys 0.000s
W20260810 11:30:18.139752 27222 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.802s user 0.008s sys 0.010s
I20260810 11:30:18.193320 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca5c88585394dba87e201696afa6934 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:18.193398 27222 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.856s user 0.008s sys 0.010s
I20260810 11:30:18.193608 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 70f6017d4d01463398cb347779dacf90 with delete_type TABLET_DATA_DELETED (replaced by tablet 110b5acc36bd4d6bba13735e5daec75f) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:17.954282 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 7e78fb1bf0534deca5cc5a603fd77592 (DEFAULT_TABLE table=default.Table_3d15fcde44db49a7ba17fd166381299f [id=e88ac45e937f49b2a8be4256d1a7279e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.194339 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e78fb1bf0534deca5cc5a603fd77592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.194427 27222 tablet_bootstrap.cc:492] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:18.194612 27222 ts_tablet_manager.cc:1397] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.875s user 0.011s sys 0.010s
I20260810 11:30:18.195472 27222 raft_consensus.cc:348] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:18.195753 27222 raft_consensus.cc:374] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:18.195837 27222 raft_consensus.cc:729] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:18.196089 27222 consensus_queue.cc:260] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:17.956326 26885 tablet_service.cc:1467] Processing CreateTablet for tablet a835d30ef9fc474ab927bb119a95d83c (DEFAULT_TABLE table=default.Table_eecd0244ecc849339f452f38db67c973 [id=41d3dec833b54d1e855194862cb1726b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.956794 26892 tablet_service.cc:1467] Processing CreateTablet for tablet 0d7a07e844984b88ab81610cb95bf21e (DEFAULT_TABLE table=default.Table_b2c244ee13d14619b9f1eac6ab1aba2a [id=afa11e2df47a4a739727c8d834e24b84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.954675 27035 tablet_service.cc:1467] Processing CreateTablet for tablet 88268e3571884ac88c1a617ce74499f3 (DEFAULT_TABLE table=default.Table_ad3534a46309483687ef9dd9471f1008 [id=0f9e142b43214fa8b2e362c54fabcb42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.197031 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88268e3571884ac88c1a617ce74499f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:17.955082 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 10210204d5ff4e5e97c98fd255f674a5 (DEFAULT_TABLE table=default.Table_4d9bc84fc41e4b87ac2f6432852e5d61 [id=9b708c86ff534253961e7c29909eb1bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.197824 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10210204d5ff4e5e97c98fd255f674a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.198439 26822 heartbeater.cc:347] Connected to a master server at 127.25.195.254:41125
I20260810 11:30:17.957378 26881 tablet_service.cc:1467] Processing CreateTablet for tablet d1d0d55b526749059470504a27887b22 (DEFAULT_TABLE table=default.Table_57b6151125a144fcb6230ee986bff7ee [id=62f404c62e4040fc801f70cafddf9d95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.957886 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 7e78fb1bf0534deca5cc5a603fd77592 (DEFAULT_TABLE table=default.Table_3d15fcde44db49a7ba17fd166381299f [id=e88ac45e937f49b2a8be4256d1a7279e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.994074 27532 tablet.cc:1722] T 6c5b650bc02f4fa393bada5b54c77f1f P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 11:30:17.958436 26878 tablet_service.cc:1467] Processing CreateTablet for tablet 88268e3571884ac88c1a617ce74499f3 (DEFAULT_TABLE table=default.Table_ad3534a46309483687ef9dd9471f1008 [id=0f9e142b43214fa8b2e362c54fabcb42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.958894 26893 tablet_service.cc:1467] Processing CreateTablet for tablet 10210204d5ff4e5e97c98fd255f674a5 (DEFAULT_TABLE table=default.Table_4d9bc84fc41e4b87ac2f6432852e5d61 [id=9b708c86ff534253961e7c29909eb1bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:17.959406 26883 tablet_service.cc:1467] Processing CreateTablet for tablet db59523b71224370bf5fce6b56592f71 (DEFAULT_TABLE table=default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.101790 27228 tablet_bootstrap.cc:492] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:18.201038 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d3406f12d9c492cbd0d86fa7a57de82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.201015 27228 ts_tablet_manager.cc:1397] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.478s user 0.087s sys 0.126s
W20260810 11:30:17.994555 27058 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 0.702s user 0.003s sys 0.002s
W20260810 11:30:18.201256 27058 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 0.909s user 0.003s sys 0.003s
I20260810 11:30:18.029129 27551 tablet.cc:1722] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 11:30:17.998401 27248 ts_tablet_manager.cc:1918] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:18.201894 27248 log.cc:1196] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/256af4222bb34745ac018dd82a9c4f9b
I20260810 11:30:18.202081 27228 raft_consensus.cc:348] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:18.202389 27228 raft_consensus.cc:374] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:18.202411 27248 ts_tablet_manager.cc:1939] T 256af4222bb34745ac018dd82a9c4f9b P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:18.202486 27228 raft_consensus.cc:729] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:18.202775 27228 consensus_queue.cc:260] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:18.161283 26887 tablet_service.cc:1514] Processing DeleteTablet for tablet 97d586d35ff144a681ad52756f4be2b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:18.007203 27231 tablet_bootstrap.cc:492] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:18.204344 27231 ts_tablet_manager.cc:1397] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.309s user 0.005s sys 0.006s
I20260810 11:30:18.204276 27228 ts_tablet_manager.cc:1428] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:18.160732 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e3707ae32624f6483866208321eefde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:18.163111 26890 tablet_service.cc:1514] Processing DeleteTablet for tablet d98948300fe6472295ea53cedb7d386c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
W20260810 11:30:18.069945 26991 consensus_peers.cc:487] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3dabfbd779c5406cb10ecf70f5a142e7. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:18.205117 26991 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 135040us
I20260810 11:30:18.165165 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 55c8749861874eca9b63d3db97afa2b1 (DEFAULT_TABLE table=default.Table_1c6221759f954488a1e7df4252c2a6ae [id=996f45529be941409f77e6682591b900]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.167773 26888 tablet_service.cc:1467] Processing CreateTablet for tablet adecd2f0952b4f4c83919c78d563e429 (DEFAULT_TABLE table=default.Table_6f7fdd85630648659dcfe3b52e5ab365 [id=862df0152eda418da6110067b4ab588b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.168503 26882 tablet_service.cc:1467] Processing CreateTablet for tablet 271a0607ec28441c91bac32c2f2bf44b (DEFAULT_TABLE table=default.Table_bd17aa8dfcdf4c09b68660896911a2ee [id=affd9fae6f704dcea386ebc27c87323e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.185014 26891 tablet_service.cc:1467] Processing CreateTablet for tablet d24726d0214947beab0bb31b1597c1c3 (DEFAULT_TABLE table=default.Table_3fd59f07e4ee4f54bce7829aec4cf4c4 [id=3719720e5ca241b1a500a1aaf7f310c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.169219 26884 tablet_service.cc:1467] Processing CreateTablet for tablet 760aeada57464892ae3b9013a761c509 (DEFAULT_TABLE table=default.Table_7157cb4b94764bf6ab05e84468872791 [id=e08caac3c4e54a5c9ed82c003898f06e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.205778 27231 raft_consensus.cc:348] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:18.206069 27231 raft_consensus.cc:374] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:18.206183 27231 raft_consensus.cc:729] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:18.206423 27231 consensus_queue.cc:260] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:18.207201 27231 ts_tablet_manager.cc:1428] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 11:30:18.076434 27464 raft_consensus.cc:482] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:18.208756 27464 raft_consensus.cc:504] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:18.209426 27464 leader_election.cc:288] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:18.162593 27023 tablet_service.cc:1467] Processing CreateTablet for tablet 55c8749861874eca9b63d3db97afa2b1 (DEFAULT_TABLE table=default.Table_1c6221759f954488a1e7df4252c2a6ae [id=996f45529be941409f77e6682591b900]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.163239 27027 tablet_service.cc:1467] Processing CreateTablet for tablet d24726d0214947beab0bb31b1597c1c3 (DEFAULT_TABLE table=default.Table_3fd59f07e4ee4f54bce7829aec4cf4c4 [id=3719720e5ca241b1a500a1aaf7f310c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.163677 27024 tablet_service.cc:1467] Processing CreateTablet for tablet adecd2f0952b4f4c83919c78d563e429 (DEFAULT_TABLE table=default.Table_6f7fdd85630648659dcfe3b52e5ab365 [id=862df0152eda418da6110067b4ab588b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.164019 27034 tablet_service.cc:1467] Processing CreateTablet for tablet 271a0607ec28441c91bac32c2f2bf44b (DEFAULT_TABLE table=default.Table_bd17aa8dfcdf4c09b68660896911a2ee [id=affd9fae6f704dcea386ebc27c87323e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.168161 27022 tablet_service.cc:1467] Processing CreateTablet for tablet 760aeada57464892ae3b9013a761c509 (DEFAULT_TABLE table=default.Table_7157cb4b94764bf6ab05e84468872791 [id=e08caac3c4e54a5c9ed82c003898f06e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.171684 27032 tablet_service.cc:1467] Processing CreateTablet for tablet a3079a68c1c74b64bf13877bd0ee68c3 (DEFAULT_TABLE table=default.Table_638a44c47a3b410ba563ae4fcf03e6a0 [id=59cbbd4c63d6417c807a18d47211fcbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.211714 27231 tablet_bootstrap.cc:492] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:18.214629 26964 heartbeater.cc:347] Connected to a master server at 127.25.195.254:41125
I20260810 11:30:18.218380 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e2c9112462f442e8de5b4a944cfdc6b" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:18.222539 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a835d30ef9fc474ab927bb119a95d83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.139875 27221 ts_tablet_manager.cc:1918] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:18.161739 26729 tablet_service.cc:1467] Processing CreateTablet for tablet 55c8749861874eca9b63d3db97afa2b1 (DEFAULT_TABLE table=default.Table_1c6221759f954488a1e7df4252c2a6ae [id=996f45529be941409f77e6682591b900]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.161739 26734 tablet_service.cc:1467] Processing CreateTablet for tablet d24726d0214947beab0bb31b1597c1c3 (DEFAULT_TABLE table=default.Table_3fd59f07e4ee4f54bce7829aec4cf4c4 [id=3719720e5ca241b1a500a1aaf7f310c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.163566 26748 tablet_service.cc:1467] Processing CreateTablet for tablet adecd2f0952b4f4c83919c78d563e429 (DEFAULT_TABLE table=default.Table_6f7fdd85630648659dcfe3b52e5ab365 [id=862df0152eda418da6110067b4ab588b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.164019 26746 tablet_service.cc:1467] Processing CreateTablet for tablet 271a0607ec28441c91bac32c2f2bf44b (DEFAULT_TABLE table=default.Table_bd17aa8dfcdf4c09b68660896911a2ee [id=affd9fae6f704dcea386ebc27c87323e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.165292 26733 tablet_service.cc:1467] Processing CreateTablet for tablet 760aeada57464892ae3b9013a761c509 (DEFAULT_TABLE table=default.Table_7157cb4b94764bf6ab05e84468872791 [id=e08caac3c4e54a5c9ed82c003898f06e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.226073 27228 tablet_bootstrap.cc:492] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:18.226611 27547 mvcc.cc:205] Tried to move back new op lower bound from 7316936365418725376 to 7316936358434009088. Current Snapshot: MvccSnapshot[applied={T|T < 7316936365418725376}]
I20260810 11:30:18.227327 27551 tablet.cc:1717] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700: Skipping requested alter to schema version 4, tablet already version 4
I20260810 11:30:18.228207 27228 tablet_bootstrap.cc:654] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:18.228962 26729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55c8749861874eca9b63d3db97afa2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.229105 27223 tablet_replica.cc:330] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:18.234211 27223 raft_consensus.cc:2229] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:18.234499 27223 raft_consensus.cc:2258] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:18.235085 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 271a0607ec28441c91bac32c2f2bf44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.238677 27221 log.cc:1196] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/9b754dc2568849deafc7a8dc6d81924c
I20260810 11:30:18.238957 27223 ts_tablet_manager.cc:1905] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:18.241063 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10210204d5ff4e5e97c98fd255f674a5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:18.243377 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 2634beb347714fc7a2e05865adb34a22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2634beb347714fc7a2e05865adb34a22 already in progress: creating tablet
W20260810 11:30:18.243605 26993 leader_election.cc:341] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 2e2c9112462f442e8de5b4a944cfdc6b
W20260810 11:30:18.243942 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 0713f4f14a284050a7774a70ab974f30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0713f4f14a284050a7774a70ab974f30 already in progress: creating tablet
W20260810 11:30:18.249003 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7aa16654b7f34f9baf856bf724cece8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7aa16654b7f34f9baf856bf724cece8f already in progress: creating tablet
I20260810 11:30:18.250356 27574 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 11:30:18.255685 26497 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 6c5b650bc02f4fa393bada5b54c77f1f (table default.Table_0541fad2df4246c69ea4c710c167a284 [id=3d8c46d7a15e457a93fd615ad99a4f36]). Expected version 4 got 0
I20260810 11:30:18.256592 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adecd2f0952b4f4c83919c78d563e429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.261922 27222 ts_tablet_manager.cc:1428] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.036s user 0.000s sys 0.003s
I20260810 11:30:18.261993 26497 master_service.cc:946] ReplaceTablet: received request to replace tablet ac4b1821ac30452cbe7a8f844d9b37e5 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:18.258080 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_f3567f07068942e9a5d42f9877f39bb7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:18.268949 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 108) took 4432 ms. Trace:
I20260810 11:30:18.270246 27032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3079a68c1c74b64bf13877bd0ee68c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.270321 27248 rpcz_store.cc:276] 0810 11:30:13.794220 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:13.794726 (+ 506us) service_pool.cc:227] Handling call
0810 11:30:17.823989 (+4029263us) ts_tablet_manager.cc:1145] Deleting tablet 256af4222bb34745ac018dd82a9c4f9b
0810 11:30:17.824052 (+ 63us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.918941 (+ 94889us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:17.997468 (+ 78527us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:18.226145 (+228677us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4028790}
I20260810 11:30:18.272367 26733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 760aeada57464892ae3b9013a761c509. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:18.268358 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3567f07068942e9a5d42f9877f39bb7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:18.275796 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 256af4222bb34745ac018dd82a9c4f9b (table default.Table_5c1990a7c1d64a6eb801c2a2ae958db8 [id=3332dd1574f04ec1a34468ad5908602b]) successfully deleted
I20260810 11:30:18.276393 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d24726d0214947beab0bb31b1597c1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.277745 27222 tablet_bootstrap.cc:492] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:18.282864 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88268e3571884ac88c1a617ce74499f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.287124 26890 tablet_service.cc:1514] Processing DeleteTablet for tablet fc2d129e99f24c018e4f8e43f211171d with delete_type TABLET_DATA_DELETED (replaced by tablet 478c0c39658349c39e3afa1aa1653e82) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:18.288300 26892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d7a07e844984b88ab81610cb95bf21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.289007 27036 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca5c88585394dba87e201696afa6934 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:18.289275 27033 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:18.289548 27464 raft_consensus.cc:482] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:18.289731 27464 raft_consensus.cc:504] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:18.290419 27464 leader_election.cc:288] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:18.292017 27221 ts_tablet_manager.cc:1939] T 9b754dc2568849deafc7a8dc6d81924c P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
W20260810 11:30:18.288420 26991 leader_election.cc:341] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:18.294102 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 271a0607ec28441c91bac32c2f2bf44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.295457 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet a3406dc345e3429fb4bce5a59643b686 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:18.296243 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db59523b71224370bf5fce6b56592f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.296773 27248 tablet_replica.cc:330] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:18.297209 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 70f6017d4d01463398cb347779dacf90 with delete_type TABLET_DATA_DELETED (replaced by tablet 110b5acc36bd4d6bba13735e5daec75f) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:18.297716 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 760aeada57464892ae3b9013a761c509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.298130 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b754dc2568849deafc7a8dc6d81924c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:18.300396 26887 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca5c88585394dba87e201696afa6934 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:18.301851 26877 tablet_service.cc:1514] Processing DeleteTablet for tablet 70f6017d4d01463398cb347779dacf90 with delete_type TABLET_DATA_DELETED (replaced by tablet 110b5acc36bd4d6bba13735e5daec75f) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:18.302469 26876 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:18.297184 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet a3406dc345e3429fb4bce5a59643b686 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:18.303858 27385 raft_consensus.cc:482] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:18.304117 27385 raft_consensus.cc:504] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:18.305143 26890 tablet_service.cc:1514] Processing DeleteTablet for tablet ec788db5b0ca40f1811b6660276d0254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
W20260810 11:30:18.306099 26993 leader_election.cc:341] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: e2732660f8964feeb5c03365df065a54
I20260810 11:30:18.307044 27385 leader_election.cc:288] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:18.307907 26891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d24726d0214947beab0bb31b1597c1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.308212 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55c8749861874eca9b63d3db97afa2b1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:18.308413 26849 leader_election.cc:341] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: d98948300fe6472295ea53cedb7d386c
I20260810 11:30:18.309196 26882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 271a0607ec28441c91bac32c2f2bf44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.310204 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e78fb1bf0534deca5cc5a603fd77592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.311391 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adecd2f0952b4f4c83919c78d563e429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.317035 27248 raft_consensus.cc:2229] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:18.320432 26884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 760aeada57464892ae3b9013a761c509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.322904 27231 tablet_bootstrap.cc:654] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:18.326493 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1d0d55b526749059470504a27887b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.327565 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d98948300fe6472295ea53cedb7d386c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:18.329741 27058 raft_consensus.cc:2454] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:18.330067 27024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adecd2f0952b4f4c83919c78d563e429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.330332 27027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d24726d0214947beab0bb31b1597c1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.332738 26495 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet ff9b649e43a9456fa51cf3330290bb91
I20260810 11:30:18.333549 26495 master_service.cc:946] ReplaceTablet: received request to replace tablet ac4b1821ac30452cbe7a8f844d9b37e5 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:18.333757 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet ff9b649e43a9456fa51cf3330290bb91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:18.334388 26499 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_c7ba8db7c9b742cdb3cfbb476dec5ace" } new_table_name: "default.Table_ce3793ec2a8449f7802d520eef6fdcc7" modify_external_catalogs: true
I20260810 11:30:18.337301 27248 raft_consensus.cc:2258] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:18.338413 26501 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet f2b555f18c1e485d9af7b08f98543c80
W20260810 11:30:18.338542 26496 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d14091e1c111438bac8bcf3d36123d80 consensus state has no leader
I20260810 11:30:18.338955 26501 catalog_manager.cc:6565] ReplaceTablet: tablet f2b555f18c1e485d9af7b08f98543c80 deleted and replaced by tablet 1801d3af4a4548dba8b0d8ea2fecf5ba
I20260810 11:30:18.339005 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 216) took 1717 ms. Trace:
I20260810 11:30:18.339998 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet f2b555f18c1e485d9af7b08f98543c80 with delete_type TABLET_DATA_DELETED (replaced by tablet 1801d3af4a4548dba8b0d8ea2fecf5ba) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:18.341385 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet ff9b649e43a9456fa51cf3330290bb91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:18.341497 26731 tablet_service.cc:1514] Processing DeleteTablet for tablet f2b555f18c1e485d9af7b08f98543c80 with delete_type TABLET_DATA_DELETED (replaced by tablet 1801d3af4a4548dba8b0d8ea2fecf5ba) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:18.342703 27222 tablet_bootstrap.cc:654] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:18.346639 27026 tablet_service.cc:1514] Processing DeleteTablet for tablet ff9b649e43a9456fa51cf3330290bb91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:18.348904 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet f2b555f18c1e485d9af7b08f98543c80 with delete_type TABLET_DATA_DELETED (replaced by tablet 1801d3af4a4548dba8b0d8ea2fecf5ba) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:18.324756 26991 leader_election.cc:302] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:18.351329 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55c8749861874eca9b63d3db97afa2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.352290 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet db5adccd80a04e328e13793b461c38b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:18.340117 27221 rpcz_store.cc:276] 0810 11:30:16.597892 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.599472 (+ 1580us) service_pool.cc:227] Handling call
0810 11:30:16.874437 (+274965us) ts_tablet_manager.cc:1145] Deleting tablet 9b754dc2568849deafc7a8dc6d81924c
0810 11:30:16.874453 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:17.270364 (+395911us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:18.098988 (+828624us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:18.315321 (+216333us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":274535}
I20260810 11:30:18.353986 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 217) took 1755 ms. Trace:
I20260810 11:30:18.355082 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 9b754dc2568849deafc7a8dc6d81924c (table default.Table_c80de92e9c2f45469ed63441d62eb4bf [id=396d42b7a2ec4e80a0b0129dec3ebd68]) successfully deleted
I20260810 11:30:18.355084 27221 rpcz_store.cc:276] 0810 11:30:16.597992 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.599983 (+ 1991us) service_pool.cc:227] Handling call
0810 11:30:18.353783 (+1753800us) ts_tablet_manager.cc:1145] Deleting tablet 2fc76603bf8843dab18c95fdab9a8be0
0810 11:30:18.353802 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:18.353914 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1753456}
W20260810 11:30:18.357820 26486 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2fc76603bf8843dab18c95fdab9a8be0 because the tablet was not found. No further retry: Not found: Tablet not found: 2fc76603bf8843dab18c95fdab9a8be0
W20260810 11:30:18.361872 26991 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 142377us
I20260810 11:30:18.340349 26848 leader_election.cc:302] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:18.363772 27558 raft_consensus.cc:2781] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:18.363958 27558 raft_consensus.cc:482] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:18.364259 27558 raft_consensus.cc:3037] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:18.347056 27385 raft_consensus.cc:482] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:18.364878 27385 raft_consensus.cc:504] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:18.365733 27385 leader_election.cc:288] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:18.369766 27464 raft_consensus.cc:2726] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:18.370297 27248 ts_tablet_manager.cc:1905] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:18.371917 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 223) took 1767 ms. Trace:
I20260810 11:30:18.373870 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ccef06fa06c4c519d8760fa948d6c8b" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:18.380081 26501 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_0541fad2df4246c69ea4c710c167a284" } new_table_name: "default.Table_e2dfb01340514a22bae735633097c78f" modify_external_catalogs: true
I20260810 11:30:18.380962 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_7458a59fbdce4e9485d51df6fccf66a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:18.381119 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_5318e36611c342278e64da2f02be8a08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:18.381690 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7458a59fbdce4e9485d51df6fccf66a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:18.381877 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5318e36611c342278e64da2f02be8a08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:18.386876 26498 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 983916da755d4d14b7a3d43bb7cbc9c4 consensus state has no leader
I20260810 11:30:18.392795 26497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet ac4b1821ac30452cbe7a8f844d9b37e5
I20260810 11:30:18.395239 26497 catalog_manager.cc:6565] ReplaceTablet: tablet ac4b1821ac30452cbe7a8f844d9b37e5 deleted and replaced by tablet a45422addab84e9083df8665a0cf9322
I20260810 11:30:18.399093 27554 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260810 11:30:18.404646 26769 raft_consensus.cc:2454] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:18.405722 27362 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" instance_seqno: 1786361407549230) as {username='slave'} at 127.25.195.193:39107; Asking this server to re-register.
I20260810 11:30:18.406612 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_8a7d3a80b9424a56a1b4583e39cadf99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:18.407447 26822 heartbeater.cc:464] Registering TS with master...
W20260810 11:30:18.407470 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a7d3a80b9424a56a1b4583e39cadf99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:18.408221 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet ac4b1821ac30452cbe7a8f844d9b37e5 with delete_type TABLET_DATA_DELETED (replaced by tablet a45422addab84e9083df8665a0cf9322) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:18.409083 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_d863b14a3a96454e8ee5a85fb2ab30c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:18.409771 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d863b14a3a96454e8ee5a85fb2ab30c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:18.410315 27336 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "b6079090b1124d84aa4477974bb53700" instance_seqno: 1786361408276910) as {username='slave'} at 127.25.195.194:38225; Asking this server to re-register.
I20260810 11:30:18.411419 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_10b2af8299224f5db4a63bd1fae61155"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:18.411839 27334 ts_manager.cc:194] Registered new tserver with Master: 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:18.412036 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10b2af8299224f5db4a63bd1fae61155 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:18.415717 27333 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "482e605580be48cbbacce05a3e61c215" instance_seqno: 1786361409040091) as {username='slave'} at 127.25.195.195:58893; Asking this server to re-register.
I20260810 11:30:18.421214 26849 leader_election.cc:302] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:18.433310 26500 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_10b1b7ecd6ab43dfab0e6a29facddaf7" } modify_external_catalogs: true
I20260810 11:30:18.434095 26500 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_10b1b7ecd6ab43dfab0e6a29facddaf7" } modify_external_catalogs: true
I20260810 11:30:18.435010 27228 tablet_bootstrap.cc:492] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:18.436699 27385 raft_consensus.cc:2781] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:18.436899 27385 raft_consensus.cc:482] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:18.436699 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet ac4b1821ac30452cbe7a8f844d9b37e5 with delete_type TABLET_DATA_DELETED (replaced by tablet a45422addab84e9083df8665a0cf9322) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:18.439837 27228 ts_tablet_manager.cc:1397] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.209s user 0.003s sys 0.007s
I20260810 11:30:18.441362 27228 raft_consensus.cc:348] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:18.445230 27385 raft_consensus.cc:3037] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:18.448380 26497 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_ace165519d4f4967aba430a52d996643" } modify_external_catalogs: true
I20260810 11:30:18.458386 27223 ts_tablet_manager.cc:1918] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 11:30:18.466668 26499 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 83992214ba314d3fa674e00d8eaddec6 consensus state has no leader
I20260810 11:30:18.468495 27223 log.cc:1196] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/97d586d35ff144a681ad52756f4be2b6
I20260810 11:30:18.469376 26499 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_393d03f5197d43b6977bf48bd7818a0e" } modify_external_catalogs: true
I20260810 11:30:18.458266 27558 raft_consensus.cc:504] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:18.469805 26499 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_393d03f5197d43b6977bf48bd7818a0e" } modify_external_catalogs: true
I20260810 11:30:18.464406 26497 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_ace165519d4f4967aba430a52d996643" } modify_external_catalogs: true
W20260810 11:30:18.473536 26849 leader_election.cc:341] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: d98948300fe6472295ea53cedb7d386c
I20260810 11:30:18.471017 27228 raft_consensus.cc:374] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:18.485355 27223 ts_tablet_manager.cc:1939] T 97d586d35ff144a681ad52756f4be2b6 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:18.486491 27223 tablet_replica.cc:330] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:18.486450 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 97d586d35ff144a681ad52756f4be2b6 (table default.Table_1515258cce7d473aa7c53c67c527ff8b [id=5051d9c6d4b8419fbc5e34fbcfe62e7e]) successfully deleted
I20260810 11:30:18.486935 27223 raft_consensus.cc:2229] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:18.487529 26484 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7e3707ae32624f6483866208321eefde because the tablet was not found. No further retry: Not found: Tablet not found: 7e3707ae32624f6483866208321eefde
I20260810 11:30:18.487989 27223 raft_consensus.cc:2258] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:18.488430 27385 raft_consensus.cc:504] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:18.489701 27228 raft_consensus.cc:729] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:18.491861 27558 leader_election.cc:288] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:18.494035 26964 heartbeater.cc:464] Registering TS with master...
I20260810 11:30:18.518949 26734 tablet_service.cc:1467] Processing CreateTablet for tablet add1743851c34d58afb7e4886325d659 (DEFAULT_TABLE table=default.Table_2d72d964c7c54d639c11a02fc168152a [id=f49e68eaa81e49bb92ed473e754de42f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.524703 27228 consensus_queue.cc:260] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:18.528239 26492 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_e0f398f685ca45afbb6395ac394410dc" } new_table_name: "default.Table_608daedb6681462f817a1cd881a57828" modify_external_catalogs: true
I20260810 11:30:18.533631 26884 tablet_service.cc:1467] Processing CreateTablet for tablet e31b380f99854eb8b63e1f9eede1fc7c (DEFAULT_TABLE table=default.Table_5ffe87ce66134f859f413c9a6ec537b5 [id=98340b81af5d4da9b563a14d7470e1ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.537882 27221 rpcz_store.cc:276] 0810 11:30:16.598797 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.600361 (+ 1564us) service_pool.cc:227] Handling call
0810 11:30:18.363369 (+1763008us) ts_tablet_manager.cc:1145] Deleting tablet 0938a2f3688246a2b46978eeb7d5d521
0810 11:30:18.363436 (+ 67us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:18.365846 (+ 2410us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1758740}
I20260810 11:30:18.539278 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ccef06fa06c4c519d8760fa948d6c8b" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:18.539389 26742 tablet_service.cc:1467] Processing CreateTablet for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (DEFAULT_TABLE table=default.Table_75fb2f1be80a464396d0245dbd1e5139 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.539587 26769 raft_consensus.cc:3037] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:18.539636 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 218) took 1941 ms. Trace:
I20260810 11:30:18.551787 27228 ts_tablet_manager.cc:1428] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.112s user 0.004s sys 0.000s
I20260810 11:30:18.552903 27333 ts_manager.cc:194] Registered new tserver with Master: b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:18.553325 27223 ts_tablet_manager.cc:1905] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:18.554993 27221 rpcz_store.cc:276] 0810 11:30:16.598117 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.600471 (+ 2354us) service_pool.cc:227] Handling call
0810 11:30:18.539084 (+1938613us) ts_tablet_manager.cc:1145] Deleting tablet cb6805a5dd264939850ea2cd9a850a1f
0810 11:30:18.539105 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:18.539442 (+ 337us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1938351}
I20260810 11:30:18.555323 26748 tablet_service.cc:1467] Processing CreateTablet for tablet e31b380f99854eb8b63e1f9eede1fc7c (DEFAULT_TABLE table=default.Table_5ffe87ce66134f859f413c9a6ec537b5 [id=98340b81af5d4da9b563a14d7470e1ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.556052 26733 tablet_service.cc:1467] Processing CreateTablet for tablet 110b5acc36bd4d6bba13735e5daec75f (DEFAULT_TABLE table=default.Table_24bdc44050024c23aa90a182bdcecb50 [id=4ea7ee58aac74fba84dbbcc009017421]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.556371 26882 tablet_service.cc:1467] Processing CreateTablet for tablet 49db12565dbc4187b78a98ed35c40fed (DEFAULT_TABLE table=default.Table_49be430f1e8f475482b54850772c0430 [id=82e113439bc04ce9955f59612ba480dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.556450 26746 tablet_service.cc:1467] Processing CreateTablet for tablet 49db12565dbc4187b78a98ed35c40fed (DEFAULT_TABLE table=default.Table_49be430f1e8f475482b54850772c0430 [id=82e113439bc04ce9955f59612ba480dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.557029 27221 tablet_replica.cc:330] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:18.557425 27221 raft_consensus.cc:2229] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:18.557693 27221 raft_consensus.cc:2258] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:18.558701 27221 ts_tablet_manager.cc:1905] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:18.559087 27566 tablet.cc:1722] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260810 11:30:18.559751 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet add1743851c34d58afb7e4886325d659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.560477 26733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 110b5acc36bd4d6bba13735e5daec75f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.564653 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49db12565dbc4187b78a98ed35c40fed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.564668 27228 tablet_bootstrap.cc:492] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:18.566314 26888 tablet_service.cc:1467] Processing CreateTablet for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (DEFAULT_TABLE table=default.Table_75fb2f1be80a464396d0245dbd1e5139 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.569749 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.573256 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e31b380f99854eb8b63e1f9eede1fc7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.574164 27551 tablet.cc:1722] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20260810 11:30:18.580374 26991 leader_election.cc:341] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: e2732660f8964feeb5c03365df065a54
I20260810 11:30:18.582481 27558 raft_consensus.cc:482] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:18.582727 27558 raft_consensus.cc:504] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:18.583817 26991 leader_election.cc:302] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:18.584072 27558 leader_election.cc:288] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:18.584511 27464 raft_consensus.cc:2726] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:18.585831 26849 leader_election.cc:341] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 9b754dc2568849deafc7a8dc6d81924c
I20260810 11:30:18.589133 26769 raft_consensus.cc:2454] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:18.589902 26849 leader_election.cc:302] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:18.596887 27558 raft_consensus.cc:2781] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:18.597786 26892 tablet_service.cc:1467] Processing CreateTablet for tablet add1743851c34d58afb7e4886325d659 (DEFAULT_TABLE table=default.Table_2d72d964c7c54d639c11a02fc168152a [id=f49e68eaa81e49bb92ed473e754de42f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:18.599308 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 0938a2f3688246a2b46978eeb7d5d521 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0938a2f3688246a2b46978eeb7d5d521 already in progress: creating tablet
W20260810 11:30:18.600421 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet cb6805a5dd264939850ea2cd9a850a1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb6805a5dd264939850ea2cd9a850a1f already in progress: creating tablet
I20260810 11:30:18.602346 27222 tablet_bootstrap.cc:492] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:18.602530 27222 ts_tablet_manager.cc:1397] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.340s user 0.001s sys 0.016s
I20260810 11:30:18.603801 27222 raft_consensus.cc:348] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:18.604077 27222 raft_consensus.cc:374] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:18.604177 27222 raft_consensus.cc:729] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:18.604617 27222 consensus_queue.cc:260] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:18.608891 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_3efc57bdbafc46dfab4d324acb0d5f73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:18.610169 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet ac4b1821ac30452cbe7a8f844d9b37e5 with delete_type TABLET_DATA_DELETED (replaced by tablet a45422addab84e9083df8665a0cf9322) from {username='slave'} at 127.0.0.1:35790
W20260810 11:30:18.621838 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3efc57bdbafc46dfab4d324acb0d5f73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:18.626255 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (DEFAULT_TABLE table=default.Table_75fb2f1be80a464396d0245dbd1e5139 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.618673 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ccef06fa06c4c519d8760fa948d6c8b" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:18.628509 27028 tablet_service.cc:1467] Processing CreateTablet for tablet e31b380f99854eb8b63e1f9eede1fc7c (DEFAULT_TABLE table=default.Table_5ffe87ce66134f859f413c9a6ec537b5 [id=98340b81af5d4da9b563a14d7470e1ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.629881 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 110b5acc36bd4d6bba13735e5daec75f (DEFAULT_TABLE table=default.Table_24bdc44050024c23aa90a182bdcecb50 [id=4ea7ee58aac74fba84dbbcc009017421]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.630576 26498 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_4e27e43aa8d9444ca022be053fcd700e" } modify_external_catalogs: true
I20260810 11:30:18.632799 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_92fc349e41184823a7fe2bab5c946f0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:18.634083 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92fc349e41184823a7fe2bab5c946f0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:18.634783 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b754dc2568849deafc7a8dc6d81924c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:18.633569 27032 tablet_service.cc:1467] Processing CreateTablet for tablet add1743851c34d58afb7e4886325d659 (DEFAULT_TABLE table=default.Table_2d72d964c7c54d639c11a02fc168152a [id=f49e68eaa81e49bb92ed473e754de42f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.635396 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d98948300fe6472295ea53cedb7d386c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:18.637774 27385 leader_election.cc:288] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:18.639780 26884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e31b380f99854eb8b63e1f9eede1fc7c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:18.644841 26848 leader_election.cc:341] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:18.649950 27059 raft_consensus.cc:3037] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:18.651191 27231 tablet_bootstrap.cc:492] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:18.656484 27024 tablet_service.cc:1514] Processing DeleteTablet for tablet e2732660f8964feeb5c03365df065a54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:18.660135 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.662379 27032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet add1743851c34d58afb7e4886325d659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.662511 27038 tablet_service.cc:1467] Processing CreateTablet for tablet 49db12565dbc4187b78a98ed35c40fed (DEFAULT_TABLE table=default.Table_49be430f1e8f475482b54850772c0430 [id=82e113439bc04ce9955f59612ba480dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.664214 27231 ts_tablet_manager.cc:1397] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.440s user 0.005s sys 0.010s
I20260810 11:30:18.665266 27035 tablet_service.cc:1467] Processing CreateTablet for tablet 110b5acc36bd4d6bba13735e5daec75f (DEFAULT_TABLE table=default.Table_24bdc44050024c23aa90a182bdcecb50 [id=4ea7ee58aac74fba84dbbcc009017421]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:18.666208 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ccef06fa06c4c519d8760fa948d6c8b" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:18.667448 27111 heartbeater.cc:464] Registering TS with master...
I20260810 11:30:18.670130 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e31b380f99854eb8b63e1f9eede1fc7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.673391 27333 ts_manager.cc:194] Registered new tserver with Master: 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:18.674500 27024 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e2c9112462f442e8de5b4a944cfdc6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:18.676664 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 08f6636df13548c49f35e1808a87c1f5
I20260810 11:30:18.677493 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 110b5acc36bd4d6bba13735e5daec75f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.678305 26500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 4c595e0892634348b64418ae9dbbd4c2
W20260810 11:30:18.678527 26492 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bd6b328baa2346afbbe9f513ae4db3df consensus state has no leader
I20260810 11:30:18.680332 26499 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 4b5a7f67ec5b48c2b5a510add0282a76
I20260810 11:30:18.685249 26498 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_4e27e43aa8d9444ca022be053fcd700e" } modify_external_catalogs: true
I20260810 11:30:18.686127 27024 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c595e0892634348b64418ae9dbbd4c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:18.686956 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b5a7f67ec5b48c2b5a510add0282a76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:18.687047 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_db5e3f1e3cf74bc0b15660e83ea59ad6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:18.687704 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db5e3f1e3cf74bc0b15660e83ea59ad6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:18.688150 27532 tablet.cc:1717] T 6c5b650bc02f4fa393bada5b54c77f1f P 482e605580be48cbbacce05a3e61c215: Skipping requested alter to schema version 4, tablet already version 4
I20260810 11:30:18.688907 27231 raft_consensus.cc:348] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:18.689608 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49db12565dbc4187b78a98ed35c40fed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.690563 26497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 7bd67ebf23694ae7b0ede6c5d1a06f88
I20260810 11:30:18.697037 26500 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_8e3a55f57e5e45dba23c641cb84c631a" } new_table_name: "default.Table_09b119fffa254fd2a7062d12b8e9ca32" modify_external_catalogs: true
I20260810 11:30:18.701247 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_71e560b0b3c84617ab561dbea1d90f7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:18.705605 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71e560b0b3c84617ab561dbea1d90f7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:18.706770 27059 raft_consensus.cc:2454] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:18.702319 26499 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_75fb2f1be80a464396d0245dbd1e5139" } new_table_name: "default.Table_f5076fbee07d4333a6bcc12bf0e319e1" modify_external_catalogs: true
I20260810 11:30:18.712580 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c595e0892634348b64418ae9dbbd4c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:18.713853 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet 08f6636df13548c49f35e1808a87c1f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:18.714146 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b5a7f67ec5b48c2b5a510add0282a76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:18.715780 26491 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_e2dfb01340514a22bae735633097c78f" } new_table_name: "default.Table_afde78ad5bfa4a23828df391f669e7fa" modify_external_catalogs: true
I20260810 11:30:18.717234 27222 ts_tablet_manager.cc:1428] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.098s user 0.000s sys 0.003s
I20260810 11:30:18.718293 27222 tablet_bootstrap.cc:492] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:18.723150 27222 tablet_bootstrap.cc:654] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:18.726761 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bd67ebf23694ae7b0ede6c5d1a06f88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:18.717446 26501 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: default.Table_e2dfb01340514a22bae735633097c78f [id=3d8c46d7a15e457a93fd615ad99a4f36] alter complete (version 5)
I20260810 11:30:18.727891 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_c447a9537b844dffa1767531896bf6fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:18.728205 27231 raft_consensus.cc:374] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 11:30:18.728698 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c447a9537b844dffa1767531896bf6fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:18.728541 27532 tablet.cc:1722] T 6c5b650bc02f4fa393bada5b54c77f1f P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20260810 11:30:18.731468 26848 leader_election.cc:341] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:18.731678 26848 leader_election.cc:302] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:18.734838 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bd67ebf23694ae7b0ede6c5d1a06f88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:18.727155 26495 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 6c5b650bc02f4fa393bada5b54c77f1f (table default.Table_e2dfb01340514a22bae735633097c78f [id=3d8c46d7a15e457a93fd615ad99a4f36]). Expected version 5 got 4
I20260810 11:30:18.738242 27221 ts_tablet_manager.cc:1918] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:18.738708 27221 log.cc:1196] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/f3c6bd6803c245b7bb3d78423de482b6
I20260810 11:30:18.739137 27027 tablet_service.cc:1514] Processing DeleteTablet for tablet 08f6636df13548c49f35e1808a87c1f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:18.739543 27231 raft_consensus.cc:729] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:18.740370 27221 ts_tablet_manager.cc:1939] T f3c6bd6803c245b7bb3d78423de482b6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:18.743853 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_b6d32d0bfc264c67a6ac2bdde0e356bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:18.744422 26891 tablet_service.cc:1514] Processing DeleteTablet for tablet 08f6636df13548c49f35e1808a87c1f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52560
W20260810 11:30:18.744485 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 86593.1us
W20260810 11:30:18.744956 26848 leader_election.cc:341] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:18.744345 27248 ts_tablet_manager.cc:1918] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:18.741694 27231 consensus_queue.cc:260] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:18.746088 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6d32d0bfc264c67a6ac2bdde0e356bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:18.747013 26848 leader_election.cc:302] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
W20260810 11:30:18.747278 26848 raft_consensus.cc:2670] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 11:30:18.747653 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 2efaf8b45a824e34b7f23037de5eec45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:18.748468 27231 ts_tablet_manager.cc:1428] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.084s user 0.004s sys 0.000s
I20260810 11:30:18.752825 27385 raft_consensus.cc:2726] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:18.755012 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bd67ebf23694ae7b0ede6c5d1a06f88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:18.755309 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b5a7f67ec5b48c2b5a510add0282a76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:18.779083 26891 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c595e0892634348b64418ae9dbbd4c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:18.785882 26892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet add1743851c34d58afb7e4886325d659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.786361 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 110b5acc36bd4d6bba13735e5daec75f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.787421 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.788269 26882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49db12565dbc4187b78a98ed35c40fed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:18.788816 27248 log.cc:1196] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/c0120575c9fd4b2fb32ca7392db277bf
I20260810 11:30:18.789532 27248 ts_tablet_manager.cc:1939] T c0120575c9fd4b2fb32ca7392db277bf P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:18.790724 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 109) took 4996 ms. Trace:
I20260810 11:30:18.790895 27248 rpcz_store.cc:276] 0810 11:30:13.794438 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:13.795210 (+ 772us) service_pool.cc:227] Handling call
0810 11:30:18.270718 (+4475508us) ts_tablet_manager.cc:1145] Deleting tablet c0120575c9fd4b2fb32ca7392db277bf
0810 11:30:18.275011 (+ 4293us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:18.650514 (+375503us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:18.744138 (+ 93624us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:18.790630 (+ 46492us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4471141}
I20260810 11:30:18.791674 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet c0120575c9fd4b2fb32ca7392db277bf (table default.Table_8e3537dc1b294128b70896bf5501c85e [id=91a6a06504b24b8892a26d1ec11da667]) successfully deleted
I20260810 11:30:18.793341 27231 tablet_bootstrap.cc:492] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:18.796546 27231 tablet_bootstrap.cc:654] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:18.802259 27228 tablet_bootstrap.cc:654] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:18.825923 26498 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 420ba6e9f74c4ae5bf450f369e7fbdb3
I20260810 11:30:18.826534 27248 tablet_replica.cc:330] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:18.826822 27248 raft_consensus.cc:2229] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:18.826789 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_93969ba1aad24adfb712d718540eaae2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:18.827246 27248 pending_rounds.cc:62] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215: Trying to abort 1 pending ops.
I20260810 11:30:18.827313 27248 pending_rounds.cc:68] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936361189363712 op_type: NO_OP noop_request { }
W20260810 11:30:18.827507 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93969ba1aad24adfb712d718540eaae2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:18.827759 27248 raft_consensus.cc:2866] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:18.827913 27248 raft_consensus.cc:2258] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:18.828828 27248 ts_tablet_manager.cc:1905] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:18.836963 27231 tablet_bootstrap.cc:492] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:18.837175 27231 ts_tablet_manager.cc:1397] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.085s user 0.004s sys 0.002s
I20260810 11:30:18.838905 26492 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5fea8f0dcb4f4400a7011477a2780476" } new_table_name: "default.Table_70976acd83de4eb39143c5afa72d8ec4" modify_external_catalogs: true
I20260810 11:30:18.839044 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52560
W20260810 11:30:18.840899 26499 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a consensus state has no leader
W20260810 11:30:18.840821 26500 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eed0e2bead85466ca99cfb34e155a391 consensus state has no leader
I20260810 11:30:18.842269 27231 raft_consensus.cc:348] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:18.842664 27231 raft_consensus.cc:374] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:18.842770 27231 raft_consensus.cc:729] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:18.842581 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_cbae6a8ecb06451aac22785bb782bdc3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:18.843318 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cbae6a8ecb06451aac22785bb782bdc3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:18.844959 26500 master_service.cc:946] ReplaceTablet: received request to replace tablet 10e6c41db71a4146840f06c5b7412d9c from {username='slave'} at 127.0.0.1:47672
W20260810 11:30:18.845546 26486 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 83992214ba314d3fa674e00d8eaddec6 consensus state has no leader
I20260810 11:30:18.847162 27527 raft_consensus.cc:482] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:18.847353 26496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_ae66005f117b4fe9bd3fb52adb6efb32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:18.848002 26496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae66005f117b4fe9bd3fb52adb6efb32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:18.847496 27527 raft_consensus.cc:504] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:18.849890 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5adccd80a04e328e13793b461c38b1" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:18.848953 27527 leader_election.cc:288] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:18.850440 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_96d4976d4de649c4a98910a1b7fd1b59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:18.851071 26702 leader_election.cc:341] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:18.851357 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96d4976d4de649c4a98910a1b7fd1b59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:18.851162 27231 consensus_queue.cc:260] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:18.859205 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 219) took 2143 ms. Trace:
I20260810 11:30:18.859424 27221 rpcz_store.cc:276] 0810 11:30:16.598269 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.600736 (+ 2467us) service_pool.cc:227] Handling call
0810 11:30:18.556882 (+1956146us) ts_tablet_manager.cc:1145] Deleting tablet f3c6bd6803c245b7bb3d78423de482b6
0810 11:30:18.556894 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:18.699482 (+142588us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:18.738093 (+ 38611us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:18.741548 (+ 3455us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1955902}
I20260810 11:30:18.861671 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5adccd80a04e328e13793b461c38b1" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:18.864239 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet f3c6bd6803c245b7bb3d78423de482b6 (table default.Table_590ce8c7b9f647ecb1e81a793a66f3b1 [id=8de62290aa814a5492665eca65a37230]) successfully deleted
I20260810 11:30:18.867573 27231 ts_tablet_manager.cc:1428] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.030s user 0.003s sys 0.000s
I20260810 11:30:18.867985 26495 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 6c5b650bc02f4fa393bada5b54c77f1f (table default.Table_afde78ad5bfa4a23828df391f669e7fa [id=3d8c46d7a15e457a93fd615ad99a4f36]). Expected version 6 got 5
I20260810 11:30:18.884195 26497 master_service.cc:946] ReplaceTablet: received request to replace tablet cb01e54d817c4b0dbcc80f90f82923c0 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:18.884945 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_8a7d3a80b9424a56a1b4583e39cadf99" } modify_external_catalogs: true
I20260810 11:30:18.885282 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_8a7d3a80b9424a56a1b4583e39cadf99" } modify_external_catalogs: true
I20260810 11:30:18.886132 26495 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_b6d32d0bfc264c67a6ac2bdde0e356bd" } modify_external_catalogs: true
I20260810 11:30:18.886183 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet f3c6bd6803c245b7bb3d78423de482b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:18.886415 26495 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_b6d32d0bfc264c67a6ac2bdde0e356bd" } modify_external_catalogs: true
I20260810 11:30:18.886698 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 97d586d35ff144a681ad52756f4be2b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:18.888914 26501 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_8a28aa37fbf54c2386ba06d398603c62" } new_table_name: "default.Table_7257f6125cd44735b0cfde14a574b1e6" modify_external_catalogs: true
I20260810 11:30:18.889633 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:18.895042 27231 tablet_bootstrap.cc:492] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:18.897567 27231 tablet_bootstrap.cc:654] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:18.898715 26492 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 983916da755d4d14b7a3d43bb7cbc9c4 consensus state has no leader
I20260810 11:30:18.900404 26492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_fb7b13261243442c9c4d8749871c1d1a" } modify_external_catalogs: true
I20260810 11:30:18.900704 26492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_fb7b13261243442c9c4d8749871c1d1a" } modify_external_catalogs: true
I20260810 11:30:18.907662 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:18.910019 27248 ts_tablet_manager.cc:1918] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:18.910945 27222 tablet_bootstrap.cc:492] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
W20260810 11:30:18.911644 26700 leader_election.cc:341] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:18.911870 26700 leader_election.cc:302] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
W20260810 11:30:18.912457 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 49649.3us
I20260810 11:30:18.913136 27221 tablet_replica.cc:330] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:18.913443 27221 raft_consensus.cc:2229] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:18.914171 27527 raft_consensus.cc:2726] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:18.917793 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ff4e19071fc435fbae4490799325e37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:18.917910 27248 log.cc:1196] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/debc114073e14ec1839c5c4c7c2f1f1e
I20260810 11:30:18.918121 27222 ts_tablet_manager.cc:1397] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.194s user 0.046s sys 0.021s
I20260810 11:30:18.918751 27221 raft_consensus.cc:2258] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:18.919242 27248 ts_tablet_manager.cc:1939] T debc114073e14ec1839c5c4c7c2f1f1e P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:18.919528 27221 ts_tablet_manager.cc:1905] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:18.920737 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 112) took 5097 ms. Trace:
I20260810 11:30:18.921118 27222 raft_consensus.cc:348] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:18.921532 27222 raft_consensus.cc:374] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:18.925339 27222 raft_consensus.cc:729] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:18.925661 27248 rpcz_store.cc:276] 0810 11:30:13.823120 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:13.823239 (+ 119us) service_pool.cc:227] Handling call
0810 11:30:18.826426 (+5003187us) ts_tablet_manager.cc:1145] Deleting tablet debc114073e14ec1839c5c4c7c2f1f1e
0810 11:30:18.826441 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:18.846526 (+ 20085us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:18.909873 (+ 63347us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:18.920649 (+ 10776us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5002535}
I20260810 11:30:18.926303 27248 tablet_replica.cc:330] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:18.887822 27385 consensus_queue.cc:1035] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260810 11:30:18.922696 27231 tablet_bootstrap.cc:492] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:18.927489 27231 ts_tablet_manager.cc:1397] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.000s
I20260810 11:30:18.928285 27566 tablet.cc:1722] T 6c5b650bc02f4fa393bada5b54c77f1f P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260810 11:30:18.928395 27231 raft_consensus.cc:348] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:18.928789 27231 raft_consensus.cc:374] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:18.929180 27231 raft_consensus.cc:729] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
W20260810 11:30:18.929503 26501 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 83631b421a614796bdf76335f1437e00 consensus state has no leader
I20260810 11:30:18.929544 27231 consensus_queue.cc:260] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:18.930248 27231 ts_tablet_manager.cc:1428] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:18.930579 27231 tablet_bootstrap.cc:492] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:18.930676 27532 tablet.cc:1722] T 6c5b650bc02f4fa393bada5b54c77f1f P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260810 11:30:18.932713 27231 tablet_bootstrap.cc:654] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:18.938694 27248 raft_consensus.cc:2229] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:18.939246 27248 raft_consensus.cc:2258] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:18.942042 26849 consensus_peers.cc:487] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc2d129e99f24c018e4f8e43f211171d. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:18.942549 27248 ts_tablet_manager.cc:1905] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:18.948230 26501 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: default.Table_afde78ad5bfa4a23828df391f669e7fa [id=3d8c46d7a15e457a93fd615ad99a4f36] alter complete (version 6)
I20260810 11:30:18.949903 26495 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet fd3b4c25b14d4ee6b6380a0d1dd7a2de
I20260810 11:30:18.952450 27558 raft_consensus.cc:686] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:18.953971 27558 consensus_queue.cc:237] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:18.960083 27223 ts_tablet_manager.cc:1918] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:18.961840 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet debc114073e14ec1839c5c4c7c2f1f1e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]) successfully deleted
I20260810 11:30:18.964849 26495 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_fa1a8ca288074aa495b826ea794186bb" } modify_external_catalogs: true
I20260810 11:30:18.965411 26495 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_fa1a8ca288074aa495b826ea794186bb" } modify_external_catalogs: true
I20260810 11:30:18.967033 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_399a19bdec684153873829bd1655feb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:18.967941 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_399a19bdec684153873829bd1655feb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:18.972952 27222 consensus_queue.cc:260] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:18.981828 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 96cae4eb16c84410926a317af70e44f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:18.987804 26500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 10e6c41db71a4146840f06c5b7412d9c
I20260810 11:30:18.988422 26500 catalog_manager.cc:6565] ReplaceTablet: tablet 10e6c41db71a4146840f06c5b7412d9c deleted and replaced by tablet 72209a805e3e4b4ea1bf99508e0f75db
I20260810 11:30:18.988819 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 10e6c41db71a4146840f06c5b7412d9c with delete_type TABLET_DATA_DELETED (replaced by tablet 72209a805e3e4b4ea1bf99508e0f75db) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:18.992728 26500 master_service.cc:946] ReplaceTablet: received request to replace tablet cb6805a5dd264939850ea2cd9a850a1f from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:18.995028 27231 tablet_bootstrap.cc:492] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:18.995338 27231 ts_tablet_manager.cc:1397] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.065s user 0.002s sys 0.005s
I20260810 11:30:18.962564 27551 tablet.cc:1722] T 6c5b650bc02f4fa393bada5b54c77f1f P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260810 11:30:18.971719 27228 tablet_bootstrap.cc:492] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:18.996503 27231 raft_consensus.cc:348] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:18.996814 27231 raft_consensus.cc:374] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:18.996924 27228 ts_tablet_manager.cc:1397] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.445s user 0.008s sys 0.004s
I20260810 11:30:18.996945 27231 raft_consensus.cc:729] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:18.997223 27231 consensus_queue.cc:260] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:18.989413 26882 tablet_service.cc:1514] Processing DeleteTablet for tablet 10e6c41db71a4146840f06c5b7412d9c with delete_type TABLET_DATA_DELETED (replaced by tablet 72209a805e3e4b4ea1bf99508e0f75db) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:18.998248 27231 ts_tablet_manager.cc:1428] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260810 11:30:18.998435 27248 ts_tablet_manager.cc:1918] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:18.998970 27248 log.cc:1196] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/3dabfbd779c5406cb10ecf70f5a142e7
I20260810 11:30:18.999377 27222 ts_tablet_manager.cc:1428] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.081s user 0.003s sys 0.000s
I20260810 11:30:18.999403 27228 raft_consensus.cc:348] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:18.999678 27248 ts_tablet_manager.cc:1939] T 3dabfbd779c5406cb10ecf70f5a142e7 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:18.999819 27228 raft_consensus.cc:374] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:19.002226 27228 raft_consensus.cc:729] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:19.002609 27228 consensus_queue.cc:260] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.005582 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet 10e6c41db71a4146840f06c5b7412d9c with delete_type TABLET_DATA_DELETED (replaced by tablet 72209a805e3e4b4ea1bf99508e0f75db) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:19.012239 26495 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 2917f1ffb5214a80b19810540602df35
I20260810 11:30:19.012662 27223 log.cc:1196] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/d98948300fe6472295ea53cedb7d386c
I20260810 11:30:19.013463 27223 ts_tablet_manager.cc:1939] T d98948300fe6472295ea53cedb7d386c P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:19.013551 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 2917f1ffb5214a80b19810540602df35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:19.014209 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet d98948300fe6472295ea53cedb7d386c (table default.Table_642d4dc06a4a436ea666abb1ae5e6f7f [id=e3215507fa424c3d9fce745d5b906536]) successfully deleted
I20260810 11:30:19.014635 27223 tablet_replica.cc:330] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:19.015009 27223 raft_consensus.cc:2229] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:19.015587 27223 pending_rounds.cc:62] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700: Trying to abort 1 pending ops.
I20260810 11:30:19.015872 27223 pending_rounds.cc:68] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936367817289728 op_type: NO_OP noop_request { }
I20260810 11:30:19.016189 27223 raft_consensus.cc:2866] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:19.016404 27223 raft_consensus.cc:2258] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:19.017254 27223 ts_tablet_manager.cc:1905] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:19.019896 27222 tablet_bootstrap.cc:492] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:19.020927 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet 2917f1ffb5214a80b19810540602df35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:19.024031 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 809b5b6b65d244cd9186517e39494839
I20260810 11:30:19.021289 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b754dc2568849deafc7a8dc6d81924c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:19.025337 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 113) took 5190 ms. Trace:
I20260810 11:30:19.025892 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 66908164ff2a4ee5b55da6158699e0c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:19.026185 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:19.027915 27248 rpcz_store.cc:276] 0810 11:30:13.835409 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:13.835486 (+ 77us) service_pool.cc:227] Handling call
0810 11:30:18.926157 (+5090671us) ts_tablet_manager.cc:1145] Deleting tablet 3dabfbd779c5406cb10ecf70f5a142e7
0810 11:30:18.926167 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:18.956206 (+ 30039us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:18.966039 (+ 9833us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.025207 (+ 59168us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5090253}
I20260810 11:30:19.028421 27231 tablet_bootstrap.cc:492] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:19.028962 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:19.029088 26492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 64818ca5827e41d99428903ddb8688d9
I20260810 11:30:19.031195 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 64818ca5827e41d99428903ddb8688d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:19.031569 27231 tablet_bootstrap.cc:654] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:19.032019 26659 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 809b5b6b65d244cd9186517e39494839
I20260810 11:30:19.032418 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 3dabfbd779c5406cb10ecf70f5a142e7 (table default.Table_2511fda0071847d1a412482192a6bbb4 [id=66cb5c83b5894c1a9bc02e9019921428]) successfully deleted
I20260810 11:30:19.037750 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:19.040230 26497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet cb01e54d817c4b0dbcc80f90f82923c0
I20260810 11:30:19.040789 26497 catalog_manager.cc:6565] ReplaceTablet: tablet cb01e54d817c4b0dbcc80f90f82923c0 deleted and replaced by tablet 5deec04c1be64473accf8b9df14bd22e
I20260810 11:30:19.041574 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet cb01e54d817c4b0dbcc80f90f82923c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5deec04c1be64473accf8b9df14bd22e) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:19.044137 26746 tablet_service.cc:1467] Processing CreateTablet for tablet 9de57b6d03e34ee783b822b30090c077 (DEFAULT_TABLE table=default.Table_09ff2cfcae6d4c1b96479fd190b3c084 [id=7d0dd215c30648438a460f730b0b7ba4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.044766 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9de57b6d03e34ee783b822b30090c077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.048620 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:19.052657 26733 tablet_service.cc:1467] Processing CreateTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 (DEFAULT_TABLE table=default.Table_5318e36611c342278e64da2f02be8a08 [id=3b8a0c6cf3fa45c18cedc4967f725ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.017719 26882 tablet_service.cc:1514] Processing DeleteTablet for tablet 2917f1ffb5214a80b19810540602df35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:19.057713 26733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1aa4562a2247405187d9dbd1baa48f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.057994 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 1860e56467624dcdb288e13b004f78cc (DEFAULT_TABLE table=default.Table_5a4c04e087c3490fae87a17247850531 [id=323f239c11f84a69beaf74e68c0cf50a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.058511 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1860e56467624dcdb288e13b004f78cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.059358 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 64818ca5827e41d99428903ddb8688d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:19.059500 27032 tablet_service.cc:1467] Processing CreateTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 (DEFAULT_TABLE table=default.Table_5318e36611c342278e64da2f02be8a08 [id=3b8a0c6cf3fa45c18cedc4967f725ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.061523 27032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1aa4562a2247405187d9dbd1baa48f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.061932 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 116) took 5175 ms. Trace:
I20260810 11:30:19.062744 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet cb01e54d817c4b0dbcc80f90f82923c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5deec04c1be64473accf8b9df14bd22e) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:19.067230 26497 catalog_manager.cc:5495] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:19.067943 26497 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3ccef06fa06c4c519d8760fa948d6c8b (table default.Table_abbbb80ecbe4491d98912dcdcaab5dd3 [id=ba999b4084c84b2f8e0313b96849b169]). Expected version 4 got 0
I20260810 11:30:19.073357 27222 tablet_bootstrap.cc:654] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:19.026741 26884 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:19.036528 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 (DEFAULT_TABLE table=default.Table_5318e36611c342278e64da2f02be8a08 [id=3b8a0c6cf3fa45c18cedc4967f725ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.084118 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1aa4562a2247405187d9dbd1baa48f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.036687 26891 tablet_service.cc:1467] Processing CreateTablet for tablet 9de57b6d03e34ee783b822b30090c077 (DEFAULT_TABLE table=default.Table_09ff2cfcae6d4c1b96479fd190b3c084 [id=7d0dd215c30648438a460f730b0b7ba4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.038839 27228 ts_tablet_manager.cc:1428] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.042s user 0.001s sys 0.002s
I20260810 11:30:19.041600 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet cb01e54d817c4b0dbcc80f90f82923c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5deec04c1be64473accf8b9df14bd22e) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:19.040848 26892 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:19.053272 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet 64818ca5827e41d99428903ddb8688d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:19.087009 27228 tablet_bootstrap.cc:492] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:19.088253 27038 tablet_service.cc:1467] Processing CreateTablet for tablet 9de57b6d03e34ee783b822b30090c077 (DEFAULT_TABLE table=default.Table_09ff2cfcae6d4c1b96479fd190b3c084 [id=7d0dd215c30648438a460f730b0b7ba4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.089010 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_34d8fc5b6fcb49a9a2e7837be26f92fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:19.089720 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34d8fc5b6fcb49a9a2e7837be26f92fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.091461 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_dc83172ee2e44eccab63bccfa35523fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:19.091614 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_e8a49cc4f8384337ad68ccc057f28eaf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:19.091981 26891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9de57b6d03e34ee783b822b30090c077. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:19.092142 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc83172ee2e44eccab63bccfa35523fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:19.092427 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8a49cc4f8384337ad68ccc057f28eaf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.093348 27248 rpcz_store.cc:276] 0810 11:30:13.863792 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:13.863905 (+ 113us) service_pool.cc:227] Handling call
0810 11:30:19.029580 (+5165675us) ts_tablet_manager.cc:1145] Deleting tablet d91a02b22044429fb3e25840c7947a02
0810 11:30:19.029596 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.039051 (+ 9455us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5163299}
I20260810 11:30:19.094264 26491 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_da82b7e264034027b41209e3a8be8903"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:19.094871 26491 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da82b7e264034027b41209e3a8be8903 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.095942 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9de57b6d03e34ee783b822b30090c077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.100701 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet 256af4222bb34745ac018dd82a9c4f9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:19.101753 27248 tablet_replica.cc:330] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:19.102269 27248 raft_consensus.cc:2229] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:19.102533 27248 raft_consensus.cc:2258] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:19.106514 26501 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_105371a3c4b44933b4181df1297f6139" } new_table_name: "default.Table_9f14d3d9ba454257a07c6eb8b0ead5e6" modify_external_catalogs: true
I20260810 11:30:19.108763 27248 ts_tablet_manager.cc:1905] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:19.113408 27228 tablet_bootstrap.cc:654] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:19.113786 26498 master_service.cc:946] ReplaceTablet: received request to replace tablet 5ca5c88585394dba87e201696afa6934 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:19.112537 27221 ts_tablet_manager.cc:1918] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:19.118809 27221 log.cc:1196] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/7e3707ae32624f6483866208321eefde
I20260810 11:30:19.123636 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (DEFAULT_TABLE table=default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.124468 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.124441 27221 ts_tablet_manager.cc:1939] T 7e3707ae32624f6483866208321eefde P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:19.127974 26746 tablet_service.cc:1467] Processing CreateTablet for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (DEFAULT_TABLE table=default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.128664 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.128710 26884 tablet_service.cc:1467] Processing CreateTablet for tablet 809b5b6b65d244cd9186517e39494839 (DEFAULT_TABLE table=default.Table_8a7d3a80b9424a56a1b4583e39cadf99 [id=072a54ad9981451c9a5004a46fecd6c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.129236 26884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 809b5b6b65d244cd9186517e39494839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.129865 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 220) took 2531 ms. Trace:
I20260810 11:30:19.136010 27221 rpcz_store.cc:276] 0810 11:30:16.598406 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.601013 (+ 2607us) service_pool.cc:227] Handling call
0810 11:30:18.860133 (+2259120us) ts_tablet_manager.cc:1145] Deleting tablet 7e3707ae32624f6483866208321eefde
0810 11:30:18.860151 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.063495 (+203344us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.112338 (+ 48843us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.129798 (+ 17460us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2258890}
I20260810 11:30:19.136474 26748 tablet_service.cc:1467] Processing CreateTablet for tablet 809b5b6b65d244cd9186517e39494839 (DEFAULT_TABLE table=default.Table_8a7d3a80b9424a56a1b4583e39cadf99 [id=072a54ad9981451c9a5004a46fecd6c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.137440 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 809b5b6b65d244cd9186517e39494839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.137857 26733 tablet_service.cc:1467] Processing CreateTablet for tablet 1860e56467624dcdb288e13b004f78cc (DEFAULT_TABLE table=default.Table_5a4c04e087c3490fae87a17247850531 [id=323f239c11f84a69beaf74e68c0cf50a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.139168 26499 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_f5acadd3f7ff49d4883a695e2348164f" } modify_external_catalogs: true
I20260810 11:30:19.139509 26499 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_f5acadd3f7ff49d4883a695e2348164f" } modify_external_catalogs: true
I20260810 11:30:19.140388 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 1860e56467624dcdb288e13b004f78cc (DEFAULT_TABLE table=default.Table_5a4c04e087c3490fae87a17247850531 [id=323f239c11f84a69beaf74e68c0cf50a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.141072 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1860e56467624dcdb288e13b004f78cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.141984 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_340e7b53369c44cda0cb60ddbb328ccc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:19.142211 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (DEFAULT_TABLE table=default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:19.142616 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_340e7b53369c44cda0cb60ddbb328ccc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.142813 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.146032 27558 raft_consensus.cc:482] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:19.146346 27558 raft_consensus.cc:504] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.146435 26497 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_dfd9941b72e749a7b7e7bc153705cfec" } new_table_name: "default.Table_6163a9cf9af548ebabdec2b602c0e4e6" modify_external_catalogs: true
I20260810 11:30:19.147457 27558 leader_election.cc:288] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:19.148931 26500 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_e4551e8a102f4eb580426519fca21df9" } new_table_name: "default.Table_e33c9849bbd34e6b9b72e69fd3a1ab1c" modify_external_catalogs: true
I20260810 11:30:19.149668 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec788db5b0ca40f1811b6660276d0254" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:19.151002 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec788db5b0ca40f1811b6660276d0254" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:19.151425 26769 raft_consensus.cc:2454] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:19.152160 26849 leader_election.cc:302] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:19.152782 26733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1860e56467624dcdb288e13b004f78cc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:19.153116 26848 leader_election.cc:341] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:19.153937 27558 raft_consensus.cc:2781] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:19.154134 27558 raft_consensus.cc:482] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:19.154313 27558 raft_consensus.cc:3037] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:19.155916 27228 tablet_bootstrap.cc:492] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:19.156203 27228 ts_tablet_manager.cc:1397] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.069s user 0.004s sys 0.001s
I20260810 11:30:19.156527 26742 tablet_service.cc:1467] Processing CreateTablet for tablet a45422addab84e9083df8665a0cf9322 (DEFAULT_TABLE table=default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.156643 27465 raft_consensus.cc:482] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:19.156874 27465 raft_consensus.cc:504] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.157152 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a45422addab84e9083df8665a0cf9322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.167604 27465 leader_election.cc:288] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:19.169517 27222 tablet_bootstrap.cc:492] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:19.169525 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 7e3707ae32624f6483866208321eefde (table default.Table_dcc367d62a8f4e07a9e10fbb2faa27d1 [id=742f385d32c24e459b83a90971ad60ed]) successfully deleted
I20260810 11:30:19.169831 27222 ts_tablet_manager.cc:1397] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.150s user 0.007s sys 0.002s
W20260810 11:30:19.170900 26501 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0118ff9d21924aefa8c6c32977c10453 consensus state has no leader
I20260810 11:30:19.170972 27222 raft_consensus.cc:348] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.171371 27222 raft_consensus.cc:374] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:19.171528 27222 raft_consensus.cc:729] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:19.171844 27222 consensus_queue.cc:260] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.172956 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_5f7d17a1cdaa4396b5faf52b01518860"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:19.173781 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f7d17a1cdaa4396b5faf52b01518860 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.173909 27023 tablet_service.cc:1467] Processing CreateTablet for tablet 809b5b6b65d244cd9186517e39494839 (DEFAULT_TABLE table=default.Table_8a7d3a80b9424a56a1b4583e39cadf99 [id=072a54ad9981451c9a5004a46fecd6c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.174752 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 809b5b6b65d244cd9186517e39494839. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:19.175985 26993 leader_election.cc:341] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 97d586d35ff144a681ad52756f4be2b6
W20260810 11:30:19.178306 26991 leader_election.cc:341] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 97d586d35ff144a681ad52756f4be2b6
I20260810 11:30:19.181072 27222 ts_tablet_manager.cc:1428] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260810 11:30:19.181741 27222 tablet_bootstrap.cc:492] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:19.181936 26991 leader_election.cc:302] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:19.182201 27558 raft_consensus.cc:504] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.182586 27465 raft_consensus.cc:2726] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:19.183125 26500 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e329b95fc8e41c3967079896294942a consensus state has no leader
I20260810 11:30:19.183590 26499 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 91b6078efadf496fb252f725bdf56b02
I20260810 11:30:19.185931 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 91b6078efadf496fb252f725bdf56b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:19.186576 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_55d0eefc94274462b82269e97b4969a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:19.187598 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55d0eefc94274462b82269e97b4969a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.188012 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec788db5b0ca40f1811b6660276d0254" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:19.188287 26769 raft_consensus.cc:3037] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:19.188793 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet a28849649c704f2fbdec1aced9ce01b1 with delete_type TABLET_DATA_DELETED (replaced by tablet eb9394f9ca2c44de93354e23973cf902) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:19.191859 26497 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 720ef9404cb44551aaf39687f0cf94c9 consensus state has no leader
I20260810 11:30:19.192298 26769 raft_consensus.cc:2454] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:19.199892 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 221) took 2601 ms. Trace:
I20260810 11:30:19.201155 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_a22c355b17404952bced99698472d57e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:19.201406 26493 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_3000f6230869484ea058b888473e135f" } new_table_name: "default.Table_c76f533fe5374540a2971695143b3042" modify_external_catalogs: true
W20260810 11:30:19.201958 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a22c355b17404952bced99698472d57e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.202106 27221 rpcz_store.cc:276] 0810 11:30:16.598520 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.602123 (+ 3603us) service_pool.cc:227] Handling call
0810 11:30:19.199659 (+2597536us) ts_tablet_manager.cc:1145] Deleting tablet 5adcec593b8c4d40997c8911e9f77c85
0810 11:30:19.199679 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.199820 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2597224}
I20260810 11:30:19.202844 27221 tablet_replica.cc:330] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:19.203217 27221 raft_consensus.cc:2229] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:19.203466 27221 raft_consensus.cc:2258] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:19.203369 26497 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_e8a49cc4f8384337ad68ccc057f28eaf" } new_table_name: "default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e" modify_external_catalogs: true
I20260810 11:30:19.203419 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_ad62ebe50ede4d7d96922bac3e954f9e" } modify_external_catalogs: true
I20260810 11:30:19.203622 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_ad62ebe50ede4d7d96922bac3e954f9e" } modify_external_catalogs: true
I20260810 11:30:19.204209 27221 ts_tablet_manager.cc:1905] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:19.204895 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec788db5b0ca40f1811b6660276d0254" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:19.204875 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_ce142135909043cf9c17bb75b2eae0f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:19.205615 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce142135909043cf9c17bb75b2eae0f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.206312 27231 tablet_bootstrap.cc:492] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:19.206463 26849 leader_election.cc:302] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
W20260810 11:30:19.206758 26848 leader_election.cc:341] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:19.207002 27231 ts_tablet_manager.cc:1397] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.190s user 0.013s sys 0.001s
I20260810 11:30:19.207397 26495 master_service.cc:946] ReplaceTablet: received request to replace tablet 7eae49e1c6554ba2ae831831ff4bb45c from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:19.208038 27558 leader_election.cc:288] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:19.208377 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 91b6078efadf496fb252f725bdf56b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:19.208349 27231 raft_consensus.cc:348] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.207470 27587 raft_consensus.cc:2781] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 11:30:19.211078 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 5adcec593b8c4d40997c8911e9f77c85 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5adcec593b8c4d40997c8911e9f77c85 already in progress: creating tablet
I20260810 11:30:19.212306 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_04e075d361354421aa7085057964f310"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:19.213114 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04e075d361354421aa7085057964f310 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.215215 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 91b6078efadf496fb252f725bdf56b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:19.209306 27587 raft_consensus.cc:686] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:19.218847 26746 tablet_service.cc:1467] Processing CreateTablet for tablet 77ffda3325af4096bbec689397f7a324 (DEFAULT_TABLE table=default.Table_10b2af8299224f5db4a63bd1fae61155 [id=6a421de2b28a46088fd0bad429a52bad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.219488 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77ffda3325af4096bbec689397f7a324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.220841 27231 raft_consensus.cc:374] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:19.221413 26895 tablet_service.cc:1467] Processing CreateTablet for tablet a45422addab84e9083df8665a0cf9322 (DEFAULT_TABLE table=default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.221884 27032 tablet_service.cc:1467] Processing CreateTablet for tablet a45422addab84e9083df8665a0cf9322 (DEFAULT_TABLE table=default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.222254 27587 consensus_queue.cc:237] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.222987 27231 raft_consensus.cc:729] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:19.223418 27032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a45422addab84e9083df8665a0cf9322. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:19.223668 26493 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f85c0767ad164075b87ba672cafafb47 consensus state has no leader
I20260810 11:30:19.224148 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a45422addab84e9083df8665a0cf9322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.225800 26891 tablet_service.cc:1467] Processing CreateTablet for tablet 77ffda3325af4096bbec689397f7a324 (DEFAULT_TABLE table=default.Table_10b2af8299224f5db4a63bd1fae61155 [id=6a421de2b28a46088fd0bad429a52bad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.226557 26891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77ffda3325af4096bbec689397f7a324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.226639 27222 tablet_bootstrap.cc:654] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:19.226764 27231 consensus_queue.cc:260] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.233373 27465 raft_consensus.cc:482] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:19.233616 27465 raft_consensus.cc:504] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.233866 27466 raft_consensus.cc:482] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:19.234107 27466 raft_consensus.cc:504] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.234403 27465 leader_election.cc:288] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:19.234803 27466 leader_election.cc:288] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:19.235741 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66908164ff2a4ee5b55da6158699e0c6" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:19.236083 26769 raft_consensus.cc:2454] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
W20260810 11:30:19.236809 26993 leader_election.cc:341] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 607b055f8ced4372800adf5817b46e0b
I20260810 11:30:19.237094 26993 leader_election.cc:302] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:19.237447 27466 raft_consensus.cc:2781] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:19.237560 27466 raft_consensus.cc:482] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:19.237681 27466 raft_consensus.cc:3037] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:19.238703 27231 ts_tablet_manager.cc:1428] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.032s user 0.000s sys 0.003s
I20260810 11:30:19.239977 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66908164ff2a4ee5b55da6158699e0c6" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:19.243045 26888 tablet_service.cc:1467] Processing CreateTablet for tablet a63227e69df14a4ea935087fd31ece63 (DEFAULT_TABLE table=default.Table_d863b14a3a96454e8ee5a85fb2ab30c8 [id=a40ab01e5be24248b3af7ef1dc456da6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.243602 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a63227e69df14a4ea935087fd31ece63. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:19.244004 26991 leader_election.cc:341] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:19.244515 26991 leader_election.cc:341] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 607b055f8ced4372800adf5817b46e0b
I20260810 11:30:19.247375 26991 leader_election.cc:302] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:19.249486 27465 raft_consensus.cc:2726] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:19.251489 27466 raft_consensus.cc:504] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.252933 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66908164ff2a4ee5b55da6158699e0c6" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:19.253226 26769 raft_consensus.cc:3037] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:19.257786 26769 raft_consensus.cc:2454] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:19.258625 27466 leader_election.cc:288] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:19.258824 26993 leader_election.cc:302] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:19.259130 27466 raft_consensus.cc:2781] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:19.260903 27231 tablet_bootstrap.cc:492] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:19.261530 27466 raft_consensus.cc:686] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:19.262187 27466 consensus_queue.cc:237] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.263722 27038 tablet_service.cc:1467] Processing CreateTablet for tablet 77ffda3325af4096bbec689397f7a324 (DEFAULT_TABLE table=default.Table_10b2af8299224f5db4a63bd1fae61155 [id=6a421de2b28a46088fd0bad429a52bad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.269034 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet a8a65a0e8b1f4e4b8d9a82059b766cda
I20260810 11:30:19.269129 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77ffda3325af4096bbec689397f7a324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.272352 27221 ts_tablet_manager.cc:1918] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:19.288869 27221 log.cc:1196] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/949f31fa0c124eefbee695cfc7f50cbe
I20260810 11:30:19.290068 27221 ts_tablet_manager.cc:1939] T 949f31fa0c124eefbee695cfc7f50cbe P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:19.297578 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 226) took 2538 ms. Trace:
I20260810 11:30:19.298431 27221 rpcz_store.cc:276] 0810 11:30:16.758783 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.760423 (+ 1640us) service_pool.cc:227] Handling call
0810 11:30:19.202742 (+2442319us) ts_tablet_manager.cc:1145] Deleting tablet 949f31fa0c124eefbee695cfc7f50cbe
0810 11:30:19.202755 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.254133 (+ 51378us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.272197 (+ 18064us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.297330 (+ 25133us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2441859}
I20260810 11:30:19.299868 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66908164ff2a4ee5b55da6158699e0c6" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:19.302641 26991 leader_election.cc:341] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:19.303668 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 225) took 2545 ms. Trace:
I20260810 11:30:19.304440 27221 rpcz_store.cc:276] 0810 11:30:16.758606 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.764830 (+ 6224us) service_pool.cc:227] Handling call
0810 11:30:19.303374 (+2538544us) ts_tablet_manager.cc:1145] Deleting tablet 834c9c99ec424bb39e8a003e9204b2bc
0810 11:30:19.303389 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.303526 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2538185}
I20260810 11:30:19.305697 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 227) took 2507 ms. Trace:
I20260810 11:30:19.306375 27221 rpcz_store.cc:276] 0810 11:30:16.798644 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.798744 (+ 100us) service_pool.cc:227] Handling call
0810 11:30:19.305465 (+2506721us) ts_tablet_manager.cc:1145] Deleting tablet f3884736eec74c8992b8d51b37465875
0810 11:30:19.305479 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.305623 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2506272}
I20260810 11:30:19.307638 27221 tablet_replica.cc:330] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:19.308133 27221 raft_consensus.cc:2229] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:19.311509 27221 raft_consensus.cc:2258] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:19.313082 27231 tablet_bootstrap.cc:654] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:19.314440 27221 ts_tablet_manager.cc:1905] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:19.314422 26892 tablet_service.cc:1514] Processing DeleteTablet for tablet a8a65a0e8b1f4e4b8d9a82059b766cda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:19.321190 27248 ts_tablet_manager.cc:1918] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:19.322203 27222 tablet_bootstrap.cc:492] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:19.322427 27222 ts_tablet_manager.cc:1397] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.141s user 0.018s sys 0.051s
I20260810 11:30:19.322489 27248 log.cc:1196] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/2efaf8b45a824e34b7f23037de5eec45
I20260810 11:30:19.323271 27248 ts_tablet_manager.cc:1939] T 2efaf8b45a824e34b7f23037de5eec45 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:19.323514 27222 raft_consensus.cc:348] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.323877 27222 raft_consensus.cc:374] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:19.323993 27222 raft_consensus.cc:729] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:19.324488 27222 consensus_queue.cc:260] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.331516 27222 ts_tablet_manager.cc:1428] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260810 11:30:19.332108 27222 tablet_bootstrap.cc:492] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:19.332372 26499 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d722b93fe27f4c08a592bc393046b6bd (table default.Table_60e35bdf23f74306a9b5299e927771de [id=0faf073b01654e38b8f6083f5012abd7]). Expected version 2 got 0
I20260810 11:30:19.334273 27228 raft_consensus.cc:348] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.338048 26499 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d722b93fe27f4c08a592bc393046b6bd (table default.Table_60e35bdf23f74306a9b5299e927771de [id=0faf073b01654e38b8f6083f5012abd7]). Expected version 2 got 0
I20260810 11:30:19.342100 27228 raft_consensus.cc:374] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:19.342429 27228 raft_consensus.cc:729] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:19.343207 27228 consensus_queue.cc:260] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.344488 27228 ts_tablet_manager.cc:1428] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.188s user 0.002s sys 0.003s
I20260810 11:30:19.348709 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 121) took 5266 ms. Trace:
I20260810 11:30:19.348929 27248 rpcz_store.cc:276] 0810 11:30:14.074134 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.074638 (+ 504us) service_pool.cc:227] Handling call
0810 11:30:19.093869 (+5019231us) ts_tablet_manager.cc:1145] Deleting tablet 2efaf8b45a824e34b7f23037de5eec45
0810 11:30:19.093885 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.243386 (+149501us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.315372 (+ 71986us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.340467 (+ 25095us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5018851}
I20260810 11:30:19.349511 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 120) took 5304 ms. Trace:
I20260810 11:30:19.349651 27248 rpcz_store.cc:276] 0810 11:30:14.045507 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.045639 (+ 132us) service_pool.cc:227] Handling call
0810 11:30:19.349257 (+5303618us) ts_tablet_manager.cc:1145] Deleting tablet 3ff4e19071fc435fbae4490799325e37
0810 11:30:19.349269 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.349419 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5258301}
I20260810 11:30:19.350327 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 124) took 4700 ms. Trace:
I20260810 11:30:19.350483 27248 rpcz_store.cc:276] 0810 11:30:14.650168 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.655943 (+ 5775us) service_pool.cc:227] Handling call
0810 11:30:19.350036 (+4694093us) ts_tablet_manager.cc:1145] Deleting tablet 43e42cc642544f779bb79cee7479c4f4
0810 11:30:19.350051 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.350200 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4693836}
I20260810 11:30:19.350831 27228 tablet_bootstrap.cc:492] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:19.351001 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 125) took 4700 ms. Trace:
I20260810 11:30:19.351341 27222 tablet_bootstrap.cc:654] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:19.356716 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 949f31fa0c124eefbee695cfc7f50cbe (table default.Table_d4cbe876014f4433b57552ea4db823b6 [id=de28bf5b1f604446a69f9651a1eb9b93]) successfully deleted
W20260810 11:30:19.357029 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 834c9c99ec424bb39e8a003e9204b2bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 834c9c99ec424bb39e8a003e9204b2bc already in progress: creating tablet
W20260810 11:30:19.357479 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet f3884736eec74c8992b8d51b37465875 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3884736eec74c8992b8d51b37465875 already in progress: creating tablet
W20260810 11:30:19.358878 26497 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 65756c37fe514194bebe76921419653c has no consensus state
I20260810 11:30:19.351131 27248 rpcz_store.cc:276] 0810 11:30:14.650276 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.656229 (+ 5953us) service_pool.cc:227] Handling call
0810 11:30:19.350779 (+4694550us) ts_tablet_manager.cc:1145] Deleting tablet 4b15cc8669b549a2b4461dccd66a0c5a
0810 11:30:19.350789 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.350882 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4694291}
I20260810 11:30:19.360364 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 138) took 4656 ms. Trace:
I20260810 11:30:19.360533 27248 rpcz_store.cc:276] 0810 11:30:14.703548 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.713451 (+ 9903us) service_pool.cc:227] Handling call
0810 11:30:19.360122 (+4646671us) ts_tablet_manager.cc:1145] Deleting tablet a28849649c704f2fbdec1aced9ce01b1
0810 11:30:19.360147 (+ 25us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.360291 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4636304}
I20260810 11:30:19.363940 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 141) took 4630 ms. Trace:
I20260810 11:30:19.364114 27248 rpcz_store.cc:276] 0810 11:30:14.733573 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.733642 (+ 69us) service_pool.cc:227] Handling call
0810 11:30:19.363668 (+4630026us) ts_tablet_manager.cc:1145] Deleting tablet e25ae21cc8cc4749a507fcab5ee225a3
0810 11:30:19.363690 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.363854 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4589048}
I20260810 11:30:19.364683 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_399a19bdec684153873829bd1655feb1" } modify_external_catalogs: true
I20260810 11:30:19.365283 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_399a19bdec684153873829bd1655feb1" } modify_external_catalogs: true
I20260810 11:30:19.365288 26746 tablet_service.cc:1467] Processing CreateTablet for tablet a63227e69df14a4ea935087fd31ece63 (DEFAULT_TABLE table=default.Table_d863b14a3a96454e8ee5a85fb2ab30c8 [id=a40ab01e5be24248b3af7ef1dc456da6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.366017 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a63227e69df14a4ea935087fd31ece63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.368784 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet a8a65a0e8b1f4e4b8d9a82059b766cda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:19.369061 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 149) took 4547 ms. Trace:
I20260810 11:30:19.369189 27248 rpcz_store.cc:276] 0810 11:30:14.821854 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.822766 (+ 912us) service_pool.cc:227] Handling call
0810 11:30:19.368755 (+4545989us) ts_tablet_manager.cc:1145] Deleting tablet 31cafb7c691d40a48a40f7d4190c4f8d
0810 11:30:19.368794 (+ 39us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.368965 (+ 171us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4541461}
I20260810 11:30:19.369670 27248 tablet_replica.cc:330] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:19.369943 27248 raft_consensus.cc:2229] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:19.370254 27248 raft_consensus.cc:2258] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:19.371347 26497 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_733cd3d375dd4cf9b1297c9395073c3c" } modify_external_catalogs: true
I20260810 11:30:19.371619 26497 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_733cd3d375dd4cf9b1297c9395073c3c" } modify_external_catalogs: true
I20260810 11:30:19.372303 27526 raft_consensus.cc:482] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:19.372524 27526 raft_consensus.cc:504] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.372659 27558 raft_consensus.cc:482] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:19.373492 27526 leader_election.cc:288] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:19.373391 26892 tablet_service.cc:1467] Processing CreateTablet for tablet 4efa31ad2ce8436b9638e6759d9b5421 (DEFAULT_TABLE table=default.Table_f3567f07068942e9a5d42f9877f39bb7 [id=c557d3488f464c5bbff89fd13e52b02a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.374281 27558 raft_consensus.cc:504] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.375150 27558 leader_election.cc:288] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:19.377370 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 490ada0a918d48c3a07e12eed58bda19 (DEFAULT_TABLE table=default.Table_ba61129cdf35481dbf06effd223949f6 [id=e20f1c45c6d743cba2c3cc60c78186a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.378122 27221 ts_tablet_manager.cc:1918] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:19.378427 27221 log.cc:1196] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/ec788db5b0ca40f1811b6660276d0254
I20260810 11:30:19.370910 27248 ts_tablet_manager.cc:1905] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:19.374330 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a28849649c704f2fbdec1aced9ce01b1" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:19.378957 27221 ts_tablet_manager.cc:1939] T ec788db5b0ca40f1811b6660276d0254 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
W20260810 11:30:19.379453 26702 leader_election.cc:341] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:19.379961 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 228) took 2579 ms. Trace:
W20260810 11:30:19.380672 26849 leader_election.cc:341] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 2efaf8b45a824e34b7f23037de5eec45
I20260810 11:30:19.377621 26882 tablet_service.cc:1467] Processing CreateTablet for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f (DEFAULT_TABLE table=default.Table_7458a59fbdce4e9485d51df6fccf66a5 [id=d63533f5d837481889b34a78d860e018]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.370790 26893 tablet_service.cc:1467] Processing CreateTablet for tablet fc558690dce44e999e55e9bf1b6ca172 (DEFAULT_TABLE table=default.Table_6ab452637eba400386dddb52dbb3eedd [id=95c1850f17d3460b8d7fff2ce922d7d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.383746 26734 tablet_service.cc:1467] Processing CreateTablet for tablet fc558690dce44e999e55e9bf1b6ca172 (DEFAULT_TABLE table=default.Table_6ab452637eba400386dddb52dbb3eedd [id=95c1850f17d3460b8d7fff2ce922d7d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.392175 27221 rpcz_store.cc:276] 0810 11:30:16.800272 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.800331 (+ 59us) service_pool.cc:227] Handling call
0810 11:30:19.307300 (+2506969us) ts_tablet_manager.cc:1145] Deleting tablet ec788db5b0ca40f1811b6660276d0254
0810 11:30:19.307313 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.338389 (+ 31076us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.377908 (+ 39519us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.379923 (+ 2015us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2506677}
I20260810 11:30:19.392690 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc558690dce44e999e55e9bf1b6ca172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.394069 27221 tablet_replica.cc:330] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:19.394484 27221 raft_consensus.cc:2229] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:19.394729 27221 raft_consensus.cc:2258] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:19.394734 26491 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet a8ec28df1621411989369b5dc6a06e97
I20260810 11:30:19.395519 27221 ts_tablet_manager.cc:1905] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:19.384279 26733 tablet_service.cc:1467] Processing CreateTablet for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f (DEFAULT_TABLE table=default.Table_7458a59fbdce4e9485d51df6fccf66a5 [id=d63533f5d837481889b34a78d860e018]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.401139 26733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.405617 26497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 44d5e146eeec4fe0be33c1c169d32e68
I20260810 11:30:19.407050 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet ec788db5b0ca40f1811b6660276d0254 (table default.Table_b400d58717834fafa8a580a57cd0e325 [id=9d4e514d06c54ffc8db5d4b3e3ec65c9]) successfully deleted
I20260810 11:30:19.407796 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d5e146eeec4fe0be33c1c169d32e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:19.408793 27248 ts_tablet_manager.cc:1918] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:19.409052 27248 log.cc:1196] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/607b055f8ced4372800adf5817b46e0b
I20260810 11:30:19.409596 27248 ts_tablet_manager.cc:1939] T 607b055f8ced4372800adf5817b46e0b P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:19.413558 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 145) took 4604 ms. Trace:
I20260810 11:30:19.413749 27248 rpcz_store.cc:276] 0810 11:30:14.808805 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.808934 (+ 129us) service_pool.cc:227] Handling call
0810 11:30:19.369485 (+4560551us) ts_tablet_manager.cc:1145] Deleting tablet 607b055f8ced4372800adf5817b46e0b
0810 11:30:19.369496 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.392081 (+ 22585us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.396472 (+ 4391us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.412498 (+ 16026us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x618000004d18. stack: 00007faac62fb66e 00007faac62fb430 00007faac53825ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007faac62f10fd 00007faac62f216e 00007faad9246cfd 00007faad91c4883 00007faad5466752 00007faad5498404 00007faad5479870 00007faad54795fd 00000000009edb7c 00007faac6341344
0810 11:30:19.413491 (+ 993us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5344128,"tablet-delete.queue_time_us":4532119}
I20260810 11:30:19.414201 27248 tablet_replica.cc:330] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:19.414515 27248 raft_consensus.cc:2229] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:19.414915 27248 raft_consensus.cc:2258] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:19.414849 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_f55e75edcec14683a44d60250c42dbc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:19.415669 27248 ts_tablet_manager.cc:1905] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:19.417230 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f55e75edcec14683a44d60250c42dbc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.422230 26735 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d5e146eeec4fe0be33c1c169d32e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:19.422164 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_9f14d3d9ba454257a07c6eb8b0ead5e6" } modify_external_catalogs: true
I20260810 11:30:19.422983 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_9f14d3d9ba454257a07c6eb8b0ead5e6" } modify_external_catalogs: true
I20260810 11:30:19.423554 26748 tablet_service.cc:1467] Processing CreateTablet for tablet 4efa31ad2ce8436b9638e6759d9b5421 (DEFAULT_TABLE table=default.Table_f3567f07068942e9a5d42f9877f39bb7 [id=c557d3488f464c5bbff89fd13e52b02a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.424181 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4efa31ad2ce8436b9638e6759d9b5421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.432063 26742 tablet_service.cc:1467] Processing CreateTablet for tablet 490ada0a918d48c3a07e12eed58bda19 (DEFAULT_TABLE table=default.Table_ba61129cdf35481dbf06effd223949f6 [id=e20f1c45c6d743cba2c3cc60c78186a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.433669 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 490ada0a918d48c3a07e12eed58bda19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.434010 27222 tablet_bootstrap.cc:492] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:19.434303 27222 ts_tablet_manager.cc:1397] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.102s user 0.005s sys 0.013s
I20260810 11:30:19.435672 27231 tablet_bootstrap.cc:492] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:19.436957 27231 ts_tablet_manager.cc:1397] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.197s user 0.009s sys 0.017s
I20260810 11:30:19.439117 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_4857a0fc183c421382b9b70094d76ac3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:19.439924 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4857a0fc183c421382b9b70094d76ac3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.437057 27222 raft_consensus.cc:348] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.445132 27231 raft_consensus.cc:348] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.445634 27231 raft_consensus.cc:374] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:19.445771 27231 raft_consensus.cc:729] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:19.446074 27231 consensus_queue.cc:260] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.447467 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_94097f0758264fc986fbe731111c6851"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:19.448194 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94097f0758264fc986fbe731111c6851 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.451370 27221 ts_tablet_manager.cc:1918] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:19.451596 27221 log.cc:1196] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/66908164ff2a4ee5b55da6158699e0c6
I20260810 11:30:19.452246 27222 raft_consensus.cc:374] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:19.452580 27222 raft_consensus.cc:729] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:19.453073 26500 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d14091e1c111438bac8bcf3d36123d80 (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]). Expected version 1 got 0
I20260810 11:30:19.453238 27222 consensus_queue.cc:260] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.454434 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_168dc06875d64f40830cac1440688bd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:19.455227 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_168dc06875d64f40830cac1440688bd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.456261 27231 ts_tablet_manager.cc:1428] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.018s user 0.001s sys 0.002s
I20260810 11:30:19.461501 27222 ts_tablet_manager.cc:1428] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.026s user 0.002s sys 0.001s
I20260810 11:30:19.462153 26497 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d14091e1c111438bac8bcf3d36123d80 (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]). Expected version 1 got 0
I20260810 11:30:19.462525 27231 tablet_bootstrap.cc:492] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:19.467852 27221 ts_tablet_manager.cc:1939] T 66908164ff2a4ee5b55da6158699e0c6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:19.467949 27231 tablet_bootstrap.cc:654] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:19.471908 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 229) took 2670 ms. Trace:
I20260810 11:30:19.476267 26882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.470588 27526 raft_consensus.cc:482] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:19.477586 27526 raft_consensus.cc:504] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.477133 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a28849649c704f2fbdec1aced9ce01b1" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:19.478590 26700 leader_election.cc:341] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:19.478662 27526 leader_election.cc:288] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:19.478827 26700 leader_election.cc:302] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:19.468461 27222 tablet_bootstrap.cc:492] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:19.480305 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff4e19071fc435fbae4490799325e37" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:19.481027 27221 rpcz_store.cc:276] 0810 11:30:16.801681 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.801755 (+ 74us) service_pool.cc:227] Handling call
0810 11:30:19.393952 (+2592197us) ts_tablet_manager.cc:1145] Deleting tablet 66908164ff2a4ee5b55da6158699e0c6
0810 11:30:19.393972 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.431507 (+ 37535us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.451261 (+ 19754us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.471840 (+ 20579us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2591651}
I20260810 11:30:19.482077 26500 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_cbae6a8ecb06451aac22785bb782bdc3" } new_table_name: "default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc" modify_external_catalogs: true
I20260810 11:30:19.482537 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 66908164ff2a4ee5b55da6158699e0c6 (table default.Table_5920ba1cda06446c8f95e65aec6a42bf [id=10cadcb426e64a27a94df23fc8956de1]) successfully deleted
W20260810 11:30:19.483546 26702 leader_election.cc:341] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:19.483816 26848 leader_election.cc:341] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 2efaf8b45a824e34b7f23037de5eec45
I20260810 11:30:19.484217 27526 raft_consensus.cc:2726] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:19.484503 27231 tablet_bootstrap.cc:492] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:19.485236 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff4e19071fc435fbae4490799325e37" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:19.485404 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 237) took 2278 ms. Trace:
I20260810 11:30:19.485543 27221 rpcz_store.cc:276] 0810 11:30:17.205884 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.205998 (+ 114us) service_pool.cc:227] Handling call
0810 11:30:19.482940 (+2276942us) ts_tablet_manager.cc:1145] Deleting tablet 9311943eebaa4824bde96b4cb09f1e2c
0810 11:30:19.482958 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.484535 (+ 1577us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2276507}
W20260810 11:30:19.486255 26700 leader_election.cc:341] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:19.486371 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 9311943eebaa4824bde96b4cb09f1e2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9311943eebaa4824bde96b4cb09f1e2c already in progress: creating tablet
I20260810 11:30:19.486773 26700 leader_election.cc:302] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:19.487893 27526 raft_consensus.cc:2726] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:19.488322 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 238) took 2269 ms. Trace:
I20260810 11:30:19.489509 27222 tablet_bootstrap.cc:654] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:19.489703 27466 raft_consensus.cc:482] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:19.489887 27466 raft_consensus.cc:504] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.490902 27466 leader_election.cc:288] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:19.491568 27221 rpcz_store.cc:276] 0810 11:30:17.216986 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.220320 (+ 3334us) service_pool.cc:227] Handling call
0810 11:30:19.485881 (+2265561us) ts_tablet_manager.cc:1145] Deleting tablet eb9394f9ca2c44de93354e23973cf902
0810 11:30:19.485896 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.486041 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2265114}
I20260810 11:30:19.488206 27231 ts_tablet_manager.cc:1397] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.001s
W20260810 11:30:19.492380 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet eb9394f9ca2c44de93354e23973cf902 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb9394f9ca2c44de93354e23973cf902 already in progress: creating tablet
W20260810 11:30:19.492946 26500 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 372b49dc083d46538442fcbfdfeb3545 has no consensus state
I20260810 11:30:19.493956 26848 leader_election.cc:302] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:19.494154 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 239) took 2246 ms. Trace:
I20260810 11:30:19.494292 27221 rpcz_store.cc:276] 0810 11:30:17.247313 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.247594 (+ 281us) service_pool.cc:227] Handling call
0810 11:30:19.493008 (+2245414us) ts_tablet_manager.cc:1145] Deleting tablet 3851d39aeb3142938a5ac558ab438c21
0810 11:30:19.493025 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.494084 (+ 1059us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2244919}
I20260810 11:30:19.494664 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 490ada0a918d48c3a07e12eed58bda19. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:19.494702 26993 leader_election.cc:341] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: f3c6bd6803c245b7bb3d78423de482b6
W20260810 11:30:19.494864 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 3851d39aeb3142938a5ac558ab438c21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3851d39aeb3142938a5ac558ab438c21 already in progress: creating tablet
I20260810 11:30:19.495697 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 240) took 2248 ms. Trace:
I20260810 11:30:19.495463 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_54efd7f2894348cf9dbf82586d44b6b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:19.496933 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 109212us
W20260810 11:30:19.497052 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54efd7f2894348cf9dbf82586d44b6b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.497848 27221 rpcz_store.cc:276] 0810 11:30:17.247532 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.248136 (+ 604us) service_pool.cc:227] Handling call
0810 11:30:19.495259 (+2247123us) ts_tablet_manager.cc:1145] Deleting tablet 8798892eb4604ee8ac9c95e64dbb14e9
0810 11:30:19.495275 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.495576 (+ 301us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2246836}
I20260810 11:30:19.489579 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet d729baae40a64e6e8c23e6870f230afb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:19.500804 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 8798892eb4604ee8ac9c95e64dbb14e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8798892eb4604ee8ac9c95e64dbb14e9 already in progress: creating tablet
I20260810 11:30:19.502117 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 236) took 2297 ms. Trace:
I20260810 11:30:19.503196 27221 rpcz_store.cc:276] 0810 11:30:17.204724 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.250547 (+ 45823us) service_pool.cc:227] Handling call
0810 11:30:19.501430 (+2250883us) ts_tablet_manager.cc:1145] Deleting tablet 60d56e162b4b41e2867ac845e524aca4
0810 11:30:19.501450 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.502008 (+ 558us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2250574}
I20260810 11:30:19.504480 27558 raft_consensus.cc:2726] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:19.504805 27558 raft_consensus.cc:482] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:19.505376 27558 raft_consensus.cc:504] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.505868 27221 tablet_replica.cc:330] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:19.506176 27558 leader_election.cc:288] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:19.506168 27221 raft_consensus.cc:2229] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:19.509060 26892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4efa31ad2ce8436b9638e6759d9b5421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.509075 27221 raft_consensus.cc:2258] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:19.509791 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 60d56e162b4b41e2867ac845e524aca4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60d56e162b4b41e2867ac845e524aca4 already in progress: creating tablet
I20260810 11:30:19.509999 27221 ts_tablet_manager.cc:1905] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:19.512432 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc558690dce44e999e55e9bf1b6ca172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.515357 26495 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_638a44c47a3b410ba563ae4fcf03e6a0" } new_table_name: "default.Table_0c1c960361be4daaab7ecd5cc74c33aa" modify_external_catalogs: true
I20260810 11:30:19.526988 27231 raft_consensus.cc:348] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.527420 27231 raft_consensus.cc:374] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:19.527525 27231 raft_consensus.cc:729] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:19.527911 27231 consensus_queue.cc:260] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:19.534076 26849 leader_election.cc:341] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 79953795f07845aba3f028741cdcdd9e
W20260810 11:30:19.536895 26495 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a3079a68c1c74b64bf13877bd0ee68c3 consensus state has no leader
I20260810 11:30:19.539458 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_c40dd8e327db40b59167de093a5c616d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:19.540020 26493 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_b6c6809bdbac4c2d86853a11b84b872e" } new_table_name: "default.Table_51a0b22255e14dd996d464ccf6176c70" modify_external_catalogs: true
W20260810 11:30:19.541365 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c40dd8e327db40b59167de093a5c616d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.541463 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_2c4f303b1d1c47c9a4c089efccdd1d37"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:19.544449 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c4f303b1d1c47c9a4c089efccdd1d37 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.546789 27231 ts_tablet_manager.cc:1428] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.053s user 0.004s sys 0.000s
I20260810 11:30:19.551627 26497 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_9329d33b857541719c3852e79fdc14b6" } modify_external_catalogs: true
I20260810 11:30:19.554396 27574 catalog_manager.cc:1259] Loaded cluster ID: 5081849c8420415b9be91728667896d5
I20260810 11:30:19.554842 26497 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_9329d33b857541719c3852e79fdc14b6" } modify_external_catalogs: true
I20260810 11:30:19.561949 27223 ts_tablet_manager.cc:1918] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:19.561939 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet b7a3b877457c4a2489d397f3f864d6b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:19.568419 27221 ts_tablet_manager.cc:1918] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:19.571076 27221 log.cc:1196] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/7eae49e1c6554ba2ae831831ff4bb45c
I20260810 11:30:19.572165 27221 ts_tablet_manager.cc:1939] T 7eae49e1c6554ba2ae831831ff4bb45c P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:19.575956 27231 tablet_bootstrap.cc:492] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:19.578882 27228 tablet_bootstrap.cc:654] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:19.579270 26493 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f64d4b9320c4cb39f57573d781a47d3 consensus state has no leader
I20260810 11:30:19.580861 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 241) took 2249 ms. Trace:
I20260810 11:30:19.581902 27221 rpcz_store.cc:276] 0810 11:30:17.331672 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.337693 (+ 6021us) service_pool.cc:227] Handling call
0810 11:30:19.505356 (+2167663us) ts_tablet_manager.cc:1145] Deleting tablet 7eae49e1c6554ba2ae831831ff4bb45c
0810 11:30:19.505372 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.530744 (+ 25372us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.568228 (+ 37484us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.580790 (+ 12562us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2167288}
I20260810 11:30:19.583127 27221 tablet_replica.cc:330] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:19.583328 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 7eae49e1c6554ba2ae831831ff4bb45c (table default.Table_29f8cf6d48514b87bae05b1c797607cd [id=aee0dce4bed94ceebb0ad9fbba02f4b3]) successfully deleted
I20260810 11:30:19.583797 27221 raft_consensus.cc:2229] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:19.584448 27466 raft_consensus.cc:482] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:19.584903 27221 raft_consensus.cc:2258] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:19.584755 27466 raft_consensus.cc:504] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:19.585660 27466 leader_election.cc:288] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:19.587276 26993 leader_election.cc:341] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 9b754dc2568849deafc7a8dc6d81924c
I20260810 11:30:19.587559 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 79953795f07845aba3f028741cdcdd9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:19.588132 27221 ts_tablet_manager.cc:1905] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:19.588670 27223 log.cc:1196] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/fc2d129e99f24c018e4f8e43f211171d
I20260810 11:30:19.591825 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet a8a65a0e8b1f4e4b8d9a82059b766cda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:19.593842 27038 tablet_service.cc:1467] Processing CreateTablet for tablet a63227e69df14a4ea935087fd31ece63 (DEFAULT_TABLE table=default.Table_d863b14a3a96454e8ee5a85fb2ab30c8 [id=a40ab01e5be24248b3af7ef1dc456da6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.594376 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a63227e69df14a4ea935087fd31ece63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.598868 27574 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: loading cluster ID for follower catalog manager: success
I20260810 11:30:19.601575 27032 tablet_service.cc:1467] Processing CreateTablet for tablet 4efa31ad2ce8436b9638e6759d9b5421 (DEFAULT_TABLE table=default.Table_f3567f07068942e9a5d42f9877f39bb7 [id=c557d3488f464c5bbff89fd13e52b02a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.602123 27032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4efa31ad2ce8436b9638e6759d9b5421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.602921 27231 tablet_bootstrap.cc:654] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:19.614451 27248 ts_tablet_manager.cc:1918] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:19.615015 27248 log.cc:1196] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/2c6b3f8626724d12986f388b1ca90b3c
I20260810 11:30:19.615638 27248 ts_tablet_manager.cc:1939] T 2c6b3f8626724d12986f388b1ca90b3c P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:19.618044 27223 ts_tablet_manager.cc:1939] T fc2d129e99f24c018e4f8e43f211171d P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:19.618546 27028 tablet_service.cc:1467] Processing CreateTablet for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f (DEFAULT_TABLE table=default.Table_7458a59fbdce4e9485d51df6fccf66a5 [id=d63533f5d837481889b34a78d860e018]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.618618 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 256) took 1333 ms. Trace:
I20260810 11:30:19.618799 27021 tablet_service.cc:1467] Processing CreateTablet for tablet fc558690dce44e999e55e9bf1b6ca172 (DEFAULT_TABLE table=default.Table_6ab452637eba400386dddb52dbb3eedd [id=95c1850f17d3460b8d7fff2ce922d7d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.619550 27223 rpcz_store.cc:276] 0810 11:30:18.285208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.285278 (+ 70us) service_pool.cc:227] Handling call
0810 11:30:19.014559 (+729281us) ts_tablet_manager.cc:1145] Deleting tablet fc2d129e99f24c018e4f8e43f211171d
0810 11:30:19.014572 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.166001 (+151429us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.547287 (+381286us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.618580 (+ 71293us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":727202}
I20260810 11:30:19.619863 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.619896 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d5e146eeec4fe0be33c1c169d32e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:19.620097 27223 tablet_replica.cc:330] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:19.620823 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc558690dce44e999e55e9bf1b6ca172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.620865 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet fc2d129e99f24c018e4f8e43f211171d (table default.Table_38150fc48b7148a8bc17eb85f039d7b3 [id=b54ba03677734f2da90a534a0f5ff58e]) successfully deleted
I20260810 11:30:19.621047 27223 raft_consensus.cc:2229] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:19.621268 27223 raft_consensus.cc:2258] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:19.622511 27599 log.cc:924] Time spent T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700: Append to log took a long time: real 0.071s user 0.000s sys 0.000s
I20260810 11:30:19.623256 27038 tablet_service.cc:1467] Processing CreateTablet for tablet 490ada0a918d48c3a07e12eed58bda19 (DEFAULT_TABLE table=default.Table_ba61129cdf35481dbf06effd223949f6 [id=e20f1c45c6d743cba2c3cc60c78186a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.625607 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 2efaf8b45a824e34b7f23037de5eec45 (table default.Table_a006976247434094b81729d5aa32d9f7 [id=bf77960e83134a008f3e19008893a6e1]) successfully deleted
W20260810 11:30:19.627784 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 3ff4e19071fc435fbae4490799325e37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ff4e19071fc435fbae4490799325e37 already in progress: creating tablet
W20260810 11:30:19.629823 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 43e42cc642544f779bb79cee7479c4f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43e42cc642544f779bb79cee7479c4f4 already in progress: creating tablet
W20260810 11:30:19.630205 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 4b15cc8669b549a2b4461dccd66a0c5a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b15cc8669b549a2b4461dccd66a0c5a already in progress: creating tablet
W20260810 11:30:19.630659 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet a28849649c704f2fbdec1aced9ce01b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a28849649c704f2fbdec1aced9ce01b1 already in progress: creating tablet
W20260810 11:30:19.631212 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet e25ae21cc8cc4749a507fcab5ee225a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e25ae21cc8cc4749a507fcab5ee225a3 already in progress: creating tablet
W20260810 11:30:19.631675 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 31cafb7c691d40a48a40f7d4190c4f8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31cafb7c691d40a48a40f7d4190c4f8d already in progress: creating tablet
I20260810 11:30:19.632001 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 607b055f8ced4372800adf5817b46e0b (table default.Table_dc355f349bc9426eb26a69cf93c089cf [id=68a29d5ebf8140198fbf4da3cd974847]) successfully deleted
I20260810 11:30:19.634558 26498 master_service.cc:946] ReplaceTablet: received request to replace tablet 8798892eb4604ee8ac9c95e64dbb14e9 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:19.648308 27526 raft_consensus.cc:482] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:19.648658 27526 raft_consensus.cc:504] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.649571 27526 leader_election.cc:288] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:19.649966 27574 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: acquiring CA information for follower catalog manager: success
I20260810 11:30:19.652352 26498 master_service.cc:946] ReplaceTablet: received request to replace tablet 49db12565dbc4187b78a98ed35c40fed from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:19.658026 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 490ada0a918d48c3a07e12eed58bda19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.657999 27223 ts_tablet_manager.cc:1905] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:19.659804 27466 raft_consensus.cc:482] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:19.660104 27466 raft_consensus.cc:504] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.661688 27222 tablet_bootstrap.cc:492] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:19.661880 27222 ts_tablet_manager.cc:1397] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.194s user 0.010s sys 0.010s
I20260810 11:30:19.662777 27222 raft_consensus.cc:348] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.663035 27222 raft_consensus.cc:374] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:19.663113 27222 raft_consensus.cc:729] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:19.663393 27222 consensus_queue.cc:260] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.664103 27222 ts_tablet_manager.cc:1428] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 11:30:19.665288 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d14091e1c111438bac8bcf3d36123d80" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:19.665565 26769 raft_consensus.cc:2454] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:19.667001 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96cae4eb16c84410926a317af70e44f7" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:19.669003 27222 tablet_bootstrap.cc:492] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:19.669688 26700 leader_election.cc:341] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:19.669730 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3c6bd6803c245b7bb3d78423de482b6" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:19.671358 27222 tablet_bootstrap.cc:654] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:19.681970 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 148) took 4801 ms. Trace:
I20260810 11:30:19.682461 27248 rpcz_store.cc:276] 0810 11:30:14.821692 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.822695 (+ 1003us) service_pool.cc:227] Handling call
0810 11:30:19.414115 (+4591420us) ts_tablet_manager.cc:1145] Deleting tablet 2c6b3f8626724d12986f388b1ca90b3c
0810 11:30:19.414127 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.520809 (+106682us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.613478 (+ 92669us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.622651 (+ 9173us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4567837}
I20260810 11:30:19.683193 27526 raft_consensus.cc:482] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:19.683451 27526 raft_consensus.cc:504] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.683993 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b754dc2568849deafc7a8dc6d81924c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:19.684188 27526 leader_election.cc:288] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:19.685160 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d729baae40a64e6e8c23e6870f230afb" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:19.685959 26700 leader_election.cc:341] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:19.660890 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet 7eae49e1c6554ba2ae831831ff4bb45c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:19.682233 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96cae4eb16c84410926a317af70e44f7" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:19.682096 27466 leader_election.cc:288] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:19.689340 26702 leader_election.cc:341] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:19.689447 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 2c6b3f8626724d12986f388b1ca90b3c (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]) successfully deleted
I20260810 11:30:19.689606 26702 leader_election.cc:302] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
W20260810 11:30:19.685453 26991 leader_election.cc:341] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:19.686034 26993 leader_election.cc:302] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:19.686261 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d729baae40a64e6e8c23e6870f230afb" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:19.690127 27526 raft_consensus.cc:2726] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:19.690418 27574 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 11:30:19.691191 26702 leader_election.cc:341] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:19.691378 26702 leader_election.cc:302] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:19.691948 27526 raft_consensus.cc:2726] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:19.692670 27222 tablet_bootstrap.cc:492] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:19.693480 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d14091e1c111438bac8bcf3d36123d80" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:19.694334 27231 tablet_bootstrap.cc:492] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:19.694490 27228 tablet_bootstrap.cc:492] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:19.694535 27231 ts_tablet_manager.cc:1397] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.119s user 0.003s sys 0.005s
I20260810 11:30:19.694702 27228 ts_tablet_manager.cc:1397] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.350s user 0.007s sys 0.015s
I20260810 11:30:19.695250 27466 raft_consensus.cc:2781] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:19.695362 26991 leader_election.cc:302] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:19.697876 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79953795f07845aba3f028741cdcdd9e" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:19.698159 27060 raft_consensus.cc:2454] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:19.699442 27466 raft_consensus.cc:482] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:19.699576 27466 raft_consensus.cc:3037] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:19.704105 26991 leader_election.cc:341] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: Tablet not RUNNING: STOPPED
I20260810 11:30:19.704294 26991 leader_election.cc:302] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:19.704339 26500 master_service.cc:946] ReplaceTablet: received request to replace tablet ec788db5b0ca40f1811b6660276d0254 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:19.704957 27465 raft_consensus.cc:2726] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:19.705191 27465 raft_consensus.cc:2726] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:19.712486 27231 raft_consensus.cc:348] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.713012 27231 raft_consensus.cc:374] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:19.713152 27231 raft_consensus.cc:729] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:19.713505 27231 consensus_queue.cc:260] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.713925 27466 raft_consensus.cc:504] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.716399 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d14091e1c111438bac8bcf3d36123d80" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:19.716770 26769 raft_consensus.cc:3037] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:19.717664 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 0118ff9d21924aefa8c6c32977c10453
I20260810 11:30:19.719487 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet 0118ff9d21924aefa8c6c32977c10453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:19.720038 27221 ts_tablet_manager.cc:1918] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:19.720232 27221 log.cc:1196] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/b7a3b877457c4a2489d397f3f864d6b2
I20260810 11:30:19.720088 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet 0118ff9d21924aefa8c6c32977c10453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:19.720206 26769 raft_consensus.cc:2454] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:19.721560 26993 leader_election.cc:302] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:19.726506 26497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 1a83391804894d268d0e603f4feb1745
I20260810 11:30:19.727506 26884 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a83391804894d268d0e603f4feb1745 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:19.728092 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a83391804894d268d0e603f4feb1745 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:19.728505 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a83391804894d268d0e603f4feb1745 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:19.730113 26495 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 23637a02b6464e17aa2a69ea5cc4ddfe (table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85]). Expected version 1 got 0
I20260810 11:30:19.733006 27465 raft_consensus.cc:2781] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:19.733210 27465 raft_consensus.cc:686] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:19.733595 27465 consensus_queue.cc:237] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.735349 26495 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 23637a02b6464e17aa2a69ea5cc4ddfe (table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85]). Expected version 1 got 0
I20260810 11:30:19.737454 27231 ts_tablet_manager.cc:1428] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.041s user 0.001s sys 0.002s
I20260810 11:30:19.737720 26742 tablet_service.cc:1467] Processing CreateTablet for tablet b755744059b04967857c1b00e951b8ee (DEFAULT_TABLE table=default.Table_04e075d361354421aa7085057964f310 [id=94c8e7388b644043b77cb6b5087e87e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.738093 27221 ts_tablet_manager.cc:1939] T b7a3b877457c4a2489d397f3f864d6b2 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:19.738291 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b755744059b04967857c1b00e951b8ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.738351 27023 tablet_service.cc:1467] Processing CreateTablet for tablet b755744059b04967857c1b00e951b8ee (DEFAULT_TABLE table=default.Table_04e075d361354421aa7085057964f310 [id=94c8e7388b644043b77cb6b5087e87e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.738855 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b755744059b04967857c1b00e951b8ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.739168 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 260) took 2125 ms. Trace:
I20260810 11:30:19.739296 27221 rpcz_store.cc:276] 0810 11:30:17.613568 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.613615 (+ 47us) service_pool.cc:227] Handling call
0810 11:30:19.583013 (+1969398us) ts_tablet_manager.cc:1145] Deleting tablet b7a3b877457c4a2489d397f3f864d6b2
0810 11:30:19.583029 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.595703 (+ 12674us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.719871 (+124168us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.739078 (+ 19207us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1969096}
I20260810 11:30:19.740176 27466 leader_election.cc:288] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:19.741279 26498 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 49db12565dbc4187b78a98ed35c40fed
I20260810 11:30:19.741909 26498 catalog_manager.cc:6565] ReplaceTablet: tablet 49db12565dbc4187b78a98ed35c40fed deleted and replaced by tablet 3a1e46f80f7f4e3a84638421892e6236
I20260810 11:30:19.741806 26495 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_bb3131b0059a44d68866825f94543d0f" } new_table_name: "default.Table_2c888d6a14f943e9b4dd4285c53791b4" modify_external_catalogs: true
I20260810 11:30:19.742679 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet b7a3b877457c4a2489d397f3f864d6b2 (table default.Table_3449a59ebd4f47d58e6a93dee9ef6f73 [id=6a400e6303ea4b42a4fa36252c95a62b]) successfully deleted
I20260810 11:30:19.743561 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 49db12565dbc4187b78a98ed35c40fed with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1e46f80f7f4e3a84638421892e6236) from {username='slave'} at 127.0.0.1:39688
W20260810 11:30:19.749042 26991 leader_election.cc:341] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:19.750828 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 49db12565dbc4187b78a98ed35c40fed with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1e46f80f7f4e3a84638421892e6236) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:19.751685 26498 master_service.cc:946] ReplaceTablet: received request to replace tablet 81f24c84cdd945b78f39f24015eb1e43 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:19.751858 27231 tablet_bootstrap.cc:492] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:19.693207 27222 ts_tablet_manager.cc:1397] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.005s
I20260810 11:30:19.754456 27222 raft_consensus.cc:348] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.754875 27222 raft_consensus.cc:374] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:19.755055 27222 raft_consensus.cc:729] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:19.755537 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet 0118ff9d21924aefa8c6c32977c10453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:19.755434 27222 consensus_queue.cc:260] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.756199 27222 ts_tablet_manager.cc:1428] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260810 11:30:19.756799 27021 tablet_service.cc:1467] Processing CreateTablet for tablet a22cdf7d273d427cb32b811aa5caa3a3 (DEFAULT_TABLE table=default.Table_a22c355b17404952bced99698472d57e [id=72544a36bf7e46ca8a020d40d5370b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.757434 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a22cdf7d273d427cb32b811aa5caa3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.757599 26883 tablet_service.cc:1467] Processing CreateTablet for tablet b755744059b04967857c1b00e951b8ee (DEFAULT_TABLE table=default.Table_04e075d361354421aa7085057964f310 [id=94c8e7388b644043b77cb6b5087e87e8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:19.759024 26495 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72209a805e3e4b4ea1bf99508e0f75db consensus state has no leader
I20260810 11:30:19.760325 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 (DEFAULT_TABLE table=default.Table_340e7b53369c44cda0cb60ddbb328ccc [id=7861512191c341b9a85c6a1885a52ca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.761191 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.761245 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d14091e1c111438bac8bcf3d36123d80" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:19.761211 27228 raft_consensus.cc:348] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.761888 27228 raft_consensus.cc:374] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:19.762048 26848 leader_election.cc:302] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
W20260810 11:30:19.762742 26991 leader_election.cc:341] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:19.765666 27231 tablet_bootstrap.cc:654] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:19.766307 26892 tablet_service.cc:1467] Processing CreateTablet for tablet d560157da0624333b91a18481b058f91 (DEFAULT_TABLE table=default.Table_5f7d17a1cdaa4396b5faf52b01518860 [id=973454ab92f84e73be26260d66ee9763]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.766258 26882 tablet_service.cc:1467] Processing CreateTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 (DEFAULT_TABLE table=default.Table_340e7b53369c44cda0cb60ddbb328ccc [id=7861512191c341b9a85c6a1885a52ca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.767256 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet 49db12565dbc4187b78a98ed35c40fed with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1e46f80f7f4e3a84638421892e6236) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:19.757846 27023 tablet_service.cc:1467] Processing CreateTablet for tablet d560157da0624333b91a18481b058f91 (DEFAULT_TABLE table=default.Table_5f7d17a1cdaa4396b5faf52b01518860 [id=973454ab92f84e73be26260d66ee9763]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.768278 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d560157da0624333b91a18481b058f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.768632 27032 tablet_service.cc:1467] Processing CreateTablet for tablet 5409c96c1949416e85cfcaa8f2f61227 (DEFAULT_TABLE table=default.Table_da82b7e264034027b41209e3a8be8903 [id=d7ee651e98084bd798d76ecf28546e83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.769029 27032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5409c96c1949416e85cfcaa8f2f61227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.770109 27223 ts_tablet_manager.cc:1918] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:19.772302 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 147) took 4871 ms. Trace:
I20260810 11:30:19.772509 27248 rpcz_store.cc:276] 0810 11:30:14.821560 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.822485 (+ 925us) service_pool.cc:227] Handling call
0810 11:30:19.688754 (+4866269us) ts_tablet_manager.cc:1145] Deleting tablet 2fc76603bf8843dab18c95fdab9a8be0
0810 11:30:19.688768 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.693346 (+ 4578us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4837240}
I20260810 11:30:19.773110 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 146) took 4951 ms. Trace:
I20260810 11:30:19.773100 27228 raft_consensus.cc:729] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:19.773444 27228 consensus_queue.cc:260] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.775607 27228 ts_tablet_manager.cc:1428] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.079s user 0.001s sys 0.001s
I20260810 11:30:19.776546 26884 tablet_service.cc:1467] Processing CreateTablet for tablet a22cdf7d273d427cb32b811aa5caa3a3 (DEFAULT_TABLE table=default.Table_a22c355b17404952bced99698472d57e [id=72544a36bf7e46ca8a020d40d5370b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.777295 27222 tablet_bootstrap.cc:492] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:19.773208 27248 rpcz_store.cc:276] 0810 11:30:14.821351 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.827544 (+ 6193us) service_pool.cc:227] Handling call
0810 11:30:19.772850 (+4945306us) ts_tablet_manager.cc:1145] Deleting tablet d729baae40a64e6e8c23e6870f230afb
0810 11:30:19.772864 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.773027 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4875282}
I20260810 11:30:19.778687 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 150) took 4830 ms. Trace:
I20260810 11:30:19.772787 26748 tablet_service.cc:1467] Processing CreateTablet for tablet a22cdf7d273d427cb32b811aa5caa3a3 (DEFAULT_TABLE table=default.Table_a22c355b17404952bced99698472d57e [id=72544a36bf7e46ca8a020d40d5370b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.780433 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 257) took 2167 ms. Trace:
I20260810 11:30:19.780673 27221 rpcz_store.cc:276] 0810 11:30:17.613043 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.613963 (+ 920us) service_pool.cc:227] Handling call
0810 11:30:19.780150 (+2166187us) ts_tablet_manager.cc:1145] Deleting tablet 2634beb347714fc7a2e05865adb34a22
0810 11:30:19.780166 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.780316 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2125604}
I20260810 11:30:19.781136 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a22cdf7d273d427cb32b811aa5caa3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.773320 26733 tablet_service.cc:1467] Processing CreateTablet for tablet d560157da0624333b91a18481b058f91 (DEFAULT_TABLE table=default.Table_5f7d17a1cdaa4396b5faf52b01518860 [id=973454ab92f84e73be26260d66ee9763]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.781592 27248 rpcz_store.cc:276] 0810 11:30:14.948659 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:14.951331 (+ 2672us) service_pool.cc:227] Handling call
0810 11:30:19.778354 (+4827023us) ts_tablet_manager.cc:1145] Deleting tablet eb51618d37ac488fa7e3d23e5f85ec36
0810 11:30:19.778368 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.778523 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4817912}
I20260810 11:30:19.773702 26734 tablet_service.cc:1467] Processing CreateTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 (DEFAULT_TABLE table=default.Table_340e7b53369c44cda0cb60ddbb328ccc [id=7861512191c341b9a85c6a1885a52ca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.773960 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet b28f3dcbd6d74559b372d3452e13ce9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:19.774291 26735 tablet_service.cc:1467] Processing CreateTablet for tablet 5409c96c1949416e85cfcaa8f2f61227 (DEFAULT_TABLE table=default.Table_da82b7e264034027b41209e3a8be8903 [id=d7ee651e98084bd798d76ecf28546e83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.782150 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 170) took 4316 ms. Trace:
I20260810 11:30:19.784296 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b755744059b04967857c1b00e951b8ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.765849 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_56b4699099fd417496e71ccbed272638"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:19.789991 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56b4699099fd417496e71ccbed272638 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:19.778788 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet d729baae40a64e6e8c23e6870f230afb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d729baae40a64e6e8c23e6870f230afb already in progress: creating tablet
W20260810 11:30:19.790778 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet eb51618d37ac488fa7e3d23e5f85ec36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb51618d37ac488fa7e3d23e5f85ec36 already in progress: creating tablet
I20260810 11:30:19.791050 26491 catalog_manager.cc:5495] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:19.791334 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_03a616a243fc4350b4a01d7f5bb86949"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:19.791771 26491 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d14091e1c111438bac8bcf3d36123d80 (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]). Expected version 1 got 0
W20260810 11:30:19.792089 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03a616a243fc4350b4a01d7f5bb86949 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.789153 26498 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 81f24c84cdd945b78f39f24015eb1e43
I20260810 11:30:19.796027 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_44e5f0610f934d889eaf76d00116f0e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:19.794809 26498 catalog_manager.cc:6565] ReplaceTablet: tablet 81f24c84cdd945b78f39f24015eb1e43 deleted and replaced by tablet 2b95f3ec8ff34c89a68cd1edf8391f9b
W20260810 11:30:19.797116 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44e5f0610f934d889eaf76d00116f0e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.797549 26493 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_9b714db8cc714c0999f926e8182ca6e4" } modify_external_catalogs: true
I20260810 11:30:19.797783 26493 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_9b714db8cc714c0999f926e8182ca6e4" } modify_external_catalogs: true
W20260810 11:30:19.798583 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2634beb347714fc7a2e05865adb34a22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2634beb347714fc7a2e05865adb34a22 already in progress: creating tablet
I20260810 11:30:19.782308 27248 rpcz_store.cc:276] 0810 11:30:15.465548 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.465908 (+ 360us) service_pool.cc:227] Handling call
0810 11:30:19.781901 (+4315993us) ts_tablet_manager.cc:1145] Deleting tablet 96cae4eb16c84410926a317af70e44f7
0810 11:30:19.781915 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.782067 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4314461}
W20260810 11:30:19.802713 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 96cae4eb16c84410926a317af70e44f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96cae4eb16c84410926a317af70e44f7 already in progress: creating tablet
I20260810 11:30:19.803406 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 169) took 4338 ms. Trace:
I20260810 11:30:19.805909 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 5409c96c1949416e85cfcaa8f2f61227 (DEFAULT_TABLE table=default.Table_da82b7e264034027b41209e3a8be8903 [id=d7ee651e98084bd798d76ecf28546e83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.806784 27248 rpcz_store.cc:276] 0810 11:30:15.464836 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.465111 (+ 275us) service_pool.cc:227] Handling call
0810 11:30:19.803156 (+4338045us) ts_tablet_manager.cc:1145] Deleting tablet 23d8ce485cb84495a6e964b6d5977f0d
0810 11:30:19.803169 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.803321 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4332923}
W20260810 11:30:19.807498 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 23d8ce485cb84495a6e964b6d5977f0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23d8ce485cb84495a6e964b6d5977f0d already in progress: creating tablet
I20260810 11:30:19.808190 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 172) took 4306 ms. Trace:
I20260810 11:30:19.808415 27223 log.cc:1196] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/9b754dc2568849deafc7a8dc6d81924c
I20260810 11:30:19.808387 27248 rpcz_store.cc:276] 0810 11:30:15.501336 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.503323 (+ 1987us) service_pool.cc:227] Handling call
0810 11:30:19.807934 (+4304611us) ts_tablet_manager.cc:1145] Deleting tablet bb0357271cfd46478867a3cc0660bcdc
0810 11:30:19.807965 (+ 31us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.808120 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4304268}
I20260810 11:30:19.808840 27587 raft_consensus.cc:482] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 11:30:19.808969 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet bb0357271cfd46478867a3cc0660bcdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb0357271cfd46478867a3cc0660bcdc already in progress: creating tablet
I20260810 11:30:19.809145 27228 tablet_bootstrap.cc:492] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:19.811461 27038 tablet_service.cc:1467] Processing CreateTablet for tablet 65756c37fe514194bebe76921419653c (DEFAULT_TABLE table=default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.811357 27587 raft_consensus.cc:504] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.812227 27587 leader_election.cc:288] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:19.812218 26501 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_6ab452637eba400386dddb52dbb3eedd" } new_table_name: "default.Table_d6cf37fdb7354b7aa9cd2227a94c407e" modify_external_catalogs: true
I20260810 11:30:19.812602 26492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_7257f6125cd44735b0cfde14a574b1e6" } modify_external_catalogs: true
I20260810 11:30:19.812842 26492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_7257f6125cd44735b0cfde14a574b1e6" } modify_external_catalogs: true
I20260810 11:30:19.813968 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65756c37fe514194bebe76921419653c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.813959 26496 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_92fc349e41184823a7fe2bab5c946f0c" } modify_external_catalogs: true
I20260810 11:30:19.814193 26496 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_92fc349e41184823a7fe2bab5c946f0c" } modify_external_catalogs: true
I20260810 11:30:19.800865 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f24c84cdd945b78f39f24015eb1e43 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b95f3ec8ff34c89a68cd1edf8391f9b) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:19.817616 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 258) took 2168 ms. Trace:
I20260810 11:30:19.818011 26884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a22cdf7d273d427cb32b811aa5caa3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.819803 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_a48c8668e73f4919a9c32c9c3e95f485"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:19.802167 27231 tablet_bootstrap.cc:492] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:19.821061 27231 ts_tablet_manager.cc:1397] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.069s user 0.006s sys 0.000s
I20260810 11:30:19.821272 27526 raft_consensus.cc:482] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:19.821550 27526 raft_consensus.cc:504] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.822413 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5409c96c1949416e85cfcaa8f2f61227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.822582 27231 raft_consensus.cc:348] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.822979 27231 raft_consensus.cc:374] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:19.823240 27231 raft_consensus.cc:729] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:19.823949 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.823997 27231 consensus_queue.cc:260] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:19.824776 27032 tablet_service.cc:1467] Processing CreateTablet for tablet afbe6ce99f7c4f7cb939bea086cd90be (DEFAULT_TABLE table=default.Table_93969ba1aad24adfb712d718540eaae2 [id=0d443055d28146b9a2bf6780b6f44daa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.824990 26733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d560157da0624333b91a18481b058f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.828109 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5409c96c1949416e85cfcaa8f2f61227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.828186 27526 leader_election.cc:288] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:19.828363 27526 raft_consensus.cc:482] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:19.829195 27609 raft_consensus.cc:2781] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:19.829356 27609 raft_consensus.cc:482] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:19.829516 26891 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fc76603bf8843dab18c95fdab9a8be0 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ffc2c43885841d2a6a4cce52eaf7129) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:19.830278 27609 raft_consensus.cc:3037] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:19.829268 27221 rpcz_store.cc:276] 0810 11:30:17.613321 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.614203 (+ 882us) service_pool.cc:227] Handling call
0810 11:30:19.781163 (+2166960us) ts_tablet_manager.cc:1145] Deleting tablet 0713f4f14a284050a7774a70ab974f30
0810 11:30:19.781176 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.781333 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2166758}
I20260810 11:30:19.830212 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f24c84cdd945b78f39f24015eb1e43 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b95f3ec8ff34c89a68cd1edf8391f9b) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:19.831911 27223 ts_tablet_manager.cc:1939] T 9b754dc2568849deafc7a8dc6d81924c P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:19.832049 27032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afbe6ce99f7c4f7cb939bea086cd90be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.832190 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f24c84cdd945b78f39f24015eb1e43 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b95f3ec8ff34c89a68cd1edf8391f9b) from {username='slave'} at 127.0.0.1:52560
W20260810 11:30:19.832373 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a48c8668e73f4919a9c32c9c3e95f485 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:19.832388 26889 tablet_service.cc:1467] Processing CreateTablet for tablet afbe6ce99f7c4f7cb939bea086cd90be (DEFAULT_TABLE table=default.Table_93969ba1aad24adfb712d718540eaae2 [id=0d443055d28146b9a2bf6780b6f44daa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.831707 26888 tablet_service.cc:1467] Processing CreateTablet for tablet 65756c37fe514194bebe76921419653c (DEFAULT_TABLE table=default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.835260 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 173) took 4333 ms. Trace:
I20260810 11:30:19.835453 27248 rpcz_store.cc:276] 0810 11:30:15.501586 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.503996 (+ 2410us) service_pool.cc:227] Handling call
0810 11:30:19.834916 (+4330920us) ts_tablet_manager.cc:1145] Deleting tablet ffeb0373c6124af291336ca9da50c318
0810 11:30:19.834932 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.835089 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4308884}
I20260810 11:30:19.835716 26729 tablet_service.cc:1467] Processing CreateTablet for tablet 65756c37fe514194bebe76921419653c (DEFAULT_TABLE table=default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:19.836262 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet ffeb0373c6124af291336ca9da50c318 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffeb0373c6124af291336ca9da50c318 already in progress: creating tablet
I20260810 11:30:19.836398 26729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65756c37fe514194bebe76921419653c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.837831 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 171) took 4342 ms. Trace:
I20260810 11:30:19.837990 27248 rpcz_store.cc:276] 0810 11:30:15.494064 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.494417 (+ 353us) service_pool.cc:227] Handling call
0810 11:30:19.836723 (+4342306us) ts_tablet_manager.cc:1145] Deleting tablet a18cb43b4dc04a1290a6bade7ac1f3cf
0810 11:30:19.836747 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.836880 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4309052}
W20260810 11:30:19.838512 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet a18cb43b4dc04a1290a6bade7ac1f3cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a18cb43b4dc04a1290a6bade7ac1f3cf already in progress: creating tablet
W20260810 11:30:19.838930 26848 leader_election.cc:341] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 256af4222bb34745ac018dd82a9c4f9b
I20260810 11:30:19.839084 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 185) took 4248 ms. Trace:
I20260810 11:30:19.839187 26891 tablet_service.cc:1467] Processing CreateTablet for tablet 372b49dc083d46538442fcbfdfeb3545 (DEFAULT_TABLE table=default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.839219 27248 rpcz_store.cc:276] 0810 11:30:15.590530 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.590600 (+ 70us) service_pool.cc:227] Handling call
0810 11:30:19.838837 (+4248237us) ts_tablet_manager.cc:1145] Deleting tablet 478c0c39658349c39e3afa1aa1653e82
0810 11:30:19.838850 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.838972 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4247571}
W20260810 11:30:19.839720 26849 leader_election.cc:341] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 256af4222bb34745ac018dd82a9c4f9b
W20260810 11:30:19.839911 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 478c0c39658349c39e3afa1aa1653e82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 478c0c39658349c39e3afa1aa1653e82 already in progress: creating tablet
I20260810 11:30:19.839985 26849 leader_election.cc:302] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:19.840631 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 189) took 4230 ms. Trace:
I20260810 11:30:19.840763 27248 rpcz_store.cc:276] 0810 11:30:15.610262 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.610330 (+ 68us) service_pool.cc:227] Handling call
0810 11:30:19.840215 (+4229885us) ts_tablet_manager.cc:1145] Deleting tablet 31888ddeafe14738b818016a9c0a4ad3
0810 11:30:19.840234 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.840445 (+ 211us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4197102}
I20260810 11:30:19.841239 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 259) took 2219 ms. Trace:
W20260810 11:30:19.841288 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 31888ddeafe14738b818016a9c0a4ad3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31888ddeafe14738b818016a9c0a4ad3 already in progress: creating tablet
I20260810 11:30:19.841459 27587 raft_consensus.cc:2726] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:19.841403 27221 rpcz_store.cc:276] 0810 11:30:17.613469 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.614422 (+ 953us) service_pool.cc:227] Handling call
0810 11:30:19.830660 (+2216238us) ts_tablet_manager.cc:1145] Deleting tablet 7aa16654b7f34f9baf856bf724cece8f
0810 11:30:19.830673 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.833276 (+ 2603us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2216058}
I20260810 11:30:19.841962 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 277) took 1653 ms. Trace:
I20260810 11:30:19.842103 27221 rpcz_store.cc:276] 0810 11:30:18.188749 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.189141 (+ 392us) service_pool.cc:227] Handling call
0810 11:30:19.841722 (+1652581us) ts_tablet_manager.cc:1145] Deleting tablet 7ff5b980ce4e41d7a6e1ca0e740b739c
0810 11:30:19.841738 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.841888 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1652258}
I20260810 11:30:19.842618 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 278) took 1653 ms. Trace:
I20260810 11:30:19.842450 27035 tablet_service.cc:1467] Processing CreateTablet for tablet 372b49dc083d46538442fcbfdfeb3545 (DEFAULT_TABLE table=default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.842723 27221 rpcz_store.cc:276] 0810 11:30:18.188902 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.189491 (+ 589us) service_pool.cc:227] Handling call
0810 11:30:19.842370 (+1652879us) ts_tablet_manager.cc:1145] Deleting tablet a3406dc345e3429fb4bce5a59643b686
0810 11:30:19.842381 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.842523 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1652672}
I20260810 11:30:19.843225 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 372b49dc083d46538442fcbfdfeb3545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.843220 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 279) took 1650 ms. Trace:
I20260810 11:30:19.843357 27221 rpcz_store.cc:276] 0810 11:30:18.192745 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.193163 (+ 418us) service_pool.cc:227] Handling call
0810 11:30:19.842960 (+1649797us) ts_tablet_manager.cc:1145] Deleting tablet 5ca5c88585394dba87e201696afa6934
0810 11:30:19.842972 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.843089 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1649487}
I20260810 11:30:19.843783 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 280) took 1650 ms. Trace:
I20260810 11:30:19.843901 27221 rpcz_store.cc:276] 0810 11:30:18.193063 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.193518 (+ 455us) service_pool.cc:227] Handling call
0810 11:30:19.843573 (+1650055us) ts_tablet_manager.cc:1145] Deleting tablet 70f6017d4d01463398cb347779dacf90
0810 11:30:19.843583 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.843712 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1649848}
I20260810 11:30:19.844429 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 282) took 1503 ms. Trace:
I20260810 11:30:19.844923 26892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d560157da0624333b91a18481b058f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.845652 27027 tablet_service.cc:1467] Processing CreateTablet for tablet ab2471d06e0841e7bebae4ca1865618c (DEFAULT_TABLE table=default.Table_db5e3f1e3cf74bc0b15660e83ea59ad6 [id=e7142023363b432b803533be5da13aec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.846354 27027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab2471d06e0841e7bebae4ca1865618c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.846558 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b28f3dcbd6d74559b372d3452e13ce9f" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:19.846557 26487 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 372b49dc083d46538442fcbfdfeb3545 consensus state has no leader
I20260810 11:30:19.853855 27030 tablet_service.cc:1467] Processing CreateTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 (DEFAULT_TABLE table=default.Table_92fc349e41184823a7fe2bab5c946f0c [id=18fc89ba8e7e4a97a04dd030c340a95f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.854512 27030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34bd3c0edf6b49d1891c0ee9af344872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.857617 27022 tablet_service.cc:1467] Processing CreateTablet for tablet 5deec04c1be64473accf8b9df14bd22e (DEFAULT_TABLE table=default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.858291 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5deec04c1be64473accf8b9df14bd22e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.858299 26891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 372b49dc083d46538442fcbfdfeb3545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.863866 26893 tablet_service.cc:1467] Processing CreateTablet for tablet ab2471d06e0841e7bebae4ca1865618c (DEFAULT_TABLE table=default.Table_db5e3f1e3cf74bc0b15660e83ea59ad6 [id=e7142023363b432b803533be5da13aec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.865422 26879 tablet_service.cc:1467] Processing CreateTablet for tablet 5deec04c1be64473accf8b9df14bd22e (DEFAULT_TABLE table=default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.866091 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 40f5eecfc66a4711aef60c1a2bff6b97 (DEFAULT_TABLE table=default.Table_3efc57bdbafc46dfab4d324acb0d5f73 [id=bcba186b6e93492fb06f70e033be3296]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.871234 26885 tablet_service.cc:1467] Processing CreateTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 (DEFAULT_TABLE table=default.Table_71e560b0b3c84617ab561dbea1d90f7e [id=480613c985b74b2786f4c23dfb9a5f4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.845808 27526 raft_consensus.cc:504] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.846350 26746 tablet_service.cc:1467] Processing CreateTablet for tablet afbe6ce99f7c4f7cb939bea086cd90be (DEFAULT_TABLE table=default.Table_93969ba1aad24adfb712d718540eaae2 [id=0d443055d28146b9a2bf6780b6f44daa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.844540 27221 rpcz_store.cc:276] 0810 11:30:18.340529 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.340944 (+ 415us) service_pool.cc:227] Handling call
0810 11:30:19.844222 (+1503278us) ts_tablet_manager.cc:1145] Deleting tablet ff9b649e43a9456fa51cf3330290bb91
0810 11:30:19.844233 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.844346 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1502652}
I20260810 11:30:19.867352 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40f5eecfc66a4711aef60c1a2bff6b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.875188 26890 tablet_service.cc:1467] Processing CreateTablet for tablet 8083fa130cd04dae9d61aeed977c1c63 (DEFAULT_TABLE table=default.Table_34d8fc5b6fcb49a9a2e7837be26f92fd [id=39e1741c8eed4714b9fd844fb1f3e81d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.880025 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afbe6ce99f7c4f7cb939bea086cd90be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.882714 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 257) took 1572 ms. Trace:
I20260810 11:30:19.884908 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 283) took 1543 ms. Trace:
I20260810 11:30:19.885593 26878 tablet_service.cc:1467] Processing CreateTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 (DEFAULT_TABLE table=default.Table_92fc349e41184823a7fe2bab5c946f0c [id=18fc89ba8e7e4a97a04dd030c340a95f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.885648 27221 rpcz_store.cc:276] 0810 11:30:18.340878 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.341360 (+ 482us) service_pool.cc:227] Handling call
0810 11:30:19.874199 (+1532839us) ts_tablet_manager.cc:1145] Deleting tablet f2b555f18c1e485d9af7b08f98543c80
0810 11:30:19.874245 (+ 46us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.884439 (+ 10194us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1532498}
I20260810 11:30:19.887820 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 40f5eecfc66a4711aef60c1a2bff6b97 (DEFAULT_TABLE table=default.Table_3efc57bdbafc46dfab4d324acb0d5f73 [id=bcba186b6e93492fb06f70e033be3296]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.891304 27231 ts_tablet_manager.cc:1428] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.070s user 0.003s sys 0.000s
I20260810 11:30:19.891377 27023 tablet_service.cc:1467] Processing CreateTablet for tablet 8083fa130cd04dae9d61aeed977c1c63 (DEFAULT_TABLE table=default.Table_34d8fc5b6fcb49a9a2e7837be26f92fd [id=39e1741c8eed4714b9fd844fb1f3e81d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.887200 27223 rpcz_store.cc:276] 0810 11:30:18.285880 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.285931 (+ 51us) service_pool.cc:227] Handling call
0810 11:30:19.620035 (+1334104us) ts_tablet_manager.cc:1145] Deleting tablet 9b754dc2568849deafc7a8dc6d81924c
0810 11:30:19.620047 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.682642 (+ 62595us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.769967 (+ 87325us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:19.857914 (+ 87947us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1321700}
I20260810 11:30:19.896756 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afbe6ce99f7c4f7cb939bea086cd90be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.896863 26876 tablet_service.cc:1467] Processing CreateTablet for tablet 6926d0dc68fa48ae8ffabf5b5272b3d0 (DEFAULT_TABLE table=default.Table_96d4976d4de649c4a98910a1b7fd1b59 [id=777f92ce815f4314898abce665fec1eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.897399 26879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5deec04c1be64473accf8b9df14bd22e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.898535 27526 leader_election.cc:288] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:19.897022 26700 leader_election.cc:341] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:19.902515 26877 tablet_service.cc:1467] Processing CreateTablet for tablet 859477ecf37240a4888542d2559f99cd (DEFAULT_TABLE table=default.Table_c447a9537b844dffa1767531896bf6fe [id=a74215a4f78c47348bc5a41e4b1232f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.904484 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 256ad2e2d8e54a4caa1b5091bab60dd5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:19.912708 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 50096.5us
I20260810 11:30:19.913911 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d722b93fe27f4c08a592bc393046b6bd" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:19.914163 26731 tablet_service.cc:1467] Processing CreateTablet for tablet ab2471d06e0841e7bebae4ca1865618c (DEFAULT_TABLE table=default.Table_db5e3f1e3cf74bc0b15660e83ea59ad6 [id=e7142023363b432b803533be5da13aec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.914357 26740 tablet_service.cc:1467] Processing CreateTablet for tablet 372b49dc083d46538442fcbfdfeb3545 (DEFAULT_TABLE table=default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.914710 26731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab2471d06e0841e7bebae4ca1865618c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.915465 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 372b49dc083d46538442fcbfdfeb3545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.919312 27231 tablet_bootstrap.cc:492] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:19.919488 27038 tablet_service.cc:1467] Processing CreateTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 (DEFAULT_TABLE table=default.Table_71e560b0b3c84617ab561dbea1d90f7e [id=480613c985b74b2786f4c23dfb9a5f4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.920933 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 196) took 3970 ms. Trace:
I20260810 11:30:19.921087 27248 rpcz_store.cc:276] 0810 11:30:15.921053 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.974850 (+ 53797us) service_pool.cc:227] Handling call
0810 11:30:19.876433 (+3901583us) ts_tablet_manager.cc:1145] Deleting tablet a7a2cb1d2e8e40f58144908e34438d53
0810 11:30:19.876460 (+ 27us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.891832 (+ 15372us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3860251}
I20260810 11:30:19.923043 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 203) took 3639 ms. Trace:
I20260810 11:30:19.923096 27035 tablet_service.cc:1467] Processing CreateTablet for tablet f6e264e8507446809f3c386fdb3c34ae (DEFAULT_TABLE table=default.Table_ae66005f117b4fe9bd3fb52adb6efb32 [id=03cc701eb88641fa844ee3d192b321ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.923211 27248 rpcz_store.cc:276] 0810 11:30:16.282113 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.282587 (+ 474us) service_pool.cc:227] Handling call
0810 11:30:19.921353 (+3638766us) ts_tablet_manager.cc:1145] Deleting tablet 2801709d53614916abac370f7ae5e913
0810 11:30:19.921368 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.921499 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3628065}
I20260810 11:30:19.923072 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8083fa130cd04dae9d61aeed977c1c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.924705 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 204) took 3564 ms. Trace:
I20260810 11:30:19.924871 27248 rpcz_store.cc:276] 0810 11:30:16.359503 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.359756 (+ 253us) service_pool.cc:227] Handling call
0810 11:30:19.923464 (+3563708us) ts_tablet_manager.cc:1145] Deleting tablet 0033d61d07d84262a98b0ebc54bd7960
0810 11:30:19.923473 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.923564 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3540548}
I20260810 11:30:19.924978 27027 tablet_service.cc:1467] Processing CreateTablet for tablet 6926d0dc68fa48ae8ffabf5b5272b3d0 (DEFAULT_TABLE table=default.Table_96d4976d4de649c4a98910a1b7fd1b59 [id=777f92ce815f4314898abce665fec1eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.926047 27248 tablet_replica.cc:330] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:19.927222 27248 raft_consensus.cc:2229] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:19.927237 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6e264e8507446809f3c386fdb3c34ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.928375 27248 raft_consensus.cc:2258] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:19.928608 27034 tablet_service.cc:1467] Processing CreateTablet for tablet 859477ecf37240a4888542d2559f99cd (DEFAULT_TABLE table=default.Table_c447a9537b844dffa1767531896bf6fe [id=a74215a4f78c47348bc5a41e4b1232f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.929095 27248 ts_tablet_manager.cc:1905] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:19.930207 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet a7a2cb1d2e8e40f58144908e34438d53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7a2cb1d2e8e40f58144908e34438d53 already in progress: creating tablet
W20260810 11:30:19.930536 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 2801709d53614916abac370f7ae5e913 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2801709d53614916abac370f7ae5e913 already in progress: creating tablet
W20260810 11:30:19.931005 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 0033d61d07d84262a98b0ebc54bd7960 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0033d61d07d84262a98b0ebc54bd7960 already in progress: creating tablet
I20260810 11:30:19.931442 27024 tablet_service.cc:1467] Processing CreateTablet for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (DEFAULT_TABLE table=default.Table_55d0eefc94274462b82269e97b4969a9 [id=a4755db8deca4541b6f671cd5444f070]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.933135 27026 tablet_service.cc:1467] Processing CreateTablet for tablet 0f048b690d764c83a4a9ce4cbadc75b0 (DEFAULT_TABLE table=default.Table_dc83172ee2e44eccab63bccfa35523fe [id=19ea42a81c4f471592628b27a3404c4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.934911 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 256ad2e2d8e54a4caa1b5091bab60dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.935701 27027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6926d0dc68fa48ae8ffabf5b5272b3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.937232 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d722b93fe27f4c08a592bc393046b6bd" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:19.937883 26882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.942065 27025 tablet_service.cc:1467] Processing CreateTablet for tablet 72209a805e3e4b4ea1bf99508e0f75db (DEFAULT_TABLE table=default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.942504 27026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f048b690d764c83a4a9ce4cbadc75b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.946722 27231 tablet_bootstrap.cc:654] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:19.949937 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 5deec04c1be64473accf8b9df14bd22e (DEFAULT_TABLE table=default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.956270 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b28f3dcbd6d74559b372d3452e13ce9f" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:19.956727 27024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52a9367b7a8345739b5b9acf9ea1e6d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.956980 27221 tablet_replica.cc:330] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:19.956962 26886 tablet_service.cc:1467] Processing CreateTablet for tablet f6e264e8507446809f3c386fdb3c34ae (DEFAULT_TABLE table=default.Table_ae66005f117b4fe9bd3fb52adb6efb32 [id=03cc701eb88641fa844ee3d192b321ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.957641 26732 tablet_service.cc:1467] Processing CreateTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 (DEFAULT_TABLE table=default.Table_92fc349e41184823a7fe2bab5c946f0c [id=18fc89ba8e7e4a97a04dd030c340a95f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.957894 26887 tablet_service.cc:1467] Processing CreateTablet for tablet 7d3e78dcaa55491393f529ea33007786 (DEFAULT_TABLE table=default.Table_ce142135909043cf9c17bb75b2eae0f9 [id=43d34198e1ae4e33ba4ae808df4d40b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.960184 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34bd3c0edf6b49d1891c0ee9af344872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.960450 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5deec04c1be64473accf8b9df14bd22e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:19.961287 26848 consensus_peers.cc:487] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:19.961395 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6e264e8507446809f3c386fdb3c34ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.962597 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 (DEFAULT_TABLE table=default.Table_71e560b0b3c84617ab561dbea1d90f7e [id=480613c985b74b2786f4c23dfb9a5f4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.963047 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34bd3c0edf6b49d1891c0ee9af344872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.964238 26887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d3e78dcaa55491393f529ea33007786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.964207 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 859477ecf37240a4888542d2559f99cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.965711 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72209a805e3e4b4ea1bf99508e0f75db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.966280 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 256ad2e2d8e54a4caa1b5091bab60dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.964406 26742 tablet_service.cc:1467] Processing CreateTablet for tablet 40f5eecfc66a4711aef60c1a2bff6b97 (DEFAULT_TABLE table=default.Table_3efc57bdbafc46dfab4d324acb0d5f73 [id=bcba186b6e93492fb06f70e033be3296]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.968853 26890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8083fa130cd04dae9d61aeed977c1c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.970089 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (DEFAULT_TABLE table=default.Table_55d0eefc94274462b82269e97b4969a9 [id=a4755db8deca4541b6f671cd5444f070]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:19.970198 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 0713f4f14a284050a7774a70ab974f30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0713f4f14a284050a7774a70ab974f30 already in progress: creating tablet
I20260810 11:30:19.973018 26736 tablet_service.cc:1467] Processing CreateTablet for tablet f6e264e8507446809f3c386fdb3c34ae (DEFAULT_TABLE table=default.Table_ae66005f117b4fe9bd3fb52adb6efb32 [id=03cc701eb88641fa844ee3d192b321ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.976820 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52a9367b7a8345739b5b9acf9ea1e6d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.978188 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40f5eecfc66a4711aef60c1a2bff6b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.979631 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 6926d0dc68fa48ae8ffabf5b5272b3d0 (DEFAULT_TABLE table=default.Table_96d4976d4de649c4a98910a1b7fd1b59 [id=777f92ce815f4314898abce665fec1eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:19.982383 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6e264e8507446809f3c386fdb3c34ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.985518 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 9b754dc2568849deafc7a8dc6d81924c (table default.Table_c80de92e9c2f45469ed63441d62eb4bf [id=396d42b7a2ec4e80a0b0129dec3ebd68]) successfully deleted
W20260810 11:30:19.981123 26702 leader_election.cc:341] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:19.971441 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7aa16654b7f34f9baf856bf724cece8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7aa16654b7f34f9baf856bf724cece8f already in progress: creating tablet
I20260810 11:30:19.983698 26880 tablet_service.cc:1467] Processing CreateTablet for tablet 0f048b690d764c83a4a9ce4cbadc75b0 (DEFAULT_TABLE table=default.Table_dc83172ee2e44eccab63bccfa35523fe [id=19ea42a81c4f471592628b27a3404c4b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:19.986768 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ff5b980ce4e41d7a6e1ca0e740b739c already in progress: creating tablet
W20260810 11:30:19.987771 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet a3406dc345e3429fb4bce5a59643b686 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3406dc345e3429fb4bce5a59643b686 already in progress: creating tablet
W20260810 11:30:19.988766 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 5ca5c88585394dba87e201696afa6934 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ca5c88585394dba87e201696afa6934 already in progress: creating tablet
W20260810 11:30:19.989836 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 70f6017d4d01463398cb347779dacf90 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70f6017d4d01463398cb347779dacf90 already in progress: creating tablet
I20260810 11:30:19.992540 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6926d0dc68fa48ae8ffabf5b5272b3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:19.982864 27609 raft_consensus.cc:504] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:19.995303 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 258) took 1608 ms. Trace:
I20260810 11:30:19.998744 27221 raft_consensus.cc:2229] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:19.999822 26700 leader_election.cc:341] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:20.000234 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ff9b649e43a9456fa51cf3330290bb91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff9b649e43a9456fa51cf3330290bb91 already in progress: creating tablet
W20260810 11:30:20.002480 26702 leader_election.cc:341] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:20.005031 26880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f048b690d764c83a4a9ce4cbadc75b0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:20.006733 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet f2b555f18c1e485d9af7b08f98543c80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2b555f18c1e485d9af7b08f98543c80 already in progress: creating tablet
W20260810 11:30:20.010823 26849 leader_election.cc:341] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 79953795f07845aba3f028741cdcdd9e
I20260810 11:30:20.015208 27223 rpcz_store.cc:276] 0810 11:30:18.287135 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.287215 (+ 80us) service_pool.cc:227] Handling call
0810 11:30:19.894631 (+1607416us) ts_tablet_manager.cc:1145] Deleting tablet 5ca5c88585394dba87e201696afa6934
0810 11:30:19.895076 (+ 445us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:19.895435 (+ 359us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1593915}
I20260810 11:30:20.015682 26702 leader_election.cc:302] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:20.021206 27228 tablet_bootstrap.cc:654] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:20.024633 27587 consensus_queue.cc:1035] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260810 11:30:20.003295 26748 tablet_service.cc:1467] Processing CreateTablet for tablet 8083fa130cd04dae9d61aeed977c1c63 (DEFAULT_TABLE table=default.Table_34d8fc5b6fcb49a9a2e7837be26f92fd [id=39e1741c8eed4714b9fd844fb1f3e81d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.033982 27221 raft_consensus.cc:2258] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:20.046588 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 5ca5c88585394dba87e201696afa6934 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ca5c88585394dba87e201696afa6934 already in progress: creating tablet
I20260810 11:30:20.046774 26491 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_0d757328d26e45dba1be7c8a88565727" } new_table_name: "default.Table_8326a5b5a7544e828699f8b41fdee4d1" modify_external_catalogs: true
I20260810 11:30:20.048861 26500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_1f48a9af47ad4e0c93ed4dd43ecd12a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:20.049604 26500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f48a9af47ad4e0c93ed4dd43ecd12a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:20.053681 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79953795f07845aba3f028741cdcdd9e" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:20.054466 26499 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_6163a9cf9af548ebabdec2b602c0e4e6" } new_table_name: "default.Table_db0667edf5704901a7d33dad61b48608" modify_external_catalogs: true
I20260810 11:30:20.056330 26877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 859477ecf37240a4888542d2559f99cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.058116 27465 raft_consensus.cc:482] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:20.058159 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_ddaa0e35d54b49c894cbf994bb7fbbab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:20.059048 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddaa0e35d54b49c894cbf994bb7fbbab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:20.059403 27060 raft_consensus.cc:3037] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:20.066987 27465 raft_consensus.cc:504] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:20.068033 27465 leader_election.cc:288] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:20.068765 26700 leader_election.cc:302] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:20.074156 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 7d3e78dcaa55491393f529ea33007786 (DEFAULT_TABLE table=default.Table_ce142135909043cf9c17bb75b2eae0f9 [id=43d34198e1ae4e33ba4ae808df4d40b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.086647 26493 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e
I20260810 11:30:20.087637 26493 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_05e208843c2f40e6adbf28e17b7156cd" } new_table_name: "default.Table_7cbd744a71da44b28fef2d5b57df58d4" modify_external_catalogs: true
I20260810 11:30:20.092314 27616 raft_consensus.cc:2726] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:20.090950 26495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_2d6c3a53213a458aaee6bd445240041c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:20.097206 26495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d6c3a53213a458aaee6bd445240041c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:20.101418 26993 leader_election.cc:341] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: b7a3b877457c4a2489d397f3f864d6b2
W20260810 11:30:20.102761 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 126741us
I20260810 11:30:20.103719 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:20.106550 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d3e78dcaa55491393f529ea33007786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.111917 27526 raft_consensus.cc:2726] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:20.112336 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8083fa130cd04dae9d61aeed977c1c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.124207 27609 leader_election.cc:288] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:20.127144 27221 ts_tablet_manager.cc:1905] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:20.128492 26991 consensus_peers.cc:487] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:20.131807 27222 tablet_bootstrap.cc:654] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:20.136615 26501 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc558690dce44e999e55e9bf1b6ca172 consensus state has no leader
I20260810 11:30:20.137544 26492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 83631b421a614796bdf76335f1437e00
I20260810 11:30:20.140115 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 259) took 1771 ms. Trace:
I20260810 11:30:20.143172 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7a3b877457c4a2489d397f3f864d6b2" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:20.153625 26876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6926d0dc68fa48ae8ffabf5b5272b3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.155422 27223 rpcz_store.cc:276] 0810 11:30:18.287334 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.287386 (+ 52us) service_pool.cc:227] Handling call
0810 11:30:20.017294 (+1729908us) ts_tablet_manager.cc:1145] Deleting tablet 70f6017d4d01463398cb347779dacf90
0810 11:30:20.017343 (+ 49us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:20.058313 (+ 40970us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1715213}
W20260810 11:30:20.156394 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 70f6017d4d01463398cb347779dacf90 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70f6017d4d01463398cb347779dacf90 already in progress: creating tablet
I20260810 11:30:20.159736 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab2471d06e0841e7bebae4ca1865618c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.171226 27526 raft_consensus.cc:482] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:20.183445 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65756c37fe514194bebe76921419653c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.186471 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 254) took 1908 ms. Trace:
W20260810 11:30:20.187959 26991 leader_election.cc:341] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:20.188896 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 83631b421a614796bdf76335f1437e00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:20.194931 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_9744be92699b40d1bae23bbb564db585"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:20.195652 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9744be92699b40d1bae23bbb564db585 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:20.196931 26492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_6d8b58857bb84e579c8c308dcb0800f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:20.198122 26492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d8b58857bb84e579c8c308dcb0800f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:20.206609 26884 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:20.210625 26884 tablet_service.cc:1514] Processing DeleteTablet for tablet 83631b421a614796bdf76335f1437e00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:20.217037 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fc76603bf8843dab18c95fdab9a8be0 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ffc2c43885841d2a6a4cce52eaf7129) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:20.217298 26496 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 34bd3c0edf6b49d1891c0ee9af344872
I20260810 11:30:20.218122 26496 master_service.cc:946] ReplaceTablet: received request to replace tablet 2917f1ffb5214a80b19810540602df35 from {username='slave'} at 127.0.0.1:47672
I20260810 11:30:20.219457 26991 leader_election.cc:302] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:20.219930 26884 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:52560
W20260810 11:30:20.221243 26991 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 77211.6us
I20260810 11:30:20.228494 27613 raft_consensus.cc:2726] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:20.229066 27026 tablet_service.cc:1514] Processing DeleteTablet for tablet 949f31fa0c124eefbee695cfc7f50cbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:20.239018 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:20.174726 27526 raft_consensus.cc:504] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:20.242579 27526 leader_election.cc:288] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:20.249857 26734 tablet_service.cc:1467] Processing CreateTablet for tablet 859477ecf37240a4888542d2559f99cd (DEFAULT_TABLE table=default.Table_c447a9537b844dffa1767531896bf6fe [id=a74215a4f78c47348bc5a41e4b1232f8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:20.250007 26993 consensus_peers.cc:487] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66908164ff2a4ee5b55da6158699e0c6. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:20.251144 26731 tablet_service.cc:1467] Processing CreateTablet for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (DEFAULT_TABLE table=default.Table_55d0eefc94274462b82269e97b4969a9 [id=a4755db8deca4541b6f671cd5444f070]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.251866 26731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52a9367b7a8345739b5b9acf9ea1e6d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.254633 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 859477ecf37240a4888542d2559f99cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.266503 27248 ts_tablet_manager.cc:1918] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:20.267192 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23637a02b6464e17aa2a69ea5cc4ddfe" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:20.271725 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40f5eecfc66a4711aef60c1a2bff6b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.272280 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:20.273625 27538 mvcc.cc:205] Tried to move back new op lower bound from 7316936364309667840 to 7316936334838403072. Current Snapshot: MvccSnapshot[applied={T|T < 7316936363274698752 or (T in {7316936363595403264})}]
I20260810 11:30:20.274497 26887 tablet_service.cc:1467] Processing CreateTablet for tablet 72209a805e3e4b4ea1bf99508e0f75db (DEFAULT_TABLE table=default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.280614 27231 tablet_bootstrap.cc:492] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:20.280912 27231 ts_tablet_manager.cc:1397] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.389s user 0.056s sys 0.068s
I20260810 11:30:20.281785 27248 log.cc:1196] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/d98948300fe6472295ea53cedb7d386c
I20260810 11:30:20.283808 27231 raft_consensus.cc:348] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:20.284142 27231 raft_consensus.cc:374] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:20.274868 27223 rpcz_store.cc:276] 0810 11:30:18.250987 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.265755 (+ 14768us) service_pool.cc:227] Handling call
0810 11:30:20.156341 (+1890586us) ts_tablet_manager.cc:1145] Deleting tablet 7ff5b980ce4e41d7a6e1ca0e740b739c
0810 11:30:20.156356 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:20.159053 (+ 2697us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1853702}
W20260810 11:30:20.285066 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ff5b980ce4e41d7a6e1ca0e740b739c already in progress: creating tablet
I20260810 11:30:20.286983 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 72209a805e3e4b4ea1bf99508e0f75db (DEFAULT_TABLE table=default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:20.290463 26702 leader_election.cc:341] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:20.292241 27231 raft_consensus.cc:729] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:20.292672 27231 consensus_queue.cc:260] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:20.301687 26496 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_94097f0758264fc986fbe731111c6851" } modify_external_catalogs: true
I20260810 11:30:20.302173 26496 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_94097f0758264fc986fbe731111c6851" } modify_external_catalogs: true
I20260810 11:30:20.303623 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_a0630a37a4e44862b8947cd848615cdb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:20.304464 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0630a37a4e44862b8947cd848615cdb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:20.309219 26848 consensus_peers.cc:487] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:20.311847 27231 ts_tablet_manager.cc:1428] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.028s user 0.003s sys 0.000s
I20260810 11:30:20.312353 27231 tablet_bootstrap.cc:492] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:20.315743 26887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72209a805e3e4b4ea1bf99508e0f75db. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:20.316905 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 119520us
I20260810 11:30:20.325501 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 255) took 2024 ms. Trace:
I20260810 11:30:20.326305 27248 ts_tablet_manager.cc:1939] T d98948300fe6472295ea53cedb7d386c P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:20.333066 27231 tablet_bootstrap.cc:654] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:20.350217 27060 raft_consensus.cc:2454] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:20.350981 26848 leader_election.cc:302] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:20.351554 27609 raft_consensus.cc:2781] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:20.351734 27609 raft_consensus.cc:686] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:20.352016 27609 consensus_queue.cc:237] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:20.353605 27613 raft_consensus.cc:482] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:20.354043 27613 raft_consensus.cc:504] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:20.355154 27613 leader_election.cc:288] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:20.356383 26491 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 587c6ce242c0411b886404a0df03b1bb consensus state has no leader
I20260810 11:30:20.358876 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 205) took 3997 ms. Trace:
I20260810 11:30:20.359970 27248 rpcz_store.cc:276] 0810 11:30:16.361726 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.361806 (+ 80us) service_pool.cc:227] Handling call
0810 11:30:19.925158 (+3563352us) ts_tablet_manager.cc:1145] Deleting tablet d98948300fe6472295ea53cedb7d386c
0810 11:30:19.925168 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:20.125848 (+200680us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:20.241837 (+115989us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:20.358809 (+116972us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3515496}
I20260810 11:30:20.361052 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 207) took 3774 ms. Trace:
I20260810 11:30:20.361833 27223 rpcz_store.cc:276] 0810 11:30:18.282466 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.282638 (+ 172us) service_pool.cc:227] Handling call
0810 11:30:20.284508 (+2001870us) ts_tablet_manager.cc:1145] Deleting tablet a3406dc345e3429fb4bce5a59643b686
0810 11:30:20.290021 (+ 5513us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:20.306490 (+ 16469us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1981414}
I20260810 11:30:20.361865 27248 rpcz_store.cc:276] 0810 11:30:16.586715 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.587136 (+ 421us) service_pool.cc:227] Handling call
0810 11:30:20.360758 (+3773622us) ts_tablet_manager.cc:1145] Deleting tablet cb6805a5dd264939850ea2cd9a850a1f
0810 11:30:20.360774 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:20.360923 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3773233}
W20260810 11:30:20.363207 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet a3406dc345e3429fb4bce5a59643b686 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3406dc345e3429fb4bce5a59643b686 already in progress: creating tablet
I20260810 11:30:20.363508 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet d98948300fe6472295ea53cedb7d386c (table default.Table_642d4dc06a4a436ea666abb1ae5e6f7f [id=e3215507fa424c3d9fce745d5b906536]) successfully deleted
W20260810 11:30:20.365031 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet cb6805a5dd264939850ea2cd9a850a1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb6805a5dd264939850ea2cd9a850a1f already in progress: creating tablet
I20260810 11:30:20.371234 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 208) took 3784 ms. Trace:
I20260810 11:30:20.371531 27248 rpcz_store.cc:276] 0810 11:30:16.586875 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.587580 (+ 705us) service_pool.cc:227] Handling call
0810 11:30:20.362718 (+3775138us) ts_tablet_manager.cc:1145] Deleting tablet 5adcec593b8c4d40997c8911e9f77c85
0810 11:30:20.362742 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:20.371172 (+ 8430us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3774902}
I20260810 11:30:20.372304 27248 tablet_replica.cc:330] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:20.372933 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 5adcec593b8c4d40997c8911e9f77c85 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5adcec593b8c4d40997c8911e9f77c85 already in progress: creating tablet
I20260810 11:30:20.373442 26500 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_ae66005f117b4fe9bd3fb52adb6efb32" } modify_external_catalogs: true
I20260810 11:30:20.373800 26500 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_ae66005f117b4fe9bd3fb52adb6efb32" } modify_external_catalogs: true
I20260810 11:30:20.371150 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eae49e1c6554ba2ae831831ff4bb45c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:20.378034 26491 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_1528f143d0414238812c27c83d4ea987" } new_table_name: "default.Table_ea330e3236fb4089b9b4f17ae165fa3c" modify_external_catalogs: true
W20260810 11:30:20.378855 26991 leader_election.cc:341] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:20.380762 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet ec788db5b0ca40f1811b6660276d0254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:20.382983 27248 raft_consensus.cc:2229] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:20.383244 26499 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 720ef9404cb44551aaf39687f0cf94c9 consensus state has no leader
I20260810 11:30:20.383387 27248 pending_rounds.cc:62] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215: Trying to abort 1 pending ops.
I20260810 11:30:20.383507 27248 pending_rounds.cc:68] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936367817289728 op_type: NO_OP noop_request { }
I20260810 11:30:20.383788 27248 raft_consensus.cc:2866] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:20.383982 27248 raft_consensus.cc:2258] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:20.384846 27248 ts_tablet_manager.cc:1905] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:20.385926 26499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_9efdfb09fd194dc2a9cbdc9a87749126"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:20.386777 26499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9efdfb09fd194dc2a9cbdc9a87749126 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:20.390409 27223 tablet_replica.cc:330] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:20.390758 27223 raft_consensus.cc:2229] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:20.391537 26497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_53285a0af75e4705982c23850f7b27e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:20.392262 26497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53285a0af75e4705982c23850f7b27e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:20.393652 27223 pending_rounds.cc:62] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700: Trying to abort 1 pending ops.
I20260810 11:30:20.393813 27223 pending_rounds.cc:68] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936373139795968 op_type: NO_OP noop_request { }
I20260810 11:30:20.395861 27223 raft_consensus.cc:2866] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:20.396070 27223 raft_consensus.cc:2258] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:20.399375 26993 leader_election.cc:341] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 7eae49e1c6554ba2ae831831ff4bb45c
I20260810 11:30:20.399597 26993 leader_election.cc:302] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:20.400360 27613 raft_consensus.cc:2726] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:20.412689 26732 tablet_service.cc:1467] Processing CreateTablet for tablet 7d3e78dcaa55491393f529ea33007786 (DEFAULT_TABLE table=default.Table_ce142135909043cf9c17bb75b2eae0f9 [id=43d34198e1ae4e33ba4ae808df4d40b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.415594 26729 tablet_service.cc:1467] Processing CreateTablet for tablet 0f048b690d764c83a4a9ce4cbadc75b0 (DEFAULT_TABLE table=default.Table_dc83172ee2e44eccab63bccfa35523fe [id=19ea42a81c4f471592628b27a3404c4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.422366 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 83631b421a614796bdf76335f1437e00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:20.423897 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72209a805e3e4b4ea1bf99508e0f75db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.427197 26729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f048b690d764c83a4a9ce4cbadc75b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.431042 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d3e78dcaa55491393f529ea33007786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.434087 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:20.442593 27223 ts_tablet_manager.cc:1905] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:20.452123 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23637a02b6464e17aa2a69ea5cc4ddfe" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:20.455540 26493 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 00c4599256684f5dbc745c9283f31a08 consensus state has no leader
I20260810 11:30:20.457505 26493 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3ccef06fa06c4c519d8760fa948d6c8b (table default.Table_abbbb80ecbe4491d98912dcdcaab5dd3 [id=ba999b4084c84b2f8e0313b96849b169]). Expected version 4 got 0
I20260810 11:30:20.458515 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_e58ae45f9ea949a2a0d7bf7f0e862647"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:20.459221 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e58ae45f9ea949a2a0d7bf7f0e862647 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:20.460894 26495 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_a5fcf59dae954757a15883ee4da1bf29" } modify_external_catalogs: true
I20260810 11:30:20.461138 26495 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_a5fcf59dae954757a15883ee4da1bf29" } modify_external_catalogs: true
I20260810 11:30:20.479652 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 1549a26ba0f6427fae87b204c5d49eff (DEFAULT_TABLE table=default.Table_f55e75edcec14683a44d60250c42dbc7 [id=4f456ea1fbfe40dc8ed31415b77d4743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.479837 27231 tablet_bootstrap.cc:492] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:20.480116 27231 ts_tablet_manager.cc:1397] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.168s user 0.004s sys 0.000s
I20260810 11:30:20.480238 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1549a26ba0f6427fae87b204c5d49eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.480950 26878 tablet_service.cc:1467] Processing CreateTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 (DEFAULT_TABLE table=default.Table_54efd7f2894348cf9dbf82586d44b6b5 [id=3b60ed35e72d41b58f176184a08303ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.481564 26882 tablet_service.cc:1467] Processing CreateTablet for tablet 932ac2ae54324e6e830291ed449a31a8 (DEFAULT_TABLE table=default.Table_168dc06875d64f40830cac1440688bd0 [id=167c03593b73416ab0f9607c87937a60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.482713 26883 tablet_service.cc:1467] Processing CreateTablet for tablet e25557126afd4f51a31fba73cd7da219 (DEFAULT_TABLE table=default.Table_4857a0fc183c421382b9b70094d76ac3 [id=eb184bc24462433e89048f962a639600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.484720 26879 tablet_service.cc:1467] Processing CreateTablet for tablet 3a1e46f80f7f4e3a84638421892e6236 (DEFAULT_TABLE table=default.Table_49be430f1e8f475482b54850772c0430 [id=82e113439bc04ce9955f59612ba480dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.486088 26877 tablet_service.cc:1467] Processing CreateTablet for tablet e69916a35fba4714bbc565921738888f (DEFAULT_TABLE table=default.Table_c40dd8e327db40b59167de093a5c616d [id=10ebb746a2b343b08b5b13d1107a7cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.486234 27231 raft_consensus.cc:348] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:20.486574 27231 raft_consensus.cc:374] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:20.486666 27231 raft_consensus.cc:729] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:20.487139 26890 tablet_service.cc:1467] Processing CreateTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 (DEFAULT_TABLE table=default.Table_2c4f303b1d1c47c9a4c089efccdd1d37 [id=fe5337909463467788d24d76e379cb48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.488891 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ae27bf110114b70a3e3f6cf64f31b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.491021 26882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 932ac2ae54324e6e830291ed449a31a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.490427 27231 consensus_queue.cc:260] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:20.493561 27231 ts_tablet_manager.cc:1428] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260810 11:30:20.494367 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d (DEFAULT_TABLE table=default.Table_94097f0758264fc986fbe731111c6851 [id=223e521d377e4209943be22f5ab4b422]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.494856 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8228600e3f6b4f9993dd25e4ceb57e4d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:20.496240 26491 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 39beb126ac324842b7e387c46bcb4099 consensus state has no leader
I20260810 11:30:20.496295 26877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e69916a35fba4714bbc565921738888f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.496829 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5ffe87ce66134f859f413c9a6ec537b5" } modify_external_catalogs: true
I20260810 11:30:20.497241 26492 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_146776d44301462096eb098adde86d0e" } new_table_name: "default.Table_50f879f623d840fb9433e7ba8380272e" modify_external_catalogs: true
I20260810 11:30:20.497638 26501 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5318e36611c342278e64da2f02be8a08" } modify_external_catalogs: true
I20260810 11:30:20.497897 26501 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5318e36611c342278e64da2f02be8a08" } modify_external_catalogs: true
I20260810 11:30:20.498636 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_5ffe87ce66134f859f413c9a6ec537b5" } modify_external_catalogs: true
I20260810 11:30:20.500751 26890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d000f0ebaf0049a7bdaad93e307e16e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.502319 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25557126afd4f51a31fba73cd7da219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.503473 26879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a1e46f80f7f4e3a84638421892e6236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.515950 27231 tablet_bootstrap.cc:492] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:20.517385 27035 tablet_service.cc:1467] Processing CreateTablet for tablet 1549a26ba0f6427fae87b204c5d49eff (DEFAULT_TABLE table=default.Table_f55e75edcec14683a44d60250c42dbc7 [id=4f456ea1fbfe40dc8ed31415b77d4743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.519826 27023 tablet_service.cc:1467] Processing CreateTablet for tablet e25557126afd4f51a31fba73cd7da219 (DEFAULT_TABLE table=default.Table_4857a0fc183c421382b9b70094d76ac3 [id=eb184bc24462433e89048f962a639600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.521374 27038 tablet_service.cc:1467] Processing CreateTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d (DEFAULT_TABLE table=default.Table_94097f0758264fc986fbe731111c6851 [id=223e521d377e4209943be22f5ab4b422]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.522158 27024 tablet_service.cc:1467] Processing CreateTablet for tablet 932ac2ae54324e6e830291ed449a31a8 (DEFAULT_TABLE table=default.Table_168dc06875d64f40830cac1440688bd0 [id=167c03593b73416ab0f9607c87937a60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.522835 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 3a1e46f80f7f4e3a84638421892e6236 (DEFAULT_TABLE table=default.Table_49be430f1e8f475482b54850772c0430 [id=82e113439bc04ce9955f59612ba480dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.523368 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1549a26ba0f6427fae87b204c5d49eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.529516 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a1e46f80f7f4e3a84638421892e6236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.532495 27027 tablet_service.cc:1467] Processing CreateTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 (DEFAULT_TABLE table=default.Table_2c4f303b1d1c47c9a4c089efccdd1d37 [id=fe5337909463467788d24d76e379cb48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.533061 27026 tablet_service.cc:1467] Processing CreateTablet for tablet 2b95f3ec8ff34c89a68cd1edf8391f9b (DEFAULT_TABLE table=default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.536702 27027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d000f0ebaf0049a7bdaad93e307e16e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.538333 26498 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3ccef06fa06c4c519d8760fa948d6c8b (table default.Table_abbbb80ecbe4491d98912dcdcaab5dd3 [id=ba999b4084c84b2f8e0313b96849b169]). Expected version 4 got 0
I20260810 11:30:20.541350 26498 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47672:
name: "default.Table_67580ad3fe7a47d6a051e7da7005c171"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:20.542172 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8228600e3f6b4f9993dd25e4ceb57e4d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:20.542454 26498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67580ad3fe7a47d6a051e7da7005c171 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:20.545651 27024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 932ac2ae54324e6e830291ed449a31a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.492831 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 2b95f3ec8ff34c89a68cd1edf8391f9b (DEFAULT_TABLE table=default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.565223 26499 master_service.cc:946] ReplaceTablet: received request to replace tablet 6e829d4bffeb4289a54b4d3d7a53c44e from {username='slave'} at 127.0.0.1:47672
W20260810 11:30:20.580845 27539 log.cc:924] Time spent T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Append to log took a long time: real 0.204s user 0.000s sys 0.001s
I20260810 11:30:20.590209 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 1549a26ba0f6427fae87b204c5d49eff (DEFAULT_TABLE table=default.Table_f55e75edcec14683a44d60250c42dbc7 [id=4f456ea1fbfe40dc8ed31415b77d4743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.590824 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1549a26ba0f6427fae87b204c5d49eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.591476 26736 tablet_service.cc:1467] Processing CreateTablet for tablet e25557126afd4f51a31fba73cd7da219 (DEFAULT_TABLE table=default.Table_4857a0fc183c421382b9b70094d76ac3 [id=eb184bc24462433e89048f962a639600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.591882 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25557126afd4f51a31fba73cd7da219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.593006 26740 tablet_service.cc:1467] Processing CreateTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d (DEFAULT_TABLE table=default.Table_94097f0758264fc986fbe731111c6851 [id=223e521d377e4209943be22f5ab4b422]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.592963 26733 tablet_service.cc:1467] Processing CreateTablet for tablet 3a1e46f80f7f4e3a84638421892e6236 (DEFAULT_TABLE table=default.Table_49be430f1e8f475482b54850772c0430 [id=82e113439bc04ce9955f59612ba480dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.593475 26733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a1e46f80f7f4e3a84638421892e6236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.593484 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 932ac2ae54324e6e830291ed449a31a8 (DEFAULT_TABLE table=default.Table_168dc06875d64f40830cac1440688bd0 [id=167c03593b73416ab0f9607c87937a60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.597414 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b95f3ec8ff34c89a68cd1edf8391f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.600188 27587 raft_consensus.cc:482] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:20.600425 27587 raft_consensus.cc:504] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:20.601121 26383 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu pid 26465
I20260810 11:30:20.601715 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25557126afd4f51a31fba73cd7da219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.602041 27026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b95f3ec8ff34c89a68cd1edf8391f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.603062 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 (DEFAULT_TABLE table=default.Table_54efd7f2894348cf9dbf82586d44b6b5 [id=3b60ed35e72d41b58f176184a08303ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.606796 26497 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47672:
table { table_name: "default.Table_7157cb4b94764bf6ab05e84468872791" } new_table_name: "default.Table_a23328d9f82f426fa2993d07f5909694" modify_external_catalogs: true
I20260810 11:30:20.610688 26534 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 11:30:20.604513 27587 leader_election.cc:288] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:20.615200 27228 tablet_bootstrap.cc:492] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:20.626308 27025 tablet_service.cc:1467] Processing CreateTablet for tablet e69916a35fba4714bbc565921738888f (DEFAULT_TABLE table=default.Table_c40dd8e327db40b59167de093a5c616d [id=10ebb746a2b343b08b5b13d1107a7cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.627143 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fc76603bf8843dab18c95fdab9a8be0" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:20.627471 27060 raft_consensus.cc:2454] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:20.627995 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ae27bf110114b70a3e3f6cf64f31b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.629803 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e69916a35fba4714bbc565921738888f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.632901 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 932ac2ae54324e6e830291ed449a31a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.634140 26735 tablet_service.cc:1467] Processing CreateTablet for tablet 2b95f3ec8ff34c89a68cd1edf8391f9b (DEFAULT_TABLE table=default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.635555 27231 tablet_bootstrap.cc:654] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:20.636344 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8228600e3f6b4f9993dd25e4ceb57e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.663897 27228 ts_tablet_manager.cc:1397] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.839s user 0.015s sys 0.031s
I20260810 11:30:20.665073 27228 raft_consensus.cc:348] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:20.669950 27228 raft_consensus.cc:374] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:20.670130 27228 raft_consensus.cc:729] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:20.674682 26848 leader_election.cc:302] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
W20260810 11:30:20.697105 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 57107.5us
W20260810 11:30:20.697386 26849 leader_election.cc:341] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 2fc76603bf8843dab18c95fdab9a8be0
W20260810 11:30:20.697822 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 67353.1us
I20260810 11:30:20.702077 27613 raft_consensus.cc:482] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:20.702322 27613 raft_consensus.cc:504] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:20.703279 27613 leader_election.cc:288] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:20.704260 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949f31fa0c124eefbee695cfc7f50cbe" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:20.705705 26991 leader_election.cc:341] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:20.706044 26993 leader_election.cc:341] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 949f31fa0c124eefbee695cfc7f50cbe
I20260810 11:30:20.706235 26993 leader_election.cc:302] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:20.706735 27613 raft_consensus.cc:2726] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:20.711395 27222 tablet_bootstrap.cc:492] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:20.718948 27613 raft_consensus.cc:482] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:20.719276 27613 raft_consensus.cc:504] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:20.720081 27613 leader_election.cc:288] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:20.723114 26993 leader_election.cc:341] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: ec788db5b0ca40f1811b6660276d0254
I20260810 11:30:20.724704 27228 consensus_queue.cc:260] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:20.726562 27228 ts_tablet_manager.cc:1428] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.062s user 0.003s sys 0.000s
I20260810 11:30:20.736478 26742 tablet_service.cc:1467] Processing CreateTablet for tablet e69916a35fba4714bbc565921738888f (DEFAULT_TABLE table=default.Table_c40dd8e327db40b59167de093a5c616d [id=10ebb746a2b343b08b5b13d1107a7cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.736699 26748 tablet_service.cc:1467] Processing CreateTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 (DEFAULT_TABLE table=default.Table_54efd7f2894348cf9dbf82586d44b6b5 [id=3b60ed35e72d41b58f176184a08303ad]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:20.737974 26700 leader_election.cc:341] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:20.738255 26700 leader_election.cc:302] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
W20260810 11:30:20.738718 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 109150us
I20260810 11:30:20.739511 27526 raft_consensus.cc:2726] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:20.739797 27587 raft_consensus.cc:2781] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:20.742666 27587 raft_consensus.cc:482] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:20.742940 27587 raft_consensus.cc:3037] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:20.745039 26746 tablet_service.cc:1467] Processing CreateTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 (DEFAULT_TABLE table=default.Table_2c4f303b1d1c47c9a4c089efccdd1d37 [id=fe5337909463467788d24d76e379cb48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:20.746168 27221 ts_tablet_manager.cc:1918] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:20.746366 27221 log.cc:1196] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/db5adccd80a04e328e13793b461c38b1
I20260810 11:30:20.746673 27613 consensus_queue.cc:1035] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:20.746968 27221 ts_tablet_manager.cc:1939] T db5adccd80a04e328e13793b461c38b1 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:20.748205 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 281) took 2492 ms. Trace:
I20260810 11:30:20.748497 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b95f3ec8ff34c89a68cd1edf8391f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.749276 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec788db5b0ca40f1811b6660276d0254" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:20.750074 26991 leader_election.cc:341] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: Tablet not RUNNING: STOPPED
I20260810 11:30:20.750234 26991 leader_election.cc:302] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:20.750787 27222 ts_tablet_manager.cc:1397] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.935s user 0.019s sys 0.050s
I20260810 11:30:20.750806 27613 raft_consensus.cc:2726] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:20.751766 27222 raft_consensus.cc:348] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:20.750393 27221 rpcz_store.cc:276] 0810 11:30:18.256052 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.299517 (+ 43465us) service_pool.cc:227] Handling call
0810 11:30:19.886890 (+1587373us) ts_tablet_manager.cc:1145] Deleting tablet db5adccd80a04e328e13793b461c38b1
0810 11:30:19.886961 (+ 71us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:20.421185 (+534224us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:20.691036 (+269851us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:20.748149 (+ 57113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1534292}
I20260810 11:30:20.752413 27222 raft_consensus.cc:374] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:20.752658 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ae27bf110114b70a3e3f6cf64f31b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.752528 27222 raft_consensus.cc:729] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:20.754814 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 284) took 2350 ms. Trace:
I20260810 11:30:20.755362 27222 consensus_queue.cc:260] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:20.756148 27222 ts_tablet_manager.cc:1428] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260810 11:30:20.756817 27222 tablet_bootstrap.cc:492] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:20.757004 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d000f0ebaf0049a7bdaad93e307e16e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.775787 27222 tablet_bootstrap.cc:654] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:20.780148 27228 tablet_bootstrap.cc:492] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:20.792105 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e69916a35fba4714bbc565921738888f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:20.802892 27221 rpcz_store.cc:276] 0810 11:30:18.405022 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.405186 (+ 164us) service_pool.cc:227] Handling call
0810 11:30:20.754416 (+2349230us) ts_tablet_manager.cc:1145] Deleting tablet ac4b1821ac30452cbe7a8f844d9b37e5
0810 11:30:20.754431 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:20.754742 (+ 311us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2346011}
I20260810 11:30:20.811467 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 292) took 2115 ms. Trace:
I20260810 11:30:20.811762 27221 rpcz_store.cc:276] 0810 11:30:18.696339 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.696444 (+ 105us) service_pool.cc:227] Handling call
0810 11:30:20.805548 (+2109104us) ts_tablet_manager.cc:1145] Deleting tablet 4c595e0892634348b64418ae9dbbd4c2
0810 11:30:20.811246 (+ 5698us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:20.811373 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2092746}
I20260810 11:30:20.812808 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 291) took 2116 ms. Trace:
I20260810 11:30:20.813058 27221 rpcz_store.cc:276] 0810 11:30:18.696131 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.696776 (+ 645us) service_pool.cc:227] Handling call
0810 11:30:20.812146 (+2115370us) ts_tablet_manager.cc:1145] Deleting tablet 08f6636df13548c49f35e1808a87c1f5
0810 11:30:20.812158 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:20.812531 (+ 373us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2098111}
I20260810 11:30:20.813675 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 293) took 2105 ms. Trace:
I20260810 11:30:20.813982 27221 rpcz_store.cc:276] 0810 11:30:18.708255 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.708471 (+ 216us) service_pool.cc:227] Handling call
0810 11:30:20.813347 (+2104876us) ts_tablet_manager.cc:1145] Deleting tablet 4b5a7f67ec5b48c2b5a510add0282a76
0810 11:30:20.813358 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:20.813553 (+ 195us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2099075}
I20260810 11:30:20.814522 27221 tablet_replica.cc:330] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:20.814942 27221 raft_consensus.cc:2229] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:20.815162 27221 raft_consensus.cc:2258] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:20.819240 27221 ts_tablet_manager.cc:1905] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:20.849886 26991 consensus_peers.cc:487] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:20.851783 27222 tablet_bootstrap.cc:492] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:20.852116 27222 ts_tablet_manager.cc:1397] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.096s user 0.001s sys 0.011s
I20260810 11:30:20.853173 27222 raft_consensus.cc:348] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:20.853560 27222 raft_consensus.cc:374] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:20.853801 27222 raft_consensus.cc:729] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:20.854249 27222 consensus_queue.cc:260] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:20.860180 27613 raft_consensus.cc:482] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:20.860395 27613 raft_consensus.cc:504] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:20.861168 27613 leader_election.cc:288] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:20.861466 27637 log.cc:924] Time spent T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d: Append to log took a long time: real 0.053s user 0.001s sys 0.000s
W20260810 11:30:20.864374 26991 leader_election.cc:341] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 952fc4eb5e5c4d9597f4b6eee860ab3a
I20260810 11:30:20.866127 27231 tablet_bootstrap.cc:492] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:20.869066 27231 ts_tablet_manager.cc:1397] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.353s user 0.008s sys 0.002s
I20260810 11:30:20.870139 27248 ts_tablet_manager.cc:1918] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:20.870452 27248 log.cc:1196] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/fc2d129e99f24c018e4f8e43f211171d
I20260810 11:30:20.870612 27231 raft_consensus.cc:348] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:20.872792 27248 ts_tablet_manager.cc:1939] T fc2d129e99f24c018e4f8e43f211171d P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:20.872851 27231 raft_consensus.cc:374] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:20.873976 27231 raft_consensus.cc:729] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:20.874483 27231 consensus_queue.cc:260] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:20.889566 27228 tablet_bootstrap.cc:654] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:20.902648 27587 raft_consensus.cc:504] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:20.904310 26993 leader_election.cc:341] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 952fc4eb5e5c4d9597f4b6eee860ab3a
I20260810 11:30:20.907788 27587 leader_election.cc:288] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:20.909154 26849 leader_election.cc:341] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 2fc76603bf8843dab18c95fdab9a8be0
I20260810 11:30:20.911017 27223 ts_tablet_manager.cc:1918] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:20.911293 27223 log.cc:1196] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/ec788db5b0ca40f1811b6660276d0254
I20260810 11:30:20.896152 27222 ts_tablet_manager.cc:1428] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.044s user 0.002s sys 0.000s
I20260810 11:30:20.912184 27222 tablet_bootstrap.cc:492] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:20.912554 27223 ts_tablet_manager.cc:1939] T ec788db5b0ca40f1811b6660276d0254 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:20.915299 26876 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52560 (request call id 318) took 1023 ms. Trace:
I20260810 11:30:20.915459 26876 rpcz_store.cc:276] 0810 11:30:19.892152 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.892228 (+ 76us) service_pool.cc:227] Handling call
0810 11:30:19.897141 (+ 4913us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:19.897168 (+ 27us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:20.726386 (+829218us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:20.915092 (+188706us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:20.915259 (+ 167us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:20.915602 27640 tablet.cc:1722] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 11:30:20.920840 27222 tablet_bootstrap.cc:654] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:20.934137 27228 tablet_bootstrap.cc:492] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:20.934387 27228 ts_tablet_manager.cc:1397] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.170s user 0.004s sys 0.003s
I20260810 11:30:20.934641 26993 leader_election.cc:302] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:20.936259 27222 tablet_bootstrap.cc:492] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:20.936784 27222 ts_tablet_manager.cc:1397] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.004s
I20260810 11:30:20.936522 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fc76603bf8843dab18c95fdab9a8be0" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:20.936365 27228 raft_consensus.cc:348] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:20.937413 27228 raft_consensus.cc:374] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:20.937484 27060 raft_consensus.cc:3037] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:20.937562 27228 raft_consensus.cc:729] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:20.937850 27228 consensus_queue.cc:260] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:20.936975 27644 tablet.cc:1722] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 11:30:20.936805 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 206) took 4362 ms. Trace:
I20260810 11:30:20.937062 27613 raft_consensus.cc:2726] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:20.944378 27228 ts_tablet_manager.cc:1428] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260810 11:30:20.950824 27228 tablet_bootstrap.cc:492] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:20.949276 27222 raft_consensus.cc:348] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:20.951496 27222 raft_consensus.cc:374] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:20.952211 27222 raft_consensus.cc:729] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:20.954038 27228 tablet_bootstrap.cc:654] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:20.955325 27231 ts_tablet_manager.cc:1428] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.086s user 0.006s sys 0.005s
I20260810 11:30:20.955957 27231 tablet_bootstrap.cc:492] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:20.955070 27248 rpcz_store.cc:276] 0810 11:30:16.573044 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.600319 (+ 27275us) service_pool.cc:227] Handling call
0810 11:30:20.372219 (+3771900us) ts_tablet_manager.cc:1145] Deleting tablet fc2d129e99f24c018e4f8e43f211171d
0810 11:30:20.372236 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:20.701681 (+329445us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:20.866647 (+164966us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:20.935237 (+ 68590us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3771579}
I20260810 11:30:20.959333 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 209) took 4372 ms. Trace:
I20260810 11:30:20.959858 27248 rpcz_store.cc:276] 0810 11:30:16.587055 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.614670 (+ 27615us) service_pool.cc:227] Handling call
0810 11:30:20.959048 (+4344378us) ts_tablet_manager.cc:1145] Deleting tablet 0938a2f3688246a2b46978eeb7d5d521
0810 11:30:20.959067 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:20.959225 (+ 158us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4342846}
I20260810 11:30:20.961367 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 210) took 4135 ms. Trace:
I20260810 11:30:20.962266 27248 rpcz_store.cc:276] 0810 11:30:16.826273 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.826439 (+ 166us) service_pool.cc:227] Handling call
0810 11:30:20.961041 (+4134602us) ts_tablet_manager.cc:1145] Deleting tablet 834c9c99ec424bb39e8a003e9204b2bc
0810 11:30:20.961054 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:20.961264 (+ 210us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4115706}
I20260810 11:30:20.954505 27222 consensus_queue.cc:260] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:20.965685 27222 ts_tablet_manager.cc:1428] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.028s user 0.000s sys 0.005s
I20260810 11:30:20.966964 27222 tablet_bootstrap.cc:492] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:20.978577 27222 tablet_bootstrap.cc:654] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:20.993050 26486 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 65756c37fe514194bebe76921419653c consensus state has no leader
I20260810 11:30:21.004218 26485 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet fc2d129e99f24c018e4f8e43f211171d (table default.Table_38150fc48b7148a8bc17eb85f039d7b3 [id=b54ba03677734f2da90a534a0f5ff58e]) successfully deleted
W20260810 11:30:21.004616 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 0938a2f3688246a2b46978eeb7d5d521 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0938a2f3688246a2b46978eeb7d5d521 already in progress: creating tablet
I20260810 11:30:21.004629 27221 ts_tablet_manager.cc:1918] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:21.004837 27221 log.cc:1196] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/7bd67ebf23694ae7b0ede6c5d1a06f88
W20260810 11:30:21.004896 26485 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 834c9c99ec424bb39e8a003e9204b2bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 834c9c99ec424bb39e8a003e9204b2bc already in progress: creating tablet
I20260810 11:30:21.005316 27221 ts_tablet_manager.cc:1939] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:21.005709 27060 raft_consensus.cc:2454] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:21.010063 26848 leader_election.cc:302] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:21.013523 27526 raft_consensus.cc:482] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.013815 27526 raft_consensus.cc:504] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.014631 27526 leader_election.cc:288] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:21.017804 26496 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 8228600e3f6b4f9993dd25e4ceb57e4d
I20260810 11:30:21.018498 26496 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:47672 (request call id 501) took 1095 ms. Trace:
I20260810 11:30:21.031673 26486 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet db5adccd80a04e328e13793b461c38b1 (table default.Table_baaf705869df4c36a233bb967b25455a [id=f325caa441054ab180909b9af9de3ba6]) successfully deleted
W20260810 11:30:21.032804 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ac4b1821ac30452cbe7a8f844d9b37e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac4b1821ac30452cbe7a8f844d9b37e5 already in progress: creating tablet
W20260810 11:30:21.033290 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 4c595e0892634348b64418ae9dbbd4c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c595e0892634348b64418ae9dbbd4c2 already in progress: creating tablet
I20260810 11:30:21.033435 26500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet f6e264e8507446809f3c386fdb3c34ae
W20260810 11:30:21.033696 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 08f6636df13548c49f35e1808a87c1f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08f6636df13548c49f35e1808a87c1f5 already in progress: creating tablet
I20260810 11:30:21.034478 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:21.034317 26500 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:47672 (request call id 502) took 1096 ms. Trace:
I20260810 11:30:21.038619 27587 raft_consensus.cc:2781] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:21.038525 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31888ddeafe14738b818016a9c0a4ad3" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:21.040393 26501 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 1aa4562a2247405187d9dbd1baa48f39
I20260810 11:30:21.041627 27228 tablet_bootstrap.cc:492] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:21.042485 27228 ts_tablet_manager.cc:1397] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.092s user 0.006s sys 0.003s
I20260810 11:30:21.044178 26495 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Sending DeleteTablet for 3 replicas of tablet 603fe104b7ab485eab6b225a58bddc1c
I20260810 11:30:21.046420 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet f6e264e8507446809f3c386fdb3c34ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:52560
W20260810 11:30:21.047019 26700 leader_election.cc:341] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:21.047780 27587 raft_consensus.cc:686] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:21.047848 27640 tablet.cc:1717] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700: Skipping requested alter to schema version 4, tablet already version 4
I20260810 11:30:21.048213 27587 consensus_queue.cc:237] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.048707 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 260) took 2760 ms. Trace:
I20260810 11:30:21.048854 27223 rpcz_store.cc:276] 0810 11:30:18.287575 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.287617 (+ 42us) service_pool.cc:227] Handling call
0810 11:30:20.387863 (+2100246us) ts_tablet_manager.cc:1145] Deleting tablet ec788db5b0ca40f1811b6660276d0254
0810 11:30:20.387885 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:20.719383 (+331498us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:20.910856 (+191473us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.048393 (+137537us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2965,"tablet-delete.queue_time_us":2057184}
I20260810 11:30:21.049712 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 261) took 2716 ms. Trace:
I20260810 11:30:21.049947 27223 rpcz_store.cc:276] 0810 11:30:18.333504 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.333633 (+ 129us) service_pool.cc:227] Handling call
0810 11:30:21.049272 (+2715639us) ts_tablet_manager.cc:1145] Deleting tablet ff9b649e43a9456fa51cf3330290bb91
0810 11:30:21.049286 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.049552 (+ 266us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2715303}
I20260810 11:30:21.050436 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 262) took 2710 ms. Trace:
I20260810 11:30:21.050580 27223 rpcz_store.cc:276] 0810 11:30:18.339739 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.339848 (+ 109us) service_pool.cc:227] Handling call
0810 11:30:21.050232 (+2710384us) ts_tablet_manager.cc:1145] Deleting tablet f2b555f18c1e485d9af7b08f98543c80
0810 11:30:21.050244 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.050371 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2687426}
I20260810 11:30:21.037932 26500 rpcz_store.cc:276] 0810 11:30:19.937560 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:20.359271 (+421711us) service_pool.cc:227] Handling call
0810 11:30:20.373340 (+ 14069us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x615000033024. stack: 00007ff5bee8266e 00007ff5bee82430 00007ff5bdf095ed 00000000008ea064 00000000008ea02d 00007ff5cd59b27d 00007ff5cd59b373 00007ff5ca3bd361 00007ff5d1d3066a 00007ff5d1eb92e6 00007ff5c91ac126 00007ff5c91abe55 00007ff5c59be9be 00007ff5c59bd79e 00007ff5c59c3b25 00007ff5c59c454f
0810 11:30:20.373992 (+ 652us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:20.374158 (+ 166us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:20.374245 (+ 87us) catalog_manager.cc:2761] Locking tablets
0810 11:30:20.468046 (+ 93801us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:21.033139 (+565093us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:21.033260 (+ 121us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:21.033322 (+ 62us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:21.034258 (+ 936us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:20.510914 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:20.511025 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:20.511336 (+ 311us) write_op.cc:435] Acquired schema lock
0810 11:30:20.511339 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:20.511478 (+ 139us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:20.511491 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:20.511496 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:20.511619 (+ 123us) tablet.cc:699] Row locks acquired
0810 11:30:20.511622 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:20.511667 (+ 45us) write_op.cc:270] Start()
0810 11:30:20.511709 (+ 42us) write_op.cc:276] Timestamp: P: 1786361420511611 usec, L: 0
0810 11:30:20.511713 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:20.512013 (+ 300us) log.cc:842] Serialized 734 byte log entry
0810 11:30:21.031222 (+519209us) op_driver.cc:444] REPLICATION: finished
0810 11:30:21.031411 (+ 189us) write_op.cc:301] APPLY: starting
0810 11:30:21.031432 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:21.031532 (+ 100us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:21.031598 (+ 66us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:21.031732 (+ 134us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:21.031800 (+ 68us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:21.031807 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:21.032402 (+ 595us) log.cc:842] Serialized 29 byte log entry
0810 11:30:21.032716 (+ 314us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:21.032896 (+ 180us) write_op.cc:454] Released schema lock
0810 11:30:21.032906 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:21.032980 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:21.032984 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":31553408,"child_traces":[["op",{"apply.queue_time_us":70,"apply.run_cpu_time_us":864,"apply.run_wall_time_us":4839,"num_ops":2,"prepare.queue_time_us":38091,"prepare.run_cpu_time_us":1433,"prepare.run_wall_time_us":6369,"replication_time_us":519470}]]}
I20260810 11:30:21.052814 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:21.053085 26890 tablet_service.cc:1514] Processing DeleteTablet for tablet 603fe104b7ab485eab6b225a58bddc1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:52560
I20260810 11:30:21.053349 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 263) took 2650 ms. Trace:
I20260810 11:30:21.053485 27223 rpcz_store.cc:276] 0810 11:30:18.402188 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.418473 (+ 16285us) service_pool.cc:227] Handling call
0810 11:30:21.050946 (+2632473us) ts_tablet_manager.cc:1145] Deleting tablet ac4b1821ac30452cbe7a8f844d9b37e5
0810 11:30:21.050956 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.052325 (+ 1369us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2612475}
I20260810 11:30:21.053910 27640 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:52560 (request call id 324) took 1065 ms. Trace:
I20260810 11:30:21.054087 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 270) took 2358 ms. Trace:
I20260810 11:30:21.054291 27223 rpcz_store.cc:276] 0810 11:30:18.695340 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.695844 (+ 504us) service_pool.cc:227] Handling call
0810 11:30:21.053862 (+2358018us) ts_tablet_manager.cc:1145] Deleting tablet 08f6636df13548c49f35e1808a87c1f5
0810 11:30:21.053877 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.053994 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2309218}
I20260810 11:30:21.054504 26484 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet ec788db5b0ca40f1811b6660276d0254 (table default.Table_b400d58717834fafa8a580a57cd0e325 [id=9d4e514d06c54ffc8db5d4b3e3ec65c9]) successfully deleted
I20260810 11:30:21.054806 27223 tablet_replica.cc:330] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
W20260810 11:30:21.054911 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ff9b649e43a9456fa51cf3330290bb91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff9b649e43a9456fa51cf3330290bb91 already in progress: creating tablet
I20260810 11:30:21.055110 27223 raft_consensus.cc:2229] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:21.055189 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet f2b555f18c1e485d9af7b08f98543c80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2b555f18c1e485d9af7b08f98543c80 already in progress: creating tablet
W20260810 11:30:21.055418 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ac4b1821ac30452cbe7a8f844d9b37e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac4b1821ac30452cbe7a8f844d9b37e5 already in progress: creating tablet
I20260810 11:30:21.055389 27223 raft_consensus.cc:2258] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:21.055737 26484 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 08f6636df13548c49f35e1808a87c1f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08f6636df13548c49f35e1808a87c1f5 already in progress: creating tablet
I20260810 11:30:21.054119 27640 rpcz_store.cc:276] 0810 11:30:19.985243 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:20.189412 (+204169us) service_pool.cc:227] Handling call
0810 11:30:21.048317 (+858905us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:20.659830 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0810 11:30:20.659998 (+ 168us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 11:30:21.005479 (+345481us) alter_schema_op.cc:65] Acquired schema lock
0810 11:30:21.005494 (+ 15us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0810 11:30:21.005555 (+ 61us) alter_schema_op.cc:126] START. Timestamp: 1786361421005459
0810 11:30:21.005561 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:21.005855 (+ 294us) log.cc:842] Serialized 173 byte log entry
0810 11:30:21.032858 (+ 27003us) op_driver.cc:444] REPLICATION: finished
0810 11:30:21.047489 (+ 14631us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0810 11:30:21.048175 (+ 686us) log.cc:842] Serialized 94 byte log entry
0810 11:30:21.048231 (+ 56us) alter_schema_op.cc:71] Released schema lock
0810 11:30:21.048234 (+ 3us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":14541,"prepare.queue_time_us":287317,"prepare.run_cpu_time_us":26874,"prepare.run_wall_time_us":346169,"raft.queue_time_us":5617,"raft.run_cpu_time_us":375,"raft.run_wall_time_us":377,"replication_time_us":27267}]]}
I20260810 11:30:21.058712 27228 raft_consensus.cc:348] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.059130 27228 raft_consensus.cc:374] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.059273 27228 raft_consensus.cc:729] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.059667 27228 consensus_queue.cc:260] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.060422 27228 ts_tablet_manager.cc:1428] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
W20260810 11:30:21.060668 26486 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 4b5a7f67ec5b48c2b5a510add0282a76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b5a7f67ec5b48c2b5a510add0282a76 already in progress: creating tablet
I20260810 11:30:21.060966 27223 ts_tablet_manager.cc:1905] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:21.018652 26496 rpcz_store.cc:276] 0810 11:30:19.923135 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:20.301084 (+377949us) service_pool.cc:227] Handling call
0810 11:30:20.302355 (+ 1271us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:20.302530 (+ 175us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:20.302638 (+ 108us) catalog_manager.cc:2761] Locking tablets
0810 11:30:20.466822 (+164184us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:21.017383 (+550561us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:21.017643 (+ 260us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:21.017720 (+ 77us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:21.018418 (+ 698us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:20.508640 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:20.508739 (+ 99us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:20.508744 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:20.508746 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:20.508846 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:20.508855 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:20.508859 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:20.509006 (+ 147us) tablet.cc:699] Row locks acquired
0810 11:30:20.509008 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:20.509243 (+ 235us) write_op.cc:270] Start()
0810 11:30:20.509376 (+ 133us) write_op.cc:276] Timestamp: P: 1786361420509089 usec, L: 0
0810 11:30:20.509383 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:20.509706 (+ 323us) log.cc:842] Serialized 734 byte log entry
0810 11:30:21.014798 (+505092us) op_driver.cc:444] REPLICATION: finished
0810 11:30:21.015425 (+ 627us) write_op.cc:301] APPLY: starting
0810 11:30:21.015436 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:21.015463 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:21.015484 (+ 21us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:21.015549 (+ 65us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:21.015576 (+ 27us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:21.015581 (+ 5us) write_op.cc:312] APPLY: finished
0810 11:30:21.015627 (+ 46us) log.cc:842] Serialized 29 byte log entry
0810 11:30:21.015660 (+ 33us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:21.015671 (+ 11us) write_op.cc:454] Released schema lock
0810 11:30:21.015675 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:21.015712 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:21.015715 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":582,"apply.run_cpu_time_us":336,"apply.run_wall_time_us":338,"num_ops":2,"prepare.queue_time_us":40825,"prepare.run_cpu_time_us":1505,"prepare.run_wall_time_us":2187,"replication_time_us":505396,"threads_started":1}]]}
I20260810 11:30:21.077895 27228 tablet_bootstrap.cc:492] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:21.080947 26383 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu with pid 26465
I20260810 11:30:21.081830 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 211) took 4231 ms. Trace:
I20260810 11:30:21.082342 27248 rpcz_store.cc:276] 0810 11:30:16.845699 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:16.845878 (+ 179us) service_pool.cc:227] Handling call
0810 11:30:20.962762 (+4116884us) ts_tablet_manager.cc:1145] Deleting tablet f3884736eec74c8992b8d51b37465875
0810 11:30:20.962775 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.077111 (+114336us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4116074}
I20260810 11:30:21.082846 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 222) took 3807 ms. Trace:
I20260810 11:30:21.084843 27248 rpcz_store.cc:276] 0810 11:30:17.275165 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.275490 (+ 325us) service_pool.cc:227] Handling call
0810 11:30:21.082683 (+3807193us) ts_tablet_manager.cc:1145] Deleting tablet 3851d39aeb3142938a5ac558ab438c21
0810 11:30:21.082699 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.082817 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3800127}
I20260810 11:30:21.086045 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 221) took 3810 ms. Trace:
I20260810 11:30:21.091845 27248 rpcz_store.cc:276] 0810 11:30:17.275050 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.275518 (+ 468us) service_pool.cc:227] Handling call
0810 11:30:21.085387 (+3809869us) ts_tablet_manager.cc:1145] Deleting tablet 8798892eb4604ee8ac9c95e64dbb14e9
0810 11:30:21.085652 (+ 265us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.085985 (+ 333us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3802365}
I20260810 11:30:21.092949 27231 tablet_bootstrap.cc:654] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.093446 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:21.093992 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:21.094165 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet f6e264e8507446809f3c386fdb3c34ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:21.095602 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 294) took 2387 ms. Trace:
I20260810 11:30:21.095762 27221 rpcz_store.cc:276] 0810 11:30:18.708400 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.730757 (+ 22357us) service_pool.cc:227] Handling call
0810 11:30:20.814311 (+2083554us) ts_tablet_manager.cc:1145] Deleting tablet 7bd67ebf23694ae7b0ede6c5d1a06f88
0810 11:30:20.814324 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:20.896525 (+ 82201us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.004422 (+107897us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.095521 (+ 91099us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2079155}
I20260810 11:30:21.096395 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 295) took 2262 ms. Trace:
I20260810 11:30:21.096525 27221 rpcz_store.cc:276] 0810 11:30:18.833731 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.871355 (+ 37624us) service_pool.cc:227] Handling call
0810 11:30:21.096179 (+2224824us) ts_tablet_manager.cc:1145] Deleting tablet 420ba6e9f74c4ae5bf450f369e7fbdb3
0810 11:30:21.096195 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.096324 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2188312}
I20260810 11:30:21.096949 27221 tablet_replica.cc:330] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:21.097210 27221 raft_consensus.cc:2229] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:21.097486 27221 raft_consensus.cc:2258] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:21.097874 27228 tablet_bootstrap.cc:654] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.097834 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet 603fe104b7ab485eab6b225a58bddc1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:35790
I20260810 11:30:21.098668 27221 ts_tablet_manager.cc:1905] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:21.102443 26735 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:21.107340 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:21.107630 26735 tablet_service.cc:1514] Processing DeleteTablet for tablet f6e264e8507446809f3c386fdb3c34ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:21.107935 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet 603fe104b7ab485eab6b225a58bddc1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:39688
I20260810 11:30:21.110687 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 220) took 3835 ms. Trace:
I20260810 11:30:21.110889 27248 rpcz_store.cc:276] 0810 11:30:17.274918 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.275537 (+ 619us) service_pool.cc:227] Handling call
0810 11:30:21.092284 (+3816747us) ts_tablet_manager.cc:1145] Deleting tablet eb9394f9ca2c44de93354e23973cf902
0810 11:30:21.092300 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.110607 (+ 18307us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3808878}
I20260810 11:30:21.111425 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 219) took 3836 ms. Trace:
I20260810 11:30:21.111756 27248 rpcz_store.cc:276] 0810 11:30:17.274653 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.275600 (+ 947us) service_pool.cc:227] Handling call
0810 11:30:21.111245 (+3835645us) ts_tablet_manager.cc:1145] Deleting tablet 9311943eebaa4824bde96b4cb09f1e2c
0810 11:30:21.111260 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.111387 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3823959}
I20260810 11:30:21.112218 27248 tablet_replica.cc:330] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:21.112521 27248 raft_consensus.cc:2229] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:21.115172 27644 tablet.cc:1717] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d: Skipping requested alter to schema version 4, tablet already version 4
I20260810 11:30:21.125650 27248 raft_consensus.cc:2258] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:21.128293 27644 tablet.cc:1722] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:21.129787 27248 ts_tablet_manager.cc:1905] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:21.130714 27662 tablet.cc:1722] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:21.133013 27231 tablet_bootstrap.cc:492] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.133353 27231 ts_tablet_manager.cc:1397] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.177s user 0.010s sys 0.001s
I20260810 11:30:21.137599 27061 raft_consensus.cc:3037] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:21.140250 27228 tablet_bootstrap.cc:492] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:21.140689 27228 ts_tablet_manager.cc:1397] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.063s user 0.007s sys 0.000s
I20260810 11:30:21.142765 27228 raft_consensus.cc:348] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.143153 27228 raft_consensus.cc:374] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.143298 27228 raft_consensus.cc:729] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.143631 27228 consensus_queue.cc:260] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.144599 27228 ts_tablet_manager.cc:1428] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20260810 11:30:21.145153 27228 tablet_bootstrap.cc:492] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:21.154853 27231 raft_consensus.cc:348] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.155409 27231 raft_consensus.cc:374] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.155628 27231 raft_consensus.cc:729] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.156368 27231 consensus_queue.cc:260] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.148540 27228 tablet_bootstrap.cc:654] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:21.180073 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 165346us
I20260810 11:30:21.181177 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31888ddeafe14738b818016a9c0a4ad3" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:21.182493 26702 leader_election.cc:341] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:21.182948 26702 leader_election.cc:302] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:21.184418 27526 raft_consensus.cc:2726] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:21.194056 27231 ts_tablet_manager.cc:1428] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.061s user 0.003s sys 0.000s
I20260810 11:30:21.196798 27222 tablet_bootstrap.cc:492] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:21.197659 27222 ts_tablet_manager.cc:1397] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.231s user 0.016s sys 0.018s
I20260810 11:30:21.198715 27222 raft_consensus.cc:348] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.199134 27222 raft_consensus.cc:374] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.199286 27222 raft_consensus.cc:729] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.200032 27231 tablet_bootstrap.cc:492] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.201597 27221 ts_tablet_manager.cc:1918] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:21.201761 27221 log.cc:1196] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/3ff4e19071fc435fbae4490799325e37
I20260810 11:30:21.201719 27223 ts_tablet_manager.cc:1918] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:21.201897 27223 log.cc:1196] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/2efaf8b45a824e34b7f23037de5eec45
I20260810 11:30:21.202474 27223 ts_tablet_manager.cc:1939] T 2efaf8b45a824e34b7f23037de5eec45 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:21.202512 27221 ts_tablet_manager.cc:1939] T 3ff4e19071fc435fbae4490799325e37 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:21.203868 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 296) took 2344 ms. Trace:
I20260810 11:30:21.204038 27221 rpcz_store.cc:276] 0810 11:30:18.859284 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.895522 (+ 36238us) service_pool.cc:227] Handling call
0810 11:30:21.096847 (+2201325us) ts_tablet_manager.cc:1145] Deleting tablet 3ff4e19071fc435fbae4490799325e37
0810 11:30:21.096860 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.108779 (+ 11919us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.201425 (+ 92646us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.203802 (+ 2377us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2178827}
I20260810 11:30:21.204510 27221 tablet_replica.cc:330] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:21.204766 27221 raft_consensus.cc:2229] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:21.204968 27221 raft_consensus.cc:2258] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:21.205718 27221 ts_tablet_manager.cc:1905] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:21.206995 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 269) took 2566 ms. Trace:
I20260810 11:30:21.207222 27223 rpcz_store.cc:276] 0810 11:30:18.640094 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.648465 (+ 8371us) service_pool.cc:227] Handling call
0810 11:30:21.054640 (+2406175us) ts_tablet_manager.cc:1145] Deleting tablet 2efaf8b45a824e34b7f23037de5eec45
0810 11:30:21.054652 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.108538 (+ 53886us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.201434 (+ 92896us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.206945 (+ 5511us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2306831}
I20260810 11:30:21.207675 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 273) took 2462 ms. Trace:
I20260810 11:30:21.207780 27223 rpcz_store.cc:276] 0810 11:30:18.745173 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.745227 (+ 54us) service_pool.cc:227] Handling call
0810 11:30:21.207517 (+2462290us) ts_tablet_manager.cc:1145] Deleting tablet 7bd67ebf23694ae7b0ede6c5d1a06f88
0810 11:30:21.207529 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.207645 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2452292}
I20260810 11:30:21.208098 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 272) took 2463 ms. Trace:
I20260810 11:30:21.208202 27223 rpcz_store.cc:276] 0810 11:30:18.745036 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.745239 (+ 203us) service_pool.cc:227] Handling call
0810 11:30:21.207970 (+2462731us) ts_tablet_manager.cc:1145] Deleting tablet 4b5a7f67ec5b48c2b5a510add0282a76
0810 11:30:21.207988 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.208071 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2452520}
I20260810 11:30:21.208611 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 271) took 2463 ms. Trace:
I20260810 11:30:21.208734 27223 rpcz_store.cc:276] 0810 11:30:18.744819 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.745278 (+ 459us) service_pool.cc:227] Handling call
0810 11:30:21.208440 (+2463162us) ts_tablet_manager.cc:1145] Deleting tablet 4c595e0892634348b64418ae9dbbd4c2
0810 11:30:21.208450 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.208537 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2429132}
I20260810 11:30:21.209182 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 274) took 2379 ms. Trace:
I20260810 11:30:21.209314 27223 rpcz_store.cc:276] 0810 11:30:18.830308 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.831011 (+ 703us) service_pool.cc:227] Handling call
0810 11:30:21.208957 (+2377946us) ts_tablet_manager.cc:1145] Deleting tablet 420ba6e9f74c4ae5bf450f369e7fbdb3
0810 11:30:21.208966 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.209140 (+ 174us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2369739}
I20260810 11:30:21.211807 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 275) took 2222 ms. Trace:
I20260810 11:30:21.212085 27223 rpcz_store.cc:276] 0810 11:30:18.989207 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.989295 (+ 88us) service_pool.cc:227] Handling call
0810 11:30:21.209541 (+2220246us) ts_tablet_manager.cc:1145] Deleting tablet 10e6c41db71a4146840f06c5b7412d9c
0810 11:30:21.211643 (+ 2102us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.211761 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2211302}
I20260810 11:30:21.212505 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 276) took 2198 ms. Trace:
I20260810 11:30:21.212688 27223 rpcz_store.cc:276] 0810 11:30:19.013898 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.017503 (+ 3605us) service_pool.cc:227] Handling call
0810 11:30:21.212368 (+2194865us) ts_tablet_manager.cc:1145] Deleting tablet 2917f1ffb5214a80b19810540602df35
0810 11:30:21.212380 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.212463 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2154940}
I20260810 11:30:21.213083 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 282) took 2171 ms. Trace:
I20260810 11:30:21.213243 27223 rpcz_store.cc:276] 0810 11:30:19.041315 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.041380 (+ 65us) service_pool.cc:227] Handling call
0810 11:30:21.212943 (+2171563us) ts_tablet_manager.cc:1145] Deleting tablet cb01e54d817c4b0dbcc80f90f82923c0
0810 11:30:21.212952 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.213033 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2126513}
I20260810 11:30:21.214049 27231 tablet_bootstrap.cc:654] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.215233 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 279) took 2180 ms. Trace:
I20260810 11:30:21.215399 27223 rpcz_store.cc:276] 0810 11:30:19.034525 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.040292 (+ 5767us) service_pool.cc:227] Handling call
0810 11:30:21.213468 (+2173176us) ts_tablet_manager.cc:1145] Deleting tablet 809b5b6b65d244cd9186517e39494839
0810 11:30:21.214962 (+ 1494us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.215126 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2126923}
I20260810 11:30:21.215822 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 278) took 2185 ms. Trace:
I20260810 11:30:21.215955 27223 rpcz_store.cc:276] 0810 11:30:19.030273 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.052789 (+ 22516us) service_pool.cc:227] Handling call
0810 11:30:21.215669 (+2162880us) ts_tablet_manager.cc:1145] Deleting tablet 64818ca5827e41d99428903ddb8688d9
0810 11:30:21.215681 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.215774 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2129068}
I20260810 11:30:21.216351 27223 tablet_replica.cc:330] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:21.216619 27223 raft_consensus.cc:2229] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:21.216850 27223 raft_consensus.cc:2258] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:21.217772 27223 ts_tablet_manager.cc:1905] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:21.214748 27222 consensus_queue.cc:260] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.221382 27222 ts_tablet_manager.cc:1428] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260810 11:30:21.223374 27222 tablet_bootstrap.cc:492] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:21.225462 27222 tablet_bootstrap.cc:654] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.230650 27228 tablet_bootstrap.cc:492] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:21.230895 27228 ts_tablet_manager.cc:1397] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.086s user 0.012s sys 0.001s
I20260810 11:30:21.231810 27228 raft_consensus.cc:348] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.232091 27228 raft_consensus.cc:374] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.232188 27228 raft_consensus.cc:729] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.232465 27228 consensus_queue.cc:260] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.235255 27228 ts_tablet_manager.cc:1428] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 11:30:21.235642 27228 tablet_bootstrap.cc:492] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:21.237583 27228 tablet_bootstrap.cc:654] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.250988 27222 tablet_bootstrap.cc:492] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:21.251237 27222 ts_tablet_manager.cc:1397] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.003s
I20260810 11:30:21.251842 27231 tablet_bootstrap.cc:492] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.252005 27231 ts_tablet_manager.cc:1397] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.052s user 0.005s sys 0.000s
I20260810 11:30:21.252151 27222 raft_consensus.cc:348] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.252468 27222 raft_consensus.cc:374] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.252549 27222 raft_consensus.cc:729] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.252914 27231 raft_consensus.cc:348] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.253448 27662 tablet.cc:1722] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 11:30:21.253568 27222 consensus_queue.cc:260] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.253434 27231 raft_consensus.cc:374] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.254295 27231 raft_consensus.cc:729] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.255398 27231 consensus_queue.cc:260] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.256177 27231 ts_tablet_manager.cc:1428] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 11:30:21.256771 27231 tablet_bootstrap.cc:492] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.261224 27222 ts_tablet_manager.cc:1428] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260810 11:30:21.267349 27222 tablet_bootstrap.cc:492] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:21.270134 27222 tablet_bootstrap.cc:654] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.270385 27228 tablet_bootstrap.cc:492] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:21.270678 27228 ts_tablet_manager.cc:1397] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.000s
I20260810 11:30:21.272306 27228 raft_consensus.cc:348] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.272873 27228 raft_consensus.cc:374] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.273072 27228 raft_consensus.cc:729] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.273626 27228 consensus_queue.cc:260] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.274257 27587 raft_consensus.cc:482] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.274537 27587 raft_consensus.cc:504] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.275288 27587 leader_election.cc:288] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:21.275573 27228 ts_tablet_manager.cc:1428] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260810 11:30:21.276281 27228 tablet_bootstrap.cc:492] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:21.278463 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3c6bd6803c245b7bb3d78423de482b6" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:21.278802 27061 raft_consensus.cc:2454] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:21.278993 27231 tablet_bootstrap.cc:654] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.279924 26848 leader_election.cc:302] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
W20260810 11:30:21.280812 26849 leader_election.cc:341] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: f3c6bd6803c245b7bb3d78423de482b6
I20260810 11:30:21.283267 27587 raft_consensus.cc:2781] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:21.283470 27587 raft_consensus.cc:482] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:21.283576 27587 raft_consensus.cc:3037] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:21.286158 27228 tablet_bootstrap.cc:654] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.289546 27633 consensus_queue.cc:1035] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:21.308210 27223 ts_tablet_manager.cc:1918] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:21.308736 27223 log.cc:1196] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/256af4222bb34745ac018dd82a9c4f9b
I20260810 11:30:21.309325 27223 ts_tablet_manager.cc:1939] T 256af4222bb34745ac018dd82a9c4f9b P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:21.313683 27662 tablet.cc:1717] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215: Skipping requested alter to schema version 4, tablet already version 4
I20260810 11:30:21.315601 27248 ts_tablet_manager.cc:1918] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:21.316300 27248 log.cc:1196] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/952fc4eb5e5c4d9597f4b6eee860ab3a
I20260810 11:30:21.316994 27587 raft_consensus.cc:504] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.317427 27248 ts_tablet_manager.cc:1939] T 952fc4eb5e5c4d9597f4b6eee860ab3a P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:21.318593 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3c6bd6803c245b7bb3d78423de482b6" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:21.318861 27060 raft_consensus.cc:3037] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:21.319348 26849 leader_election.cc:341] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: f3c6bd6803c245b7bb3d78423de482b6
I20260810 11:30:21.319602 27587 leader_election.cc:288] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:21.320142 27231 tablet_bootstrap.cc:492] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.320405 27231 ts_tablet_manager.cc:1397] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.064s user 0.007s sys 0.006s
I20260810 11:30:21.320842 27641 mvcc.cc:205] Tried to move back new op lower bound from 7316936380438360064 to 7316936372110102528. Current Snapshot: MvccSnapshot[applied={T|T < 7316936380438360064}]
I20260810 11:30:21.321571 27231 raft_consensus.cc:348] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.321947 27231 raft_consensus.cc:374] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.322062 27231 raft_consensus.cc:729] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.322510 27231 consensus_queue.cc:260] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.323365 27231 ts_tablet_manager.cc:1428] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 11:30:21.323561 27222 tablet_bootstrap.cc:492] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:21.323828 27222 ts_tablet_manager.cc:1397] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.057s user 0.005s sys 0.003s
I20260810 11:30:21.323985 27231 tablet_bootstrap.cc:492] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.324921 27222 raft_consensus.cc:348] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.325295 27222 raft_consensus.cc:374] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.325457 27222 raft_consensus.cc:729] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.325796 27222 consensus_queue.cc:260] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.326634 27231 tablet_bootstrap.cc:654] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.335573 27222 ts_tablet_manager.cc:1428] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260810 11:30:21.338948 27526 raft_consensus.cc:482] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.339166 27526 raft_consensus.cc:504] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.339869 27526 leader_election.cc:288] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:21.341404 27228 tablet_bootstrap.cc:492] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:21.341391 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2917f1ffb5214a80b19810540602df35" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:21.341624 27228 ts_tablet_manager.cc:1397] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.066s user 0.018s sys 0.019s
I20260810 11:30:21.342195 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2917f1ffb5214a80b19810540602df35" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:21.342934 26700 leader_election.cc:341] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:21.342993 27228 raft_consensus.cc:348] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.343376 27228 raft_consensus.cc:374] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.343456 27228 raft_consensus.cc:729] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
W20260810 11:30:21.343444 26702 leader_election.cc:341] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:21.343562 26702 leader_election.cc:302] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:21.343709 27228 consensus_queue.cc:260] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.344336 27228 ts_tablet_manager.cc:1428] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260810 11:30:21.344854 27526 raft_consensus.cc:2726] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:21.345187 27228 tablet_bootstrap.cc:492] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:21.347978 27231 tablet_bootstrap.cc:492] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.348173 27231 ts_tablet_manager.cc:1397] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260810 11:30:21.349202 27231 raft_consensus.cc:348] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.349488 27231 raft_consensus.cc:374] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.349606 27231 raft_consensus.cc:729] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.349862 27231 consensus_queue.cc:260] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.350545 27231 ts_tablet_manager.cc:1428] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 11:30:21.350872 27231 tablet_bootstrap.cc:492] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
W20260810 11:30:21.358597 26849 consensus_peers.cc:487] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 79953795f07845aba3f028741cdcdd9e. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:21.362022 27228 tablet_bootstrap.cc:654] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.363394 27231 tablet_bootstrap.cc:654] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.367621 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 284) took 2267 ms. Trace:
I20260810 11:30:21.367813 27223 rpcz_store.cc:276] 0810 11:30:19.100456 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.100520 (+ 64us) service_pool.cc:227] Handling call
0810 11:30:21.216275 (+2115755us) ts_tablet_manager.cc:1145] Deleting tablet 256af4222bb34745ac018dd82a9c4f9b
0810 11:30:21.216285 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.304203 (+ 87918us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.308029 (+ 3826us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.367519 (+ 59490us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2115319}
I20260810 11:30:21.368377 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 277) took 2343 ms. Trace:
I20260810 11:30:21.368476 27223 rpcz_store.cc:276] 0810 11:30:19.025093 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.026369 (+ 1276us) service_pool.cc:227] Handling call
0810 11:30:21.368163 (+2341794us) ts_tablet_manager.cc:1145] Deleting tablet 809b5b6b65d244cd9186517e39494839
0810 11:30:21.368173 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.368316 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2252646}
I20260810 11:30:21.370286 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 287) took 2163 ms. Trace:
I20260810 11:30:21.371330 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 223) took 4085 ms. Trace:
I20260810 11:30:21.371447 27248 rpcz_store.cc:276] 0810 11:30:17.285981 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.287420 (+ 1439us) service_pool.cc:227] Handling call
0810 11:30:21.112102 (+3824682us) ts_tablet_manager.cc:1145] Deleting tablet 952fc4eb5e5c4d9597f4b6eee860ab3a
0810 11:30:21.112115 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.304191 (+192076us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.315429 (+ 11238us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.371262 (+ 55833us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3823043}
I20260810 11:30:21.371973 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 218) took 4098 ms. Trace:
I20260810 11:30:21.372072 27248 rpcz_store.cc:276] 0810 11:30:17.274107 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.275564 (+ 1457us) service_pool.cc:227] Handling call
0810 11:30:21.371813 (+4096249us) ts_tablet_manager.cc:1145] Deleting tablet 60d56e162b4b41e2867ac845e524aca4
0810 11:30:21.371824 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.371922 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4080434}
I20260810 11:30:21.372329 27248 tablet_replica.cc:330] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:21.372540 27248 raft_consensus.cc:2229] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:21.372877 27248 raft_consensus.cc:2258] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:21.370399 27223 rpcz_store.cc:276] 0810 11:30:19.206953 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.207344 (+ 391us) service_pool.cc:227] Handling call
0810 11:30:21.369926 (+2162582us) ts_tablet_manager.cc:1145] Deleting tablet 91b6078efadf496fb252f725bdf56b02
0810 11:30:21.369938 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.370226 (+ 288us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2161396}
I20260810 11:30:21.373394 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 291) took 2075 ms. Trace:
I20260810 11:30:21.373513 27223 rpcz_store.cc:276] 0810 11:30:19.298011 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.298119 (+ 108us) service_pool.cc:227] Handling call
0810 11:30:21.373150 (+2075031us) ts_tablet_manager.cc:1145] Deleting tablet a8a65a0e8b1f4e4b8d9a82059b766cda
0810 11:30:21.373161 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.373285 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2058502}
I20260810 11:30:21.373864 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 296) took 1966 ms. Trace:
I20260810 11:30:21.373951 27223 rpcz_store.cc:276] 0810 11:30:19.407496 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.407582 (+ 86us) service_pool.cc:227] Handling call
0810 11:30:21.373725 (+1966143us) ts_tablet_manager.cc:1145] Deleting tablet 44d5e146eeec4fe0be33c1c169d32e68
0810 11:30:21.373735 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.373809 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1965726}
I20260810 11:30:21.373991 27248 ts_tablet_manager.cc:1905] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:21.374254 27223 tablet_replica.cc:330] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:21.374461 27223 raft_consensus.cc:2229] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:21.375025 27223 raft_consensus.cc:2258] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:21.377876 27223 ts_tablet_manager.cc:1905] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:21.379365 27290 connection.cc:535] server connection from 127.0.0.1:49114 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 11:30:21.379558 26566 connection.cc:535] server connection from 127.0.0.1:51222 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 11:30:21.380353 27120 connection.cc:535] client connection to 127.25.195.253:34547 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 11:30:21.381171 27120 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.25.195.253:34547)
W20260810 11:30:21.381835 27120 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.25.195.253:34547)
W20260810 11:30:21.382341 27120 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.25.195.253:34547)
I20260810 11:30:21.383445 27231 tablet_bootstrap.cc:492] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
W20260810 11:30:21.383505 27120 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.25.195.253:34547)
I20260810 11:30:21.383689 27231 ts_tablet_manager.cc:1397] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.004s
W20260810 11:30:21.385033 26700 connection.cc:535] server connection from 127.0.0.1:39688 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 11:30:21.387966 26994 connection.cc:535] server connection from 127.0.0.1:35790 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 11:30:21.389273 27231 raft_consensus.cc:348] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.395455 27231 raft_consensus.cc:374] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.395851 27231 raft_consensus.cc:729] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.396754 27231 consensus_queue.cc:260] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.400228 27231 ts_tablet_manager.cc:1428] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.016s user 0.001s sys 0.005s
I20260810 11:30:21.401806 27231 tablet_bootstrap.cc:492] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.404003 27060 raft_consensus.cc:2454] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:21.412245 27221 ts_tablet_manager.cc:1918] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:21.412458 27221 log.cc:1196] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/96cae4eb16c84410926a317af70e44f7
I20260810 11:30:21.413389 27221 ts_tablet_manager.cc:1939] T 96cae4eb16c84410926a317af70e44f7 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:21.414851 27231 tablet_bootstrap.cc:654] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.426712 27222 tablet_bootstrap.cc:492] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:21.387619 26850 connection.cc:535] server connection from 127.0.0.1:52560 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 11:30:21.404796 26848 leader_election.cc:302] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:21.433105 27609 raft_consensus.cc:2781] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:21.433295 27609 raft_consensus.cc:686] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:21.433626 27609 consensus_queue.cc:237] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.449186 27222 tablet_bootstrap.cc:654] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.450479 27231 tablet_bootstrap.cc:492] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.450870 27231 ts_tablet_manager.cc:1397] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.049s user 0.010s sys 0.006s
I20260810 11:30:21.452296 27231 raft_consensus.cc:348] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.452845 27231 raft_consensus.cc:374] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.453044 27231 raft_consensus.cc:729] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.453447 27231 consensus_queue.cc:260] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.454464 27231 ts_tablet_manager.cc:1428] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:21.454958 27231 tablet_bootstrap.cc:492] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.464092 27222 tablet_bootstrap.cc:492] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:21.464423 27222 ts_tablet_manager.cc:1397] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.004s
I20260810 11:30:21.465260 27231 tablet_bootstrap.cc:654] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.465600 27222 raft_consensus.cc:348] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.465891 27222 raft_consensus.cc:374] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.465972 27222 raft_consensus.cc:729] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.466274 27222 consensus_queue.cc:260] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.482144 27231 tablet_bootstrap.cc:492] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.482548 27231 ts_tablet_manager.cc:1397] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.028s user 0.008s sys 0.000s
I20260810 11:30:21.483829 27231 raft_consensus.cc:348] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.485670 27231 raft_consensus.cc:374] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.486637 27231 raft_consensus.cc:729] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.487458 27231 consensus_queue.cc:260] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.488816 27231 ts_tablet_manager.cc:1428] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.006s user 0.002s sys 0.002s
I20260810 11:30:21.489553 27231 tablet_bootstrap.cc:492] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.493036 27231 tablet_bootstrap.cc:654] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.500355 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 298) took 2519 ms. Trace:
I20260810 11:30:21.500500 27221 rpcz_store.cc:276] 0810 11:30:18.981071 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.981636 (+ 565us) service_pool.cc:227] Handling call
0810 11:30:21.204421 (+2222785us) ts_tablet_manager.cc:1145] Deleting tablet 96cae4eb16c84410926a317af70e44f7
0810 11:30:21.204436 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.312354 (+107918us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.412072 (+ 99718us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.500285 (+ 88213us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2222322}
I20260810 11:30:21.501003 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 299) took 2512 ms. Trace:
I20260810 11:30:21.501092 27221 rpcz_store.cc:276] 0810 11:30:18.988625 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.988705 (+ 80us) service_pool.cc:227] Handling call
0810 11:30:21.500821 (+2512116us) ts_tablet_manager.cc:1145] Deleting tablet 10e6c41db71a4146840f06c5b7412d9c
0810 11:30:21.500834 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.500954 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2511801}
I20260810 11:30:21.508049 27248 ts_tablet_manager.cc:1918] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:21.508247 27248 log.cc:1196] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/79953795f07845aba3f028741cdcdd9e
I20260810 11:30:21.508899 27248 ts_tablet_manager.cc:1939] T 79953795f07845aba3f028741cdcdd9e P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:21.510025 27221 tablet_replica.cc:330] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:21.510316 27221 raft_consensus.cc:2229] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:21.510545 27221 raft_consensus.cc:2258] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:21.511286 27221 ts_tablet_manager.cc:1905] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:21.499435 27222 ts_tablet_manager.cc:1428] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.035s user 0.002s sys 0.000s
I20260810 11:30:21.519001 27231 tablet_bootstrap.cc:492] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.519287 27231 ts_tablet_manager.cc:1397] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.006s
I20260810 11:30:21.520519 27231 raft_consensus.cc:348] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.520882 27231 raft_consensus.cc:374] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.521014 27231 raft_consensus.cc:729] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.521405 27231 consensus_queue.cc:260] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.522360 27231 ts_tablet_manager.cc:1428] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 11:30:21.522804 27231 tablet_bootstrap.cc:492] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.525432 27231 tablet_bootstrap.cc:654] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.534409 27692 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c40c76e125b44de181b88b7f63a566f7)
I20260810 11:30:21.535545 27692 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:21.538736 27379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac259bcf213a4aa297d1d8e73b262361" candidate_term: 3 candidate_status { last_received { term: 2 index: 491 } } ignore_live_leader: false dest_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" is_pre_election: true
I20260810 11:30:21.540927 27222 tablet_bootstrap.cc:492] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:21.541816 27692 leader_election.cc:288] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547)
I20260810 11:30:21.543286 27222 tablet_bootstrap.cc:654] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:21.541199 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 298) could send its response
W20260810 11:30:21.548883 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 299) could send its response
I20260810 11:30:21.549132 27228 tablet_bootstrap.cc:492] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:21.549329 27228 ts_tablet_manager.cc:1397] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.204s user 0.062s sys 0.097s
I20260810 11:30:21.549485 27231 tablet_bootstrap.cc:492] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.549518 27526 raft_consensus.cc:482] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.549697 27231 ts_tablet_manager.cc:1397] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.027s user 0.009s sys 0.000s
I20260810 11:30:21.549702 27526 raft_consensus.cc:504] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.550351 27526 leader_election.cc:288] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:21.550266 27228 raft_consensus.cc:348] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.550642 27228 raft_consensus.cc:374] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.550762 27228 raft_consensus.cc:729] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.550669 27231 raft_consensus.cc:348] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.550930 27231 raft_consensus.cc:374] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.551023 27231 raft_consensus.cc:729] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.551230 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca5c88585394dba87e201696afa6934" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:21.551383 27231 consensus_queue.cc:260] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.552295 27231 ts_tablet_manager.cc:1428] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260810 11:30:21.552346 26702 leader_election.cc:341] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:21.552786 27526 raft_consensus.cc:482] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.552860 27231 tablet_bootstrap.cc:492] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.552927 27526 raft_consensus.cc:504] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.553548 27526 leader_election.cc:288] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:21.555346 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31cafb7c691d40a48a40f7d4190c4f8d" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:21.555830 27228 consensus_queue.cc:260] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.559556 27228 ts_tablet_manager.cc:1428] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260810 11:30:21.555480 27231 tablet_bootstrap.cc:654] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.562238 27228 tablet_bootstrap.cc:492] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:21.565047 27228 tablet_bootstrap.cc:654] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:21.556360 26702 leader_election.cc:341] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:21.569111 26564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111)
W20260810 11:30:21.572916 26564 leader_election.cc:334] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547): Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111)
I20260810 11:30:21.573099 26564 leader_election.cc:302] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac259bcf213a4aa297d1d8e73b262361; no voters: 83cc8e39a3b9455f8242a6da6a54c38a, c40c76e125b44de181b88b7f63a566f7
I20260810 11:30:21.573271 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31cafb7c691d40a48a40f7d4190c4f8d" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:21.573311 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca5c88585394dba87e201696afa6934" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:21.573735 27692 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260810 11:30:21.574826 27228 tablet_bootstrap.cc:492] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:21.575009 27228 ts_tablet_manager.cc:1397] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260810 11:30:21.575117 27231 tablet_bootstrap.cc:492] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.575276 27231 ts_tablet_manager.cc:1397] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.002s
I20260810 11:30:21.575873 27228 raft_consensus.cc:348] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.576153 27228 raft_consensus.cc:374] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.576040 27231 raft_consensus.cc:348] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.576221 27228 raft_consensus.cc:729] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.576269 27231 raft_consensus.cc:374] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.576362 27231 raft_consensus.cc:729] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.576510 27228 consensus_queue.cc:260] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.576607 27231 consensus_queue.cc:260] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.577235 27231 ts_tablet_manager.cc:1428] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:21.577926 27231 tablet_bootstrap.cc:492] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.580376 27228 ts_tablet_manager.cc:1428] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260810 11:30:21.581943 27228 tablet_bootstrap.cc:492] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:21.584750 27228 tablet_bootstrap.cc:654] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.592809 27231 tablet_bootstrap.cc:654] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.594920 27609 raft_consensus.cc:482] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.595151 27609 raft_consensus.cc:504] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.595890 27609 leader_election.cc:288] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:21.596755 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7a3b877457c4a2489d397f3f864d6b2" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:21.597293 27060 raft_consensus.cc:2454] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:21.597975 26848 leader_election.cc:302] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:21.598567 27609 raft_consensus.cc:2781] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:21.598676 27609 raft_consensus.cc:482] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:21.598781 27609 raft_consensus.cc:3037] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:21.603353 27609 raft_consensus.cc:504] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:21.604048 26849 leader_election.cc:341] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: b7a3b877457c4a2489d397f3f864d6b2
I20260810 11:30:21.604700 27609 leader_election.cc:288] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:21.605726 26849 leader_election.cc:341] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: b7a3b877457c4a2489d397f3f864d6b2
I20260810 11:30:21.607936 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7a3b877457c4a2489d397f3f864d6b2" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:21.608253 27060 raft_consensus.cc:3037] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:21.613986 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 224) took 4276 ms. Trace:
I20260810 11:30:21.614169 27248 rpcz_store.cc:276] 0810 11:30:17.337611 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.338122 (+ 511us) service_pool.cc:227] Handling call
0810 11:30:21.372256 (+4034134us) ts_tablet_manager.cc:1145] Deleting tablet 79953795f07845aba3f028741cdcdd9e
0810 11:30:21.372264 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.404123 (+ 31859us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.507817 (+103694us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.613930 (+106113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4033760}
I20260810 11:30:21.614732 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 240) took 4005 ms. Trace:
I20260810 11:30:21.614866 27248 rpcz_store.cc:276] 0810 11:30:17.609778 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.609844 (+ 66us) service_pool.cc:227] Handling call
0810 11:30:21.614531 (+4004687us) ts_tablet_manager.cc:1145] Deleting tablet 2634beb347714fc7a2e05865adb34a22
0810 11:30:21.614545 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.614688 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3931786}
I20260810 11:30:21.615276 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 241) took 4005 ms. Trace:
I20260810 11:30:21.615391 27248 rpcz_store.cc:276] 0810 11:30:17.610309 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.610361 (+ 52us) service_pool.cc:227] Handling call
0810 11:30:21.615110 (+4004749us) ts_tablet_manager.cc:1145] Deleting tablet 0713f4f14a284050a7774a70ab974f30
0810 11:30:21.615120 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.615242 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3932303}
I20260810 11:30:21.615736 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 242) took 4005 ms. Trace:
I20260810 11:30:21.615885 27248 rpcz_store.cc:276] 0810 11:30:17.610674 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:17.610736 (+ 62us) service_pool.cc:227] Handling call
0810 11:30:21.615614 (+4004878us) ts_tablet_manager.cc:1145] Deleting tablet 7aa16654b7f34f9baf856bf724cece8f
0810 11:30:21.615623 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.615697 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3932770}
I20260810 11:30:21.616230 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 260) took 3345 ms. Trace:
W20260810 11:30:21.616743 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 224) could send its response
W20260810 11:30:21.617041 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 240) could send its response
W20260810 11:30:21.617201 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 241) could send its response
W20260810 11:30:21.617355 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 242) could send its response
I20260810 11:30:21.619516 27231 tablet_bootstrap.cc:492] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.621239 27609 raft_consensus.cc:482] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.621258 27231 ts_tablet_manager.cc:1397] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.043s user 0.007s sys 0.005s
I20260810 11:30:21.621487 27609 raft_consensus.cc:504] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.622225 27609 leader_election.cc:288] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:21.622512 27231 raft_consensus.cc:348] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.622972 27231 raft_consensus.cc:374] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.623096 27231 raft_consensus.cc:729] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.623291 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e2c9112462f442e8de5b4a944cfdc6b" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:21.623610 27061 raft_consensus.cc:2454] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:21.623458 27231 consensus_queue.cc:260] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:21.623742 26849 leader_election.cc:341] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 2e2c9112462f442e8de5b4a944cfdc6b
I20260810 11:30:21.624282 26848 leader_election.cc:302] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:21.624388 27231 ts_tablet_manager.cc:1428] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260810 11:30:21.625149 27609 raft_consensus.cc:2781] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:21.625280 27609 raft_consensus.cc:482] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:21.625404 27609 raft_consensus.cc:3037] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:21.616608 27248 rpcz_store.cc:276] 0810 11:30:18.271240 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.271562 (+ 322us) service_pool.cc:227] Handling call
0810 11:30:21.616089 (+3344527us) ts_tablet_manager.cc:1145] Deleting tablet 5ca5c88585394dba87e201696afa6934
0810 11:30:21.616098 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.616189 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3326916}
W20260810 11:30:21.629470 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 260) could send its response
I20260810 11:30:21.629683 27231 tablet_bootstrap.cc:492] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.630534 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 258) took 3360 ms. Trace:
I20260810 11:30:21.630762 27248 rpcz_store.cc:276] 0810 11:30:18.270884 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.271488 (+ 604us) service_pool.cc:227] Handling call
0810 11:30:21.629387 (+3357899us) ts_tablet_manager.cc:1145] Deleting tablet 7ff5b980ce4e41d7a6e1ca0e740b739c
0810 11:30:21.630321 (+ 934us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.630479 (+ 158us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3339973}
I20260810 11:30:21.631311 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 259) took 3360 ms. Trace:
W20260810 11:30:21.631529 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 258) could send its response
I20260810 11:30:21.632090 27248 rpcz_store.cc:276] 0810 11:30:18.271099 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.271531 (+ 432us) service_pool.cc:227] Handling call
0810 11:30:21.631175 (+3359644us) ts_tablet_manager.cc:1145] Deleting tablet a3406dc345e3429fb4bce5a59643b686
0810 11:30:21.631186 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.631270 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3335510}
W20260810 11:30:21.632627 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 259) could send its response
I20260810 11:30:21.633128 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 261) took 3357 ms. Trace:
I20260810 11:30:21.633296 27248 rpcz_store.cc:276] 0810 11:30:18.275324 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.275595 (+ 271us) service_pool.cc:227] Handling call
0810 11:30:21.632978 (+3357383us) ts_tablet_manager.cc:1145] Deleting tablet 70f6017d4d01463398cb347779dacf90
0810 11:30:21.632989 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.633092 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3335600}
W20260810 11:30:21.633611 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 261) could send its response
I20260810 11:30:21.634647 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 262) took 3292 ms. Trace:
W20260810 11:30:21.634655 26700 leader_election.cc:341] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:21.634821 26700 leader_election.cc:302] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:21.634884 27248 rpcz_store.cc:276] 0810 11:30:18.342049 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.346375 (+ 4326us) service_pool.cc:227] Handling call
0810 11:30:21.633894 (+3287519us) ts_tablet_manager.cc:1145] Deleting tablet ff9b649e43a9456fa51cf3330290bb91
0810 11:30:21.633904 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.634231 (+ 327us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3287060}
I20260810 11:30:21.635263 27526 raft_consensus.cc:2726] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:21.635428 26700 leader_election.cc:341] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:21.635542 26700 leader_election.cc:302] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:21.637531 27526 raft_consensus.cc:2726] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:21.638346 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 262) could send its response
I20260810 11:30:21.638908 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 263) took 3294 ms. Trace:
I20260810 11:30:21.639103 27248 rpcz_store.cc:276] 0810 11:30:18.344093 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.344165 (+ 72us) service_pool.cc:227] Handling call
0810 11:30:21.638708 (+3294543us) ts_tablet_manager.cc:1145] Deleting tablet f2b555f18c1e485d9af7b08f98543c80
0810 11:30:21.638725 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.638869 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3289136}
W20260810 11:30:21.639482 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 263) could send its response
I20260810 11:30:21.639875 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 264) took 3057 ms. Trace:
I20260810 11:30:21.640265 27248 rpcz_store.cc:276] 0810 11:30:18.582172 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.582705 (+ 533us) service_pool.cc:227] Handling call
0810 11:30:21.639741 (+3057036us) ts_tablet_manager.cc:1145] Deleting tablet ac4b1821ac30452cbe7a8f844d9b37e5
0810 11:30:21.639752 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.639842 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3029352}
W20260810 11:30:21.645437 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 264) could send its response
I20260810 11:30:21.642663 27231 tablet_bootstrap.cc:654] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.646011 27248 tablet_replica.cc:330] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:21.647444 27248 raft_consensus.cc:2229] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:21.647753 27248 raft_consensus.cc:2258] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:21.648416 27223 ts_tablet_manager.cc:1918] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:21.651463 27639 raft_consensus.cc:482] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.651599 27223 log.cc:1196] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/79953795f07845aba3f028741cdcdd9e
I20260810 11:30:21.651665 27639 raft_consensus.cc:504] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.652381 27223 ts_tablet_manager.cc:1939] T 79953795f07845aba3f028741cdcdd9e P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:21.652483 27639 leader_election.cc:288] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:21.652778 27248 ts_tablet_manager.cc:1905] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:21.654196 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff4e19071fc435fbae4490799325e37" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:21.654496 26915 raft_consensus.cc:2454] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
W20260810 11:30:21.655090 26993 leader_election.cc:341] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 3ff4e19071fc435fbae4490799325e37
I20260810 11:30:21.655548 26991 leader_election.cc:302] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:21.656023 27639 raft_consensus.cc:2781] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:21.656180 27639 raft_consensus.cc:482] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:21.656301 27639 raft_consensus.cc:3037] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:21.659379 27222 tablet_bootstrap.cc:492] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:21.659752 27222 ts_tablet_manager.cc:1397] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.119s user 0.005s sys 0.017s
I20260810 11:30:21.659782 27700 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c40c76e125b44de181b88b7f63a566f7)
I20260810 11:30:21.660004 27700 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:21.661064 27222 raft_consensus.cc:348] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.661433 27222 raft_consensus.cc:374] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.661589 27222 raft_consensus.cc:729] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.661566 26591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" candidate_term: 3 candidate_status { last_received { term: 2 index: 491 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361" is_pre_election: true
I20260810 11:30:21.661711 27700 leader_election.cc:288] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
I20260810 11:30:21.661942 26591 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83cc8e39a3b9455f8242a6da6a54c38a in term 2.
I20260810 11:30:21.661954 27222 consensus_queue.cc:260] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.662631 27291 leader_election.cc:302] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83cc8e39a3b9455f8242a6da6a54c38a, ac259bcf213a4aa297d1d8e73b262361; no voters:
I20260810 11:30:21.663074 27700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 11:30:21.663265 27700 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c40c76e125b44de181b88b7f63a566f7)
I20260810 11:30:21.663439 27700 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 2 FOLLOWER]: Advancing to term 3
I20260810 11:30:21.664911 27655 raft_consensus.cc:482] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.665149 27655 raft_consensus.cc:504] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.665932 27655 leader_election.cc:288] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:21.667841 27222 ts_tablet_manager.cc:1428] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 11:30:21.668202 27222 tablet_bootstrap.cc:492] T bbe34108a7604fa6aa667758be11f569 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:21.669288 27231 tablet_bootstrap.cc:492] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.669334 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d14091e1c111438bac8bcf3d36123d80" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:21.670471 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d14091e1c111438bac8bcf3d36123d80" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:21.669472 27231 ts_tablet_manager.cc:1397] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.003s
I20260810 11:30:21.670820 27222 tablet_bootstrap.cc:654] T bbe34108a7604fa6aa667758be11f569 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.672199 26849 leader_election.cc:302] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:21.672688 27633 raft_consensus.cc:482] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.672876 27633 raft_consensus.cc:504] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.672345 27231 raft_consensus.cc:348] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.673553 27633 leader_election.cc:288] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:21.673570 27231 raft_consensus.cc:374] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.673688 27231 raft_consensus.cc:729] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.673756 27633 raft_consensus.cc:2726] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:21.673941 27231 consensus_queue.cc:260] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.675071 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949f31fa0c124eefbee695cfc7f50cbe" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:21.675369 27061 raft_consensus.cc:2454] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:21.678510 26848 leader_election.cc:302] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
W20260810 11:30:21.679090 26849 leader_election.cc:341] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 949f31fa0c124eefbee695cfc7f50cbe
I20260810 11:30:21.679553 27633 raft_consensus.cc:2781] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:21.679689 27633 raft_consensus.cc:482] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:21.679787 27633 raft_consensus.cc:3037] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:21.681342 27708 raft_consensus.cc:482] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.682334 27231 ts_tablet_manager.cc:1428] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
I20260810 11:30:21.682778 27231 tablet_bootstrap.cc:492] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.681640 27708 raft_consensus.cc:504] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:21.688149 27286 leader_election.cc:334] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547): Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111)
I20260810 11:30:21.688890 27708 leader_election.cc:288] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:21.690310 27231 tablet_bootstrap.cc:654] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.691068 27222 tablet_bootstrap.cc:492] T bbe34108a7604fa6aa667758be11f569 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:21.691270 27222 ts_tablet_manager.cc:1397] T bbe34108a7604fa6aa667758be11f569 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260810 11:30:21.692302 27222 raft_consensus.cc:348] T bbe34108a7604fa6aa667758be11f569 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.692682 27222 raft_consensus.cc:374] T bbe34108a7604fa6aa667758be11f569 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.692806 27222 raft_consensus.cc:729] T bbe34108a7604fa6aa667758be11f569 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.693085 27222 consensus_queue.cc:260] T bbe34108a7604fa6aa667758be11f569 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.694479 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31888ddeafe14738b818016a9c0a4ad3" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:21.694855 27231 tablet_bootstrap.cc:492] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.695053 27231 ts_tablet_manager.cc:1397] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
W20260810 11:30:21.695276 26991 leader_election.cc:341] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:21.696281 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31888ddeafe14738b818016a9c0a4ad3" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:21.696616 26769 raft_consensus.cc:2454] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:21.697285 26993 leader_election.cc:302] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:21.697784 27709 raft_consensus.cc:2781] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:21.697907 27709 raft_consensus.cc:482] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:21.698022 27709 raft_consensus.cc:3037] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:21.697319 27231 raft_consensus.cc:348] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.698711 27231 raft_consensus.cc:374] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.698829 27231 raft_consensus.cc:729] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.699136 27222 ts_tablet_manager.cc:1428] T bbe34108a7604fa6aa667758be11f569 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.008s user 0.002s sys 0.001s
I20260810 11:30:21.699138 27231 consensus_queue.cc:260] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.700407 27231 ts_tablet_manager.cc:1428] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260810 11:30:21.700822 27231 tablet_bootstrap.cc:492] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.703322 27222 tablet_bootstrap.cc:492] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:21.703516 27060 raft_consensus.cc:2454] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:21.704016 27231 tablet_bootstrap.cc:654] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.704077 27609 raft_consensus.cc:504] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.704893 27609 leader_election.cc:288] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:21.705399 27221 ts_tablet_manager.cc:1918] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:21.705732 27221 log.cc:1196] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/2917f1ffb5214a80b19810540602df35
I20260810 11:30:21.709097 27222 tablet_bootstrap.cc:654] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.712589 27221 ts_tablet_manager.cc:1939] T 2917f1ffb5214a80b19810540602df35 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:21.714098 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 297) took 2157 ms. Trace:
I20260810 11:30:21.714464 27231 tablet_bootstrap.cc:492] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.714637 27231 ts_tablet_manager.cc:1397] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260810 11:30:21.714498 27223 rpcz_store.cc:276] 0810 11:30:19.556988 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.557405 (+ 417us) service_pool.cc:227] Handling call
0810 11:30:21.374170 (+1816765us) ts_tablet_manager.cc:1145] Deleting tablet 79953795f07845aba3f028741cdcdd9e
0810 11:30:21.374179 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.524866 (+150687us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.648212 (+123346us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.714028 (+ 65816us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1784621}
I20260810 11:30:21.715154 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 299) took 1987 ms. Trace:
I20260810 11:30:21.715288 27223 rpcz_store.cc:276] 0810 11:30:19.727298 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.727364 (+ 66us) service_pool.cc:227] Handling call
0810 11:30:21.714901 (+1987537us) ts_tablet_manager.cc:1145] Deleting tablet 1a83391804894d268d0e603f4feb1745
0810 11:30:21.714916 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.715098 (+ 182us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1987149}
I20260810 11:30:21.715544 27231 raft_consensus.cc:348] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.715709 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 298) took 1994 ms. Trace:
I20260810 11:30:21.715801 27231 raft_consensus.cc:374] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.715888 27231 raft_consensus.cc:729] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.715833 27223 rpcz_store.cc:276] 0810 11:30:19.721628 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.722080 (+ 452us) service_pool.cc:227] Handling call
0810 11:30:21.715529 (+1993449us) ts_tablet_manager.cc:1145] Deleting tablet 0118ff9d21924aefa8c6c32977c10453
0810 11:30:21.715539 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.715673 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1959794}
I20260810 11:30:21.716184 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 301) took 1951 ms. Trace:
I20260810 11:30:21.716288 27223 rpcz_store.cc:276] 0810 11:30:19.765272 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.766488 (+ 1216us) service_pool.cc:227] Handling call
0810 11:30:21.716073 (+1949585us) ts_tablet_manager.cc:1145] Deleting tablet 49db12565dbc4187b78a98ed35c40fed
0810 11:30:21.716082 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.716155 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1948669}
I20260810 11:30:21.716120 27231 consensus_queue.cc:260] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:21.716684 26850 connection.cc:441] server connection from 127.0.0.1:52560 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 297) could send its response
W20260810 11:30:21.716943 26850 connection.cc:441] server connection from 127.0.0.1:52560 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 299) could send its response
W20260810 11:30:21.717089 26850 connection.cc:441] server connection from 127.0.0.1:52560 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 298) could send its response
W20260810 11:30:21.717228 26850 connection.cc:441] server connection from 127.0.0.1:52560 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 301) could send its response
I20260810 11:30:21.717274 27231 ts_tablet_manager.cc:1428] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:21.717672 27231 tablet_bootstrap.cc:492] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.720060 27231 tablet_bootstrap.cc:654] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.723381 27222 tablet_bootstrap.cc:492] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:21.723635 27222 ts_tablet_manager.cc:1397] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.003s
I20260810 11:30:21.724596 27222 raft_consensus.cc:348] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.724885 27222 raft_consensus.cc:374] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.725024 27222 raft_consensus.cc:729] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
W20260810 11:30:21.725049 26849 leader_election.cc:341] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 2e2c9112462f442e8de5b4a944cfdc6b
I20260810 11:30:21.725308 27222 consensus_queue.cc:260] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.727890 26848 leader_election.cc:302] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:21.728780 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e2c9112462f442e8de5b4a944cfdc6b" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:21.729061 27060 raft_consensus.cc:3037] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:21.729513 27609 raft_consensus.cc:2781] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:21.729724 27609 raft_consensus.cc:686] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:21.730008 27609 consensus_queue.cc:237] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.730545 27222 ts_tablet_manager.cc:1428] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260810 11:30:21.733526 27223 tablet_replica.cc:330] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:21.733829 27223 raft_consensus.cc:2229] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:21.734148 27223 pending_rounds.cc:62] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700: Trying to abort 1 pending ops.
I20260810 11:30:21.734275 27223 pending_rounds.cc:68] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936380621357056 op_type: NO_OP noop_request { }
I20260810 11:30:21.734473 27223 raft_consensus.cc:2866] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:21.734648 27223 raft_consensus.cc:2258] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:21.734817 27231 tablet_bootstrap.cc:492] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.735003 27231 ts_tablet_manager.cc:1397] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.000s
I20260810 11:30:21.735010 27222 tablet_bootstrap.cc:492] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:21.735957 27223 ts_tablet_manager.cc:1905] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:21.735841 27231 raft_consensus.cc:348] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.736153 27231 raft_consensus.cc:374] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.736236 27231 raft_consensus.cc:729] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.736591 27231 consensus_queue.cc:260] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.737643 27231 ts_tablet_manager.cc:1428] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:21.738318 27231 tablet_bootstrap.cc:492] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.740250 27231 tablet_bootstrap.cc:654] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.742820 27222 tablet_bootstrap.cc:654] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.749251 27708 raft_consensus.cc:482] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.749502 27708 raft_consensus.cc:504] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.750350 27708 leader_election.cc:288] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:21.751541 26993 leader_election.cc:341] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 7e3707ae32624f6483866208321eefde
W20260810 11:30:21.751832 26991 leader_election.cc:341] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 7e3707ae32624f6483866208321eefde
I20260810 11:30:21.752045 26991 leader_election.cc:302] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:21.752383 27708 raft_consensus.cc:2726] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:21.752801 27708 raft_consensus.cc:482] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.753067 27708 raft_consensus.cc:504] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.753814 27708 leader_election.cc:288] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:21.754472 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a28849649c704f2fbdec1aced9ce01b1" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:21.754781 26769 raft_consensus.cc:2454] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:21.755432 26993 leader_election.cc:302] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:21.755941 27708 raft_consensus.cc:2781] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:21.756060 27708 raft_consensus.cc:482] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:21.756172 27708 raft_consensus.cc:3037] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:21.759373 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a28849649c704f2fbdec1aced9ce01b1" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:21.760715 27222 tablet_bootstrap.cc:492] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
W20260810 11:30:21.760685 26991 leader_election.cc:341] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:21.761025 27222 ts_tablet_manager.cc:1397] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.001s
I20260810 11:30:21.761960 27222 raft_consensus.cc:348] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.762449 27222 raft_consensus.cc:374] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.762576 27222 raft_consensus.cc:729] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.763073 27222 consensus_queue.cc:260] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.770308 27228 tablet_bootstrap.cc:492] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:21.770591 27228 ts_tablet_manager.cc:1397] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.189s user 0.026s sys 0.034s
I20260810 11:30:21.771800 27228 raft_consensus.cc:348] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.772148 27228 raft_consensus.cc:374] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.772282 27228 raft_consensus.cc:729] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.772675 27228 consensus_queue.cc:260] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.773656 27222 ts_tablet_manager.cc:1428] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260810 11:30:21.773993 27228 ts_tablet_manager.cc:1428] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260810 11:30:21.774392 27228 tablet_bootstrap.cc:492] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:21.780756 27228 tablet_bootstrap.cc:654] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.781584 27222 tablet_bootstrap.cc:492] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:21.785436 27231 tablet_bootstrap.cc:492] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.785643 27231 ts_tablet_manager.cc:1397] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.047s user 0.020s sys 0.020s
I20260810 11:30:21.786696 27231 raft_consensus.cc:348] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.786944 27231 raft_consensus.cc:374] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.787029 27231 raft_consensus.cc:729] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.787271 27231 consensus_queue.cc:260] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.788064 27231 ts_tablet_manager.cc:1428] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:21.788393 27231 tablet_bootstrap.cc:492] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.791988 27231 tablet_bootstrap.cc:654] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.795930 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 300) took 2782 ms. Trace:
I20260810 11:30:21.796128 27221 rpcz_store.cc:276] 0810 11:30:19.013312 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.013390 (+ 78us) service_pool.cc:227] Handling call
0810 11:30:21.509907 (+2496517us) ts_tablet_manager.cc:1145] Deleting tablet 2917f1ffb5214a80b19810540602df35
0810 11:30:21.509925 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.618541 (+108616us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.705243 (+ 86702us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.795872 (+ 90629us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2496161}
I20260810 11:30:21.796281 27228 tablet_bootstrap.cc:492] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:21.796481 27228 ts_tablet_manager.cc:1397] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.006s
I20260810 11:30:21.796766 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 301) took 2771 ms. Trace:
I20260810 11:30:21.796911 27221 rpcz_store.cc:276] 0810 11:30:19.025771 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.025846 (+ 75us) service_pool.cc:227] Handling call
0810 11:30:21.796542 (+2770696us) ts_tablet_manager.cc:1145] Deleting tablet 809b5b6b65d244cd9186517e39494839
0810 11:30:21.796588 (+ 46us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.796721 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2770172}
I20260810 11:30:21.797327 27228 raft_consensus.cc:348] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.797595 27228 raft_consensus.cc:374] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.797660 27228 raft_consensus.cc:729] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.797758 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 302) took 2766 ms. Trace:
I20260810 11:30:21.797886 27221 rpcz_store.cc:276] 0810 11:30:19.030822 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.030899 (+ 77us) service_pool.cc:227] Handling call
0810 11:30:21.797526 (+2766627us) ts_tablet_manager.cc:1145] Deleting tablet 64818ca5827e41d99428903ddb8688d9
0810 11:30:21.797538 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.797653 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2766133}
I20260810 11:30:21.797904 27228 consensus_queue.cc:260] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.798267 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 303) took 2761 ms. Trace:
I20260810 11:30:21.798688 27228 ts_tablet_manager.cc:1428] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 11:30:21.802821 27231 tablet_bootstrap.cc:492] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.803026 27231 ts_tablet_manager.cc:1397] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.000s
I20260810 11:30:21.804101 27231 raft_consensus.cc:348] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.804486 27231 raft_consensus.cc:374] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.804631 27231 raft_consensus.cc:729] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.804963 27231 consensus_queue.cc:260] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.805716 27228 tablet_bootstrap.cc:492] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:21.807919 27228 tablet_bootstrap.cc:654] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.804636 27709 raft_consensus.cc:504] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.809015 27709 leader_election.cc:288] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:21.810003 27231 ts_tablet_manager.cc:1428] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260810 11:30:21.810042 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31888ddeafe14738b818016a9c0a4ad3" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:21.810168 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31888ddeafe14738b818016a9c0a4ad3" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:21.810436 27231 tablet_bootstrap.cc:492] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.810395 26769 raft_consensus.cc:3037] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:21.811815 27633 raft_consensus.cc:504] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.812673 27633 leader_election.cc:288] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:21.813941 26849 leader_election.cc:341] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 949f31fa0c124eefbee695cfc7f50cbe
W20260810 11:30:21.815050 26991 leader_election.cc:341] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:21.815485 27231 tablet_bootstrap.cc:654] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:21.815503 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 300) could send its response
W20260810 11:30:21.815752 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 301) could send its response
W20260810 11:30:21.815965 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 302) could send its response
I20260810 11:30:21.815496 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949f31fa0c124eefbee695cfc7f50cbe" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:21.816255 27221 rpcz_store.cc:276] 0810 11:30:19.037320 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.037570 (+ 250us) service_pool.cc:227] Handling call
0810 11:30:21.798122 (+2760552us) ts_tablet_manager.cc:1145] Deleting tablet 809b5b6b65d244cd9186517e39494839
0810 11:30:21.798132 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.798240 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2760199}
I20260810 11:30:21.816452 27061 raft_consensus.cc:3037] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:21.817020 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 305) took 2775 ms. Trace:
I20260810 11:30:21.817158 27221 rpcz_store.cc:276] 0810 11:30:19.041280 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.041348 (+ 68us) service_pool.cc:227] Handling call
0810 11:30:21.816774 (+2775426us) ts_tablet_manager.cc:1145] Deleting tablet cb01e54d817c4b0dbcc80f90f82923c0
0810 11:30:21.816793 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.816924 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2775014}
I20260810 11:30:21.817561 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 312) took 2632 ms. Trace:
I20260810 11:30:21.817705 27221 rpcz_store.cc:276] 0810 11:30:19.185359 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.185808 (+ 449us) service_pool.cc:227] Handling call
0810 11:30:21.817424 (+2631616us) ts_tablet_manager.cc:1145] Deleting tablet 91b6078efadf496fb252f725bdf56b02
0810 11:30:21.817434 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.817526 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13696,"tablet-delete.queue_time_us":2631274}
I20260810 11:30:21.818012 27221 tablet_replica.cc:330] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:21.818267 27221 raft_consensus.cc:2229] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:21.818472 27221 raft_consensus.cc:2258] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:21.819525 27221 ts_tablet_manager.cc:1905] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:21.820050 27228 tablet_bootstrap.cc:492] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:21.820257 27228 ts_tablet_manager.cc:1397] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.005s
W20260810 11:30:21.820784 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 303) could send its response
W20260810 11:30:21.821401 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 305) could send its response
W20260810 11:30:21.821595 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 312) could send its response
I20260810 11:30:21.821691 27228 raft_consensus.cc:348] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.822533 27228 raft_consensus.cc:374] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.822856 27228 raft_consensus.cc:729] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.823357 27228 consensus_queue.cc:260] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.822347 27248 ts_tablet_manager.cc:1918] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:21.824210 27248 log.cc:1196] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/e2732660f8964feeb5c03365df065a54
I20260810 11:30:21.824795 27248 ts_tablet_manager.cc:1939] T e2732660f8964feeb5c03365df065a54 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:21.825906 27700 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:21.826433 27228 ts_tablet_manager.cc:1428] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.006s user 0.000s sys 0.004s
W20260810 11:30:21.829746 27286 leader_election.cc:334] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547): Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111)
I20260810 11:30:21.831230 27700 leader_election.cc:288] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 3 election: Requested vote from peers c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
I20260810 11:30:21.833885 26541 master_runner.cc:186] Error getting master registration for 127.25.195.253:34547: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111),
I20260810 11:30:21.834089 26541 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 11:30:21.834957 26591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" candidate_term: 3 candidate_status { last_received { term: 2 index: 491 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361"
I20260810 11:30:21.835294 26591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 2 FOLLOWER]: Advancing to term 3
I20260810 11:30:21.838184 27222 tablet_bootstrap.cc:654] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.838922 27228 tablet_bootstrap.cc:492] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:21.841943 27228 tablet_bootstrap.cc:654] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.844424 27231 tablet_bootstrap.cc:492] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.844643 27231 ts_tablet_manager.cc:1397] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.034s user 0.008s sys 0.013s
I20260810 11:30:21.845520 27231 raft_consensus.cc:348] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.847519 27231 raft_consensus.cc:374] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.847743 27231 raft_consensus.cc:729] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.848076 27231 consensus_queue.cc:260] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.849115 27231 ts_tablet_manager.cc:1428] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 11:30:21.849663 27231 tablet_bootstrap.cc:492] T b6a3b1e37ac943e391d54640987136f8 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.852408 27231 tablet_bootstrap.cc:654] T b6a3b1e37ac943e391d54640987136f8 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.853811 27228 tablet_bootstrap.cc:492] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:21.854045 27228 ts_tablet_manager.cc:1397] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.001s
I20260810 11:30:21.854955 27228 raft_consensus.cc:348] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.855226 27228 raft_consensus.cc:374] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.855300 27228 raft_consensus.cc:729] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.855660 27228 consensus_queue.cc:260] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.858019 27228 ts_tablet_manager.cc:1428] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 11:30:21.859880 27228 tablet_bootstrap.cc:492] T d722b93fe27f4c08a592bc393046b6bd P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:21.862624 27228 tablet_bootstrap.cc:654] T d722b93fe27f4c08a592bc393046b6bd P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.854530 27709 raft_consensus.cc:482] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.865608 27709 raft_consensus.cc:504] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.867497 27709 leader_election.cc:288] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:21.869517 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e0a8513171f4c39b74c08760a139d9e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:21.871168 27222 tablet_bootstrap.cc:492] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
W20260810 11:30:21.871131 26991 leader_election.cc:341] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:21.871524 27222 ts_tablet_manager.cc:1397] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.090s user 0.005s sys 0.001s
I20260810 11:30:21.872125 27228 tablet_bootstrap.cc:492] T d722b93fe27f4c08a592bc393046b6bd P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:21.872313 27228 ts_tablet_manager.cc:1397] T d722b93fe27f4c08a592bc393046b6bd P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.000s
I20260810 11:30:21.872664 27222 raft_consensus.cc:348] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.872979 27222 raft_consensus.cc:374] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.872853 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e0a8513171f4c39b74c08760a139d9e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:21.873113 27222 raft_consensus.cc:729] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.873297 27228 raft_consensus.cc:348] T d722b93fe27f4c08a592bc393046b6bd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.873572 27228 raft_consensus.cc:374] T d722b93fe27f4c08a592bc393046b6bd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.873450 27222 consensus_queue.cc:260] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.873692 27228 raft_consensus.cc:729] T d722b93fe27f4c08a592bc393046b6bd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
W20260810 11:30:21.874138 26993 leader_election.cc:341] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:21.874399 26993 leader_election.cc:302] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:21.874373 27228 consensus_queue.cc:260] T d722b93fe27f4c08a592bc393046b6bd P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.875069 27228 ts_tablet_manager.cc:1428] T d722b93fe27f4c08a592bc393046b6bd P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 11:30:21.875468 27228 tablet_bootstrap.cc:492] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:21.877770 27709 raft_consensus.cc:482] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.878829 27222 ts_tablet_manager.cc:1428] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260810 11:30:21.879966 27222 tablet_bootstrap.cc:492] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:21.880875 27633 raft_consensus.cc:482] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.881112 27633 raft_consensus.cc:504] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.881742 27228 tablet_bootstrap.cc:654] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.881916 27222 tablet_bootstrap.cc:654] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.882048 27633 leader_election.cc:288] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:21.883857 26849 leader_election.cc:341] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 66908164ff2a4ee5b55da6158699e0c6
I20260810 11:30:21.884171 27718 raft_consensus.cc:2726] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:21.884421 27709 raft_consensus.cc:504] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.884886 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66908164ff2a4ee5b55da6158699e0c6" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:21.885571 26848 leader_election.cc:302] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:21.886047 27633 raft_consensus.cc:2726] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:21.886408 27231 tablet_bootstrap.cc:492] T b6a3b1e37ac943e391d54640987136f8 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.886603 27231 ts_tablet_manager.cc:1397] T b6a3b1e37ac943e391d54640987136f8 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.012s
I20260810 11:30:21.888597 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbe34108a7604fa6aa667758be11f569" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:21.887526 27709 leader_election.cc:288] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:21.889353 26991 leader_election.cc:341] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:21.888011 27231 raft_consensus.cc:348] T b6a3b1e37ac943e391d54640987136f8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.890053 27231 raft_consensus.cc:374] T b6a3b1e37ac943e391d54640987136f8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.890167 27231 raft_consensus.cc:729] T b6a3b1e37ac943e391d54640987136f8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.890110 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbe34108a7604fa6aa667758be11f569" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:21.890429 26771 raft_consensus.cc:2454] T bbe34108a7604fa6aa667758be11f569 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:21.890544 27231 consensus_queue.cc:260] T b6a3b1e37ac943e391d54640987136f8 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.891330 26993 leader_election.cc:302] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:21.891567 27231 ts_tablet_manager.cc:1428] T b6a3b1e37ac943e391d54640987136f8 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 11:30:21.891714 27718 raft_consensus.cc:2781] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:21.891851 27718 raft_consensus.cc:482] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:21.891964 27718 raft_consensus.cc:3037] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:21.892302 27231 tablet_bootstrap.cc:492] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.895057 27231 tablet_bootstrap.cc:654] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.900089 27228 tablet_bootstrap.cc:492] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:21.900300 27228 ts_tablet_manager.cc:1397] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.004s
I20260810 11:30:21.901559 27228 raft_consensus.cc:348] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.901818 27228 raft_consensus.cc:374] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.902166 27228 raft_consensus.cc:729] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.902577 27228 consensus_queue.cc:260] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.903205 27228 ts_tablet_manager.cc:1428] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 11:30:21.903864 27228 tablet_bootstrap.cc:492] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:21.904541 26591 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83cc8e39a3b9455f8242a6da6a54c38a in term 3.
I20260810 11:30:21.905424 27223 ts_tablet_manager.cc:1918] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:21.905406 27291 leader_election.cc:302] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83cc8e39a3b9455f8242a6da6a54c38a, ac259bcf213a4aa297d1d8e73b262361; no voters: c40c76e125b44de181b88b7f63a566f7
I20260810 11:30:21.905735 27223 log.cc:1196] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/2fc76603bf8843dab18c95fdab9a8be0
I20260810 11:30:21.906075 27700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 3 FOLLOWER]: Leader election won for term 3
I20260810 11:30:21.906893 27223 ts_tablet_manager.cc:1939] T 2fc76603bf8843dab18c95fdab9a8be0 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:21.907430 26769 raft_consensus.cc:2454] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:21.908066 27639 raft_consensus.cc:504] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.909227 27639 leader_election.cc:288] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:21.911553 27708 raft_consensus.cc:504] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.911883 27221 ts_tablet_manager.cc:1918] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:21.912063 27221 log.cc:1196] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/a28849649c704f2fbdec1aced9ce01b1
I20260810 11:30:21.912748 27221 ts_tablet_manager.cc:1939] T a28849649c704f2fbdec1aced9ce01b1 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:21.913338 27061 raft_consensus.cc:2454] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:21.914682 27639 raft_consensus.cc:482] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.914942 26993 leader_election.cc:302] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:21.914865 27639 raft_consensus.cc:504] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.915249 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 270) took 3260 ms. Trace:
I20260810 11:30:21.915519 27639 leader_election.cc:288] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:21.915374 27248 rpcz_store.cc:276] 0810 11:30:18.655004 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.655947 (+ 943us) service_pool.cc:227] Handling call
0810 11:30:21.645913 (+2989966us) ts_tablet_manager.cc:1145] Deleting tablet e2732660f8964feeb5c03365df065a54
0810 11:30:21.645926 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.747134 (+101208us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.822108 (+ 74974us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.915171 (+ 93063us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2988944}
I20260810 11:30:21.915714 27639 raft_consensus.cc:2781] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:21.915856 27639 raft_consensus.cc:686] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:21.912313 27708 leader_election.cc:288] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:21.916116 27639 consensus_queue.cc:237] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.917359 27231 tablet_bootstrap.cc:492] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.917523 27231 ts_tablet_manager.cc:1397] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.000s
I20260810 11:30:21.917701 27228 tablet_bootstrap.cc:654] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.918349 27231 raft_consensus.cc:348] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.918653 27231 raft_consensus.cc:374] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.918761 27231 raft_consensus.cc:729] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
W20260810 11:30:21.918797 26993 leader_election.cc:341] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 3ff4e19071fc435fbae4490799325e37
I20260810 11:30:21.918828 26848 leader_election.cc:302] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:21.918968 27231 consensus_queue.cc:260] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.919668 27231 ts_tablet_manager.cc:1428] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 11:30:21.920071 27231 tablet_bootstrap.cc:492] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.920324 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff4e19071fc435fbae4490799325e37" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:21.920585 26915 raft_consensus.cc:3037] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:21.922951 27222 tablet_bootstrap.cc:492] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:21.923257 27222 ts_tablet_manager.cc:1397] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.044s user 0.001s sys 0.004s
I20260810 11:30:21.923753 27231 tablet_bootstrap.cc:654] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.924376 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a28849649c704f2fbdec1aced9ce01b1" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:21.924577 27222 raft_consensus.cc:348] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.924852 27222 raft_consensus.cc:374] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.924949 27222 raft_consensus.cc:729] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.925236 27222 consensus_queue.cc:260] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.926223 27222 ts_tablet_manager.cc:1428] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
W20260810 11:30:21.926240 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 270) could send its response
I20260810 11:30:21.926766 27222 tablet_bootstrap.cc:492] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:21.928642 26912 raft_consensus.cc:3037] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:21.924764 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d91a02b22044429fb3e25840c7947a02" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:21.928277 27633 raft_consensus.cc:2781] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:21.929515 27633 raft_consensus.cc:686] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:21.929865 27633 consensus_queue.cc:237] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:21.931994 27228 tablet_bootstrap.cc:492] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:21.932209 27228 ts_tablet_manager.cc:1397] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.005s
I20260810 11:30:21.933472 27228 raft_consensus.cc:348] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.933678 27222 tablet_bootstrap.cc:654] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.933784 27228 raft_consensus.cc:374] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.933887 27228 raft_consensus.cc:729] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.934331 27228 consensus_queue.cc:260] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.935499 27526 raft_consensus.cc:482] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.936127 27228 ts_tablet_manager.cc:1428] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 11:30:21.936153 27526 raft_consensus.cc:504] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.936684 27228 tablet_bootstrap.cc:492] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:21.937255 27526 leader_election.cc:288] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:21.937664 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d91a02b22044429fb3e25840c7947a02" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:21.937994 26769 raft_consensus.cc:2454] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:21.939709 27228 tablet_bootstrap.cc:654] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.942235 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6a3b1e37ac943e391d54640987136f8" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:21.942955 27061 raft_consensus.cc:2454] T b6a3b1e37ac943e391d54640987136f8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:21.943264 27231 tablet_bootstrap.cc:492] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.943979 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 311) took 2758 ms. Trace:
I20260810 11:30:21.944332 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a28849649c704f2fbdec1aced9ce01b1" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:21.944499 27221 rpcz_store.cc:276] 0810 11:30:19.185007 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.188646 (+ 3639us) service_pool.cc:227] Handling call
0810 11:30:21.817940 (+2629294us) ts_tablet_manager.cc:1145] Deleting tablet a28849649c704f2fbdec1aced9ce01b1
0810 11:30:21.817960 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.899123 (+ 81163us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.911738 (+ 12615us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.943763 (+ 32025us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11516,"tablet-delete.queue_time_us":2628999}
I20260810 11:30:21.946373 27231 ts_tablet_manager.cc:1397] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.007s
I20260810 11:30:21.947330 27231 raft_consensus.cc:348] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.947635 27231 raft_consensus.cc:374] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.947731 27231 raft_consensus.cc:729] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.947587 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 315) took 2583 ms. Trace:
I20260810 11:30:21.947978 27231 consensus_queue.cc:260] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.949139 27700 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 3 LEADER]: Becoming Leader. State: Replica: 83cc8e39a3b9455f8242a6da6a54c38a, State: Running, Role: LEADER
I20260810 11:30:21.949972 27222 tablet_bootstrap.cc:492] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:21.950155 27222 ts_tablet_manager.cc:1397] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.004s
I20260810 11:30:21.950145 27700 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 490, Committed index: 490, Last appended: 2.491, Last appended by leader: 491, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:21.951066 27222 raft_consensus.cc:348] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.951334 27222 raft_consensus.cc:374] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.951408 27222 raft_consensus.cc:729] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.951740 27222 consensus_queue.cc:260] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.952370 27222 ts_tablet_manager.cc:1428] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:21.954237 27222 tablet_bootstrap.cc:492] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:21.956280 27222 tablet_bootstrap.cc:654] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.957930 26702 leader_election.cc:302] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:21.957871 27731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83cc8e39a3b9455f8242a6da6a54c38a. Latest consensus state: current_term: 3 leader_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:21.958323 27731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: This master's current role is: LEADER
I20260810 11:30:21.958498 27231 ts_tablet_manager.cc:1428] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260810 11:30:21.960621 26993 leader_election.cc:302] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
W20260810 11:30:21.961002 26993 leader_election.cc:341] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: Tablet not RUNNING: SHUTDOWN
I20260810 11:30:21.961018 27639 raft_consensus.cc:2781] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:21.961998 27639 raft_consensus.cc:482] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:21.962229 27639 raft_consensus.cc:3037] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:21.962205 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 311) could send its response
I20260810 11:30:21.963378 27248 tablet_replica.cc:330] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:21.964459 26991 leader_election.cc:341] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:21.965323 26914 raft_consensus.cc:3037] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:21.966454 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6a3b1e37ac943e391d54640987136f8" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:21.968369 26700 leader_election.cc:341] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:21.969913 27231 tablet_bootstrap.cc:492] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.971660 27526 raft_consensus.cc:2781] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:21.971853 27526 raft_consensus.cc:482] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:21.971932 27231 tablet_bootstrap.cc:654] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.972079 27526 raft_consensus.cc:3037] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:21.973851 27222 tablet_bootstrap.cc:492] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:21.974906 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 308) took 2149 ms. Trace:
I20260810 11:30:21.975106 27223 rpcz_store.cc:276] 0810 11:30:19.825391 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.825451 (+ 60us) service_pool.cc:227] Handling call
0810 11:30:21.716533 (+1891082us) ts_tablet_manager.cc:1145] Deleting tablet 2fc76603bf8843dab18c95fdab9a8be0
0810 11:30:21.716542 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.823731 (+107189us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.905216 (+ 81485us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:21.974847 (+ 69631us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1886845}
W20260810 11:30:21.975457 26850 connection.cc:441] server connection from 127.0.0.1:52560 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 308) could send its response
I20260810 11:30:21.975957 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 306) took 2164 ms. Trace:
I20260810 11:30:21.976629 27223 rpcz_store.cc:276] 0810 11:30:19.811493 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.817738 (+ 6245us) service_pool.cc:227] Handling call
0810 11:30:21.975746 (+2158008us) ts_tablet_manager.cc:1145] Deleting tablet 81f24c84cdd945b78f39f24015eb1e43
0810 11:30:21.975762 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.975909 (+ 147us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2143401}
W20260810 11:30:21.977253 26850 connection.cc:441] server connection from 127.0.0.1:52560 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 306) could send its response
I20260810 11:30:21.981801 27231 tablet_bootstrap.cc:492] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:21.982095 27231 ts_tablet_manager.cc:1397] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20260810 11:30:21.983170 27231 raft_consensus.cc:348] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.983484 27231 raft_consensus.cc:374] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.983588 27231 raft_consensus.cc:729] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.984009 27231 consensus_queue.cc:260] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.986795 27231 ts_tablet_manager.cc:1428] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260810 11:30:21.987457 27222 ts_tablet_manager.cc:1397] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.008s
I20260810 11:30:21.988049 27231 tablet_bootstrap.cc:492] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:21.989513 27222 raft_consensus.cc:348] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.990234 27231 tablet_bootstrap.cc:654] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:21.990875 27222 raft_consensus.cc:374] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:21.991020 27222 raft_consensus.cc:729] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:21.947950 27221 rpcz_store.cc:276] 0810 11:30:19.364164 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.368669 (+ 4505us) service_pool.cc:227] Handling call
0810 11:30:21.945057 (+2576388us) ts_tablet_manager.cc:1145] Deleting tablet a8a65a0e8b1f4e4b8d9a82059b766cda
0810 11:30:21.945077 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.947437 (+ 2360us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2576102}
I20260810 11:30:21.993585 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 325) took 1872 ms. Trace:
I20260810 11:30:21.993809 27222 consensus_queue.cc:260] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.993898 27223 rpcz_store.cc:276] 0810 11:30:20.121009 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:20.203213 (+ 82204us) service_pool.cc:227] Handling call
0810 11:30:21.993233 (+1790020us) ts_tablet_manager.cc:1145] Deleting tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e
0810 11:30:21.993255 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.993481 (+ 226us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1784778}
W20260810 11:30:21.994320 26850 connection.cc:441] server connection from 127.0.0.1:52560 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 325) could send its response
I20260810 11:30:21.994517 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 326) took 1850 ms. Trace:
I20260810 11:30:21.994763 27223 rpcz_store.cc:276] 0810 11:30:20.144096 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:20.208807 (+ 64711us) service_pool.cc:227] Handling call
0810 11:30:21.994317 (+1785510us) ts_tablet_manager.cc:1145] Deleting tablet 83631b421a614796bdf76335f1437e00
0810 11:30:21.994332 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.994469 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1782113}
W20260810 11:30:21.995402 26850 connection.cc:441] server connection from 127.0.0.1:52560 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 326) could send its response
W20260810 11:30:21.996259 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 315) could send its response
I20260810 11:30:21.996989 27609 raft_consensus.cc:482] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:21.995505 27223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 327) took 1776 ms. Trace:
I20260810 11:30:21.997200 27609 raft_consensus.cc:504] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:21.998003 27609 leader_election.cc:288] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:21.997224 27223 rpcz_store.cc:276] 0810 11:30:20.219078 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:20.219401 (+ 323us) service_pool.cc:227] Handling call
0810 11:30:21.995310 (+1775909us) ts_tablet_manager.cc:1145] Deleting tablet 34bd3c0edf6b49d1891c0ee9af344872
0810 11:30:21.995325 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.995443 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1774832}
W20260810 11:30:21.999203 26850 connection.cc:441] server connection from 127.0.0.1:52560 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 327) could send its response
W20260810 11:30:21.999950 26850 connection.cc:441] server connection from 127.0.0.1:52560 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 338) could send its response
I20260810 11:30:22.000115 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96cae4eb16c84410926a317af70e44f7" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:22.000491 26850 connection.cc:441] server connection from 127.0.0.1:52560 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 339) could send its response
I20260810 11:30:22.000530 27061 raft_consensus.cc:2454] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
W20260810 11:30:22.000999 26850 connection.cc:441] server connection from 127.0.0.1:52560 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 340) could send its response
I20260810 11:30:22.001132 26848 leader_election.cc:302] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:22.001432 27609 raft_consensus.cc:2781] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.001747 27609 raft_consensus.cc:482] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.001919 27609 raft_consensus.cc:3037] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.002017 26383 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
/tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.195.253:34547
--webserver_interface=127.25.195.253
--webserver_port=42129
--builtin_ntp_servers=127.25.195.212:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260810 11:30:22.002924 27708 raft_consensus.cc:482] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.003242 27708 raft_consensus.cc:504] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:22.003649 26850 connection.cc:441] server connection from 127.0.0.1:52560 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52560 (request call id 341) could send its response
I20260810 11:30:22.004307 27708 leader_election.cc:288] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:22.010203 27228 tablet_bootstrap.cc:492] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.010435 27228 ts_tablet_manager.cc:1397] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.074s user 0.015s sys 0.000s
I20260810 11:30:22.011451 27228 raft_consensus.cc:348] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.011755 27228 raft_consensus.cc:374] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.012873 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5adccd80a04e328e13793b461c38b1" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:22.013175 26911 raft_consensus.cc:2454] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:22.014197 26991 leader_election.cc:302] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:22.014622 27708 raft_consensus.cc:2781] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.014739 27708 raft_consensus.cc:482] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.014858 27708 raft_consensus.cc:3037] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.015501 26911 raft_consensus.cc:3037] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.017915 27231 tablet_bootstrap.cc:492] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:22.018112 27231 ts_tablet_manager.cc:1397] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.031s user 0.011s sys 0.003s
I20260810 11:30:22.018443 27228 raft_consensus.cc:729] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.019603 26915 raft_consensus.cc:2454] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:22.019724 27228 consensus_queue.cc:260] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.020596 27228 ts_tablet_manager.cc:1428] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260810 11:30:22.021147 27228 tablet_bootstrap.cc:492] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.021246 27231 raft_consensus.cc:348] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.021485 27231 raft_consensus.cc:374] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.021572 27231 raft_consensus.cc:729] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.021850 27231 consensus_queue.cc:260] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.025245 27231 ts_tablet_manager.cc:1428] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260810 11:30:22.026866 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 320) took 2574 ms. Trace:
I20260810 11:30:22.027017 27709 raft_consensus.cc:482] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.027055 27221 rpcz_store.cc:276] 0810 11:30:19.421981 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.422066 (+ 85us) service_pool.cc:227] Handling call
0810 11:30:21.992428 (+2570362us) ts_tablet_manager.cc:1145] Deleting tablet 44d5e146eeec4fe0be33c1c169d32e68
0810 11:30:21.995690 (+ 3262us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:21.995873 (+ 183us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2569998}
I20260810 11:30:22.027204 27709 raft_consensus.cc:504] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.028007 27231 tablet_bootstrap.cc:492] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:22.028034 27228 tablet_bootstrap.cc:654] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.028162 27709 leader_election.cc:288] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:22.030532 27231 tablet_bootstrap.cc:654] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.035531 27231 tablet_bootstrap.cc:492] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:22.035764 27231 ts_tablet_manager.cc:1397] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260810 11:30:22.036684 27231 raft_consensus.cc:348] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.037027 27231 raft_consensus.cc:374] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.037119 27231 raft_consensus.cc:729] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.037424 27231 consensus_queue.cc:260] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.038609 27228 tablet_bootstrap.cc:492] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.038709 26991 leader_election.cc:302] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:22.039765 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d722b93fe27f4c08a592bc393046b6bd" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:22.040109 26915 raft_consensus.cc:2454] T d722b93fe27f4c08a592bc393046b6bd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:22.040341 27228 ts_tablet_manager.cc:1397] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.005s
I20260810 11:30:22.040988 27709 raft_consensus.cc:2781] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.041148 27709 raft_consensus.cc:686] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:22.041476 27709 consensus_queue.cc:237] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:22.041527 27228 raft_consensus.cc:348] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.041832 27228 raft_consensus.cc:374] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.041953 27228 raft_consensus.cc:729] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.050284 26991 leader_election.cc:302] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:22.051113 27228 consensus_queue.cc:260] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.052062 27228 ts_tablet_manager.cc:1428] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260810 11:30:22.053653 27709 raft_consensus.cc:482] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.052446 27228 tablet_bootstrap.cc:492] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.054225 27231 ts_tablet_manager.cc:1428] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.018s user 0.003s sys 0.013s
I20260810 11:30:22.054255 27709 raft_consensus.cc:504] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.054693 27231 tablet_bootstrap.cc:492] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:22.055418 27709 leader_election.cc:288] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:22.057018 27228 tablet_bootstrap.cc:654] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.057174 27231 tablet_bootstrap.cc:654] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.053654 27748 raft_consensus.cc:2781] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.064635 27748 raft_consensus.cc:482] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.064850 27748 raft_consensus.cc:3037] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.065116 27718 raft_consensus.cc:504] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.069957 27655 raft_consensus.cc:482] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.070297 27655 raft_consensus.cc:504] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.071321 27655 leader_election.cc:288] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.072839 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d729baae40a64e6e8c23e6870f230afb" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:22.073232 27061 raft_consensus.cc:2454] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:22.074204 26848 leader_election.cc:302] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:22.074760 27655 raft_consensus.cc:2781] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.074911 27655 raft_consensus.cc:482] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.075042 27655 raft_consensus.cc:3037] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.093080 27718 leader_election.cc:288] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:22.095634 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa16654b7f34f9baf856bf724cece8f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:22.097137 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbe34108a7604fa6aa667758be11f569" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:22.101306 26991 leader_election.cc:341] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:22.103765 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 320) could send its response
I20260810 11:30:22.108202 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa16654b7f34f9baf856bf724cece8f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:22.108536 26769 raft_consensus.cc:2454] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:22.106983 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d722b93fe27f4c08a592bc393046b6bd" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:22.109293 26771 raft_consensus.cc:2454] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:22.112854 27221 tablet_replica.cc:330] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:22.113260 27221 raft_consensus.cc:2229] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:22.115253 27221 raft_consensus.cc:2258] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:22.116400 27221 ts_tablet_manager.cc:1905] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:22.122370 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbe34108a7604fa6aa667758be11f569" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:22.122699 26771 raft_consensus.cc:3037] T bbe34108a7604fa6aa667758be11f569 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.128248 27609 raft_consensus.cc:504] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.130658 26912 raft_consensus.cc:2454] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:22.134603 27655 raft_consensus.cc:504] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.149292 27655 leader_election.cc:288] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.153297 27526 raft_consensus.cc:504] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.157882 27609 leader_election.cc:288] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.167467 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6a3b1e37ac943e391d54640987136f8" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:22.168816 26700 leader_election.cc:341] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:22.160014 27744 raft_consensus.cc:482] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.160238 27222 ts_tablet_manager.cc:1428] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.173s user 0.022s sys 0.047s
I20260810 11:30:22.170454 27222 tablet_bootstrap.cc:492] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:22.169752 27744 raft_consensus.cc:504] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.173766 27222 tablet_bootstrap.cc:654] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.161551 26771 raft_consensus.cc:2454] T bbe34108a7604fa6aa667758be11f569 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
W20260810 11:30:22.176916 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 219020us
I20260810 11:30:22.178261 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e829d4bffeb4289a54b4d3d7a53c44e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:22.179416 26700 leader_election.cc:341] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:22.114928 26993 leader_election.cc:341] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: db5adccd80a04e328e13793b461c38b1
W20260810 11:30:22.180039 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 65185.3us
I20260810 11:30:22.121099 27060 raft_consensus.cc:2454] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:22.126431 27708 raft_consensus.cc:504] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:22.180852 27248 raft_consensus.cc:2229] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:22.126379 27748 raft_consensus.cc:504] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.132326 27639 raft_consensus.cc:504] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.181620 27708 leader_election.cc:288] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:22.181481 27248 raft_consensus.cc:2258] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:22.181871 27748 leader_election.cc:288] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:22.182271 27639 leader_election.cc:288] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:22.182436 27248 ts_tablet_manager.cc:1905] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:22.183923 26993 leader_election.cc:302] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:22.184633 26993 leader_election.cc:302] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:22.185820 27748 raft_consensus.cc:2781] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.186085 27708 raft_consensus.cc:2781] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.185981 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96cae4eb16c84410926a317af70e44f7" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:22.186264 27708 raft_consensus.cc:686] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:22.186357 27059 raft_consensus.cc:3037] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.186581 27708 consensus_queue.cc:237] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.185983 27748 raft_consensus.cc:482] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.187974 27748 raft_consensus.cc:3037] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.191061 27059 raft_consensus.cc:2454] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:22.191677 27748 raft_consensus.cc:504] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.192952 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e829d4bffeb4289a54b4d3d7a53c44e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:22.193351 27060 raft_consensus.cc:2454] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:22.194156 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d729baae40a64e6e8c23e6870f230afb" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:22.193964 26702 leader_election.cc:302] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:22.194376 27061 raft_consensus.cc:3037] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.195282 27248 ts_tablet_manager.cc:1918] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:22.195439 27248 log.cc:1196] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/2e2c9112462f442e8de5b4a944cfdc6b
I20260810 11:30:22.195977 27248 ts_tablet_manager.cc:1939] T 2e2c9112462f442e8de5b4a944cfdc6b P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:22.197013 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 271) took 3538 ms. Trace:
I20260810 11:30:22.197178 27248 rpcz_store.cc:276] 0810 11:30:18.658347 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.658428 (+ 81us) service_pool.cc:227] Handling call
0810 11:30:21.915762 (+3257334us) ts_tablet_manager.cc:1145] Deleting tablet 2e2c9112462f442e8de5b4a944cfdc6b
0810 11:30:21.915774 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.181285 (+265511us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x6150000c29a4. stack: 00007faac62fb66e 00007faac62fb430 00007faac53825ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007faad183304d 00007faad2ad75ec 00007faad54662e6 00007faad5498404 00007faad5479870 00007faad54795fd 00000000009edb7c 00007faac6341344 00007faac634491b 00007faac6344798
0810 11:30:22.190910 (+ 9625us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:22.195068 (+ 4158us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:22.196968 (+ 1900us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":498642816,"tablet-delete.queue_time_us":3241049}
W20260810 11:30:22.197531 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 271) could send its response
I20260810 11:30:22.197561 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d91a02b22044429fb3e25840c7947a02" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:22.197597 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d722b93fe27f4c08a592bc393046b6bd" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:22.197835 26765 raft_consensus.cc:3037] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.197894 26769 raft_consensus.cc:3037] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.199379 27222 tablet_bootstrap.cc:492] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:22.199584 27222 ts_tablet_manager.cc:1397] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.006s
I20260810 11:30:22.200618 27222 raft_consensus.cc:348] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.201529 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 273) took 3518 ms. Trace:
I20260810 11:30:22.202802 27248 rpcz_store.cc:276] 0810 11:30:18.685772 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.685994 (+ 222us) service_pool.cc:227] Handling call
0810 11:30:22.201301 (+3515307us) ts_tablet_manager.cc:1145] Deleting tablet 4c595e0892634348b64418ae9dbbd4c2
0810 11:30:22.201319 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.201483 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3515007}
I20260810 11:30:22.203699 27061 raft_consensus.cc:2454] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:22.201814 26765 raft_consensus.cc:2454] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:22.205699 27222 raft_consensus.cc:374] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.205829 27222 raft_consensus.cc:729] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.204855 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa16654b7f34f9baf856bf724cece8f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:22.206197 26767 raft_consensus.cc:3037] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.206132 27222 consensus_queue.cc:260] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.207165 26769 raft_consensus.cc:2454] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
W20260810 11:30:22.203857 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 273) could send its response
I20260810 11:30:22.209263 26848 leader_election.cc:302] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:22.209928 26767 raft_consensus.cc:2454] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:22.210041 26848 leader_election.cc:302] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:22.210361 27655 raft_consensus.cc:2781] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.210512 27639 raft_consensus.cc:482] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.210590 27655 raft_consensus.cc:686] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:22.210989 27655 consensus_queue.cc:237] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.210816 27639 raft_consensus.cc:504] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.211926 27639 leader_election.cc:288] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:22.210939 26993 leader_election.cc:302] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:22.212324 26993 leader_election.cc:302] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:22.212666 26993 leader_election.cc:302] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:22.212723 27751 raft_consensus.cc:2781] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.212925 27750 raft_consensus.cc:2781] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.213078 27750 raft_consensus.cc:686] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:22.213511 27609 raft_consensus.cc:2781] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.213372 27750 consensus_queue.cc:237] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:22.213856 26993 leader_election.cc:341] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 7bd67ebf23694ae7b0ede6c5d1a06f88
I20260810 11:30:22.213902 27639 raft_consensus.cc:2781] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.207930 27708 raft_consensus.cc:482] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.207515 27748 leader_election.cc:288] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:22.214058 27708 raft_consensus.cc:504] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.214613 27708 leader_election.cc:288] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:22.214573 27751 raft_consensus.cc:686] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:22.215035 27639 raft_consensus.cc:686] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:22.214958 27751 consensus_queue.cc:237] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.215307 27639 consensus_queue.cc:237] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.216629 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3884736eec74c8992b8d51b37465875" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:22.217001 27763 raft_consensus.cc:2781] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.218535 27763 raft_consensus.cc:482] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.219023 27763 raft_consensus.cc:3037] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:22.222365 26993 leader_election.cc:341] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: db5adccd80a04e328e13793b461c38b1
W20260810 11:30:22.227150 26991 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 125876us
W20260810 11:30:22.227574 26991 leader_election.cc:341] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:22.228135 26991 leader_election.cc:302] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:22.229321 27748 raft_consensus.cc:2781] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.229542 27748 raft_consensus.cc:686] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:22.229889 27748 consensus_queue.cc:237] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.175004 27740 raft_consensus.cc:482] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.231901 27740 raft_consensus.cc:504] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.183117 27744 leader_election.cc:288] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.236397 27526 leader_election.cc:288] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.237794 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6a3b1e37ac943e391d54640987136f8" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:22.238210 27061 raft_consensus.cc:3037] T b6a3b1e37ac943e391d54640987136f8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.241863 27061 raft_consensus.cc:2454] T b6a3b1e37ac943e391d54640987136f8 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:22.242556 26702 leader_election.cc:302] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:22.243170 27526 raft_consensus.cc:2781] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.243402 27526 raft_consensus.cc:686] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:22.243765 27526 consensus_queue.cc:237] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.210399 26848 leader_election.cc:302] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:22.252739 27633 raft_consensus.cc:2781] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.253093 27633 raft_consensus.cc:686] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:22.253252 26767 raft_consensus.cc:2454] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:22.253434 27633 consensus_queue.cc:237] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.254914 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3884736eec74c8992b8d51b37465875" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:22.255937 26700 leader_election.cc:341] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:22.256305 27763 raft_consensus.cc:504] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.256670 26993 leader_election.cc:302] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
W20260810 11:30:22.256705 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 46328.5us
I20260810 11:30:22.257176 27748 raft_consensus.cc:2781] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.257385 27748 raft_consensus.cc:482] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.257694 27748 raft_consensus.cc:3037] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.260107 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e829d4bffeb4289a54b4d3d7a53c44e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:22.260478 27061 raft_consensus.cc:3037] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.262068 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d722b93fe27f4c08a592bc393046b6bd" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:22.262355 26911 raft_consensus.cc:3037] T d722b93fe27f4c08a592bc393046b6bd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.262598 27748 raft_consensus.cc:504] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.263279 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e829d4bffeb4289a54b4d3d7a53c44e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:22.264721 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3884736eec74c8992b8d51b37465875" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:22.265161 26767 raft_consensus.cc:3037] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.267009 26911 raft_consensus.cc:2454] T d722b93fe27f4c08a592bc393046b6bd P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:22.267560 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5adccd80a04e328e13793b461c38b1" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:22.267892 26912 raft_consensus.cc:3037] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:22.264851 26700 leader_election.cc:341] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:22.269191 26767 raft_consensus.cc:2454] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:22.270242 26993 leader_election.cc:302] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:22.270620 27708 raft_consensus.cc:2781] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.270804 27708 raft_consensus.cc:686] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:22.271092 27708 consensus_queue.cc:237] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.272147 27763 leader_election.cc:288] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.279215 27061 raft_consensus.cc:2454] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:22.280910 26702 leader_election.cc:302] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:22.281383 27763 raft_consensus.cc:2781] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.281468 27740 leader_election.cc:288] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.281793 27763 raft_consensus.cc:686] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:22.204293 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 274) took 3518 ms. Trace:
I20260810 11:30:22.281984 27248 rpcz_store.cc:276] 0810 11:30:18.685943 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.686170 (+ 227us) service_pool.cc:227] Handling call
0810 11:30:22.204106 (+3517936us) ts_tablet_manager.cc:1145] Deleting tablet 4b5a7f67ec5b48c2b5a510add0282a76
0810 11:30:22.204120 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.204254 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3516998}
W20260810 11:30:22.282379 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 274) could send its response
I20260810 11:30:22.282495 27763 consensus_queue.cc:237] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.283017 27248 tablet_replica.cc:330] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:22.283416 27248 raft_consensus.cc:2229] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:22.283659 27248 raft_consensus.cc:2258] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:22.284454 27248 ts_tablet_manager.cc:1905] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:22.284453 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d91a02b22044429fb3e25840c7947a02" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:22.284969 26911 raft_consensus.cc:3037] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.289314 26911 raft_consensus.cc:2454] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:22.291890 27221 ts_tablet_manager.cc:1918] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:22.292691 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd67ebf23694ae7b0ede6c5d1a06f88" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:22.292963 26915 raft_consensus.cc:2454] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:22.293932 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3884736eec74c8992b8d51b37465875" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:22.295825 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3884736eec74c8992b8d51b37465875" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:22.296746 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa16654b7f34f9baf856bf724cece8f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:22.298779 26912 raft_consensus.cc:2454] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
W20260810 11:30:22.299396 26849 leader_election.cc:341] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 96cae4eb16c84410926a317af70e44f7
W20260810 11:30:22.302420 26849 leader_election.cc:341] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 96cae4eb16c84410926a317af70e44f7
I20260810 11:30:22.285742 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3884736eec74c8992b8d51b37465875" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:22.288719 27718 raft_consensus.cc:482] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.309188 27633 raft_consensus.cc:482] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.309230 27718 raft_consensus.cc:504] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.309460 27633 raft_consensus.cc:504] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:22.309938 27748 leader_election.cc:288] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:22.310043 27718 leader_election.cc:288] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:22.310472 27633 leader_election.cc:288] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:22.310874 27759 tablet.cc:1722] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:22.299667 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d729baae40a64e6e8c23e6870f230afb" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:22.301322 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d729baae40a64e6e8c23e6870f230afb" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:22.301467 27526 raft_consensus.cc:482] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.309712 26702 leader_election.cc:302] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:22.310904 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca5c88585394dba87e201696afa6934" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:22.318398 26769 raft_consensus.cc:2454] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:22.318410 27763 raft_consensus.cc:2726] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:22.319185 26993 leader_election.cc:302] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:22.321560 27718 raft_consensus.cc:2781] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.321736 27718 raft_consensus.cc:482] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.321969 27718 raft_consensus.cc:3037] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:22.322980 26849 leader_election.cc:341] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: Tablet not RUNNING: STOPPED
W20260810 11:30:22.323716 26849 leader_election.cc:341] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: Tablet not RUNNING: STOPPED
I20260810 11:30:22.324836 27526 raft_consensus.cc:504] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.326761 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25ae21cc8cc4749a507fcab5ee225a3" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:22.327310 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25ae21cc8cc4749a507fcab5ee225a3" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:22.327733 26849 leader_election.cc:341] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 7eae49e1c6554ba2ae831831ff4bb45c
I20260810 11:30:22.327785 27060 raft_consensus.cc:2454] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
W20260810 11:30:22.328158 26700 leader_election.cc:341] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:22.328383 26702 leader_election.cc:302] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:22.328924 27526 leader_election.cc:288] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.329355 27526 raft_consensus.cc:2781] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.329567 27526 raft_consensus.cc:482] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.329748 27526 raft_consensus.cc:3037] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.332314 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eae49e1c6554ba2ae831831ff4bb45c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:22.333173 27609 raft_consensus.cc:686] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:22.333642 27609 consensus_queue.cc:237] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.333931 27061 raft_consensus.cc:2454] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:22.334641 26848 leader_election.cc:302] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:22.335739 27765 raft_consensus.cc:2781] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.336042 27221 log.cc:1196] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/d729baae40a64e6e8c23e6870f230afb
I20260810 11:30:22.306877 26991 leader_election.cc:302] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:22.336866 27221 ts_tablet_manager.cc:1939] T d729baae40a64e6e8c23e6870f230afb P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:22.335973 27765 raft_consensus.cc:482] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.337932 27765 raft_consensus.cc:3037] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.339627 27222 ts_tablet_manager.cc:1428] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.140s user 0.005s sys 0.001s
W20260810 11:30:22.341764 26991 raft_consensus.cc:2670] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 11:30:22.345062 27718 raft_consensus.cc:504] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.345592 27231 tablet_bootstrap.cc:492] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:22.346170 27231 ts_tablet_manager.cc:1397] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.291s user 0.016s sys 0.056s
I20260810 11:30:22.346604 27718 leader_election.cc:288] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:22.346941 26991 leader_election.cc:341] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:22.347107 27231 raft_consensus.cc:348] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.347365 27231 raft_consensus.cc:374] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.347465 27231 raft_consensus.cc:729] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.349002 27222 tablet_bootstrap.cc:492] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:22.350031 27526 raft_consensus.cc:504] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.350888 27526 leader_election.cc:288] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.350837 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca5c88585394dba87e201696afa6934" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:22.351100 26769 raft_consensus.cc:3037] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.355758 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25ae21cc8cc4749a507fcab5ee225a3" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:22.356609 26769 raft_consensus.cc:2454] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
W20260810 11:30:22.360751 26700 leader_election.cc:341] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:22.361769 27231 consensus_queue.cc:260] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.362504 27228 tablet_bootstrap.cc:492] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.362739 27228 ts_tablet_manager.cc:1397] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.310s user 0.034s sys 0.073s
I20260810 11:30:22.362813 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 321) took 2901 ms. Trace:
W20260810 11:30:22.362129 26991 leader_election.cc:341] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:22.363642 27228 raft_consensus.cc:348] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.363945 27228 raft_consensus.cc:374] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.364269 27228 raft_consensus.cc:729] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.366117 26993 leader_election.cc:302] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:22.366695 27718 raft_consensus.cc:2781] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.366626 27221 rpcz_store.cc:276] 0810 11:30:19.461046 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.486747 (+ 25701us) service_pool.cc:227] Handling call
0810 11:30:22.027442 (+2540695us) ts_tablet_manager.cc:1145] Deleting tablet d729baae40a64e6e8c23e6870f230afb
0810 11:30:22.027459 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.225052 (+197593us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:22.291686 (+ 66634us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:22.362756 (+ 71070us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2526941}
I20260810 11:30:22.366971 27718 raft_consensus.cc:686] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:22.366677 27228 consensus_queue.cc:260] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:22.367058 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 321) could send its response
I20260810 11:30:22.367281 27718 consensus_queue.cc:237] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.367589 27228 ts_tablet_manager.cc:1428] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 11:30:22.369201 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 322) took 2650 ms. Trace:
I20260810 11:30:22.369827 27228 tablet_bootstrap.cc:492] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.370543 27222 tablet_bootstrap.cc:654] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.369802 27221 rpcz_store.cc:276] 0810 11:30:19.718945 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.719310 (+ 365us) service_pool.cc:227] Handling call
0810 11:30:22.368983 (+2649673us) ts_tablet_manager.cc:1145] Deleting tablet 0118ff9d21924aefa8c6c32977c10453
0810 11:30:22.368999 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.369156 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2649305}
I20260810 11:30:22.373070 27228 tablet_bootstrap.cc:654] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:22.373558 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 322) could send its response
I20260810 11:30:22.374401 27765 raft_consensus.cc:504] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:22.377233 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 323) took 2649 ms. Trace:
I20260810 11:30:22.377544 27221 rpcz_store.cc:276] 0810 11:30:19.727828 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.727897 (+ 69us) service_pool.cc:227] Handling call
0810 11:30:22.376993 (+2649096us) ts_tablet_manager.cc:1145] Deleting tablet 1a83391804894d268d0e603f4feb1745
0810 11:30:22.377011 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.377174 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2648694}
W20260810 11:30:22.377674 26991 leader_election.cc:341] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:22.377882 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 323) could send its response
I20260810 11:30:22.377982 27231 ts_tablet_manager.cc:1428] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.032s user 0.001s sys 0.001s
I20260810 11:30:22.378162 26991 leader_election.cc:302] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:22.381155 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 325) took 2637 ms. Trace:
I20260810 11:30:22.382361 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca5c88585394dba87e201696afa6934" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:22.383589 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca5c88585394dba87e201696afa6934" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:22.384069 27228 tablet_bootstrap.cc:492] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.384552 27228 ts_tablet_manager.cc:1397] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.007s
I20260810 11:30:22.385821 27228 raft_consensus.cc:348] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.386124 27228 raft_consensus.cc:374] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.386482 27228 raft_consensus.cc:729] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.386844 27228 consensus_queue.cc:260] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.387877 27228 ts_tablet_manager.cc:1428] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260810 11:30:22.391707 27765 leader_election.cc:288] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:22.392750 26849 leader_election.cc:341] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 7eae49e1c6554ba2ae831831ff4bb45c
I20260810 11:30:22.381686 27221 rpcz_store.cc:276] 0810 11:30:19.743194 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.743259 (+ 65us) service_pool.cc:227] Handling call
0810 11:30:22.380867 (+2637608us) ts_tablet_manager.cc:1145] Deleting tablet 49db12565dbc4187b78a98ed35c40fed
0810 11:30:22.380890 (+ 23us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.381088 (+ 198us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2637143}
W20260810 11:30:22.393721 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 325) could send its response
I20260810 11:30:22.394220 27228 tablet_bootstrap.cc:492] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.394622 27221 tablet_replica.cc:330] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:22.395287 27221 raft_consensus.cc:2229] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:22.396229 27221 raft_consensus.cc:2258] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:22.397013 27228 tablet_bootstrap.cc:654] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.397747 27222 tablet_bootstrap.cc:492] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:22.398023 27222 ts_tablet_manager.cc:1397] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.006s
I20260810 11:30:22.399844 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25ae21cc8cc4749a507fcab5ee225a3" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:22.398090 27221 ts_tablet_manager.cc:1905] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:22.401288 27222 raft_consensus.cc:348] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.401598 27222 raft_consensus.cc:374] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.401676 27222 raft_consensus.cc:729] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.402279 27765 raft_consensus.cc:482] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.402523 27765 raft_consensus.cc:504] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.403697 27765 leader_election.cc:288] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.404004 27750 raft_consensus.cc:2781] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.403996 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31cafb7c691d40a48a40f7d4190c4f8d" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:22.404287 26769 raft_consensus.cc:2454] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:22.404943 26849 leader_election.cc:302] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:22.401996 27222 consensus_queue.cc:260] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.405263 27231 tablet_bootstrap.cc:492] T 08f6636df13548c49f35e1808a87c1f5 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:22.405997 27222 ts_tablet_manager.cc:1428] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260810 11:30:22.406445 27222 tablet_bootstrap.cc:492] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:22.407192 27231 tablet_bootstrap.cc:654] T 08f6636df13548c49f35e1808a87c1f5 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.409176 27222 tablet_bootstrap.cc:654] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:22.410212 26991 leader_election.cc:341] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:22.410651 26991 leader_election.cc:341] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:22.411041 27061 raft_consensus.cc:3037] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.414839 27061 raft_consensus.cc:2454] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:22.415680 27750 raft_consensus.cc:686] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:22.414441 27765 raft_consensus.cc:2781] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.416016 27750 consensus_queue.cc:237] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:22.416275 27765 raft_consensus.cc:482] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.416429 27765 raft_consensus.cc:3037] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.418927 27709 raft_consensus.cc:482] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.419116 27709 raft_consensus.cc:504] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.419768 27709 leader_election.cc:288] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:22.420698 27708 raft_consensus.cc:482] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.420944 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2917f1ffb5214a80b19810540602df35" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:22.421232 26914 raft_consensus.cc:2454] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:22.422379 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eae49e1c6554ba2ae831831ff4bb45c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:22.423324 27060 raft_consensus.cc:3037] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.424309 27765 raft_consensus.cc:504] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.427253 27060 raft_consensus.cc:2454] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:22.428229 27765 leader_election.cc:288] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:22.428345 26993 leader_election.cc:341] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 2917f1ffb5214a80b19810540602df35
I20260810 11:30:22.428984 26848 leader_election.cc:302] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:22.429069 27228 tablet_bootstrap.cc:492] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.429333 27228 ts_tablet_manager.cc:1397] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.001s
I20260810 11:30:22.429329 27765 raft_consensus.cc:2781] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.430434 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31cafb7c691d40a48a40f7d4190c4f8d" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:22.430683 27765 raft_consensus.cc:686] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:22.430711 27059 raft_consensus.cc:2454] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:22.430950 27228 raft_consensus.cc:348] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.431005 27765 consensus_queue.cc:237] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:22.431270 27228 raft_consensus.cc:374] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.432926 27228 raft_consensus.cc:729] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.433280 27228 consensus_queue.cc:260] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.428009 27708 raft_consensus.cc:504] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.434921 27228 ts_tablet_manager.cc:1428] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260810 11:30:22.436339 27228 tablet_bootstrap.cc:492] T b6a3b1e37ac943e391d54640987136f8 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.437907 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31cafb7c691d40a48a40f7d4190c4f8d" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:22.439088 27228 tablet_bootstrap.cc:654] T b6a3b1e37ac943e391d54640987136f8 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.439378 27708 leader_election.cc:288] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:22.439378 27059 raft_consensus.cc:3037] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.439667 26991 leader_election.cc:302] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:22.440718 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b28f3dcbd6d74559b372d3452e13ce9f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:22.440980 26914 raft_consensus.cc:2454] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:22.443781 26991 leader_election.cc:302] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:22.444298 27708 raft_consensus.cc:2781] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.444451 27708 raft_consensus.cc:482] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.444547 27708 raft_consensus.cc:3037] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.451742 26591 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 3 FOLLOWER]: Refusing update from remote peer 83cc8e39a3b9455f8242a6da6a54c38a: Log matching property violated. Preceding OpId in replica: term: 2 index: 491. Preceding OpId from leader: term: 3 index: 492. (index mismatch)
I20260810 11:30:22.452661 27731 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 492, Last known committed idx: 490, Time since last communication: 0.000s
I20260810 11:30:22.453570 27708 raft_consensus.cc:504] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.454583 27059 raft_consensus.cc:2454] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:22.454922 27228 tablet_bootstrap.cc:492] T b6a3b1e37ac943e391d54640987136f8 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.455246 27228 ts_tablet_manager.cc:1397] T b6a3b1e37ac943e391d54640987136f8 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.001s
W20260810 11:30:22.455790 26993 leader_election.cc:341] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 2917f1ffb5214a80b19810540602df35
I20260810 11:30:22.456141 26848 leader_election.cc:302] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:22.456315 27228 raft_consensus.cc:348] T b6a3b1e37ac943e391d54640987136f8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.456748 27228 raft_consensus.cc:374] T b6a3b1e37ac943e391d54640987136f8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.456862 27228 raft_consensus.cc:729] T b6a3b1e37ac943e391d54640987136f8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.456954 27655 raft_consensus.cc:2781] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.457088 27655 raft_consensus.cc:686] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:22.457185 27228 consensus_queue.cc:260] T b6a3b1e37ac943e391d54640987136f8 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.457356 27655 consensus_queue.cc:237] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.458427 27248 ts_tablet_manager.cc:1918] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:22.458616 27248 log.cc:1196] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/7bd67ebf23694ae7b0ede6c5d1a06f88
I20260810 11:30:22.459007 27248 ts_tablet_manager.cc:1939] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:22.459184 27228 ts_tablet_manager.cc:1428] T b6a3b1e37ac943e391d54640987136f8 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
W20260810 11:30:22.459452 26849 consensus_peers.cc:487] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3c6bd6803c245b7bb3d78423de482b6. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:22.460366 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2917f1ffb5214a80b19810540602df35" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:22.460506 27228 tablet_bootstrap.cc:492] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.460654 26914 raft_consensus.cc:3037] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.461292 27609 raft_consensus.cc:482] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.461465 27609 raft_consensus.cc:504] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.462100 27609 leader_election.cc:288] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.463299 27609 raft_consensus.cc:482] T b6a3b1e37ac943e391d54640987136f8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.463469 27609 raft_consensus.cc:504] T b6a3b1e37ac943e391d54640987136f8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.463969 27228 tablet_bootstrap.cc:654] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.464200 27609 leader_election.cc:288] T b6a3b1e37ac943e391d54640987136f8 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.466187 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca5c88585394dba87e201696afa6934" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:22.468703 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6a3b1e37ac943e391d54640987136f8" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:22.469362 27061 raft_consensus.cc:2379] T b6a3b1e37ac943e391d54640987136f8 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:22.471205 26914 raft_consensus.cc:2454] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:22.472189 27708 leader_election.cc:288] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:22.472386 27718 raft_consensus.cc:2781] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.472841 27718 raft_consensus.cc:482] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.473529 27718 raft_consensus.cc:3037] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.474298 26991 leader_election.cc:302] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:22.479712 27708 raft_consensus.cc:2781] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.480118 27708 raft_consensus.cc:686] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:22.482765 27708 consensus_queue.cc:237] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.485451 27231 tablet_bootstrap.cc:492] T 08f6636df13548c49f35e1808a87c1f5 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:22.485690 27231 ts_tablet_manager.cc:1397] T 08f6636df13548c49f35e1808a87c1f5 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.086s user 0.006s sys 0.009s
I20260810 11:30:22.487401 27231 raft_consensus.cc:348] T 08f6636df13548c49f35e1808a87c1f5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.487716 27231 raft_consensus.cc:374] T 08f6636df13548c49f35e1808a87c1f5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.487847 27231 raft_consensus.cc:729] T 08f6636df13548c49f35e1808a87c1f5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.487977 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 275) took 3784 ms. Trace:
I20260810 11:30:22.488050 27718 raft_consensus.cc:504] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.489224 27231 consensus_queue.cc:260] T 08f6636df13548c49f35e1808a87c1f5 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.489882 27231 ts_tablet_manager.cc:1428] T 08f6636df13548c49f35e1808a87c1f5 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:22.490204 27231 tablet_bootstrap.cc:492] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:22.417580 26702 leader_election.cc:302] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
W20260810 11:30:22.491865 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 74313.3us
I20260810 11:30:22.425659 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31cafb7c691d40a48a40f7d4190c4f8d" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:22.492190 26769 raft_consensus.cc:3037] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.431530 27526 raft_consensus.cc:482] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.436981 27221 ts_tablet_manager.cc:1918] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:22.438773 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b28f3dcbd6d74559b372d3452e13ce9f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:22.450510 27763 raft_consensus.cc:482] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.462957 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca5c88585394dba87e201696afa6934" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:22.465126 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6a3b1e37ac943e391d54640987136f8" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:22.497742 26993 leader_election.cc:341] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: Tablet not RUNNING: STOPPED
I20260810 11:30:22.498028 26849 leader_election.cc:302] T b6a3b1e37ac943e391d54640987136f8 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:22.498634 27609 raft_consensus.cc:3037] T b6a3b1e37ac943e391d54640987136f8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.496748 27754 raft_consensus.cc:2781] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.500962 27754 raft_consensus.cc:686] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:22.501386 27754 consensus_queue.cc:237] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.496862 27526 raft_consensus.cc:504] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.504168 27526 leader_election.cc:288] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.504258 27609 raft_consensus.cc:2726] T b6a3b1e37ac943e391d54640987136f8 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:22.496979 27221 log.cc:1196] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/b28f3dcbd6d74559b372d3452e13ce9f
I20260810 11:30:22.504776 27221 ts_tablet_manager.cc:1939] T b28f3dcbd6d74559b372d3452e13ce9f P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:22.505761 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 329) took 2733 ms. Trace:
I20260810 11:30:22.505872 27221 rpcz_store.cc:276] 0810 11:30:19.772150 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.773839 (+ 1689us) service_pool.cc:227] Handling call
0810 11:30:22.394497 (+2620658us) ts_tablet_manager.cc:1145] Deleting tablet b28f3dcbd6d74559b372d3452e13ce9f
0810 11:30:22.394519 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.429142 (+ 34623us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:22.436807 (+ 7665us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:22.505696 (+ 68889us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2612621}
I20260810 11:30:22.506407 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 331) took 2688 ms. Trace:
I20260810 11:30:22.506636 27221 rpcz_store.cc:276] 0810 11:30:19.817818 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.817953 (+ 135us) service_pool.cc:227] Handling call
0810 11:30:22.506205 (+2688252us) ts_tablet_manager.cc:1145] Deleting tablet 81f24c84cdd945b78f39f24015eb1e43
0810 11:30:22.506218 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.506350 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2673238}
I20260810 11:30:22.497319 26767 raft_consensus.cc:2379] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
I20260810 11:30:22.497184 27763 raft_consensus.cc:504] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.508821 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "725d2e70e1d441b497d56a278e1de0ad" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:22.508961 27709 raft_consensus.cc:482] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.509192 27709 raft_consensus.cc:504] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.509893 27709 leader_election.cc:288] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:22.513132 27763 leader_election.cc:288] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:22.513510 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 329) could send its response
W20260810 11:30:22.513687 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 331) could send its response
I20260810 11:30:22.513984 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 349) took 2235 ms. Trace:
I20260810 11:30:22.519754 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23637a02b6464e17aa2a69ea5cc4ddfe" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:22.520359 26912 raft_consensus.cc:2454] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:22.521157 26991 leader_election.cc:302] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:22.521669 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffeb0373c6124af291336ca9da50c318" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:22.521979 27059 raft_consensus.cc:2454] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:22.522317 27709 raft_consensus.cc:2781] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.522291 26849 leader_election.cc:302] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:22.522437 27709 raft_consensus.cc:482] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.522543 27709 raft_consensus.cc:3037] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.523131 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffeb0373c6124af291336ca9da50c318" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:22.523761 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "725d2e70e1d441b497d56a278e1de0ad" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:22.524034 27061 raft_consensus.cc:2454] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:22.515276 27221 rpcz_store.cc:276] 0810 11:30:20.272028 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:20.272081 (+ 53us) service_pool.cc:227] Handling call
0810 11:30:22.507338 (+2235257us) ts_tablet_manager.cc:1145] Deleting tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e
0810 11:30:22.507355 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.507619 (+ 264us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2234796}
I20260810 11:30:22.525291 26702 leader_election.cc:302] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:22.525559 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 350) took 2128 ms. Trace:
I20260810 11:30:22.525692 27221 rpcz_store.cc:276] 0810 11:30:20.397204 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:20.397275 (+ 71us) service_pool.cc:227] Handling call
0810 11:30:22.525309 (+2128034us) ts_tablet_manager.cc:1145] Deleting tablet 83631b421a614796bdf76335f1437e00
0810 11:30:22.525333 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.525481 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2102715}
I20260810 11:30:22.525908 27763 raft_consensus.cc:2781] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.526010 27763 raft_consensus.cc:482] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.526126 27763 raft_consensus.cc:3037] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.526189 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 351) took 2109 ms. Trace:
I20260810 11:30:22.526302 27221 rpcz_store.cc:276] 0810 11:30:20.416643 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:20.422171 (+ 5528us) service_pool.cc:227] Handling call
0810 11:30:22.525976 (+2103805us) ts_tablet_manager.cc:1145] Deleting tablet 34bd3c0edf6b49d1891c0ee9af344872
0810 11:30:22.525988 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.526120 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2091645}
I20260810 11:30:22.521687 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23637a02b6464e17aa2a69ea5cc4ddfe" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:22.526998 26767 raft_consensus.cc:2454] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
W20260810 11:30:22.522938 26700 leader_election.cc:341] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:22.528030 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 349) could send its response
W20260810 11:30:22.528263 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 350) could send its response
W20260810 11:30:22.528442 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 351) could send its response
W20260810 11:30:22.528728 26700 leader_election.cc:341] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:22.529131 26702 leader_election.cc:302] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:22.500272 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b28f3dcbd6d74559b372d3452e13ce9f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:22.529541 26914 raft_consensus.cc:3037] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.529942 27526 raft_consensus.cc:2781] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.530121 27526 raft_consensus.cc:482] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.530236 27526 raft_consensus.cc:3037] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.531297 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 361) took 1429 ms. Trace:
I20260810 11:30:22.531409 27221 rpcz_store.cc:276] 0810 11:30:21.101626 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:21.102294 (+ 668us) service_pool.cc:227] Handling call
0810 11:30:22.526554 (+1424260us) ts_tablet_manager.cc:1145] Deleting tablet 8228600e3f6b4f9993dd25e4ceb57e4d
0810 11:30:22.526565 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.531237 (+ 4672us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1423836}
W20260810 11:30:22.531669 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 361) could send its response
I20260810 11:30:22.534425 27709 raft_consensus.cc:504] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.535667 27709 leader_election.cc:288] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:22.537052 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23637a02b6464e17aa2a69ea5cc4ddfe" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:22.537372 26767 raft_consensus.cc:3037] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.537565 27763 raft_consensus.cc:504] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.538602 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23637a02b6464e17aa2a69ea5cc4ddfe" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:22.538935 26912 raft_consensus.cc:3037] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.496532 26769 raft_consensus.cc:2454] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:22.541226 27763 leader_election.cc:288] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.542514 27609 raft_consensus.cc:3037] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.542601 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffeb0373c6124af291336ca9da50c318" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:22.544691 27709 raft_consensus.cc:482] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.545293 27709 raft_consensus.cc:504] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.546741 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffeb0373c6124af291336ca9da50c318" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:22.547133 27061 raft_consensus.cc:3037] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.547183 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "478c0c39658349c39e3afa1aa1653e82" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:22.547434 26769 raft_consensus.cc:2454] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:22.547889 26993 leader_election.cc:302] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:22.548226 27750 raft_consensus.cc:2781] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.548349 27750 raft_consensus.cc:482] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.548465 27750 raft_consensus.cc:3037] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.550622 27609 raft_consensus.cc:2726] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:22.550988 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "478c0c39658349c39e3afa1aa1653e82" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:22.551831 26991 leader_election.cc:341] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:22.551877 27750 raft_consensus.cc:504] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.553431 27750 leader_election.cc:288] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:22.554169 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "478c0c39658349c39e3afa1aa1653e82" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:22.554863 26700 leader_election.cc:341] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:22.555086 26991 leader_election.cc:341] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:22.555323 27748 raft_consensus.cc:482] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.555641 27748 raft_consensus.cc:504] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.556282 27748 leader_election.cc:288] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:22.557070 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbe0a0ab82a147a3b6164904b135d1ab" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:22.557365 26765 raft_consensus.cc:2454] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:22.557443 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbe0a0ab82a147a3b6164904b135d1ab" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:22.558311 26991 leader_election.cc:341] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:22.558866 26993 leader_election.cc:302] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:22.559383 27748 raft_consensus.cc:2781] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.559508 27748 raft_consensus.cc:482] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.559602 27748 raft_consensus.cc:3037] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.559598 27526 raft_consensus.cc:504] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.560684 27526 leader_election.cc:288] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.561177 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "725d2e70e1d441b497d56a278e1de0ad" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:22.561261 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "725d2e70e1d441b497d56a278e1de0ad" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:22.561492 27059 raft_consensus.cc:3037] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:22.562564 26700 leader_election.cc:341] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:22.563333 27748 raft_consensus.cc:504] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.564918 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 363) took 1457 ms. Trace:
I20260810 11:30:22.565083 27221 rpcz_store.cc:276] 0810 11:30:21.106927 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:21.107008 (+ 81us) service_pool.cc:227] Handling call
0810 11:30:22.564531 (+1457523us) ts_tablet_manager.cc:1145] Deleting tablet 1aa4562a2247405187d9dbd1baa48f39
0810 11:30:22.564550 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.564724 (+ 174us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1456805}
I20260810 11:30:22.565164 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbe0a0ab82a147a3b6164904b135d1ab" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:22.565469 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 363) could send its response
W20260810 11:30:22.565843 26991 leader_election.cc:341] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:22.565936 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 362) took 1464 ms. Trace:
I20260810 11:30:22.566036 27059 raft_consensus.cc:2454] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:22.566025 27221 rpcz_store.cc:276] 0810 11:30:21.101788 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:21.107446 (+ 5658us) service_pool.cc:227] Handling call
0810 11:30:22.565766 (+1458320us) ts_tablet_manager.cc:1145] Deleting tablet f6e264e8507446809f3c386fdb3c34ae
0810 11:30:22.565779 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.565882 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1457954}
W20260810 11:30:22.566321 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 362) could send its response
I20260810 11:30:22.566641 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbe0a0ab82a147a3b6164904b135d1ab" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:22.566948 26765 raft_consensus.cc:3037] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.570619 26912 raft_consensus.cc:2454] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:22.570804 26765 raft_consensus.cc:2454] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:22.566107 27748 leader_election.cc:288] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:22.571374 26991 leader_election.cc:302] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:22.572108 27748 raft_consensus.cc:2781] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.572305 27748 raft_consensus.cc:686] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:22.572444 26993 leader_election.cc:302] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:22.546907 27709 leader_election.cc:288] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:22.572957 27639 raft_consensus.cc:2781] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.573153 27639 raft_consensus.cc:686] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:22.573189 26702 leader_election.cc:302] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:22.573464 27639 consensus_queue.cc:237] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.573741 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "478c0c39658349c39e3afa1aa1653e82" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:22.574038 26769 raft_consensus.cc:3037] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.572715 27748 consensus_queue.cc:237] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.575623 27061 raft_consensus.cc:2454] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:22.576593 26702 leader_election.cc:302] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:22.577081 27763 raft_consensus.cc:2781] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.577612 26769 raft_consensus.cc:2454] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:22.577855 27740 raft_consensus.cc:2781] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.578065 27740 raft_consensus.cc:686] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:22.578364 26993 leader_election.cc:302] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:22.578447 27740 consensus_queue.cc:237] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.578809 27750 raft_consensus.cc:2781] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.578990 27750 raft_consensus.cc:686] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:22.579267 27750 consensus_queue.cc:237] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.582252 27763 raft_consensus.cc:686] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
W20260810 11:30:22.582787 27286 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.253:34547, user_credentials={real_user=slave}} blocked reactor thread for 77986.4us
I20260810 11:30:22.582759 27763 consensus_queue.cc:237] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:22.584034 27286 consensus_peers.cc:487] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a -> Peer c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547): Couldn't send request to peer c40c76e125b44de181b88b7f63a566f7. Status: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:22.585954 27221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 364) took 1478 ms. Trace:
I20260810 11:30:22.589242 27221 rpcz_store.cc:276] 0810 11:30:21.107329 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:21.107786 (+ 457us) service_pool.cc:227] Handling call
0810 11:30:22.585644 (+1477858us) ts_tablet_manager.cc:1145] Deleting tablet 603fe104b7ab485eab6b225a58bddc1c
0810 11:30:22.585677 (+ 33us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.585867 (+ 190us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":233,"tablet-delete.queue_time_us":1477365}
W20260810 11:30:22.589774 26700 connection.cc:441] server connection from 127.0.0.1:39688 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39688 (request call id 364) could send its response
I20260810 11:30:22.591624 26914 raft_consensus.cc:2454] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:22.592127 26767 raft_consensus.cc:2454] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:22.488128 27248 rpcz_store.cc:276] 0810 11:30:18.703099 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.703880 (+ 781us) service_pool.cc:227] Handling call
0810 11:30:22.282916 (+3579036us) ts_tablet_manager.cc:1145] Deleting tablet 7bd67ebf23694ae7b0ede6c5d1a06f88
0810 11:30:22.282937 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.313938 (+ 31001us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:22.458276 (+144338us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:22.487874 (+ 29598us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3555935}
W20260810 11:30:22.597833 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 275) could send its response
I20260810 11:30:22.587821 27609 consensus_queue.cc:1035] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:22.598434 27248 tablet_replica.cc:330] T 08f6636df13548c49f35e1808a87c1f5 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:22.602321 27228 tablet_bootstrap.cc:492] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.602530 27228 ts_tablet_manager.cc:1397] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.142s user 0.027s sys 0.030s
I20260810 11:30:22.602559 27248 raft_consensus.cc:2229] T 08f6636df13548c49f35e1808a87c1f5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:22.602919 27248 raft_consensus.cc:2258] T 08f6636df13548c49f35e1808a87c1f5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:22.603309 27228 raft_consensus.cc:348] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.603587 27228 raft_consensus.cc:374] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.603657 27228 raft_consensus.cc:729] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.603892 27228 consensus_queue.cc:260] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.604285 27248 ts_tablet_manager.cc:1905] T 08f6636df13548c49f35e1808a87c1f5 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:22.604517 27228 ts_tablet_manager.cc:1428] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:22.605180 27228 tablet_bootstrap.cc:492] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.606966 27228 tablet_bootstrap.cc:654] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.613994 27796 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 83cc8e39a3b9455f8242a6da6a54c38a)
I20260810 11:30:22.598922 27231 tablet_bootstrap.cc:654] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.624668 27796 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:22.624974 27228 tablet_bootstrap.cc:492] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.600145 26991 leader_election.cc:302] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:22.625285 27228 ts_tablet_manager.cc:1397] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.005s
I20260810 11:30:22.625520 27748 raft_consensus.cc:2781] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 11:30:22.625576 26993 leader_election.cc:341] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: b28f3dcbd6d74559b372d3452e13ce9f
I20260810 11:30:22.625737 27748 raft_consensus.cc:686] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:22.626071 27748 consensus_queue.cc:237] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.626194 27228 raft_consensus.cc:348] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.626439 27228 raft_consensus.cc:374] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.626550 27228 raft_consensus.cc:729] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.626796 27228 consensus_queue.cc:260] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.627475 27228 ts_tablet_manager.cc:1428] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 11:30:22.628042 27228 tablet_bootstrap.cc:492] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.630474 27655 raft_consensus.cc:482] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.630838 27655 raft_consensus.cc:504] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.632539 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31888ddeafe14738b818016a9c0a4ad3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:22.633570 27655 leader_election.cc:288] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.634807 27228 tablet_bootstrap.cc:654] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.636930 27609 consensus_queue.cc:1035] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:22.647322 26849 consensus_peers.cc:487] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b7a3b877457c4a2489d397f3f864d6b2. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:22.647845 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31888ddeafe14738b818016a9c0a4ad3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:22.648260 26767 raft_consensus.cc:2379] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
I20260810 11:30:22.648900 26849 leader_election.cc:302] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:22.649189 27228 tablet_bootstrap.cc:492] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.649442 27228 ts_tablet_manager.cc:1397] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.001s
I20260810 11:30:22.650375 27228 raft_consensus.cc:348] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.650691 27228 raft_consensus.cc:374] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.650786 27228 raft_consensus.cc:729] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.651084 27228 consensus_queue.cc:260] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.651268 27222 tablet_bootstrap.cc:492] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:22.651433 27222 ts_tablet_manager.cc:1397] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.245s user 0.011s sys 0.026s
I20260810 11:30:22.651711 27228 ts_tablet_manager.cc:1428] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:22.651943 27609 raft_consensus.cc:3037] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.600303 27718 leader_election.cc:288] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:22.655221 27609 raft_consensus.cc:2726] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:22.656047 27228 tablet_bootstrap.cc:492] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.659801 27228 tablet_bootstrap.cc:654] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.659840 27222 raft_consensus.cc:348] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.660497 27222 raft_consensus.cc:374] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.660887 27222 raft_consensus.cc:729] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.660677 27786 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83cc8e39a3b9455f8242a6da6a54c38a. Latest consensus state: current_term: 3 leader_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:22.661504 27222 consensus_queue.cc:260] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.662832 27222 ts_tablet_manager.cc:1428] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260810 11:30:22.663635 27222 tablet_bootstrap.cc:492] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:22.665987 27222 tablet_bootstrap.cc:654] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.666824 27609 raft_consensus.cc:482] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.667484 27786 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:22.668686 27609 raft_consensus.cc:504] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.669656 27609 leader_election.cc:288] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.673305 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa16654b7f34f9baf856bf724cece8f" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:22.670248 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa16654b7f34f9baf856bf724cece8f" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:22.677050 26767 raft_consensus.cc:2379] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
I20260810 11:30:22.677953 26849 leader_election.cc:302] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:22.678449 27609 raft_consensus.cc:3037] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.681965 27609 raft_consensus.cc:2726] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:22.685230 27222 tablet_bootstrap.cc:492] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:22.685571 27222 ts_tablet_manager.cc:1397] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.003s
I20260810 11:30:22.686785 27222 raft_consensus.cc:348] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.687232 27228 tablet_bootstrap.cc:492] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.687251 27222 raft_consensus.cc:374] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.687426 27228 ts_tablet_manager.cc:1397] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.006s
I20260810 11:30:22.687472 27222 raft_consensus.cc:729] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.688009 27222 consensus_queue.cc:260] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.688254 27228 raft_consensus.cc:348] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.688509 27228 raft_consensus.cc:374] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.688671 27228 raft_consensus.cc:729] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.688958 27228 consensus_queue.cc:260] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.689585 27222 ts_tablet_manager.cc:1428] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 11:30:22.690013 27222 tablet_bootstrap.cc:492] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:22.690339 27228 ts_tablet_manager.cc:1428] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 11:30:22.690812 27228 tablet_bootstrap.cc:492] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.693176 27228 tablet_bootstrap.cc:654] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.696309 27222 tablet_bootstrap.cc:654] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.705677 27228 tablet_bootstrap.cc:492] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.705904 27228 ts_tablet_manager.cc:1397] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260810 11:30:22.707229 27228 raft_consensus.cc:348] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.708065 27228 raft_consensus.cc:374] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.708194 27228 raft_consensus.cc:729] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.708638 27228 consensus_queue.cc:260] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.709457 27228 ts_tablet_manager.cc:1428] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 11:30:22.710194 27228 tablet_bootstrap.cc:492] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.713459 27379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac259bcf213a4aa297d1d8e73b262361" candidate_term: 4 candidate_status { last_received { term: 3 index: 492 } } ignore_live_leader: false dest_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" is_pre_election: true
I20260810 11:30:22.714334 27228 tablet_bootstrap.cc:654] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.715019 27796 leader_election.cc:288] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547)
W20260810 11:30:22.734745 26564 leader_election.cc:334] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547): Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111)
I20260810 11:30:22.734910 26564 leader_election.cc:302] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac259bcf213a4aa297d1d8e73b262361; no voters: 83cc8e39a3b9455f8242a6da6a54c38a, c40c76e125b44de181b88b7f63a566f7
I20260810 11:30:22.738018 27228 tablet_bootstrap.cc:492] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.738200 27228 ts_tablet_manager.cc:1397] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.002s
I20260810 11:30:22.738610 27786 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:22.739230 27786 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:22.739647 27786 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260810 11:30:22.739656 27228 raft_consensus.cc:348] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.739910 27228 raft_consensus.cc:374] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.740015 27228 raft_consensus.cc:729] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.740271 27228 consensus_queue.cc:260] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.744592 27228 ts_tablet_manager.cc:1428] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 11:30:22.745172 27228 tablet_bootstrap.cc:492] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.747612 27228 tablet_bootstrap.cc:654] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.761075 27228 tablet_bootstrap.cc:492] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.761296 27228 ts_tablet_manager.cc:1397] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.003s
I20260810 11:30:22.762115 27228 raft_consensus.cc:348] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.762401 27228 raft_consensus.cc:374] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.762483 27228 raft_consensus.cc:729] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.762739 27228 consensus_queue.cc:260] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.763557 27228 ts_tablet_manager.cc:1428] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 11:30:22.767469 27228 tablet_bootstrap.cc:492] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.770002 27228 tablet_bootstrap.cc:654] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.783516 27228 tablet_bootstrap.cc:492] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.783694 27228 ts_tablet_manager.cc:1397] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.001s
I20260810 11:30:22.784626 27228 raft_consensus.cc:348] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.784917 27228 raft_consensus.cc:374] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.785009 27228 raft_consensus.cc:729] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.785231 27228 consensus_queue.cc:260] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.786455 27228 ts_tablet_manager.cc:1428] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 11:30:22.786901 27228 tablet_bootstrap.cc:492] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.789245 27228 tablet_bootstrap.cc:654] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.795913 27655 raft_consensus.cc:482] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.796173 27655 raft_consensus.cc:504] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.797266 27655 leader_election.cc:288] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.798341 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25ae21cc8cc4749a507fcab5ee225a3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:22.798722 27059 raft_consensus.cc:2379] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:22.799088 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25ae21cc8cc4749a507fcab5ee225a3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:22.799999 26849 leader_election.cc:302] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:22.800776 27609 raft_consensus.cc:482] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.800980 27609 raft_consensus.cc:504] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.801874 27609 leader_election.cc:288] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.802042 27609 raft_consensus.cc:3037] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.805260 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "478c0c39658349c39e3afa1aa1653e82" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:22.808857 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "478c0c39658349c39e3afa1aa1653e82" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:22.809293 26767 raft_consensus.cc:2379] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
I20260810 11:30:22.809499 27228 tablet_bootstrap.cc:492] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.809679 27228 ts_tablet_manager.cc:1397] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.001s
I20260810 11:30:22.809998 26849 leader_election.cc:302] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:22.810611 27655 raft_consensus.cc:3037] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.810619 27228 raft_consensus.cc:348] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.810912 27228 raft_consensus.cc:374] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.811039 27228 raft_consensus.cc:729] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.811308 27228 consensus_queue.cc:260] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.811941 27228 ts_tablet_manager.cc:1428] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260810 11:30:22.812266 27228 tablet_bootstrap.cc:492] T bbe34108a7604fa6aa667758be11f569 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.814224 27228 tablet_bootstrap.cc:654] T bbe34108a7604fa6aa667758be11f569 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.814220 27655 raft_consensus.cc:2726] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:22.819362 27609 raft_consensus.cc:2726] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:22.830471 27741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 11:30:22.833170 27609 consensus_queue.cc:1035] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:22.840659 27228 tablet_bootstrap.cc:492] T bbe34108a7604fa6aa667758be11f569 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.840924 27228 ts_tablet_manager.cc:1397] T bbe34108a7604fa6aa667758be11f569 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.009s
I20260810 11:30:22.841877 27228 raft_consensus.cc:348] T bbe34108a7604fa6aa667758be11f569 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.842176 27228 raft_consensus.cc:374] T bbe34108a7604fa6aa667758be11f569 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.842289 27228 raft_consensus.cc:729] T bbe34108a7604fa6aa667758be11f569 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.842311 27231 tablet_bootstrap.cc:492] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:22.842576 27231 ts_tablet_manager.cc:1397] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.352s user 0.003s sys 0.003s
I20260810 11:30:22.842597 27228 consensus_queue.cc:260] T bbe34108a7604fa6aa667758be11f569 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.843384 27228 ts_tablet_manager.cc:1428] T bbe34108a7604fa6aa667758be11f569 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:22.843364 27231 raft_consensus.cc:348] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.843765 27231 raft_consensus.cc:374] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.843850 27231 raft_consensus.cc:729] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.844152 27228 tablet_bootstrap.cc:492] T 3ddb6e67c316416681074e454ab9b01e P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.846760 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_061b7dfbcc074ad6a0d99d49113a354f [id=0186ddbf3c144b4e86ae21cbdac555d2]
I20260810 11:30:22.847899 27228 tablet_bootstrap.cc:654] T 3ddb6e67c316416681074e454ab9b01e P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.850502 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]
I20260810 11:30:22.851086 27700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:22.860146 27700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: This master's current role is: LEADER
I20260810 11:30:22.862159 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_2d6c3a53213a458aaee6bd445240041c [id=097ff3abe81b415799933e50feab6c39]
I20260810 11:30:22.863387 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]
I20260810 11:30:22.866003 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_93969ba1aad24adfb712d718540eaae2 [id=0d443055d28146b9a2bf6780b6f44daa]
I20260810 11:30:22.868389 27228 tablet_bootstrap.cc:492] T 3ddb6e67c316416681074e454ab9b01e P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.868650 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_7c178d343d8246599a00f6d1c602a818 [id=0e39402016b54f588ea123ee4ea9788a]
I20260810 11:30:22.868726 27228 ts_tablet_manager.cc:1397] T 3ddb6e67c316416681074e454ab9b01e P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.010s
I20260810 11:30:22.870002 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_ad3534a46309483687ef9dd9471f1008 [id=0f9e142b43214fa8b2e362c54fabcb42]
I20260810 11:30:22.870486 27228 raft_consensus.cc:348] T 3ddb6e67c316416681074e454ab9b01e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.871341 27228 raft_consensus.cc:374] T 3ddb6e67c316416681074e454ab9b01e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.871454 27228 raft_consensus.cc:729] T 3ddb6e67c316416681074e454ab9b01e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.871721 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_60e35bdf23f74306a9b5299e927771de [id=0faf073b01654e38b8f6083f5012abd7]
I20260810 11:30:22.871754 27228 consensus_queue.cc:260] T 3ddb6e67c316416681074e454ab9b01e P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.873895 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_c40dd8e327db40b59167de093a5c616d [id=10ebb746a2b343b08b5b13d1107a7cd8]
I20260810 11:30:22.873978 27228 ts_tablet_manager.cc:1428] T 3ddb6e67c316416681074e454ab9b01e P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260810 11:30:22.874607 27228 tablet_bootstrap.cc:492] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.875298 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_168dc06875d64f40830cac1440688bd0 [id=167c03593b73416ab0f9607c87937a60]
I20260810 11:30:22.876253 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_dc83172ee2e44eccab63bccfa35523fe [id=19ea42a81c4f471592628b27a3404c4b]
I20260810 11:30:22.878068 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_8326a5b5a7544e828699f8b41fdee4d1 [id=1ae6d36bfe0e427a9a996dff3cdccc91]
I20260810 11:30:22.878275 27228 tablet_bootstrap.cc:654] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.879021 27708 consensus_queue.cc:1035] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:22.879271 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_359f619c6e054a89898040e2f0d379c3 [id=1c6a2d6a4fa2472a9aff02fecc10077a]
I20260810 11:30:22.881942 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_66b8d163284b4347b99dea499ed256fc [id=304e1529f45d4d3c8799a22009066ce5]
I20260810 11:30:22.882848 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_5a4c04e087c3490fae87a17247850531 [id=323f239c11f84a69beaf74e68c0cf50a]
I20260810 11:30:22.883859 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_e7f8305a313f47b0a219cb6a9cb15049 [id=329af78463204d2da90569d268b49eb3]
I20260810 11:30:22.885017 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_6f7ae1749f224614a4fdaa33b125864d [id=339298a1ea1747d59a035a6a3cadfb30]
I20260810 11:30:22.885793 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_3fd59f07e4ee4f54bce7829aec4cf4c4 [id=3719720e5ca241b1a500a1aaf7f310c4]
I20260810 11:30:22.886819 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_34d8fc5b6fcb49a9a2e7837be26f92fd [id=39e1741c8eed4714b9fd844fb1f3e81d]
I20260810 11:30:22.887588 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_54efd7f2894348cf9dbf82586d44b6b5 [id=3b60ed35e72d41b58f176184a08303ad]
I20260810 11:30:22.888826 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_afde78ad5bfa4a23828df391f669e7fa [id=3d8c46d7a15e457a93fd615ad99a4f36]
I20260810 11:30:22.889845 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_eecd0244ecc849339f452f38db67c973 [id=41d3dec833b54d1e855194862cb1726b]
I20260810 11:30:22.890295 27228 tablet_bootstrap.cc:492] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.890439 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_9eee8b010360415faceef1c43fea61d9 [id=41dfd71fd24040a392812bca04e2baf6]
I20260810 11:30:22.890511 27228 ts_tablet_manager.cc:1397] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.000s
I20260810 11:30:22.891037 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_ce142135909043cf9c17bb75b2eae0f9 [id=43d34198e1ae4e33ba4ae808df4d40b5]
I20260810 11:30:22.891839 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_64f83258168749f88b4697bfee40bc2f [id=458cd8860fa448759ff4f5ee12c77599]
I20260810 11:30:22.892007 27228 raft_consensus.cc:348] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.892343 27228 raft_consensus.cc:374] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.892477 27228 raft_consensus.cc:729] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.892951 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_21a675494284471eaf3ea50b31b833d7 [id=46a8ee2948c04311b0d3c1a5174d08dc]
I20260810 11:30:22.892804 27228 consensus_queue.cc:260] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.893507 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_a48c8668e73f4919a9c32c9c3e95f485 [id=46bda36574e1430dbada751ccf16703c]
I20260810 11:30:22.893965 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_71e560b0b3c84617ab561dbea1d90f7e [id=480613c985b74b2786f4c23dfb9a5f4b]
I20260810 11:30:22.894456 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]
I20260810 11:30:22.895004 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]
I20260810 11:30:22.895010 27708 consensus_queue.cc:1035] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:22.896009 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_03a616a243fc4350b4a01d7f5bb86949 [id=4e2dc56dde3346a0917e58c6c7e921eb]
I20260810 11:30:22.896498 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_24bdc44050024c23aa90a182bdcecb50 [id=4ea7ee58aac74fba84dbbcc009017421]
I20260810 11:30:22.897480 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_f55e75edcec14683a44d60250c42dbc7 [id=4f456ea1fbfe40dc8ed31415b77d4743]
I20260810 11:30:22.897969 27228 ts_tablet_manager.cc:1428] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.007s user 0.000s sys 0.003s
I20260810 11:30:22.898574 27228 tablet_bootstrap.cc:492] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.899133 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]
I20260810 11:30:22.899652 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]
I20260810 11:30:22.900411 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_b7e6c83a5d5340b5b960f65b82d4939a [id=553f87ed39f148aba3be0a6fcd13e25d]
I20260810 11:30:22.901371 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_a88d168f91f6427e898a55cb391840af [id=56dee621acfa4f73b3bd69fefa7cb7e1]
I20260810 11:30:22.901783 27228 tablet_bootstrap.cc:654] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.902182 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]
I20260810 11:30:22.902861 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_67580ad3fe7a47d6a051e7da7005c171 [id=5ae9efa77fb54cf58ff2a1662eee03f7]
I20260810 11:30:22.903415 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_a3ca31166a6348f68da88913588098df [id=5c8a2cbef71f4c9fb038a49e1ca7f704]
I20260810 11:30:22.904865 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_f33a13096a144e538af2795c149abdcd [id=60ce1267de814f218c27ac084a08a26a]
I20260810 11:30:22.905380 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]
I20260810 11:30:22.905807 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]
I20260810 11:30:22.906334 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_57b6151125a144fcb6230ee986bff7ee [id=62f404c62e4040fc801f70cafddf9d95]
I20260810 11:30:22.906786 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]
I20260810 11:30:22.909569 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_10b2af8299224f5db4a63bd1fae61155 [id=6a421de2b28a46088fd0bad429a52bad]
I20260810 11:30:22.910488 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_59ed990b31964d6080614081ee46a6de [id=6d8fc88a491140548a45c7fbb403bb36]
I20260810 11:30:22.911701 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]
I20260810 11:30:22.912421 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_a22c355b17404952bced99698472d57e [id=72544a36bf7e46ca8a020d40d5370b82]
I20260810 11:30:22.912523 27228 tablet_bootstrap.cc:492] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.912745 27228 ts_tablet_manager.cc:1397] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260810 11:30:22.913206 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_56b4699099fd417496e71ccbed272638 [id=72829be151bc48dba287b32c7028caf7]
I20260810 11:30:22.913688 27228 raft_consensus.cc:348] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.913990 27228 raft_consensus.cc:374] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.914078 27228 raft_consensus.cc:729] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.914362 27228 consensus_queue.cc:260] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.914867 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_1e1ca07e9c824349af23675b66b77321 [id=755202f095f04307a11ce87087df835c]
I20260810 11:30:22.915416 27228 ts_tablet_manager.cc:1428] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:22.916857 27228 tablet_bootstrap.cc:492] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.917451 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_e58ae45f9ea949a2a0d7bf7f0e862647 [id=76b87112ac8e4024965d44a9b62b8c1a]
I20260810 11:30:22.918017 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_96d4976d4de649c4a98910a1b7fd1b59 [id=777f92ce815f4314898abce665fec1eb]
I20260810 11:30:22.918505 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]
I20260810 11:30:22.918916 27228 tablet_bootstrap.cc:654] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.919196 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_340e7b53369c44cda0cb60ddbb328ccc [id=7861512191c341b9a85c6a1885a52ca7]
I20260810 11:30:22.919545 27231 consensus_queue.cc:260] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.920193 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_fd64c13d7a514c7285b42e1c91a63cdf [id=7c8348b49b664bee8d8243efb2cdbb79]
I20260810 11:30:22.920832 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_09ff2cfcae6d4c1b96479fd190b3c084 [id=7d0dd215c30648438a460f730b0b7ba4]
I20260810 11:30:22.921931 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_44e5f0610f934d889eaf76d00116f0e2 [id=801df0b567d947db90abd034d997ed3f]
I20260810 11:30:22.922751 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]
I20260810 11:30:22.923348 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_cbf7fb0f0585465a9be24fa7e70d68d2 [id=82041e96f8de4fae85baf690bbbfc7a3]
I20260810 11:30:22.923923 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_49be430f1e8f475482b54850772c0430 [id=82e113439bc04ce9955f59612ba480dc]
I20260810 11:30:22.924844 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]
I20260810 11:30:22.925403 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_6f7fdd85630648659dcfe3b52e5ab365 [id=862df0152eda418da6110067b4ab588b]
I20260810 11:30:22.926046 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_9efdfb09fd194dc2a9cbdc9a87749126 [id=8afbc0cc8e704a03a064974937b5a36b]
I20260810 11:30:22.926609 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_f974a4ceae4649bb9f17115103f554cd [id=8c06eb3e2a9245af8c8e8eb250215e0c]
I20260810 11:30:22.927357 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]
I20260810 11:30:22.929138 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]
I20260810 11:30:22.929780 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_04e075d361354421aa7085057964f310 [id=94c8e7388b644043b77cb6b5087e87e8]
I20260810 11:30:22.930678 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]
I20260810 11:30:22.931226 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_5f7d17a1cdaa4396b5faf52b01518860 [id=973454ab92f84e73be26260d66ee9763]
I20260810 11:30:22.931424 27763 raft_consensus.cc:482] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.931783 27763 raft_consensus.cc:504] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.932086 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_1c6221759f954488a1e7df4252c2a6ae [id=996f45529be941409f77e6682591b900]
I20260810 11:30:22.932238 27228 tablet_bootstrap.cc:492] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.932475 27228 ts_tablet_manager.cc:1397] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.003s
I20260810 11:30:22.932718 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]
I20260810 11:30:22.933437 27228 raft_consensus.cc:348] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.933727 27228 raft_consensus.cc:374] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.933840 27228 raft_consensus.cc:729] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.933975 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_4d9bc84fc41e4b87ac2f6432852e5d61 [id=9b708c86ff534253961e7c29909eb1bd]
I20260810 11:30:22.934129 27228 consensus_queue.cc:260] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.934871 27228 ts_tablet_manager.cc:1428] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 11:30:22.934706 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e0a8513171f4c39b74c08760a139d9e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:22.935083 27059 raft_consensus.cc:2454] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:22.935667 27228 tablet_bootstrap.cc:492] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.936141 27763 leader_election.cc:288] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.936862 26702 leader_election.cc:302] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:22.937594 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_d863b14a3a96454e8ee5a85fb2ab30c8 [id=a40ab01e5be24248b3af7ef1dc456da6]
I20260810 11:30:22.937870 27763 raft_consensus.cc:2781] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:22.937995 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e0a8513171f4c39b74c08760a139d9e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:22.938135 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_55d0eefc94274462b82269e97b4969a9 [id=a4755db8deca4541b6f671cd5444f070]
I20260810 11:30:22.938130 27763 raft_consensus.cc:482] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:22.938242 27763 raft_consensus.cc:3037] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.938311 26911 raft_consensus.cc:2454] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:22.938639 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_835cdd4f3794466d808449e2e17bb15a [id=a483de6ef1fc453b93e3f183e9c15dd1]
I20260810 11:30:22.938905 27228 tablet_bootstrap.cc:654] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.939291 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_c447a9537b844dffa1767531896bf6fe [id=a74215a4f78c47348bc5a41e4b1232f8]
I20260810 11:30:22.940093 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]
I20260810 11:30:22.940650 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]
I20260810 11:30:22.941558 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_0ca6793e2c374e8d8d93872a0b2283d6 [id=ae0e3b2d14964558848b1a00a6ddc2c6]
I20260810 11:30:22.942253 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_b2c244ee13d14619b9f1eac6ab1aba2a [id=afa11e2df47a4a739727c8d834e24b84]
I20260810 11:30:22.943428 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_bd17aa8dfcdf4c09b68660896911a2ee [id=affd9fae6f704dcea386ebc27c87323e]
I20260810 11:30:22.944352 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_e33c9849bbd34e6b9b72e69fd3a1ab1c [id=b206753d4f4142be82ee28150226bd53]
I20260810 11:30:22.945269 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_61d778388656489cb2e7fe8312b8ac6e [id=b52c11bd73cd4d1f8f9dfc32562718a2]
I20260810 11:30:22.942771 27763 raft_consensus.cc:504] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.946341 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_2a7d8b62f0814dcb99b674089d4fd0c7 [id=b88e11526dbd42c2a6b51fcc1cf731d3]
I20260810 11:30:22.946869 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_abbbb80ecbe4491d98912dcdcaab5dd3 [id=ba999b4084c84b2f8e0313b96849b169]
I20260810 11:30:22.947526 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85]
I20260810 11:30:22.948043 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]
I20260810 11:30:22.948344 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e0a8513171f4c39b74c08760a139d9e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:22.948763 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_3efc57bdbafc46dfab4d324acb0d5f73 [id=bcba186b6e93492fb06f70e033be3296]
I20260810 11:30:22.948787 27059 raft_consensus.cc:3037] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.949164 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]
I20260810 11:30:22.949913 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_5f6a37537c33412a80f2642fb0162da6 [id=bfc3f2f94773444181545d43ecd88190]
I20260810 11:30:22.950878 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_f3567f07068942e9a5d42f9877f39bb7 [id=c557d3488f464c5bbff89fd13e52b02a]
I20260810 11:30:22.951800 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_fabd7780b9224b7993ad4321be6f92e2 [id=c9c81bc9d6dc48c89ba4cc51ca4f8bd9]
I20260810 11:30:22.952273 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e0a8513171f4c39b74c08760a139d9e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:22.953400 26911 raft_consensus.cc:3037] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.953755 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]
I20260810 11:30:22.954092 27228 tablet_bootstrap.cc:492] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.954319 27228 ts_tablet_manager.cc:1397] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260810 11:30:22.954746 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_53285a0af75e4705982c23850f7b27e2 [id=d58840daecc84b789f04a35ca6cd8393]
I20260810 11:30:22.955195 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]
I20260810 11:30:22.955618 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_7458a59fbdce4e9485d51df6fccf66a5 [id=d63533f5d837481889b34a78d860e018]
I20260810 11:30:22.955420 27228 raft_consensus.cc:348] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.955749 27228 raft_consensus.cc:374] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.955856 27228 raft_consensus.cc:729] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:22.956368 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_da82b7e264034027b41209e3a8be8903 [id=d7ee651e98084bd798d76ecf28546e83]
I20260810 11:30:22.956199 27228 consensus_queue.cc:260] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.953090 27655 raft_consensus.cc:482] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.957213 27655 raft_consensus.cc:504] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.958185 27655 leader_election.cc:288] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:22.958230 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]
I20260810 11:30:22.958264 27228 ts_tablet_manager.cc:1428] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20260810 11:30:22.959244 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffeb0373c6124af291336ca9da50c318" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:22.959363 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_5f8ecc7877924d0f9871dd16aaeafdde [id=e1ca02b3f3f94632843632a15fc19245]
I20260810 11:30:22.958890 27228 tablet_bootstrap.cc:492] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.959818 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_ba61129cdf35481dbf06effd223949f6 [id=e20f1c45c6d743cba2c3cc60c78186a4]
I20260810 11:30:22.960429 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_fb8c5684b00a41eebe3f5b088bcbee33 [id=e22f19a993564e53b1cc76633f25f505]
I20260810 11:30:22.961406 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_db5e3f1e3cf74bc0b15660e83ea59ad6 [id=e7142023363b432b803533be5da13aec]
I20260810 11:30:22.962028 27228 tablet_bootstrap.cc:654] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.961975 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffeb0373c6124af291336ca9da50c318" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:22.962369 27060 raft_consensus.cc:2379] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:22.962515 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_3d15fcde44db49a7ba17fd166381299f [id=e88ac45e937f49b2a8be4256d1a7279e]
I20260810 11:30:22.963018 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_1f48a9af47ad4e0c93ed4dd43ecd12a3 [id=e985b1ae60d94bfa998e1986bdf3fcd9]
I20260810 11:30:22.963853 27655 raft_consensus.cc:482] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:22.963886 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]
I20260810 11:30:22.964257 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_4857a0fc183c421382b9b70094d76ac3 [id=eb184bc24462433e89048f962a639600]
I20260810 11:30:22.964054 27655 raft_consensus.cc:504] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.965029 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_ddaa0e35d54b49c894cbf994bb7fbbab [id=ed36f07f53e04f308770145b0d7435ac]
I20260810 11:30:22.965520 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]
I20260810 11:30:22.965977 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_6d8b58857bb84e579c8c308dcb0800f0 [id=f0f8365d722447a090e236fd1fcb0e98]
I20260810 11:30:22.966197 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08f6636df13548c49f35e1808a87c1f5" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:22.966589 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e]
I20260810 11:30:22.967108 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_9744be92699b40d1bae23bbb564db585 [id=f27ef087b00e469197a44c70d4bc979b]
W20260810 11:30:22.967123 26849 leader_election.cc:341] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:22.967643 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]
I20260810 11:30:22.967661 27655 leader_election.cc:288] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:22.968545 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_2d72d964c7c54d639c11a02fc168152a [id=f49e68eaa81e49bb92ed473e754de42f]
I20260810 11:30:22.968997 26848 leader_election.cc:302] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:22.969137 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_c32d1cb0b9e744fbacbd00c8736fad21 [id=f54b49f28880453aa7bc67b9c36a219b]
I20260810 11:30:22.969624 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_a0630a37a4e44862b8947cd848615cdb [id=f7931f3f7e9c45fba1aff648c50250f2]
I20260810 11:30:22.970253 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]
I20260810 11:30:22.970266 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08f6636df13548c49f35e1808a87c1f5" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:22.970851 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_2c4f303b1d1c47c9a4c089efccdd1d37 [id=fe5337909463467788d24d76e379cb48]
I20260810 11:30:22.971086 27655 raft_consensus.cc:3037] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:22.971298 27741 catalog_manager.cc:669] Loaded metadata for table default.Table_635ef5268ea1426bb6578ba498e616e3 [id=fef997439a4346d2a9c6f2a4277ede5a]
I20260810 11:30:22.975484 27655 raft_consensus.cc:2726] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:22.977671 27228 tablet_bootstrap.cc:492] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:22.979241 27228 ts_tablet_manager.cc:1397] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.006s
I20260810 11:30:22.978205 26911 raft_consensus.cc:2454] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:22.980108 26700 leader_election.cc:302] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:22.980199 27228 raft_consensus.cc:348] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.980518 27228 raft_consensus.cc:374] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:22.980666 27228 raft_consensus.cc:729] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
W20260810 11:30:22.978730 26848 leader_election.cc:341] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: Tablet not RUNNING: STOPPED
I20260810 11:30:22.980935 27228 consensus_queue.cc:260] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:22.981048 26848 leader_election.cc:302] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:22.981711 27609 raft_consensus.cc:2726] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:22.981777 27228 ts_tablet_manager.cc:1428] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:22.982441 27754 raft_consensus.cc:2781] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:22.983433 27228 tablet_bootstrap.cc:492] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:22.983871 27754 raft_consensus.cc:686] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:22.984329 27754 consensus_queue.cc:237] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:22.985378 27741 tablet_loader.cc:96] loaded metadata for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14])
I20260810 11:30:22.985504 27228 tablet_bootstrap.cc:654] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:22.985797 27741 tablet_loader.cc:96] loaded metadata for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7])
I20260810 11:30:22.986495 27741 tablet_loader.cc:96] loaded metadata for tablet 02ff6a9bc02441ddb7f307d6b3df31bd (table default.Table_5f8ecc7877924d0f9871dd16aaeafdde [id=e1ca02b3f3f94632843632a15fc19245])
I20260810 11:30:22.987325 27059 raft_consensus.cc:2454] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:22.987915 27741 tablet_loader.cc:96] loaded metadata for tablet 0ad96bbd29ad4ce9a766ac84db1a9c60 (table default.Table_bc8bc2c9015443fb865751881638284b [id=3d0ee62af94a45ebb75470e84997368f])
I20260810 11:30:22.988505 27741 tablet_loader.cc:96] loaded metadata for tablet 0d7a07e844984b88ab81610cb95bf21e (table default.Table_b2c244ee13d14619b9f1eac6ab1aba2a [id=afa11e2df47a4a739727c8d834e24b84])
I20260810 11:30:22.989291 27741 tablet_loader.cc:96] loaded metadata for tablet 0f048b690d764c83a4a9ce4cbadc75b0 (table default.Table_dc83172ee2e44eccab63bccfa35523fe [id=19ea42a81c4f471592628b27a3404c4b])
I20260810 11:30:22.989766 27741 tablet_loader.cc:96] loaded metadata for tablet 10210204d5ff4e5e97c98fd255f674a5 (table default.Table_4d9bc84fc41e4b87ac2f6432852e5d61 [id=9b708c86ff534253961e7c29909eb1bd])
I20260810 11:30:22.990407 27741 tablet_loader.cc:96] loaded metadata for tablet 110b5acc36bd4d6bba13735e5daec75f (table default.Table_24bdc44050024c23aa90a182bdcecb50 [id=4ea7ee58aac74fba84dbbcc009017421])
I20260810 11:30:22.990801 27741 tablet_loader.cc:96] loaded metadata for tablet 1549a26ba0f6427fae87b204c5d49eff (table default.Table_f55e75edcec14683a44d60250c42dbc7 [id=4f456ea1fbfe40dc8ed31415b77d4743])
I20260810 11:30:22.991365 27741 tablet_loader.cc:96] loaded metadata for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b])
I20260810 11:30:22.991787 27741 tablet_loader.cc:96] loaded metadata for tablet 1860e56467624dcdb288e13b004f78cc (table default.Table_5a4c04e087c3490fae87a17247850531 [id=323f239c11f84a69beaf74e68c0cf50a])
I20260810 11:30:22.993448 27741 tablet_loader.cc:96] loaded metadata for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0])
I20260810 11:30:22.994366 27741 tablet_loader.cc:96] loaded metadata for tablet 2126d95992e549b7b2b3e662b0d39a36 (table default.Table_21a675494284471eaf3ea50b31b833d7 [id=46a8ee2948c04311b0d3c1a5174d08dc])
I20260810 11:30:22.994863 27741 tablet_loader.cc:96] loaded metadata for tablet 23637a02b6464e17aa2a69ea5cc4ddfe (table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85])
I20260810 11:30:22.995586 27741 tablet_loader.cc:96] loaded metadata for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 (table default.Table_71e560b0b3c84617ab561dbea1d90f7e [id=480613c985b74b2786f4c23dfb9a5f4b])
I20260810 11:30:22.996378 27741 tablet_loader.cc:96] loaded metadata for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_bd17aa8dfcdf4c09b68660896911a2ee [id=affd9fae6f704dcea386ebc27c87323e])
I20260810 11:30:22.997421 27741 tablet_loader.cc:96] loaded metadata for tablet 2b95f3ec8ff34c89a68cd1edf8391f9b (table default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e])
I20260810 11:30:22.998323 27741 tablet_loader.cc:96] loaded metadata for tablet 2da86554bc51486e91f1ea5995a245b5 (table default.Table_a0630a37a4e44862b8947cd848615cdb [id=f7931f3f7e9c45fba1aff648c50250f2])
I20260810 11:30:22.999898 27741 tablet_loader.cc:96] loaded metadata for tablet 318d5b8453fe4c438d0fa32cb91c409e (table default.Table_0ca6793e2c374e8d8d93872a0b2283d6 [id=ae0e3b2d14964558848b1a00a6ddc2c6])
I20260810 11:30:23.001149 27741 tablet_loader.cc:96] loaded metadata for tablet 34ed8c9efa634fc7b091b1bb6bc6d452 (table default.Table_fd64c13d7a514c7285b42e1c91a63cdf [id=7c8348b49b664bee8d8243efb2cdbb79])
I20260810 11:30:23.001554 27741 tablet_loader.cc:96] loaded metadata for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7])
I20260810 11:30:23.001856 27228 tablet_bootstrap.cc:492] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:23.001933 27741 tablet_loader.cc:96] loaded metadata for tablet 37cecd4266eb47669e7fd5cfeb847adc (table default.Table_7c178d343d8246599a00f6d1c602a818 [id=0e39402016b54f588ea123ee4ea9788a])
I20260810 11:30:23.002063 27228 ts_tablet_manager.cc:1397] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.001s
I20260810 11:30:23.002960 27741 tablet_loader.cc:96] loaded metadata for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_56b4699099fd417496e71ccbed272638 [id=72829be151bc48dba287b32c7028caf7])
I20260810 11:30:23.003364 27741 tablet_loader.cc:96] loaded metadata for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea])
I20260810 11:30:23.003672 27228 raft_consensus.cc:348] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.004015 27741 tablet_loader.cc:96] loaded metadata for tablet 3a0284718f694a0591888e81357721b0 (table default.Table_ddaa0e35d54b49c894cbf994bb7fbbab [id=ed36f07f53e04f308770145b0d7435ac])
I20260810 11:30:23.004077 27228 raft_consensus.cc:374] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:23.004377 27228 raft_consensus.cc:729] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:23.004645 27741 tablet_loader.cc:96] loaded metadata for tablet 3a1e46f80f7f4e3a84638421892e6236 (table default.Table_49be430f1e8f475482b54850772c0430 [id=82e113439bc04ce9955f59612ba480dc])
I20260810 11:30:23.004782 27228 consensus_queue.cc:260] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.005146 27741 tablet_loader.cc:96] loaded metadata for tablet 3ae27bf110114b70a3e3f6cf64f31b98 (table default.Table_54efd7f2894348cf9dbf82586d44b6b5 [id=3b60ed35e72d41b58f176184a08303ad])
I20260810 11:30:23.005535 27228 ts_tablet_manager.cc:1428] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 11:30:23.005535 27741 tablet_loader.cc:96] loaded metadata for tablet 3ccef06fa06c4c519d8760fa948d6c8b (table default.Table_abbbb80ecbe4491d98912dcdcaab5dd3 [id=ba999b4084c84b2f8e0313b96849b169])
I20260810 11:30:23.006480 27741 tablet_loader.cc:96] loaded metadata for tablet 3ddb6e67c316416681074e454ab9b01e (table default.Table_1e1ca07e9c824349af23675b66b77321 [id=755202f095f04307a11ce87087df835c])
I20260810 11:30:23.007313 27741 tablet_loader.cc:96] loaded metadata for tablet 40f5eecfc66a4711aef60c1a2bff6b97 (table default.Table_3efc57bdbafc46dfab4d324acb0d5f73 [id=bcba186b6e93492fb06f70e033be3296])
I20260810 11:30:23.008507 27741 tablet_loader.cc:96] loaded metadata for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 (table default.Table_340e7b53369c44cda0cb60ddbb328ccc [id=7861512191c341b9a85c6a1885a52ca7])
I20260810 11:30:23.009162 27741 tablet_loader.cc:96] loaded metadata for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_64f83258168749f88b4697bfee40bc2f [id=458cd8860fa448759ff4f5ee12c77599])
I20260810 11:30:23.009771 27741 tablet_loader.cc:96] loaded metadata for tablet 490ada0a918d48c3a07e12eed58bda19 (table default.Table_ba61129cdf35481dbf06effd223949f6 [id=e20f1c45c6d743cba2c3cc60c78186a4])
I20260810 11:30:23.011227 27741 tablet_loader.cc:96] loaded metadata for tablet 4efa31ad2ce8436b9638e6759d9b5421 (table default.Table_f3567f07068942e9a5d42f9877f39bb7 [id=c557d3488f464c5bbff89fd13e52b02a])
I20260810 11:30:23.011706 27741 tablet_loader.cc:96] loaded metadata for tablet 501defb075d142ec8b22e5e8236a009c (table default.Table_a48c8668e73f4919a9c32c9c3e95f485 [id=46bda36574e1430dbada751ccf16703c])
I20260810 11:30:23.012459 27741 tablet_loader.cc:96] loaded metadata for tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae])
I20260810 11:30:23.012930 27741 tablet_loader.cc:96] loaded metadata for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_55d0eefc94274462b82269e97b4969a9 [id=a4755db8deca4541b6f671cd5444f070])
I20260810 11:30:23.013324 27741 tablet_loader.cc:96] loaded metadata for tablet 5409c96c1949416e85cfcaa8f2f61227 (table default.Table_da82b7e264034027b41209e3a8be8903 [id=d7ee651e98084bd798d76ecf28546e83])
I20260810 11:30:23.013731 27741 tablet_loader.cc:96] loaded metadata for tablet 55c8749861874eca9b63d3db97afa2b1 (table default.Table_1c6221759f954488a1e7df4252c2a6ae [id=996f45529be941409f77e6682591b900])
I20260810 11:30:23.014308 27741 tablet_loader.cc:96] loaded metadata for tablet 587c6ce242c0411b886404a0df03b1bb (table default.Table_8326a5b5a7544e828699f8b41fdee4d1 [id=1ae6d36bfe0e427a9a996dff3cdccc91])
I20260810 11:30:23.014729 27741 tablet_loader.cc:96] loaded metadata for tablet 592be61b7e524941931264125b33d92c (table default.Table_359f619c6e054a89898040e2f0d379c3 [id=1c6a2d6a4fa2472a9aff02fecc10077a])
I20260810 11:30:23.015596 27741 tablet_loader.cc:96] loaded metadata for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14])
I20260810 11:30:23.017638 27741 tablet_loader.cc:96] loaded metadata for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219])
I20260810 11:30:23.018914 27741 tablet_loader.cc:96] loaded metadata for tablet 6926d0dc68fa48ae8ffabf5b5272b3d0 (table default.Table_96d4976d4de649c4a98910a1b7fd1b59 [id=777f92ce815f4314898abce665fec1eb])
I20260810 11:30:23.020323 27741 tablet_loader.cc:96] loaded metadata for tablet 6c5b650bc02f4fa393bada5b54c77f1f (table default.Table_afde78ad5bfa4a23828df391f669e7fa [id=3d8c46d7a15e457a93fd615ad99a4f36])
I20260810 11:30:23.020795 27741 tablet_loader.cc:96] loaded metadata for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05])
I20260810 11:30:23.021214 27741 tablet_loader.cc:96] loaded metadata for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4])
I20260810 11:30:23.022259 27741 tablet_loader.cc:96] loaded metadata for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e])
I20260810 11:30:23.022723 27741 tablet_loader.cc:96] loaded metadata for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8])
I20260810 11:30:23.023137 27741 tablet_loader.cc:96] loaded metadata for tablet 725d2e70e1d441b497d56a278e1de0ad (table default.Table_59ed990b31964d6080614081ee46a6de [id=6d8fc88a491140548a45c7fbb403bb36])
I20260810 11:30:23.023587 27741 tablet_loader.cc:96] loaded metadata for tablet 750950c424184d08bf6777774db3a0b2 (table default.Table_9eee8b010360415faceef1c43fea61d9 [id=41dfd71fd24040a392812bca04e2baf6])
I20260810 11:30:23.024004 27741 tablet_loader.cc:96] loaded metadata for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e])
I20260810 11:30:23.024447 27741 tablet_loader.cc:96] loaded metadata for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_10b2af8299224f5db4a63bd1fae61155 [id=6a421de2b28a46088fd0bad429a52bad])
W20260810 11:30:23.026415 26849 consensus_peers.cc:487] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 949f31fa0c124eefbee695cfc7f50cbe. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:23.026479 27741 tablet_loader.cc:96] loaded metadata for tablet 7cd4f555b5d840c182a31b3c94da9619 (table default.Table_061b7dfbcc074ad6a0d99d49113a354f [id=0186ddbf3c144b4e86ae21cbdac555d2])
I20260810 11:30:23.026924 27741 tablet_loader.cc:96] loaded metadata for tablet 7d3406f12d9c492cbd0d86fa7a57de82 (table default.Table_c32d1cb0b9e744fbacbd00c8736fad21 [id=f54b49f28880453aa7bc67b9c36a219b])
I20260810 11:30:23.027359 27741 tablet_loader.cc:96] loaded metadata for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_ce142135909043cf9c17bb75b2eae0f9 [id=43d34198e1ae4e33ba4ae808df4d40b5])
I20260810 11:30:23.028023 27741 tablet_loader.cc:96] loaded metadata for tablet 7de2d60cf87c48459e6663a68ac96714 (table default.Table_53285a0af75e4705982c23850f7b27e2 [id=d58840daecc84b789f04a35ca6cd8393])
I20260810 11:30:23.028424 27763 leader_election.cc:288] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:23.028771 27741 tablet_loader.cc:96] loaded metadata for tablet 7e78fb1bf0534deca5cc5a603fd77592 (table default.Table_3d15fcde44db49a7ba17fd166381299f [id=e88ac45e937f49b2a8be4256d1a7279e])
I20260810 11:30:23.029703 27228 tablet_bootstrap.cc:492] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:23.030010 27741 tablet_loader.cc:96] loaded metadata for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_34d8fc5b6fcb49a9a2e7837be26f92fd [id=39e1741c8eed4714b9fd844fb1f3e81d])
I20260810 11:30:23.031872 27609 raft_consensus.cc:482] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.032042 27228 tablet_bootstrap.cc:654] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:23.032106 27609 raft_consensus.cc:504] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:23.032312 27655 raft_consensus.cc:482] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.032606 27655 raft_consensus.cc:504] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.032948 27609 leader_election.cc:288] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:23.033898 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e829d4bffeb4289a54b4d3d7a53c44e" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:23.034169 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdbe21b4f124411988dd35a0b864f868" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:23.035004 26849 leader_election.cc:341] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:23.035319 27655 leader_election.cc:288] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:23.036312 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdbe21b4f124411988dd35a0b864f868" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:23.037048 26848 leader_election.cc:341] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:23.037249 26848 leader_election.cc:302] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:23.037849 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e829d4bffeb4289a54b4d3d7a53c44e" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:23.038230 27059 raft_consensus.cc:2379] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:23.038762 26848 leader_election.cc:302] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:23.039089 27655 raft_consensus.cc:2726] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:23.039153 27609 raft_consensus.cc:3037] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:23.039623 27741 tablet_loader.cc:96] loaded metadata for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655])
I20260810 11:30:23.040180 27741 tablet_loader.cc:96] loaded metadata for tablet 859477ecf37240a4888542d2559f99cd (table default.Table_c447a9537b844dffa1767531896bf6fe [id=a74215a4f78c47348bc5a41e4b1232f8])
I20260810 11:30:23.040940 27741 tablet_loader.cc:96] loaded metadata for tablet 88268e3571884ac88c1a617ce74499f3 (table default.Table_ad3534a46309483687ef9dd9471f1008 [id=0f9e142b43214fa8b2e362c54fabcb42])
I20260810 11:30:23.041436 27741 tablet_loader.cc:96] loaded metadata for tablet 8a1e2e624fff4692a22e29b293cd82d6 (table default.Table_f974a4ceae4649bb9f17115103f554cd [id=8c06eb3e2a9245af8c8e8eb250215e0c])
I20260810 11:30:23.041911 27741 tablet_loader.cc:96] loaded metadata for tablet 9079c8fec89043be9d0040a3728e93f4 (table default.Table_fabd7780b9224b7993ad4321be6f92e2 [id=c9c81bc9d6dc48c89ba4cc51ca4f8bd9])
I20260810 11:30:23.043102 27741 tablet_loader.cc:96] loaded metadata for tablet 932ac2ae54324e6e830291ed449a31a8 (table default.Table_168dc06875d64f40830cac1440688bd0 [id=167c03593b73416ab0f9607c87937a60])
I20260810 11:30:23.043823 27609 raft_consensus.cc:2726] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:23.045660 26849 consensus_peers.cc:487] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d729baae40a64e6e8c23e6870f230afb. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:23.046514 27741 tablet_loader.cc:96] loaded metadata for tablet 94bcb1739e5144559201479b82c07941 (table default.Table_e7f8305a313f47b0a219cb6a9cb15049 [id=329af78463204d2da90569d268b49eb3])
I20260810 11:30:23.047804 27741 tablet_loader.cc:96] loaded metadata for tablet 9744f59d7e49430e91080f56f3342038 (table default.Table_835cdd4f3794466d808449e2e17bb15a [id=a483de6ef1fc453b93e3f183e9c15dd1])
I20260810 11:30:23.048722 27741 tablet_loader.cc:96] loaded metadata for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a])
I20260810 11:30:23.049374 27741 tablet_loader.cc:96] loaded metadata for tablet 9de57b6d03e34ee783b822b30090c077 (table default.Table_09ff2cfcae6d4c1b96479fd190b3c084 [id=7d0dd215c30648438a460f730b0b7ba4])
I20260810 11:30:23.049530 27228 tablet_bootstrap.cc:492] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:23.049711 27228 ts_tablet_manager.cc:1397] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.006s
I20260810 11:30:23.049947 27741 tablet_loader.cc:96] loaded metadata for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_e33c9849bbd34e6b9b72e69fd3a1ab1c [id=b206753d4f4142be82ee28150226bd53])
I20260810 11:30:23.050679 27228 raft_consensus.cc:348] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.050933 27741 tablet_loader.cc:96] loaded metadata for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_a22c355b17404952bced99698472d57e [id=72544a36bf7e46ca8a020d40d5370b82])
I20260810 11:30:23.051020 27228 raft_consensus.cc:374] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:23.051155 27228 raft_consensus.cc:729] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:23.051640 27741 tablet_loader.cc:96] loaded metadata for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd])
I20260810 11:30:23.051435 27228 consensus_queue.cc:260] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.052314 27741 tablet_loader.cc:96] loaded metadata for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079])
I20260810 11:30:23.052376 27228 ts_tablet_manager.cc:1428] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 11:30:23.052764 27741 tablet_loader.cc:96] loaded metadata for tablet a63227e69df14a4ea935087fd31ece63 (table default.Table_d863b14a3a96454e8ee5a85fb2ab30c8 [id=a40ab01e5be24248b3af7ef1dc456da6])
I20260810 11:30:23.052976 27228 tablet_bootstrap.cc:492] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:23.053670 27741 tablet_loader.cc:96] loaded metadata for tablet a835d30ef9fc474ab927bb119a95d83c (table default.Table_eecd0244ecc849339f452f38db67c973 [id=41d3dec833b54d1e855194862cb1726b])
I20260810 11:30:23.054059 27741 tablet_loader.cc:96] loaded metadata for tablet a87f6835f0dc4ad4b3a23b297726100d (table default.Table_cbf7fb0f0585465a9be24fa7e70d68d2 [id=82041e96f8de4fae85baf690bbbfc7a3])
I20260810 11:30:23.055310 27741 tablet_loader.cc:96] loaded metadata for tablet ab2471d06e0841e7bebae4ca1865618c (table default.Table_db5e3f1e3cf74bc0b15660e83ea59ad6 [id=e7142023363b432b803533be5da13aec])
I20260810 11:30:23.056038 27741 tablet_loader.cc:96] loaded metadata for tablet add1743851c34d58afb7e4886325d659 (table default.Table_2d72d964c7c54d639c11a02fc168152a [id=f49e68eaa81e49bb92ed473e754de42f])
I20260810 11:30:23.061017 27708 consensus_queue.cc:1035] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.062958 27228 tablet_bootstrap.cc:654] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:23.062973 27526 consensus_queue.cc:1035] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.065698 27741 tablet_loader.cc:96] loaded metadata for tablet adecd2f0952b4f4c83919c78d563e429 (table default.Table_6f7fdd85630648659dcfe3b52e5ab365 [id=862df0152eda418da6110067b4ab588b])
I20260810 11:30:23.071183 27708 consensus_queue.cc:1035] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.073586 27741 tablet_loader.cc:96] loaded metadata for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_93969ba1aad24adfb712d718540eaae2 [id=0d443055d28146b9a2bf6780b6f44daa])
I20260810 11:30:23.074440 27741 tablet_loader.cc:96] loaded metadata for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_2a7d8b62f0814dcb99b674089d4fd0c7 [id=b88e11526dbd42c2a6b51fcc1cf731d3])
I20260810 11:30:23.075050 27741 tablet_loader.cc:96] loaded metadata for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96])
I20260810 11:30:23.075232 27228 tablet_bootstrap.cc:492] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:23.075346 27741 tablet_loader.cc:96] loaded metadata for tablet b6395bce17ee40c2822669246ce7eb42 (table default.Table_44e5f0610f934d889eaf76d00116f0e2 [id=801df0b567d947db90abd034d997ed3f])
I20260810 11:30:23.075413 27228 ts_tablet_manager.cc:1397] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.004s
I20260810 11:30:23.075716 27741 tablet_loader.cc:96] loaded metadata for tablet b6a3b1e37ac943e391d54640987136f8 (table default.Table_a88d168f91f6427e898a55cb391840af [id=56dee621acfa4f73b3bd69fefa7cb7e1])
I20260810 11:30:23.076242 27741 tablet_loader.cc:96] loaded metadata for tablet b755744059b04967857c1b00e951b8ee (table default.Table_04e075d361354421aa7085057964f310 [id=94c8e7388b644043b77cb6b5087e87e8])
I20260810 11:30:23.076524 27228 raft_consensus.cc:348] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.076918 27228 raft_consensus.cc:374] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:23.077008 27228 raft_consensus.cc:729] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:23.077395 27228 consensus_queue.cc:260] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.078205 27228 ts_tablet_manager.cc:1428] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 11:30:23.078884 27228 tablet_bootstrap.cc:492] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:23.080943 27741 tablet_loader.cc:96] loaded metadata for tablet b9195690e00b4f3cb3d5076dcca3519c (table default.Table_6f7ae1749f224614a4fdaa33b125864d [id=339298a1ea1747d59a035a6a3cadfb30])
I20260810 11:30:23.081465 27741 tablet_loader.cc:96] loaded metadata for tablet b945038c03e343489af6ae7e50131d97 (table default.Table_9744be92699b40d1bae23bbb564db585 [id=f27ef087b00e469197a44c70d4bc979b])
I20260810 11:30:23.085151 27228 tablet_bootstrap.cc:654] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:23.087235 27740 consensus_queue.cc:1035] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:23.088438 26993 consensus_peers.cc:487] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a28849649c704f2fbdec1aced9ce01b1. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:23.100759 27741 tablet_loader.cc:96] loaded metadata for tablet bbe34108a7604fa6aa667758be11f569 (table default.Table_5f6a37537c33412a80f2642fb0162da6 [id=bfc3f2f94773444181545d43ecd88190])
I20260810 11:30:23.103670 26911 raft_consensus.cc:3037] T bbe34108a7604fa6aa667758be11f569 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:23.106076 27741 tablet_loader.cc:96] loaded metadata for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6])
I20260810 11:30:23.107265 27741 tablet_loader.cc:96] loaded metadata for tablet c4124999339e4133b2bd47b3739da373 (table default.Table_9efdfb09fd194dc2a9cbdc9a87749126 [id=8afbc0cc8e704a03a064974937b5a36b])
I20260810 11:30:23.109623 27741 tablet_loader.cc:96] loaded metadata for tablet c60baf810a544a4a90dccd2337a39043 (table default.Table_e58ae45f9ea949a2a0d7bf7f0e862647 [id=76b87112ac8e4024965d44a9b62b8c1a])
I20260810 11:30:23.111208 27708 consensus_queue.cc:1035] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.113925 27741 tablet_loader.cc:96] loaded metadata for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_a3ca31166a6348f68da88913588098df [id=5c8a2cbef71f4c9fb038a49e1ca7f704])
I20260810 11:30:23.114850 27741 tablet_loader.cc:96] loaded metadata for tablet cc76d30f37094391b75076c92ccc277f (table default.Table_03a616a243fc4350b4a01d7f5bb86949 [id=4e2dc56dde3346a0917e58c6c7e921eb])
I20260810 11:30:23.115227 27741 tablet_loader.cc:96] loaded metadata for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156])
I20260810 11:30:23.115643 27741 tablet_loader.cc:96] loaded metadata for tablet d000f0ebaf0049a7bdaad93e307e16e2 (table default.Table_2c4f303b1d1c47c9a4c089efccdd1d37 [id=fe5337909463467788d24d76e379cb48])
I20260810 11:30:23.116041 27741 tablet_loader.cc:96] loaded metadata for tablet d14091e1c111438bac8bcf3d36123d80 (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda])
I20260810 11:30:23.116479 27741 tablet_loader.cc:96] loaded metadata for tablet d1d0d55b526749059470504a27887b22 (table default.Table_57b6151125a144fcb6230ee986bff7ee [id=62f404c62e4040fc801f70cafddf9d95])
I20260810 11:30:23.117623 27228 tablet_bootstrap.cc:492] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:23.117803 27228 ts_tablet_manager.cc:1397] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.006s
I20260810 11:30:23.118857 27228 raft_consensus.cc:348] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.119153 27228 raft_consensus.cc:374] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:23.119427 27228 raft_consensus.cc:729] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:23.119656 27228 consensus_queue.cc:260] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.120625 27228 ts_tablet_manager.cc:1428] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.002s sys 0.002s
I20260810 11:30:23.120980 27228 tablet_bootstrap.cc:492] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:23.123268 27228 tablet_bootstrap.cc:654] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:23.123998 27633 consensus_queue.cc:1035] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.132692 27708 consensus_queue.cc:1035] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.132887 27228 tablet_bootstrap.cc:492] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:23.133085 27228 ts_tablet_manager.cc:1397] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.006s
I20260810 11:30:23.133284 27741 tablet_loader.cc:96] loaded metadata for tablet d24726d0214947beab0bb31b1597c1c3 (table default.Table_3fd59f07e4ee4f54bce7829aec4cf4c4 [id=3719720e5ca241b1a500a1aaf7f310c4])
I20260810 11:30:23.133926 27741 tablet_loader.cc:96] loaded metadata for tablet d4873fe8318040a2b7e021708a875f43 (table default.Table_f33a13096a144e538af2795c149abdcd [id=60ce1267de814f218c27ac084a08a26a])
I20260810 11:30:23.134147 27228 raft_consensus.cc:348] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.134472 27228 raft_consensus.cc:374] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:23.134585 27228 raft_consensus.cc:729] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:23.134903 27228 consensus_queue.cc:260] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.135315 27741 tablet_loader.cc:96] loaded metadata for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9])
I20260810 11:30:23.135660 27228 ts_tablet_manager.cc:1428] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 11:30:23.136092 27228 tablet_bootstrap.cc:492] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:23.136415 27741 tablet_loader.cc:96] loaded metadata for tablet d560157da0624333b91a18481b058f91 (table default.Table_5f7d17a1cdaa4396b5faf52b01518860 [id=973454ab92f84e73be26260d66ee9763])
I20260810 11:30:23.141119 27741 tablet_loader.cc:96] loaded metadata for tablet d722b93fe27f4c08a592bc393046b6bd (table default.Table_60e35bdf23f74306a9b5299e927771de [id=0faf073b01654e38b8f6083f5012abd7])
I20260810 11:30:23.141341 27228 tablet_bootstrap.cc:654] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:23.142118 27741 tablet_loader.cc:96] loaded metadata for tablet d91cb30457a74d51885ad81c4ab89d71 (table default.Table_1f48a9af47ad4e0c93ed4dd43ecd12a3 [id=e985b1ae60d94bfa998e1986bdf3fcd9])
I20260810 11:30:23.142731 27741 tablet_loader.cc:96] loaded metadata for tablet db59523b71224370bf5fce6b56592f71 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6])
I20260810 11:30:23.143708 27741 tablet_loader.cc:96] loaded metadata for tablet dc2506b72a624cb388059efc326abbc1 (table default.Table_b7e6c83a5d5340b5b960f65b82d4939a [id=553f87ed39f148aba3be0a6fcd13e25d])
I20260810 11:30:23.144228 27741 tablet_loader.cc:96] loaded metadata for tablet e25557126afd4f51a31fba73cd7da219 (table default.Table_4857a0fc183c421382b9b70094d76ac3 [id=eb184bc24462433e89048f962a639600])
I20260810 11:30:23.146706 27741 tablet_loader.cc:96] loaded metadata for tablet e276b0fa124d42dfb3fe750d245e44d8 (table default.Table_2d6c3a53213a458aaee6bd445240041c [id=097ff3abe81b415799933e50feab6c39])
I20260810 11:30:23.148972 27633 raft_consensus.cc:482] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.149330 27633 raft_consensus.cc:504] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.151176 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60d56e162b4b41e2867ac845e524aca4" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:23.152105 26849 leader_election.cc:341] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:23.152467 27633 leader_election.cc:288] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:23.153529 27741 tablet_loader.cc:96] loaded metadata for tablet e69916a35fba4714bbc565921738888f (table default.Table_c40dd8e327db40b59167de093a5c616d [id=10ebb746a2b343b08b5b13d1107a7cd8])
W20260810 11:30:23.154079 26993 consensus_peers.cc:487] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ff4e19071fc435fbae4490799325e37. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:23.154107 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60d56e162b4b41e2867ac845e524aca4" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:23.155355 26848 leader_election.cc:341] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:23.156423 27741 tablet_loader.cc:96] loaded metadata for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a])
I20260810 11:30:23.155582 26848 leader_election.cc:302] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:23.157611 27741 tablet_loader.cc:96] loaded metadata for tablet ee803ddf27594d2b9e19fe440fc269c7 (table default.Table_67580ad3fe7a47d6a051e7da7005c171 [id=5ae9efa77fb54cf58ff2a1662eee03f7])
I20260810 11:30:23.158156 27633 raft_consensus.cc:2726] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:23.159248 27763 raft_consensus.cc:482] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.159732 27763 raft_consensus.cc:504] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.161051 27763 leader_election.cc:288] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:23.162251 27741 tablet_loader.cc:96] loaded metadata for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743])
I20260810 11:30:23.162290 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5adcec593b8c4d40997c8911e9f77c85" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:23.162590 27060 raft_consensus.cc:2454] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:23.162581 26910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5adcec593b8c4d40997c8911e9f77c85" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:23.162968 26910 raft_consensus.cc:2454] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:23.163309 26702 leader_election.cc:302] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:23.163707 27763 raft_consensus.cc:2781] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:23.163837 27763 raft_consensus.cc:482] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:23.163959 27763 raft_consensus.cc:3037] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:23.164799 27708 consensus_queue.cc:1035] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.167490 27763 raft_consensus.cc:504] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.169351 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5adcec593b8c4d40997c8911e9f77c85" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:23.169625 27060 raft_consensus.cc:3037] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:23.171168 26910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5adcec593b8c4d40997c8911e9f77c85" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:23.171458 26910 raft_consensus.cc:3037] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:23.173318 27060 raft_consensus.cc:2454] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:23.173936 26702 leader_election.cc:302] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:23.174271 27526 raft_consensus.cc:2781] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:23.174427 27526 raft_consensus.cc:686] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:23.174721 27526 consensus_queue.cc:237] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.175501 26910 raft_consensus.cc:2454] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:23.178411 27763 leader_election.cc:288] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:23.184343 27741 tablet_loader.cc:96] loaded metadata for tablet f7ada1df82eb44ecb9a6c615b5410e6f (table default.Table_635ef5268ea1426bb6578ba498e616e3 [id=fef997439a4346d2a9c6f2a4277ede5a])
W20260810 11:30:23.186048 26849 consensus_peers.cc:487] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96cae4eb16c84410926a317af70e44f7. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:23.184329 27708 consensus_queue.cc:1035] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260810 11:30:23.194458 27609 raft_consensus.cc:482] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.194816 27609 raft_consensus.cc:504] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:23.196376 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3884736eec74c8992b8d51b37465875" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:23.196878 26771 raft_consensus.cc:2379] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
I20260810 11:30:23.198017 27609 leader_election.cc:288] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:23.201828 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3884736eec74c8992b8d51b37465875" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:23.202489 27741 tablet_loader.cc:96] loaded metadata for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe])
I20260810 11:30:23.203162 27741 tablet_loader.cc:96] loaded metadata for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f (table default.Table_7458a59fbdce4e9485d51df6fccf66a5 [id=d63533f5d837481889b34a78d860e018])
I20260810 11:30:23.203573 27741 tablet_loader.cc:96] loaded metadata for tablet fa14fea852c24cd7bb3d57094af2e178 (table default.Table_6d8b58857bb84e579c8c308dcb0800f0 [id=f0f8365d722447a090e236fd1fcb0e98])
I20260810 11:30:23.204015 27741 tablet_loader.cc:96] loaded metadata for tablet fbe0a0ab82a147a3b6164904b135d1ab (table default.Table_61d778388656489cb2e7fe8312b8ac6e [id=b52c11bd73cd4d1f8f9dfc32562718a2])
I20260810 11:30:23.204486 27741 tablet_loader.cc:96] loaded metadata for tablet fc023d51790042ce978eb53a2979e29c (table default.Table_66b8d163284b4347b99dea499ed256fc [id=304e1529f45d4d3c8799a22009066ce5])
I20260810 11:30:23.205535 27741 tablet_loader.cc:96] loaded metadata for tablet fc558690dce44e999e55e9bf1b6ca172 (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6])
I20260810 11:30:23.206180 27741 tablet_loader.cc:96] loaded metadata for tablet fccc21cfc1ce4eb586f03276ec6e987f (table default.Table_fb8c5684b00a41eebe3f5b088bcbee33 [id=e22f19a993564e53b1cc76633f25f505])
I20260810 11:30:23.207139 27741 tablet_loader.cc:96] loaded metadata for tablet fdbe21b4f124411988dd35a0b864f868 (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57])
I20260810 11:30:23.208521 27741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260810 11:30:23.210680 26849 consensus_peers.cc:487] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e2c9112462f442e8de5b4a944cfdc6b. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:23.212644 27708 consensus_queue.cc:1035] T bbe34108a7604fa6aa667758be11f569 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.215395 26848 leader_election.cc:302] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:23.218992 27633 raft_consensus.cc:3037] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:23.220068 27741 catalog_manager.cc:1259] Loaded cluster ID: 5081849c8420415b9be91728667896d5
I20260810 11:30:23.220384 27741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 11:30:23.227557 27633 raft_consensus.cc:2726] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:23.233191 27741 catalog_manager.cc:1504] Loading token signing keys...
I20260810 11:30:23.236438 27718 consensus_queue.cc:1035] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.258442 27231 ts_tablet_manager.cc:1428] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.416s user 0.001s sys 0.001s
I20260810 11:30:23.259327 27231 tablet_bootstrap.cc:492] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:23.275272 27526 consensus_queue.cc:1035] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:23.282349 27222 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.585s user 0.124s sys 0.184s
W20260810 11:30:23.282615 27222 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.585s user 0.124s sys 0.184s
I20260810 11:30:23.295166 27231 tablet_bootstrap.cc:654] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:23.261715 27828 log.cc:924] Time spent T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215: Append to log took a long time: real 0.354s user 0.000s sys 0.000s
I20260810 11:30:23.267138 27718 consensus_queue.cc:1035] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.275225 27655 consensus_queue.cc:1035] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.309911 27741 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Loaded TSK: 0
I20260810 11:30:23.310768 27718 consensus_queue.cc:1035] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.311065 27222 tablet_bootstrap.cc:492] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:23.311371 27222 ts_tablet_manager.cc:1397] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.621s user 0.127s sys 0.185s
I20260810 11:30:23.311689 27526 raft_consensus.cc:482] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.312016 27526 raft_consensus.cc:504] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.312999 27526 leader_election.cc:288] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:23.313500 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ddb6e67c316416681074e454ab9b01e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:23.313988 27526 consensus_queue.cc:1035] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:23.314177 26702 leader_election.cc:341] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:23.314159 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ddb6e67c316416681074e454ab9b01e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:23.314852 26911 raft_consensus.cc:2454] T 3ddb6e67c316416681074e454ab9b01e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:23.315420 26700 leader_election.cc:302] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:23.315654 27222 raft_consensus.cc:348] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.315987 27526 raft_consensus.cc:2781] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:23.316015 27222 raft_consensus.cc:374] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:23.316152 27526 raft_consensus.cc:482] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:23.316298 27526 raft_consensus.cc:3037] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:23.320236 27526 raft_consensus.cc:504] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.320452 27718 raft_consensus.cc:482] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.320976 27718 raft_consensus.cc:504] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:23.322005 27750 raft_consensus.cc:482] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.322189 27750 raft_consensus.cc:504] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.322403 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ddb6e67c316416681074e454ab9b01e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:23.322959 27750 leader_election.cc:288] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:23.323134 26702 leader_election.cc:341] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:23.323338 26993 leader_election.cc:341] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 97d586d35ff144a681ad52756f4be2b6
W20260810 11:30:23.324268 26993 leader_election.cc:341] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 9b754dc2568849deafc7a8dc6d81924c
I20260810 11:30:23.324628 27718 leader_election.cc:288] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:23.324707 27526 leader_election.cc:288] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:23.324954 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ddb6e67c316416681074e454ab9b01e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:23.325253 26909 raft_consensus.cc:3037] T 3ddb6e67c316416681074e454ab9b01e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:23.327251 27655 raft_consensus.cc:482] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.327414 27655 raft_consensus.cc:504] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.328091 27655 leader_election.cc:288] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:23.328245 27655 raft_consensus.cc:482] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.328392 27655 raft_consensus.cc:504] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:23.329036 27655 leader_election.cc:288] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:23.329949 26909 raft_consensus.cc:2454] T 3ddb6e67c316416681074e454ab9b01e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:23.331284 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed0e2bead85466ca99cfb34e155a391" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:23.331524 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "725d2e70e1d441b497d56a278e1de0ad" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:23.332031 27057 raft_consensus.cc:2379] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
W20260810 11:30:23.332178 26848 leader_election.cc:341] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:23.333904 26700 leader_election.cc:302] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:23.334551 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed0e2bead85466ca99cfb34e155a391" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:23.335666 26849 leader_election.cc:341] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:23.335880 26849 leader_election.cc:302] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:23.336374 27655 raft_consensus.cc:2726] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:23.339197 27718 consensus_queue.cc:1035] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.336347 27526 raft_consensus.cc:2781] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:23.342418 27741 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 11:30:23.347489 26991 leader_election.cc:341] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 97d586d35ff144a681ad52756f4be2b6
I20260810 11:30:23.348060 27655 raft_consensus.cc:482] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.348338 27655 raft_consensus.cc:504] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.349453 27655 leader_election.cc:288] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:23.349331 27751 consensus_queue.cc:1035] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.350929 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b15cc8669b549a2b4461dccd66a0c5a" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:23.351738 26848 leader_election.cc:341] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:23.358750 26991 leader_election.cc:302] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
W20260810 11:30:23.359684 26991 leader_election.cc:341] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 9b754dc2568849deafc7a8dc6d81924c
I20260810 11:30:23.359774 27639 raft_consensus.cc:2726] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:23.359836 26991 leader_election.cc:302] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:23.363394 27526 raft_consensus.cc:686] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:23.378836 27639 raft_consensus.cc:2726] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:23.380785 27222 raft_consensus.cc:729] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:23.382473 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b15cc8669b549a2b4461dccd66a0c5a" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:23.385193 26849 consensus_peers.cc:487] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7eae49e1c6554ba2ae831831ff4bb45c. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:23.385576 26849 leader_election.cc:341] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:23.385777 26849 leader_election.cc:302] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:23.386497 27609 raft_consensus.cc:2726] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:23.389094 27748 consensus_queue.cc:1035] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.392524 27748 consensus_queue.cc:1035] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.335403 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "725d2e70e1d441b497d56a278e1de0ad" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:23.412524 26849 leader_election.cc:302] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:23.413425 27609 raft_consensus.cc:3037] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:23.401867 27526 consensus_queue.cc:237] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.425518 27763 consensus_queue.cc:1035] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260810 11:30:23.436354 27763 consensus_queue.cc:1035] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.409296 27222 consensus_queue.cc:260] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.450171 27222 ts_tablet_manager.cc:1428] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.138s user 0.002s sys 0.002s
I20260810 11:30:23.450814 27222 tablet_bootstrap.cc:492] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:23.463876 27286 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111) [suppressed 3 similar messages]
I20260810 11:30:23.467543 27609 raft_consensus.cc:2726] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:23.475565 27754 consensus_queue.cc:1035] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.482712 27222 tablet_bootstrap.cc:654] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:23.280975 27248 ts_tablet_manager.cc:1918] T 08f6636df13548c49f35e1808a87c1f5 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:23.291508 27708 consensus_queue.cc:1035] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.484433 27655 consensus_queue.cc:1035] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.485740 27248 log.cc:1196] T 08f6636df13548c49f35e1808a87c1f5 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/08f6636df13548c49f35e1808a87c1f5
W20260810 11:30:23.499565 26993 consensus_peers.cc:487] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db5adccd80a04e328e13793b461c38b1. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:23.505201 27740 consensus_queue.cc:1035] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.509733 27639 consensus_queue.cc:1035] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.514034 27248 ts_tablet_manager.cc:1939] T 08f6636df13548c49f35e1808a87c1f5 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:23.515266 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 272) took 4832 ms. Trace:
I20260810 11:30:23.515501 27248 rpcz_store.cc:276] 0810 11:30:18.682948 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.683483 (+ 535us) service_pool.cc:227] Handling call
0810 11:30:22.598302 (+3914819us) ts_tablet_manager.cc:1145] Deleting tablet 08f6636df13548c49f35e1808a87c1f5
0810 11:30:22.598324 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:22.623363 (+ 25039us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:23.280715 (+657352us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:23.515216 (+234501us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3858947}
W20260810 11:30:23.516129 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 272) could send its response
I20260810 11:30:23.516517 27248 tablet_replica.cc:330] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:23.516961 27248 raft_consensus.cc:2229] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:23.517228 27248 raft_consensus.cc:2258] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:23.540023 27333 catalog_manager.cc:5495] T b6a3b1e37ac943e391d54640987136f8 P b6079090b1124d84aa4477974bb53700 reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:23.542920 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 587c6ce242c0411b886404a0df03b1bb (table default.Table_8326a5b5a7544e828699f8b41fdee4d1 [id=1ae6d36bfe0e427a9a996dff3cdccc91]). Expected version 2 got 0
I20260810 11:30:23.544040 27333 catalog_manager.cc:5495] T d722b93fe27f4c08a592bc393046b6bd P b6079090b1124d84aa4477974bb53700 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:23.544813 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d722b93fe27f4c08a592bc393046b6bd (table default.Table_60e35bdf23f74306a9b5299e927771de [id=0faf073b01654e38b8f6083f5012abd7]). Expected version 2 got 0
I20260810 11:30:23.545445 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]). Expected version 2 got 0
W20260810 11:30:23.551563 27286 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.253:34547, user_credentials={real_user=slave}} blocked reactor thread for 87786.3us
I20260810 11:30:23.561542 27222 tablet_bootstrap.cc:492] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:23.562052 27222 ts_tablet_manager.cc:1397] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.111s user 0.005s sys 0.004s
I20260810 11:30:23.563755 27222 raft_consensus.cc:348] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.571135 27222 raft_consensus.cc:374] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:23.571635 27222 raft_consensus.cc:729] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:23.572378 27222 consensus_queue.cc:260] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.573822 27222 ts_tablet_manager.cc:1428] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260810 11:30:23.574489 27222 tablet_bootstrap.cc:492] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:23.583515 27222 tablet_bootstrap.cc:654] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:23.594385 27866 raft_consensus.cc:482] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.594622 27866 raft_consensus.cc:504] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:23.595474 27866 leader_election.cc:288] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:23.597002 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbe0a0ab82a147a3b6164904b135d1ab" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:23.597360 26767 raft_consensus.cc:2379] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
I20260810 11:30:23.601059 27754 raft_consensus.cc:482] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.601368 27754 raft_consensus.cc:504] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.602077 27754 leader_election.cc:288] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:23.604394 26702 leader_election.cc:341] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 08f6636df13548c49f35e1808a87c1f5
I20260810 11:30:23.609408 26910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08f6636df13548c49f35e1808a87c1f5" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:23.610126 26910 raft_consensus.cc:2454] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
W20260810 11:30:23.613734 26848 consensus_peers.cc:487] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e2c9112462f442e8de5b4a944cfdc6b. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:23.614663 26912 raft_consensus.cc:3037] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:23.546082 27333 catalog_manager.cc:5495] T bbe34108a7604fa6aa667758be11f569 P b6079090b1124d84aa4477974bb53700 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:23.617259 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet fdbe21b4f124411988dd35a0b864f868 (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:23.622620 27526 raft_consensus.cc:482] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.623145 27526 raft_consensus.cc:504] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.563692 27748 consensus_queue.cc:1035] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.625839 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7a2cb1d2e8e40f58144908e34438d53" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:23.589977 27894 consensus_queue.cc:1035] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:23.626689 26702 leader_election.cc:341] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:23.627611 27526 leader_election.cc:288] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:23.628099 27248 ts_tablet_manager.cc:1905] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:23.612481 26991 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 48389.6us
I20260810 11:30:23.613778 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbe0a0ab82a147a3b6164904b135d1ab" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:23.635543 26700 leader_election.cc:302] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:23.636418 27763 raft_consensus.cc:2781] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:23.636795 27754 consensus_queue.cc:1035] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 11:30:23.637064 27763 raft_consensus.cc:482] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:23.637315 27763 raft_consensus.cc:3037] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:23.640398 27748 consensus_queue.cc:1035] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.642128 27763 raft_consensus.cc:504] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:23.644488 26702 leader_election.cc:341] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 08f6636df13548c49f35e1808a87c1f5
I20260810 11:30:23.645367 27763 leader_election.cc:288] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:23.651494 26993 consensus_peers.cc:487] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2917f1ffb5214a80b19810540602df35. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:23.652726 27231 tablet_bootstrap.cc:492] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:23.652997 27231 ts_tablet_manager.cc:1397] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.394s user 0.006s sys 0.001s
I20260810 11:30:23.655404 27222 tablet_bootstrap.cc:492] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:23.655629 27222 ts_tablet_manager.cc:1397] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.081s user 0.008s sys 0.010s
I20260810 11:30:23.656780 27222 raft_consensus.cc:348] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.657064 27222 raft_consensus.cc:374] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:23.657189 27222 raft_consensus.cc:729] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:23.656836 27231 raft_consensus.cc:348] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.657433 27231 raft_consensus.cc:374] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:23.657500 27222 consensus_queue.cc:260] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.657670 27231 raft_consensus.cc:729] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:23.658154 27222 ts_tablet_manager.cc:1428] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:23.659195 27231 consensus_queue.cc:260] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.662267 27231 ts_tablet_manager.cc:1428] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260810 11:30:23.662781 27231 tablet_bootstrap.cc:492] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:23.662729 27318 master_service.cc:946] ReplaceTablet: received request to replace tablet 1aa4562a2247405187d9dbd1baa48f39 from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:23.663391 27319 master_service.cc:946] ReplaceTablet: received request to replace tablet 7aa16654b7f34f9baf856bf724cece8f from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:23.663800 27318 master_service.cc:946] ReplaceTablet: received request to replace tablet 81f24c84cdd945b78f39f24015eb1e43 from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:23.669605 27231 tablet_bootstrap.cc:654] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:23.671634 27228 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.529s user 0.037s sys 0.092s
W20260810 11:30:23.671802 27228 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.529s user 0.037s sys 0.092s
I20260810 11:30:23.671802 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7a2cb1d2e8e40f58144908e34438d53" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:23.672967 27228 tablet_bootstrap.cc:492] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:23.673203 27228 ts_tablet_manager.cc:1397] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.537s user 0.040s sys 0.092s
I20260810 11:30:23.674206 27228 raft_consensus.cc:348] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.674414 27228 raft_consensus.cc:374] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:23.674583 27228 raft_consensus.cc:729] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:23.674847 27228 consensus_queue.cc:260] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.675566 27228 ts_tablet_manager.cc:1428] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:23.675871 27228 tablet_bootstrap.cc:492] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:23.678040 26910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08f6636df13548c49f35e1808a87c1f5" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:23.684944 26700 leader_election.cc:341] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:23.685173 26700 leader_election.cc:302] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:23.686750 26910 raft_consensus.cc:3037] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:23.690760 26910 raft_consensus.cc:2454] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:23.691406 27228 tablet_bootstrap.cc:654] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:23.692165 27910 raft_consensus.cc:2726] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:23.694387 27222 tablet_bootstrap.cc:492] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:23.695730 26848 leader_election.cc:302] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:23.696971 27890 consensus_queue.cc:1035] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 11:30:23.624662 27331 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_635ef5268ea1426bb6578ba498e616e3" } modify_external_catalogs: true
I20260810 11:30:23.697757 27331 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_635ef5268ea1426bb6578ba498e616e3" } modify_external_catalogs: true
I20260810 11:30:23.623468 27336 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_54efd7f2894348cf9dbf82586d44b6b5" } modify_external_catalogs: true
I20260810 11:30:23.698159 27336 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_54efd7f2894348cf9dbf82586d44b6b5" } modify_external_catalogs: true
I20260810 11:30:23.698845 27891 raft_consensus.cc:2726] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:23.662431 27322 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_0ca6793e2c374e8d8d93872a0b2283d6" } modify_external_catalogs: true
I20260810 11:30:23.700773 27322 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_0ca6793e2c374e8d8d93872a0b2283d6" } modify_external_catalogs: true
I20260810 11:30:23.698002 26700 leader_election.cc:302] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:23.701810 27910 raft_consensus.cc:2781] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:23.702109 27910 raft_consensus.cc:686] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:23.663079 27321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_2d65cf26d2254f29a785321b186cb2c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:23.702491 27910 consensus_queue.cc:237] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.703074 27866 consensus_queue.cc:1035] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260810 11:30:23.661289 27326 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_24bdc44050024c23aa90a182bdcecb50" } modify_external_catalogs: true
I20260810 11:30:23.704830 27326 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_24bdc44050024c23aa90a182bdcecb50" } modify_external_catalogs: true
I20260810 11:30:23.664638 27318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_ce10a5f4bedc411da7e7089a730e9cc8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:23.708364 27318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce10a5f4bedc411da7e7089a730e9cc8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:23.713377 27639 consensus_queue.cc:1035] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
W20260810 11:30:23.719735 27321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d65cf26d2254f29a785321b186cb2c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:23.726300 27526 consensus_queue.cc:1035] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.726897 27248 ts_tablet_manager.cc:1918] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:23.731040 27222 tablet_bootstrap.cc:654] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:23.727851 26993 consensus_peers.cc:487] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b28f3dcbd6d74559b372d3452e13ce9f. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:23.743098 26848 consensus_peers.cc:487] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:23.744946 27248 log.cc:1196] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/f3c6bd6803c245b7bb3d78423de482b6
I20260810 11:30:23.751366 27248 ts_tablet_manager.cc:1939] T f3c6bd6803c245b7bb3d78423de482b6 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:23.754304 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 278) took 4870 ms. Trace:
I20260810 11:30:23.758245 27639 consensus_queue.cc:1035] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.758867 27748 consensus_queue.cc:1035] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.760242 27248 rpcz_store.cc:276] 0810 11:30:18.883833 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.886035 (+ 2202us) service_pool.cc:227] Handling call
0810 11:30:23.516440 (+4630405us) ts_tablet_manager.cc:1145] Deleting tablet f3c6bd6803c245b7bb3d78423de482b6
0810 11:30:23.516453 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:23.632370 (+115917us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:23.726738 (+ 94368us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:23.754229 (+ 27491us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4630106}
W20260810 11:30:23.762873 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 278) could send its response
I20260810 11:30:23.763624 27248 tablet_replica.cc:330] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:23.765014 27248 raft_consensus.cc:2229] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:23.767685 27231 tablet_bootstrap.cc:492] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:23.767791 27248 raft_consensus.cc:2258] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:23.768796 27231 ts_tablet_manager.cc:1397] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.105s user 0.010s sys 0.005s
I20260810 11:30:23.771750 27248 ts_tablet_manager.cc:1905] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:23.779811 27890 raft_consensus.cc:482] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.780117 27890 raft_consensus.cc:504] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.780998 27890 leader_election.cc:288] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:23.782577 26764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d8ce485cb84495a6e964b6d5977f0d" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:23.782922 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d8ce485cb84495a6e964b6d5977f0d" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:23.783748 26848 leader_election.cc:341] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:23.784078 26849 leader_election.cc:341] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:23.784389 26849 leader_election.cc:302] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:23.785176 27890 raft_consensus.cc:2726] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:23.788786 27231 raft_consensus.cc:348] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.789260 27890 raft_consensus.cc:482] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.789501 27890 raft_consensus.cc:504] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.790342 27890 leader_election.cc:288] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:23.791245 26764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9311943eebaa4824bde96b4cb09f1e2c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:23.792335 26849 leader_election.cc:341] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:23.800056 27222 tablet_bootstrap.cc:492] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:23.804052 27231 raft_consensus.cc:374] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:23.804229 27231 raft_consensus.cc:729] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:23.804795 27222 ts_tablet_manager.cc:1397] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.111s user 0.002s sys 0.005s
I20260810 11:30:23.804636 27231 consensus_queue.cc:260] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.805778 27231 ts_tablet_manager.cc:1428] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.037s user 0.001s sys 0.002s
I20260810 11:30:23.806290 27231 tablet_bootstrap.cc:492] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:23.807622 27222 raft_consensus.cc:348] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.809403 27639 consensus_queue.cc:1035] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.807732 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9311943eebaa4824bde96b4cb09f1e2c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:23.812958 27059 raft_consensus.cc:2454] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:23.813709 26848 leader_election.cc:302] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:23.814046 27891 raft_consensus.cc:482] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.814253 27891 raft_consensus.cc:504] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.814801 27890 raft_consensus.cc:2781] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:23.814966 27890 raft_consensus.cc:482] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:23.815168 27231 tablet_bootstrap.cc:654] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:23.815156 27890 raft_consensus.cc:3037] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:23.815220 27891 leader_election.cc:288] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:23.820022 27890 raft_consensus.cc:504] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.818966 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dc4000f1dde46a3b881a9fa8e9a6e3e" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:23.820925 26848 leader_election.cc:341] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:23.821702 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9311943eebaa4824bde96b4cb09f1e2c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:23.821949 27058 raft_consensus.cc:3037] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:23.822330 27890 leader_election.cc:288] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:23.816038 27910 consensus_queue.cc:1035] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.825816 27058 raft_consensus.cc:2454] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:23.816877 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dc4000f1dde46a3b881a9fa8e9a6e3e" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:23.821938 26764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9311943eebaa4824bde96b4cb09f1e2c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:23.826758 26848 leader_election.cc:302] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:23.827138 27222 raft_consensus.cc:374] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:23.827584 27890 raft_consensus.cc:2781] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:23.827751 27222 raft_consensus.cc:729] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:23.827924 27890 raft_consensus.cc:686] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
W20260810 11:30:23.830139 26849 leader_election.cc:341] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:23.832146 27248 ts_tablet_manager.cc:1918] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:23.835945 27248 log.cc:1196] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/97d586d35ff144a681ad52756f4be2b6
I20260810 11:30:23.837021 27890 consensus_queue.cc:237] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.840847 27248 ts_tablet_manager.cc:1939] T 97d586d35ff144a681ad52756f4be2b6 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:23.841949 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 277) took 4963 ms. Trace:
I20260810 11:30:23.848436 27222 consensus_queue.cc:260] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.848995 27248 rpcz_store.cc:276] 0810 11:30:18.879152 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.886501 (+ 7349us) service_pool.cc:227] Handling call
0810 11:30:23.763498 (+4876997us) ts_tablet_manager.cc:1145] Deleting tablet 97d586d35ff144a681ad52756f4be2b6
0810 11:30:23.763510 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:23.787558 (+ 24048us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:23.831925 (+ 44367us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:23.841904 (+ 9979us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4876599}
W20260810 11:30:23.849715 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 277) could send its response
I20260810 11:30:23.850368 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 276) took 4981 ms. Trace:
I20260810 11:30:23.851009 27248 rpcz_store.cc:276] 0810 11:30:18.868847 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:18.872400 (+ 3553us) service_pool.cc:227] Handling call
0810 11:30:23.850138 (+4977738us) ts_tablet_manager.cc:1145] Deleting tablet 420ba6e9f74c4ae5bf450f369e7fbdb3
0810 11:30:23.850153 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:23.850310 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4960260}
W20260810 11:30:23.851755 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 276) could send its response
I20260810 11:30:23.852388 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 279) took 4847 ms. Trace:
I20260810 11:30:23.853716 26767 raft_consensus.cc:2454] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:23.854569 26849 leader_election.cc:302] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:23.855296 27891 raft_consensus.cc:2781] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:23.855608 27891 raft_consensus.cc:482] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:23.855508 27248 rpcz_store.cc:276] 0810 11:30:19.005139 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.005438 (+ 299us) service_pool.cc:227] Handling call
0810 11:30:23.852107 (+4846669us) ts_tablet_manager.cc:1145] Deleting tablet 10e6c41db71a4146840f06c5b7412d9c
0810 11:30:23.852119 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:23.852310 (+ 191us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4846354}
W20260810 11:30:23.855873 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 279) could send its response
I20260810 11:30:23.856767 27228 tablet_bootstrap.cc:492] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:23.856809 27248 tablet_replica.cc:330] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:23.857362 27248 raft_consensus.cc:2229] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:23.858207 27248 raft_consensus.cc:2258] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:23.858363 27228 ts_tablet_manager.cc:1397] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.181s user 0.008s sys 0.003s
I20260810 11:30:23.858911 27891 raft_consensus.cc:3037] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:23.859441 27222 ts_tablet_manager.cc:1428] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.053s user 0.003s sys 0.000s
I20260810 11:30:23.859333 27228 raft_consensus.cc:348] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.859684 27228 raft_consensus.cc:374] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:23.859784 27228 raft_consensus.cc:729] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:23.860069 27228 consensus_queue.cc:260] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.865051 27891 raft_consensus.cc:504] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.865880 27222 tablet_bootstrap.cc:492] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:23.867945 27248 ts_tablet_manager.cc:1905] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:23.868862 27222 tablet_bootstrap.cc:654] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:23.869844 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dc4000f1dde46a3b881a9fa8e9a6e3e" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:23.870160 26767 raft_consensus.cc:3037] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:23.869788 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dc4000f1dde46a3b881a9fa8e9a6e3e" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:23.876986 27891 leader_election.cc:288] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:23.877411 26848 leader_election.cc:341] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:23.876995 27228 ts_tablet_manager.cc:1428] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260810 11:30:23.879799 27231 tablet_bootstrap.cc:492] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:23.880396 27231 ts_tablet_manager.cc:1397] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.010s
I20260810 11:30:23.881762 27231 raft_consensus.cc:348] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.882222 27231 raft_consensus.cc:374] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:23.882447 27231 raft_consensus.cc:729] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:23.882807 27231 consensus_queue.cc:260] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.888193 27231 ts_tablet_manager.cc:1428] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.008s user 0.000s sys 0.004s
I20260810 11:30:23.888769 27231 tablet_bootstrap.cc:492] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:23.890568 27228 tablet_bootstrap.cc:492] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:23.898962 26767 raft_consensus.cc:2454] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:23.899755 26849 leader_election.cc:302] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:23.900296 27891 raft_consensus.cc:2781] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:23.900502 27891 raft_consensus.cc:686] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:23.901291 27891 consensus_queue.cc:237] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.907706 27231 tablet_bootstrap.cc:654] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:23.915452 27754 consensus_queue.cc:1035] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.924520 27750 raft_consensus.cc:482] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.924834 27750 raft_consensus.cc:504] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.925724 27750 leader_election.cc:288] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:23.926870 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdbe21b4f124411988dd35a0b864f868" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:23.927939 26993 leader_election.cc:341] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:23.940265 27231 tablet_bootstrap.cc:492] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:23.940651 27231 ts_tablet_manager.cc:1397] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.004s
I20260810 11:30:23.941960 27231 raft_consensus.cc:348] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.943320 27231 raft_consensus.cc:374] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:23.943651 27231 raft_consensus.cc:729] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:23.944316 27231 consensus_queue.cc:260] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.945856 27222 tablet_bootstrap.cc:492] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:23.946064 27222 ts_tablet_manager.cc:1397] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.080s user 0.001s sys 0.015s
I20260810 11:30:23.947268 27248 ts_tablet_manager.cc:1918] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:23.947211 27222 raft_consensus.cc:348] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.947651 27222 raft_consensus.cc:374] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:23.947794 27222 raft_consensus.cc:729] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:23.948377 27222 consensus_queue.cc:260] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.949268 27222 ts_tablet_manager.cc:1428] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260810 11:30:23.949647 27222 tablet_bootstrap.cc:492] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:23.951895 27222 tablet_bootstrap.cc:654] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:23.947952 27231 ts_tablet_manager.cc:1428] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 11:30:23.960810 27248 log.cc:1196] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/2917f1ffb5214a80b19810540602df35
I20260810 11:30:23.961422 27231 tablet_bootstrap.cc:492] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:23.963532 27754 raft_consensus.cc:482] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:23.963737 27754 raft_consensus.cc:504] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.965485 27231 tablet_bootstrap.cc:654] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:23.966837 27754 leader_election.cc:288] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:23.968933 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9311943eebaa4824bde96b4cb09f1e2c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:23.969476 27059 raft_consensus.cc:2379] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate b6079090b1124d84aa4477974bb53700 in this term.
I20260810 11:30:23.970297 27248 ts_tablet_manager.cc:1939] T 2917f1ffb5214a80b19810540602df35 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:23.971475 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 280) took 4957 ms. Trace:
I20260810 11:30:23.971642 27248 rpcz_store.cc:276] 0810 11:30:19.014389 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.014450 (+ 61us) service_pool.cc:227] Handling call
0810 11:30:23.856686 (+4842236us) ts_tablet_manager.cc:1145] Deleting tablet 2917f1ffb5214a80b19810540602df35
0810 11:30:23.856699 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:23.913411 (+ 56712us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:23.947092 (+ 33681us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:23.971340 (+ 24248us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4835533}
I20260810 11:30:23.972086 27248 tablet_replica.cc:330] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:23.977160 27248 raft_consensus.cc:2229] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:23.978438 27248 raft_consensus.cc:2258] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:23.978608 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 280) could send its response
I20260810 11:30:23.979838 27248 ts_tablet_manager.cc:1905] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:23.979871 27222 tablet_bootstrap.cc:492] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:23.979933 27331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet f7ada1df82eb44ecb9a6c615b5410e6f
I20260810 11:30:23.980201 27222 ts_tablet_manager.cc:1397] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.006s
I20260810 11:30:23.982213 27222 raft_consensus.cc:348] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.982519 27222 raft_consensus.cc:374] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:23.982686 27222 raft_consensus.cc:729] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:23.983125 27222 consensus_queue.cc:260] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:23.984458 27222 ts_tablet_manager.cc:1428] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260810 11:30:23.985082 27222 tablet_bootstrap.cc:492] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:23.991210 27331 master_service.cc:946] ReplaceTablet: received request to replace tablet fc558690dce44e999e55e9bf1b6ca172 from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:23.991123 27754 consensus_queue.cc:1035] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:23.995375 27222 tablet_bootstrap.cc:654] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:23.987449 27747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 11:30:23.999492 27747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 11:30:24.005276 27747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 11:30:24.011209 27321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_91c2ed7bba91469685ccb4e15fb5c174"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:24.013530 27318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_aa56bd03f9eb42468dce12fd81958879"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:24.014236 27318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa56bd03f9eb42468dce12fd81958879 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:24.021240 27326 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet 110b5acc36bd4d6bba13735e5daec75f
I20260810 11:30:24.022359 27326 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_a3ca31166a6348f68da88913588098df" } new_table_name: "default.Table_feb78e30519943298329752c4fd77a59" modify_external_catalogs: true
W20260810 11:30:24.026057 27333 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 587c6ce242c0411b886404a0df03b1bb (table default.Table_8326a5b5a7544e828699f8b41fdee4d1 [id=1ae6d36bfe0e427a9a996dff3cdccc91], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 587c6ce242c0411b886404a0df03b1bb consensus state has no leader
W20260810 11:30:24.027963 27333 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet eed0e2bead85466ca99cfb34e155a391 consensus state has no leader
W20260810 11:30:24.028374 27333 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet fdbe21b4f124411988dd35a0b864f868 (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet fdbe21b4f124411988dd35a0b864f868 consensus state has no leader
I20260810 11:30:24.029943 27362 catalog_manager.cc:5495] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:24.030845 27362 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3ddb6e67c316416681074e454ab9b01e (table default.Table_1e1ca07e9c824349af23675b66b77321 [id=755202f095f04307a11ce87087df835c]). Expected version 2 got 0
I20260810 11:30:24.031315 27890 raft_consensus.cc:482] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:24.031476 27890 raft_consensus.cc:504] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.032351 27890 leader_election.cc:288] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:24.026351 27248 ts_tablet_manager.cc:1918] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:24.034686 27248 log.cc:1196] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/9b754dc2568849deafc7a8dc6d81924c
W20260810 11:30:24.012502 27321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91c2ed7bba91469685ccb4e15fb5c174 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:24.035315 27248 ts_tablet_manager.cc:1939] T 9b754dc2568849deafc7a8dc6d81924c P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:24.036441 27228 tablet_bootstrap.cc:654] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:24.041625 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 281) took 5023 ms. Trace:
I20260810 11:30:24.043560 27333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_341bf544f7b94ef2ba94afc342f8bc1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:24.041906 27248 rpcz_store.cc:276] 0810 11:30:19.018254 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.018320 (+ 66us) service_pool.cc:227] Handling call
0810 11:30:23.971942 (+4953622us) ts_tablet_manager.cc:1145] Deleting tablet 9b754dc2568849deafc7a8dc6d81924c
0810 11:30:23.971957 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:23.989846 (+ 17889us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:24.026163 (+ 36317us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:24.041559 (+ 15396us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4947254}
W20260810 11:30:24.044013 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 281) could send its response
W20260810 11:30:24.044248 27333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_341bf544f7b94ef2ba94afc342f8bc1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:24.045362 27248 tablet_replica.cc:330] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:24.045674 27248 raft_consensus.cc:2229] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:24.046066 27248 raft_consensus.cc:2258] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:24.047427 27248 ts_tablet_manager.cc:1905] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:24.050510 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587c6ce242c0411b886404a0df03b1bb" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:24.051785 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9311943eebaa4824bde96b4cb09f1e2c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:24.053543 26964 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
W20260810 11:30:24.059001 26849 leader_election.cc:341] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:24.059983 26700 leader_election.cc:302] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:24.060868 27526 raft_consensus.cc:3037] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:24.066558 27336 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet 3ae27bf110114b70a3e3f6cf64f31b98
I20260810 11:30:24.067674 27336 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_0b6cd084cecf499e9091685515cb1a3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:24.068527 27336 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b6cd084cecf499e9091685515cb1a3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:24.073556 27526 raft_consensus.cc:2726] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:24.074216 27747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 11:30:24.074378 27747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 11:30:24.074460 27747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 11:30:24.074554 27747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 11:30:24.077572 27322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet 318d5b8453fe4c438d0fa32cb91c409e
I20260810 11:30:24.078727 27322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_f3f00d1fa4db4cd4bbaaeefeef68897d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:24.078929 27526 consensus_queue.cc:1035] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:24.079653 27322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3f00d1fa4db4cd4bbaaeefeef68897d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:24.079802 27291 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 587c6ce242c0411b886404a0df03b1bb (table default.Table_8326a5b5a7544e828699f8b41fdee4d1 [id=1ae6d36bfe0e427a9a996dff3cdccc91], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 587c6ce242c0411b886404a0df03b1bb consensus state has no leader
I20260810 11:30:24.090608 27248 ts_tablet_manager.cc:1918] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:24.095075 27331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet fc558690dce44e999e55e9bf1b6ca172
I20260810 11:30:24.095737 27331 catalog_manager.cc:6565] ReplaceTablet: tablet fc558690dce44e999e55e9bf1b6ca172 deleted and replaced by tablet 0bb01711769f457aa0696bb59582166d
I20260810 11:30:24.096177 27331 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_34d8fc5b6fcb49a9a2e7837be26f92fd" } new_table_name: "default.Table_aaaed930df2544b3a6c30fbbcd3a637d" modify_external_catalogs: true
I20260810 11:30:24.097347 26910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdbe21b4f124411988dd35a0b864f868" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:24.097766 26910 raft_consensus.cc:2454] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:24.098616 26991 leader_election.cc:302] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:24.098954 27248 log.cc:1196] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/66908164ff2a4ee5b55da6158699e0c6
I20260810 11:30:24.099344 27318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_52c39be8057948a49dfd7394b4152265"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:24.099606 27248 ts_tablet_manager.cc:1939] T 66908164ff2a4ee5b55da6158699e0c6 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
W20260810 11:30:24.100046 27318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52c39be8057948a49dfd7394b4152265 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:24.100610 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 282) took 5075 ms. Trace:
I20260810 11:30:24.100728 27248 rpcz_store.cc:276] 0810 11:30:19.025292 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.025393 (+ 101us) service_pool.cc:227] Handling call
0810 11:30:24.045263 (+5019870us) ts_tablet_manager.cc:1145] Deleting tablet 66908164ff2a4ee5b55da6158699e0c6
0810 11:30:24.045279 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:24.052440 (+ 7161us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:24.090456 (+ 38016us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:24.100519 (+ 10063us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5017261}
W20260810 11:30:24.101074 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 282) could send its response
I20260810 11:30:24.104919 27750 raft_consensus.cc:2781] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:24.105113 27750 raft_consensus.cc:482] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:24.105296 27750 raft_consensus.cc:3037] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:24.108290 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 283) took 5080 ms. Trace:
I20260810 11:30:24.108441 27248 rpcz_store.cc:276] 0810 11:30:19.027755 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.028836 (+ 1081us) service_pool.cc:227] Handling call
0810 11:30:24.108035 (+5079199us) ts_tablet_manager.cc:1145] Deleting tablet 809b5b6b65d244cd9186517e39494839
0810 11:30:24.108052 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:24.108204 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5078876}
W20260810 11:30:24.109123 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 283) could send its response
I20260810 11:30:24.109368 27319 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_ce142135909043cf9c17bb75b2eae0f9" } new_table_name: "default.Table_b7da728f12ba46d1a9f8b99d6d837238" modify_external_catalogs: true
I20260810 11:30:24.110174 27750 raft_consensus.cc:504] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.112033 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdbe21b4f124411988dd35a0b864f868" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:24.112389 26914 raft_consensus.cc:3037] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:24.112835 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 285) took 5073 ms. Trace:
I20260810 11:30:24.112936 27248 rpcz_store.cc:276] 0810 11:30:19.039457 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.039926 (+ 469us) service_pool.cc:227] Handling call
0810 11:30:24.111704 (+5071778us) ts_tablet_manager.cc:1145] Deleting tablet 809b5b6b65d244cd9186517e39494839
0810 11:30:24.111719 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:24.112774 (+ 1055us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5062873}
W20260810 11:30:24.113209 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 285) could send its response
I20260810 11:30:24.114701 27334 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_6471724ce77d490abaf4ad26ff7ae126"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:24.114490 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 284) took 5075 ms. Trace:
W20260810 11:30:24.115568 27334 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6471724ce77d490abaf4ad26ff7ae126 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:24.115449 27248 rpcz_store.cc:276] 0810 11:30:19.039283 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.039653 (+ 370us) service_pool.cc:227] Handling call
0810 11:30:24.114288 (+5074635us) ts_tablet_manager.cc:1145] Deleting tablet 64818ca5827e41d99428903ddb8688d9
0810 11:30:24.114301 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:24.114419 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5054741}
W20260810 11:30:24.116377 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 284) could send its response
I20260810 11:30:24.117038 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 287) took 5068 ms. Trace:
I20260810 11:30:24.117307 27750 leader_election.cc:288] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:24.117201 27248 rpcz_store.cc:276] 0810 11:30:19.048846 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.049158 (+ 312us) service_pool.cc:227] Handling call
0810 11:30:24.116865 (+5067707us) ts_tablet_manager.cc:1145] Deleting tablet cb01e54d817c4b0dbcc80f90f82923c0
0810 11:30:24.116878 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:24.116966 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5053921}
W20260810 11:30:24.117480 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 287) could send its response
I20260810 11:30:24.118968 26822 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:24.119544 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 292) took 4905 ms. Trace:
I20260810 11:30:24.119800 27248 rpcz_store.cc:276] 0810 11:30:19.214552 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.214625 (+ 73us) service_pool.cc:227] Handling call
0810 11:30:24.119279 (+4904654us) ts_tablet_manager.cc:1145] Deleting tablet 91b6078efadf496fb252f725bdf56b02
0810 11:30:24.119292 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:24.119453 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4903879}
W20260810 11:30:24.120165 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 292) could send its response
I20260810 11:30:24.120822 27362 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_7157cb4b94764bf6ab05e84468872791" } new_table_name: "default.Table_a23328d9f82f426fa2993d07f5909694" modify_external_catalogs: true
I20260810 11:30:24.122053 27362 master_service.cc:946] ReplaceTablet: received request to replace tablet 6e829d4bffeb4289a54b4d3d7a53c44e from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:24.122414 27248 tablet_replica.cc:330] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:24.122720 27248 raft_consensus.cc:2229] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:24.123056 27248 raft_consensus.cc:2258] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:24.123188 27362 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_67580ad3fe7a47d6a051e7da7005c171"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:24.123998 27362 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67580ad3fe7a47d6a051e7da7005c171 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:24.124251 27248 ts_tablet_manager.cc:1905] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:24.124315 27747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.195.212:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.195.253:34547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.195.253
--webserver_port=42129
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 10:32:47 UTC on ccycloud.quasar-nosthy.root.comops.site
build id 4577509
ASAN enabled
I20260810 11:30:24.116478 26914 raft_consensus.cc:2454] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:24.125643 26991 leader_election.cc:302] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:24.126153 27718 raft_consensus.cc:2781] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:24.126427 27718 raft_consensus.cc:686] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:24.126824 27718 consensus_queue.cc:237] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.128239 27747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 11:30:24.135104 27747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 11:30:24.137946 27362 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_5ffe87ce66134f859f413c9a6ec537b5" } modify_external_catalogs: true
I20260810 11:30:24.138315 27362 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_5ffe87ce66134f859f413c9a6ec537b5" } modify_external_catalogs: true
I20260810 11:30:24.139010 27362 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_146776d44301462096eb098adde86d0e" } new_table_name: "default.Table_50f879f623d840fb9433e7ba8380272e" modify_external_catalogs: true
I20260810 11:30:24.150090 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587c6ce242c0411b886404a0df03b1bb" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:24.151051 26848 leader_election.cc:341] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:24.151222 26848 leader_election.cc:302] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:24.151913 27866 raft_consensus.cc:2726] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:24.155340 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdbe21b4f124411988dd35a0b864f868" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
W20260810 11:30:24.156345 26993 leader_election.cc:341] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:24.157168 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ada1df82eb44ecb9a6c615b5410e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:24.169215 27111 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:24.175153 27248 ts_tablet_manager.cc:1918] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:24.175328 27248 log.cc:1196] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/b7a3b877457c4a2489d397f3f864d6b2
I20260810 11:30:24.175829 27248 ts_tablet_manager.cc:1939] T b7a3b877457c4a2489d397f3f864d6b2 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:24.176270 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 295) took 4614 ms. Trace:
W20260810 11:30:24.178905 27326 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c62ae41d2dd74eedbe252c4de70fbe1e consensus state has no leader
I20260810 11:30:24.179600 26735 tablet_service.cc:1514] Processing DeleteTablet for tablet 110b5acc36bd4d6bba13735e5daec75f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:24.179910 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:24.180171 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 318d5b8453fe4c438d0fa32cb91c409e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:24.180410 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca5c88585394dba87e201696afa6934 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:24.180722 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet d91a02b22044429fb3e25840c7947a02 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ba5191082814a4f8cf821354416e1d3) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:24.181387 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 31888ddeafe14738b818016a9c0a4ad3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:24.181982 26735 tablet_service.cc:1514] Processing DeleteTablet for tablet fc558690dce44e999e55e9bf1b6ca172 with delete_type TABLET_DATA_DELETED (replaced by tablet 0bb01711769f457aa0696bb59582166d) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:24.182310 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 08f6636df13548c49f35e1808a87c1f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:24.185806 27222 tablet_bootstrap.cc:492] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:24.186231 27222 ts_tablet_manager.cc:1397] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.201s user 0.012s sys 0.046s
I20260810 11:30:24.187481 27222 raft_consensus.cc:348] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.187762 27222 raft_consensus.cc:374] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:24.187866 27222 raft_consensus.cc:729] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:24.176407 27248 rpcz_store.cc:276] 0810 11:30:19.561650 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.561753 (+ 103us) service_pool.cc:227] Handling call
0810 11:30:24.122258 (+4560505us) ts_tablet_manager.cc:1145] Deleting tablet b7a3b877457c4a2489d397f3f864d6b2
0810 11:30:24.122273 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:24.149395 (+ 27122us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:24.174935 (+ 25540us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:24.176228 (+ 1293us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4554598}
I20260810 11:30:24.193333 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 296) took 4601 ms. Trace:
I20260810 11:30:24.194365 27248 rpcz_store.cc:276] 0810 11:30:19.591597 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.591682 (+ 85us) service_pool.cc:227] Handling call
0810 11:30:24.193132 (+4601450us) ts_tablet_manager.cc:1145] Deleting tablet a8a65a0e8b1f4e4b8d9a82059b766cda
0810 11:30:24.193147 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:24.193255 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4601071}
I20260810 11:30:24.195456 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 302) took 4577 ms. Trace:
I20260810 11:30:24.196184 27248 rpcz_store.cc:276] 0810 11:30:19.618046 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.619205 (+ 1159us) service_pool.cc:227] Handling call
0810 11:30:24.195224 (+4576019us) ts_tablet_manager.cc:1145] Deleting tablet 44d5e146eeec4fe0be33c1c169d32e68
0810 11:30:24.195238 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:24.195348 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4575028}
W20260810 11:30:24.197052 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 295) could send its response
I20260810 11:30:24.197265 27248 tablet_replica.cc:330] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:24.197295 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 296) could send its response
W20260810 11:30:24.197576 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 302) could send its response
I20260810 11:30:24.198089 27248 raft_consensus.cc:2229] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:24.198414 27248 raft_consensus.cc:2258] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:24.201054 27248 ts_tablet_manager.cc:1905] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:24.202968 27976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 11:30:24.205750 26910 raft_consensus.cc:1261] T 3ddb6e67c316416681074e454ab9b01e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Refusing update from remote peer 443ec871f1ed4232b932ecfb0b18510d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260810 11:30:24.206765 27975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 11:30:24.213752 27248 ts_tablet_manager.cc:1918] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260810 11:30:24.214380 27979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 11:30:24.214883 27231 tablet_bootstrap.cc:492] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:24.215066 27231 ts_tablet_manager.cc:1397] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.254s user 0.023s sys 0.039s
I20260810 11:30:24.215969 27231 raft_consensus.cc:348] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.216231 27231 raft_consensus.cc:374] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:24.216328 27231 raft_consensus.cc:729] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:24.216706 27231 consensus_queue.cc:260] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.219122 27231 ts_tablet_manager.cc:1428] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 11:30:24.221131 27231 tablet_bootstrap.cc:492] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:24.223598 27231 tablet_bootstrap.cc:654] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:24.225281 27747 server_base.cc:1034] running on GCE node
I20260810 11:30:24.227061 27747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 11:30:24.214109 27248 log.cc:1196] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/7eae49e1c6554ba2ae831831ff4bb45c
I20260810 11:30:24.230418 27248 ts_tablet_manager.cc:1939] T 7eae49e1c6554ba2ae831831ff4bb45c P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:24.231698 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 303) took 4598 ms. Trace:
I20260810 11:30:24.231881 27248 rpcz_store.cc:276] 0810 11:30:19.632884 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.632960 (+ 76us) service_pool.cc:227] Handling call
0810 11:30:24.197143 (+4564183us) ts_tablet_manager.cc:1145] Deleting tablet 7eae49e1c6554ba2ae831831ff4bb45c
0810 11:30:24.197155 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:24.209781 (+ 12626us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:24.213594 (+ 3813us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:24.231600 (+ 18006us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4508429}
W20260810 11:30:24.232245 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 303) could send its response
I20260810 11:30:24.232772 27747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 11:30:24.233275 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 304) took 4513 ms. Trace:
I20260810 11:30:24.233409 27248 rpcz_store.cc:276] 0810 11:30:19.719839 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.719912 (+ 73us) service_pool.cc:227] Handling call
0810 11:30:24.233052 (+4513140us) ts_tablet_manager.cc:1145] Deleting tablet 0118ff9d21924aefa8c6c32977c10453
0810 11:30:24.233065 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:24.233199 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4512691}
W20260810 11:30:24.233778 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 304) could send its response
I20260810 11:30:24.235574 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 305) took 4507 ms. Trace:
I20260810 11:30:24.235704 27248 rpcz_store.cc:276] 0810 11:30:19.728302 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.728381 (+ 79us) service_pool.cc:227] Handling call
0810 11:30:24.235354 (+4506973us) ts_tablet_manager.cc:1145] Deleting tablet 1a83391804894d268d0e603f4feb1745
0810 11:30:24.235368 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:24.235500 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4506667}
W20260810 11:30:24.235998 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 305) could send its response
I20260810 11:30:24.237195 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 307) took 4491 ms. Trace:
I20260810 11:30:24.237378 27248 rpcz_store.cc:276] 0810 11:30:19.746137 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.750586 (+ 4449us) service_pool.cc:227] Handling call
0810 11:30:24.237008 (+4486422us) ts_tablet_manager.cc:1145] Deleting tablet 49db12565dbc4187b78a98ed35c40fed
0810 11:30:24.237021 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:24.237131 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4485980}
W20260810 11:30:24.237728 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 307) could send its response
I20260810 11:30:24.238920 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 312) took 4441 ms. Trace:
I20260810 11:30:24.239042 27248 rpcz_store.cc:276] 0810 11:30:19.797332 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:19.800655 (+ 3323us) service_pool.cc:227] Handling call
0810 11:30:24.238713 (+4438058us) ts_tablet_manager.cc:1145] Deleting tablet 81f24c84cdd945b78f39f24015eb1e43
0810 11:30:24.238725 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:24.238861 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4422055}
W20260810 11:30:24.239301 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 312) could send its response
I20260810 11:30:24.239190 27747 hybrid_clock.cc:648] HybridClock initialized: now 1786361424239039 us; error 102 us; skew 500 ppm
I20260810 11:30:24.240079 27747 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 11:30:24.240273 27248 tablet_replica.cc:330] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:24.240550 27248 raft_consensus.cc:2229] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:24.240863 27248 raft_consensus.cc:2258] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:24.243561 27231 tablet_bootstrap.cc:492] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:24.243825 27231 ts_tablet_manager.cc:1397] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.000s
I20260810 11:30:24.244824 27231 raft_consensus.cc:348] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.245136 27231 raft_consensus.cc:374] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:24.245234 27231 raft_consensus.cc:729] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:24.245616 27231 consensus_queue.cc:260] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.188370 27222 consensus_queue.cc:260] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.254662 27222 ts_tablet_manager.cc:1428] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.067s user 0.004s sys 0.000s
I20260810 11:30:24.255158 27222 tablet_bootstrap.cc:492] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:24.256121 27248 ts_tablet_manager.cc:1905] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:24.256886 27231 ts_tablet_manager.cc:1428] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260810 11:30:24.258702 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ada1df82eb44ecb9a6c615b5410e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:24.259217 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet 110b5acc36bd4d6bba13735e5daec75f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:24.259232 27754 consensus_queue.cc:1035] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260810 11:30:24.259805 26702 consensus_peers.cc:487] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:24.260490 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 61370.5us
I20260810 11:30:24.262941 27231 tablet_bootstrap.cc:492] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:24.263631 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:24.264132 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 318d5b8453fe4c438d0fa32cb91c409e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:24.265830 27231 tablet_bootstrap.cc:654] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:24.266634 27526 raft_consensus.cc:482] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:24.266827 27526 raft_consensus.cc:504] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.270058 27526 leader_election.cc:288] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:24.272768 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet fc558690dce44e999e55e9bf1b6ca172 with delete_type TABLET_DATA_DELETED (replaced by tablet 0bb01711769f457aa0696bb59582166d) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:24.273343 27222 tablet_bootstrap.cc:654] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:24.274837 27336 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_60e35bdf23f74306a9b5299e927771de" } new_table_name: "default.Table_99cbe48a0bd54425b588a46ae1132cad" modify_external_catalogs: true
I20260810 11:30:24.280474 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet f3884736eec74c8992b8d51b37465875 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f64d4b9320c4cb39f57573d781a47d3) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:24.280841 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d8ce485cb84495a6e964b6d5977f0d" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:24.281540 27059 raft_consensus.cc:2454] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:24.282732 26702 leader_election.cc:302] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:24.282894 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e829d4bffeb4289a54b4d3d7a53c44e with delete_type TABLET_DATA_DELETED (replaced by tablet 00d52e5c77d94854b8ba0b38c63ad015) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:24.283366 27526 raft_consensus.cc:2781] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:24.283385 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet 96cae4eb16c84410926a317af70e44f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:24.283596 27526 raft_consensus.cc:482] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:24.283720 27526 raft_consensus.cc:3037] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:24.283754 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet a28849649c704f2fbdec1aced9ce01b1 with delete_type TABLET_DATA_DELETED (replaced by tablet eb9394f9ca2c44de93354e23973cf902) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:24.284637 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ff4e19071fc435fbae4490799325e37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:24.287124 27526 raft_consensus.cc:504] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.287343 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet 5adcec593b8c4d40997c8911e9f77c85 with delete_type TABLET_DATA_DELETED (replaced by tablet 10e6c41db71a4146840f06c5b7412d9c) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:24.288889 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d8ce485cb84495a6e964b6d5977f0d" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:24.289176 27059 raft_consensus.cc:3037] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:24.290004 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet d729baae40a64e6e8c23e6870f230afb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:24.290424 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aa16654b7f34f9baf856bf724cece8f with delete_type TABLET_DATA_DELETED (replaced by tablet 760aeada57464892ae3b9013a761c509) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:24.290962 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet e25ae21cc8cc4749a507fcab5ee225a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:24.291431 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet 949f31fa0c124eefbee695cfc7f50cbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:24.292464 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet 66908164ff2a4ee5b55da6158699e0c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:24.293160 27059 raft_consensus.cc:2454] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:24.298017 26702 leader_election.cc:302] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:24.298070 27333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_f974a4ceae4649bb9f17115103f554cd" } modify_external_catalogs: true
I20260810 11:30:24.298455 27333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_f974a4ceae4649bb9f17115103f554cd" } modify_external_catalogs: true
I20260810 11:30:24.298620 27754 raft_consensus.cc:2781] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:24.298826 27754 raft_consensus.cc:686] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:24.299110 27754 consensus_queue.cc:237] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.299456 27321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_bbae9d833ed04fc89a867eb497163403"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:24.300294 27321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbae9d833ed04fc89a867eb497163403 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:24.302542 27362 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_71e560b0b3c84617ab561dbea1d90f7e" } new_table_name: "default.Table_1ce6ca6db4f34d89a4db20f32c50fb12" modify_external_catalogs: true
I20260810 11:30:24.302707 27526 leader_election.cc:288] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:24.303772 27222 tablet_bootstrap.cc:492] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:24.303987 27222 ts_tablet_manager.cc:1397] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.001s
I20260810 11:30:24.306087 27222 raft_consensus.cc:348] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.306670 27222 raft_consensus.cc:374] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:24.308066 27222 raft_consensus.cc:729] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:24.309078 27222 consensus_queue.cc:260] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.296763 27248 ts_tablet_manager.cc:1918] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:24.314318 27248 log.cc:1196] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/7dc4000f1dde46a3b881a9fa8e9a6e3e
I20260810 11:30:24.314970 27248 ts_tablet_manager.cc:1939] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:24.316864 27750 raft_consensus.cc:482] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:24.317181 27750 raft_consensus.cc:504] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.318385 27750 leader_election.cc:288] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:24.316771 27222 ts_tablet_manager.cc:1428] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.013s user 0.003s sys 0.002s
W20260810 11:30:24.320596 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet f7ada1df82eb44ecb9a6c615b5410e6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7ada1df82eb44ecb9a6c615b5410e6f already in progress: creating tablet
W20260810 11:30:24.321178 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 110b5acc36bd4d6bba13735e5daec75f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 110b5acc36bd4d6bba13735e5daec75f already in progress: creating tablet
W20260810 11:30:24.321466 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 3ae27bf110114b70a3e3f6cf64f31b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae27bf110114b70a3e3f6cf64f31b98 already in progress: creating tablet
W20260810 11:30:24.321848 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 318d5b8453fe4c438d0fa32cb91c409e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 318d5b8453fe4c438d0fa32cb91c409e already in progress: creating tablet
I20260810 11:30:24.319548 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aa16654b7f34f9baf856bf724cece8f with delete_type TABLET_DATA_DELETED (replaced by tablet 760aeada57464892ae3b9013a761c509) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:24.319777 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet 5adcec593b8c4d40997c8911e9f77c85 with delete_type TABLET_DATA_DELETED (replaced by tablet 10e6c41db71a4146840f06c5b7412d9c) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:24.321012 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet f3884736eec74c8992b8d51b37465875 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f64d4b9320c4cb39f57573d781a47d3) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:24.327217 27222 tablet_bootstrap.cc:492] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:24.329088 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 329) took 4238 ms. Trace:
I20260810 11:30:24.329248 27248 rpcz_store.cc:276] 0810 11:30:20.090307 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:20.092658 (+ 2351us) service_pool.cc:227] Handling call
0810 11:30:24.240171 (+4147513us) ts_tablet_manager.cc:1145] Deleting tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e
0810 11:30:24.240185 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:24.288808 (+ 48623us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:24.296538 (+ 7730us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:24.329003 (+ 32465us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12931,"tablet-delete.queue_time_us":4136254}
W20260810 11:30:24.329599 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 329) could send its response
I20260810 11:30:24.332185 27222 tablet_bootstrap.cc:654] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:24.335059 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 330) took 4148 ms. Trace:
I20260810 11:30:24.335270 27248 rpcz_store.cc:276] 0810 11:30:20.186608 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:20.186800 (+ 192us) service_pool.cc:227] Handling call
0810 11:30:24.334768 (+4147968us) ts_tablet_manager.cc:1145] Deleting tablet 83631b421a614796bdf76335f1437e00
0810 11:30:24.334785 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:24.334960 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4145692}
W20260810 11:30:24.335549 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 330) could send its response
I20260810 11:30:24.307755 27974 tablet_replica.cc:330] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
W20260810 11:30:24.342402 26993 consensus_peers.cc:487] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:24.353884 27987 tablet.cc:1722] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:24.355825 27747 webserver.cc:460] Webserver started at http://127.25.195.253:42129/ using document root <none> and password file <none>
I20260810 11:30:24.357103 27747 fs_manager.cc:359] Metadata directory not provided
I20260810 11:30:24.357372 27747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 11:30:24.337807 26764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60d56e162b4b41e2867ac845e524aca4" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:24.363903 26764 raft_consensus.cc:2454] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:24.365454 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d8ce485cb84495a6e964b6d5977f0d" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:24.375320 27747 fs_manager.cc:709] Time spent opening directory manager: real 0.014s user 0.006s sys 0.005s
I20260810 11:30:24.336529 27974 raft_consensus.cc:2229] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:24.385841 27974 raft_consensus.cc:2258] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:24.387928 27991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 11:30:24.371290 26993 leader_election.cc:302] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:24.389341 26912 raft_consensus.cc:3037] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:24.390023 27708 raft_consensus.cc:2781] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:24.390247 27708 raft_consensus.cc:482] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:24.390318 27747 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.008s sys 0.000s
I20260810 11:30:24.390470 27708 raft_consensus.cc:3037] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:24.390594 27747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data,/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/wal
uuid: "c40c76e125b44de181b88b7f63a566f7"
format_stamp: "Formatted at 2026-08-10 11:30:05 on dist-test-slave-rgb1"
I20260810 11:30:24.392669 27747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 11:30:24.394425 26910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60d56e162b4b41e2867ac845e524aca4" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:24.376273 27988 tablet.cc:1722] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:24.400445 27708 raft_consensus.cc:504] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.401914 27708 leader_election.cc:288] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:24.402097 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60d56e162b4b41e2867ac845e524aca4" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:24.402640 26764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60d56e162b4b41e2867ac845e524aca4" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:24.402923 26764 raft_consensus.cc:3037] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:24.403075 26910 raft_consensus.cc:2454] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:24.407796 26764 raft_consensus.cc:2454] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:24.411041 26993 leader_election.cc:302] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:24.413632 27750 raft_consensus.cc:2781] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:24.414855 27750 raft_consensus.cc:686] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:24.416141 27750 consensus_queue.cc:237] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.424440 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d8ce485cb84495a6e964b6d5977f0d" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:24.375355 27231 tablet_bootstrap.cc:492] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:24.426884 27231 ts_tablet_manager.cc:1397] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.164s user 0.010s sys 0.014s
I20260810 11:30:24.427668 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 08f6636df13548c49f35e1808a87c1f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:24.428071 27248 tablet_replica.cc:330] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:24.429467 26878 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b15cc8669b549a2b4461dccd66a0c5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:24.429708 26882 tablet_service.cc:1514] Processing DeleteTablet for tablet 31888ddeafe14738b818016a9c0a4ad3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:24.429889 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet a28849649c704f2fbdec1aced9ce01b1 with delete_type TABLET_DATA_DELETED (replaced by tablet eb9394f9ca2c44de93354e23973cf902) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:24.430075 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e829d4bffeb4289a54b4d3d7a53c44e with delete_type TABLET_DATA_DELETED (replaced by tablet 00d52e5c77d94854b8ba0b38c63ad015) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:24.430302 26876 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aa16654b7f34f9baf856bf724cece8f with delete_type TABLET_DATA_DELETED (replaced by tablet 760aeada57464892ae3b9013a761c509) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:24.437014 27248 raft_consensus.cc:2229] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:24.440838 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 60d56e162b4b41e2867ac845e524aca4 with delete_type TABLET_DATA_DELETED (replaced by tablet 10210204d5ff4e5e97c98fd255f674a5) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:24.441126 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ff4e19071fc435fbae4490799325e37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:24.443156 27231 raft_consensus.cc:348] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.443470 27231 raft_consensus.cc:374] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:24.443655 27231 raft_consensus.cc:729] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:24.443944 27231 consensus_queue.cc:260] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.444977 27974 ts_tablet_manager.cc:1905] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:24.441764 27248 raft_consensus.cc:2258] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:24.447261 27747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 11:30:24.448998 27747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 11:30:24.449394 27747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 11:30:24.450579 26877 tablet_service.cc:1514] Processing DeleteTablet for tablet 110b5acc36bd4d6bba13735e5daec75f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:24.451961 27231 ts_tablet_manager.cc:1428] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.025s user 0.001s sys 0.001s
I20260810 11:30:24.453878 27248 ts_tablet_manager.cc:1905] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:24.456033 27231 tablet_bootstrap.cc:492] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:24.456723 26890 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ada1df82eb44ecb9a6c615b5410e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:24.458362 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet 9311943eebaa4824bde96b4cb09f1e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:24.460644 26878 tablet_service.cc:1514] Processing DeleteTablet for tablet fc558690dce44e999e55e9bf1b6ca172 with delete_type TABLET_DATA_DELETED (replaced by tablet 0bb01711769f457aa0696bb59582166d) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:24.462172 26876 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d8ce485cb84495a6e964b6d5977f0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:24.462584 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:24.463085 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 5adcec593b8c4d40997c8911e9f77c85 with delete_type TABLET_DATA_DELETED (replaced by tablet 10e6c41db71a4146840f06c5b7412d9c) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:24.463320 26882 tablet_service.cc:1514] Processing DeleteTablet for tablet 318d5b8453fe4c438d0fa32cb91c409e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:24.466688 27996 tablet.cc:1722] T d722b93fe27f4c08a592bc393046b6bd P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:24.477631 27228 tablet_bootstrap.cc:492] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:24.478206 27228 ts_tablet_manager.cc:1397] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.599s user 0.012s sys 0.013s
I20260810 11:30:24.465751 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:24.481477 27228 raft_consensus.cc:348] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.482128 27999 tablet_replica.cc:330] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:24.482549 27999 raft_consensus.cc:2229] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:24.482971 27999 raft_consensus.cc:2258] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:24.482122 27228 raft_consensus.cc:374] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:24.484038 27999 ts_tablet_manager.cc:1905] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:24.489394 26912 raft_consensus.cc:2454] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:24.483512 27228 raft_consensus.cc:729] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:24.533988 27708 raft_consensus.cc:482] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:24.537540 27999 ts_tablet_manager.cc:1918] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:24.537809 27999 log.cc:1196] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/08f6636df13548c49f35e1808a87c1f5
I20260810 11:30:24.538877 27999 ts_tablet_manager.cc:1939] T 08f6636df13548c49f35e1808a87c1f5 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:24.547319 27708 raft_consensus.cc:504] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.553828 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7a2cb1d2e8e40f58144908e34438d53" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:24.554136 26912 raft_consensus.cc:2454] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:24.554883 26991 leader_election.cc:302] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:24.555305 27911 raft_consensus.cc:2781] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:24.555416 27911 raft_consensus.cc:482] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:24.555542 27911 raft_consensus.cc:3037] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:24.559464 27911 raft_consensus.cc:504] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.561187 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7a2cb1d2e8e40f58144908e34438d53" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:24.561546 26912 raft_consensus.cc:3037] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:24.566220 27911 leader_election.cc:288] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:24.566991 26912 raft_consensus.cc:2454] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:24.568041 26991 leader_election.cc:302] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:24.570000 27911 raft_consensus.cc:2781] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:24.570382 27911 raft_consensus.cc:686] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:24.570740 27911 consensus_queue.cc:237] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.572046 27999 tablet_replica.cc:330] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:24.572407 27999 raft_consensus.cc:2229] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:24.572654 27999 raft_consensus.cc:2258] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:24.573449 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7a2cb1d2e8e40f58144908e34438d53" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:24.573711 26767 raft_consensus.cc:3037] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:24.576092 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 08f6636df13548c49f35e1808a87c1f5 (table default.Table_ea17bd161fdb4c2c9603590515c75bf4 [id=66896ad6c415489da386ea5ab2702ad6]) successfully deleted
I20260810 11:30:24.577136 26767 raft_consensus.cc:2454] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:24.580595 27999 ts_tablet_manager.cc:1905] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:24.585170 27891 raft_consensus.cc:482] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:24.585374 27891 raft_consensus.cc:504] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.586098 27891 leader_election.cc:288] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:24.587006 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd3575197c464c7fb51f9592831959bb" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:24.587777 26849 leader_election.cc:341] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:24.594894 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7a2cb1d2e8e40f58144908e34438d53" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:24.595255 26767 raft_consensus.cc:2362] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1. Re-sending same reply.
W20260810 11:30:24.599545 26702 consensus_peers.cc:487] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08f6636df13548c49f35e1808a87c1f5. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:24.600615 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd3575197c464c7fb51f9592831959bb" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:24.601662 26848 leader_election.cc:341] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:24.601953 26848 leader_election.cc:302] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:24.601972 27025 tablet_service.cc:1467] Processing CreateTablet for tablet b945038c03e343489af6ae7e50131d97 (DEFAULT_TABLE table=default.Table_9744be92699b40d1bae23bbb564db585 [id=f27ef087b00e469197a44c70d4bc979b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.602454 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b945038c03e343489af6ae7e50131d97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.602615 27891 raft_consensus.cc:2726] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:24.602860 27708 leader_election.cc:288] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:24.605008 27023 tablet_service.cc:1467] Processing CreateTablet for tablet d91cb30457a74d51885ad81c4ab89d71 (DEFAULT_TABLE table=default.Table_1f48a9af47ad4e0c93ed4dd43ecd12a3 [id=e985b1ae60d94bfa998e1986bdf3fcd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.605772 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d91cb30457a74d51885ad81c4ab89d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.605965 27034 tablet_service.cc:1467] Processing CreateTablet for tablet 2da86554bc51486e91f1ea5995a245b5 (DEFAULT_TABLE table=default.Table_a0630a37a4e44862b8947cd848615cdb [id=f7931f3f7e9c45fba1aff648c50250f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.606338 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2da86554bc51486e91f1ea5995a245b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.608932 27030 tablet_service.cc:1467] Processing CreateTablet for tablet cc76d30f37094391b75076c92ccc277f (DEFAULT_TABLE table=default.Table_03a616a243fc4350b4a01d7f5bb86949 [id=4e2dc56dde3346a0917e58c6c7e921eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.609741 27035 tablet_service.cc:1467] Processing CreateTablet for tablet 7de2d60cf87c48459e6663a68ac96714 (DEFAULT_TABLE table=default.Table_53285a0af75e4705982c23850f7b27e2 [id=d58840daecc84b789f04a35ca6cd8393]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.609824 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 3a0284718f694a0591888e81357721b0 (DEFAULT_TABLE table=default.Table_ddaa0e35d54b49c894cbf994bb7fbbab [id=ed36f07f53e04f308770145b0d7435ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.610110 27321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_d4313ebe5ce04c1aa10d064712cbf3ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:24.610862 27030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc76d30f37094391b75076c92ccc277f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:24.611204 27321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4313ebe5ce04c1aa10d064712cbf3ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:24.605568 27024 tablet_service.cc:1467] Processing CreateTablet for tablet ee803ddf27594d2b9e19fe440fc269c7 (DEFAULT_TABLE table=default.Table_67580ad3fe7a47d6a051e7da7005c171 [id=5ae9efa77fb54cf58ff2a1662eee03f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.612161 27028 tablet_service.cc:1467] Processing CreateTablet for tablet c4124999339e4133b2bd47b3739da373 (DEFAULT_TABLE table=default.Table_9efdfb09fd194dc2a9cbdc9a87749126 [id=8afbc0cc8e704a03a064974937b5a36b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.612694 27027 tablet_service.cc:1467] Processing CreateTablet for tablet b6395bce17ee40c2822669246ce7eb42 (DEFAULT_TABLE table=default.Table_44e5f0610f934d889eaf76d00116f0e2 [id=801df0b567d947db90abd034d997ed3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.612972 27334 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_59ed990b31964d6080614081ee46a6de" } modify_external_catalogs: true
I20260810 11:30:24.613047 27026 tablet_service.cc:1467] Processing CreateTablet for tablet 501defb075d142ec8b22e5e8236a009c (DEFAULT_TABLE table=default.Table_a48c8668e73f4919a9c32c9c3e95f485 [id=46bda36574e1430dbada751ccf16703c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.613090 26894 tablet_service.cc:1467] Processing CreateTablet for tablet d91cb30457a74d51885ad81c4ab89d71 (DEFAULT_TABLE table=default.Table_1f48a9af47ad4e0c93ed4dd43ecd12a3 [id=e985b1ae60d94bfa998e1986bdf3fcd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.613266 27334 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_59ed990b31964d6080614081ee46a6de" } modify_external_catalogs: true
I20260810 11:30:24.613730 26882 tablet_service.cc:1467] Processing CreateTablet for tablet 7de2d60cf87c48459e6663a68ac96714 (DEFAULT_TABLE table=default.Table_53285a0af75e4705982c23850f7b27e2 [id=d58840daecc84b789f04a35ca6cd8393]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.613847 26878 tablet_service.cc:1467] Processing CreateTablet for tablet c60baf810a544a4a90dccd2337a39043 (DEFAULT_TABLE table=default.Table_e58ae45f9ea949a2a0d7bf7f0e862647 [id=76b87112ac8e4024965d44a9b62b8c1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.614298 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 3a0284718f694a0591888e81357721b0 (DEFAULT_TABLE table=default.Table_ddaa0e35d54b49c894cbf994bb7fbbab [id=ed36f07f53e04f308770145b0d7435ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.614418 26879 tablet_service.cc:1467] Processing CreateTablet for tablet c4124999339e4133b2bd47b3739da373 (DEFAULT_TABLE table=default.Table_9efdfb09fd194dc2a9cbdc9a87749126 [id=8afbc0cc8e704a03a064974937b5a36b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.614946 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 501defb075d142ec8b22e5e8236a009c (DEFAULT_TABLE table=default.Table_a48c8668e73f4919a9c32c9c3e95f485 [id=46bda36574e1430dbada751ccf16703c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.615247 26877 tablet_service.cc:1467] Processing CreateTablet for tablet 2da86554bc51486e91f1ea5995a245b5 (DEFAULT_TABLE table=default.Table_a0630a37a4e44862b8947cd848615cdb [id=f7931f3f7e9c45fba1aff648c50250f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.615504 26876 tablet_service.cc:1467] Processing CreateTablet for tablet ee803ddf27594d2b9e19fe440fc269c7 (DEFAULT_TABLE table=default.Table_67580ad3fe7a47d6a051e7da7005c171 [id=5ae9efa77fb54cf58ff2a1662eee03f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.615667 27038 tablet_service.cc:1467] Processing CreateTablet for tablet c60baf810a544a4a90dccd2337a39043 (DEFAULT_TABLE table=default.Table_e58ae45f9ea949a2a0d7bf7f0e862647 [id=76b87112ac8e4024965d44a9b62b8c1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.614964 26890 tablet_service.cc:1467] Processing CreateTablet for tablet b6395bce17ee40c2822669246ce7eb42 (DEFAULT_TABLE table=default.Table_44e5f0610f934d889eaf76d00116f0e2 [id=801df0b567d947db90abd034d997ed3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.617738 26883 tablet_service.cc:1467] Processing CreateTablet for tablet b945038c03e343489af6ae7e50131d97 (DEFAULT_TABLE table=default.Table_9744be92699b40d1bae23bbb564db585 [id=f27ef087b00e469197a44c70d4bc979b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.619292 26893 tablet_service.cc:1467] Processing CreateTablet for tablet cc76d30f37094391b75076c92ccc277f (DEFAULT_TABLE table=default.Table_03a616a243fc4350b4a01d7f5bb86949 [id=4e2dc56dde3346a0917e58c6c7e921eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.621773 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7de2d60cf87c48459e6663a68ac96714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.624378 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 00d52e5c77d94854b8ba0b38c63ad015 (DEFAULT_TABLE table=default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.629031 26888 tablet_service.cc:1467] Processing CreateTablet for tablet 3853603eac544d769cef8cff9a008784 (DEFAULT_TABLE table=default.Table_56b4699099fd417496e71ccbed272638 [id=72829be151bc48dba287b32c7028caf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.629577 27988 tablet.cc:1722] T 3ddb6e67c316416681074e454ab9b01e P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:24.632984 27996 tablet.cc:1722] T 3ddb6e67c316416681074e454ab9b01e P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:24.642774 27974 ts_tablet_manager.cc:1918] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:24.642980 27974 log.cc:1196] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/5ca5c88585394dba87e201696afa6934
I20260810 11:30:24.643594 27974 ts_tablet_manager.cc:1939] T 5ca5c88585394dba87e201696afa6934 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:24.653227 26887 tablet_service.cc:1467] Processing CreateTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 (DEFAULT_TABLE table=default.Table_2d6c3a53213a458aaee6bd445240041c [id=097ff3abe81b415799933e50feab6c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.654732 26891 tablet_service.cc:1467] Processing CreateTablet for tablet fa14fea852c24cd7bb3d57094af2e178 (DEFAULT_TABLE table=default.Table_6d8b58857bb84e579c8c308dcb0800f0 [id=f0f8365d722447a090e236fd1fcb0e98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.659713 27974 tablet_replica.cc:330] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:24.662797 27974 raft_consensus.cc:2229] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:24.666870 27974 raft_consensus.cc:2258] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:24.671559 26740 tablet_service.cc:1467] Processing CreateTablet for tablet b945038c03e343489af6ae7e50131d97 (DEFAULT_TABLE table=default.Table_9744be92699b40d1bae23bbb564db585 [id=f27ef087b00e469197a44c70d4bc979b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.672252 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b945038c03e343489af6ae7e50131d97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.673751 26734 tablet_service.cc:1467] Processing CreateTablet for tablet 7de2d60cf87c48459e6663a68ac96714 (DEFAULT_TABLE table=default.Table_53285a0af75e4705982c23850f7b27e2 [id=d58840daecc84b789f04a35ca6cd8393]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.674212 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7de2d60cf87c48459e6663a68ac96714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.677270 26742 tablet_service.cc:1467] Processing CreateTablet for tablet d91cb30457a74d51885ad81c4ab89d71 (DEFAULT_TABLE table=default.Table_1f48a9af47ad4e0c93ed4dd43ecd12a3 [id=e985b1ae60d94bfa998e1986bdf3fcd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.678119 27974 ts_tablet_manager.cc:1905] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:24.689755 26700 consensus_peers.cc:487] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08f6636df13548c49f35e1808a87c1f5. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:24.698634 27866 consensus_queue.cc:1035] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:24.713443 26848 consensus_peers.cc:487] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7eae49e1c6554ba2ae831831ff4bb45c. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:24.724102 27022 tablet_service.cc:1467] Processing CreateTablet for tablet 00d52e5c77d94854b8ba0b38c63ad015 (DEFAULT_TABLE table=default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.724751 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a0284718f694a0591888e81357721b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.714798 27228 consensus_queue.cc:260] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.728189 27036 tablet_service.cc:1467] Processing CreateTablet for tablet fa14fea852c24cd7bb3d57094af2e178 (DEFAULT_TABLE table=default.Table_6d8b58857bb84e579c8c308dcb0800f0 [id=f0f8365d722447a090e236fd1fcb0e98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.728853 27033 tablet_service.cc:1467] Processing CreateTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 (DEFAULT_TABLE table=default.Table_2d6c3a53213a458aaee6bd445240041c [id=097ff3abe81b415799933e50feab6c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.729255 27032 tablet_service.cc:1467] Processing CreateTablet for tablet 3853603eac544d769cef8cff9a008784 (DEFAULT_TABLE table=default.Table_56b4699099fd417496e71ccbed272638 [id=72829be151bc48dba287b32c7028caf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.732714 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00d52e5c77d94854b8ba0b38c63ad015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.736341 27033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e276b0fa124d42dfb3fe750d245e44d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.741637 27321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_b2381e8587204bffa96b34e428682d5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:24.741897 27228 ts_tablet_manager.cc:1428] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.263s user 0.003s sys 0.002s
W20260810 11:30:24.742451 27321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2381e8587204bffa96b34e428682d5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:24.743830 27228 tablet_bootstrap.cc:492] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:24.749835 27032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3853603eac544d769cef8cff9a008784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.750979 27036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa14fea852c24cd7bb3d57094af2e178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.751029 27231 tablet_bootstrap.cc:654] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:24.759788 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
W20260810 11:30:24.762068 26848 consensus_peers.cc:487] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b7a3b877457c4a2489d397f3f864d6b2. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:24.773483 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:24.789970 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d91cb30457a74d51885ad81c4ab89d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.794971 26887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e276b0fa124d42dfb3fe750d245e44d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.795442 26876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee803ddf27594d2b9e19fe440fc269c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.795679 26891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa14fea852c24cd7bb3d57094af2e178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.795917 26882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7de2d60cf87c48459e6663a68ac96714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.796201 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b945038c03e343489af6ae7e50131d97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.800428 26877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2da86554bc51486e91f1ea5995a245b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.801186 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00d52e5c77d94854b8ba0b38c63ad015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.803858 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c60baf810a544a4a90dccd2337a39043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.804702 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3853603eac544d769cef8cff9a008784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.793606 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:24.807096 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_e33c9849bbd34e6b9b72e69fd3a1ab1c [id=b206753d4f4142be82ee28150226bd53]). Expected version 1 got 0
I20260810 11:30:24.808007 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:24.808835 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]). Expected version 2 got 0
I20260810 11:30:24.808873 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d91cb30457a74d51885ad81c4ab89d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.809113 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]). Expected version 2 got 0
I20260810 11:30:24.809347 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:24.809633 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:24.809907 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]). Expected version 1 got 0
I20260810 11:30:24.810375 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:24.810710 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:24.810882 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:24.811208 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:24.811383 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]). Expected version 1 got 0
I20260810 11:30:24.811769 27326 catalog_manager.cc:5495] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:24.812283 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 725d2e70e1d441b497d56a278e1de0ad (table default.Table_59ed990b31964d6080614081ee46a6de [id=6d8fc88a491140548a45c7fbb403bb36]). Expected version 4 got 0
I20260810 11:30:24.812639 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 587c6ce242c0411b886404a0df03b1bb (table default.Table_8326a5b5a7544e828699f8b41fdee4d1 [id=1ae6d36bfe0e427a9a996dff3cdccc91]). Expected version 2 got 0
I20260810 11:30:24.812999 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3ddb6e67c316416681074e454ab9b01e (table default.Table_1e1ca07e9c824349af23675b66b77321 [id=755202f095f04307a11ce87087df835c]). Expected version 2 got 0
I20260810 11:30:24.813531 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet fdbe21b4f124411988dd35a0b864f868 (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:24.814002 26879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4124999339e4133b2bd47b3739da373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.813808 27326 catalog_manager.cc:5495] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:24.814456 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 23637a02b6464e17aa2a69ea5cc4ddfe (table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85]). Expected version 1 got 0
I20260810 11:30:24.814574 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc76d30f37094391b75076c92ccc277f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.814697 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:24.815124 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:24.815600 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 501defb075d142ec8b22e5e8236a009c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.816273 26890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6395bce17ee40c2822669246ce7eb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.815582 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]). Expected version 1 got 0
I20260810 11:30:24.819460 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 1 got 0
I20260810 11:30:24.819743 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]). Expected version 1 got 0
I20260810 11:30:24.820122 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]). Expected version 2 got 0
I20260810 11:30:24.820580 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d722b93fe27f4c08a592bc393046b6bd (table default.Table_60e35bdf23f74306a9b5299e927771de [id=0faf073b01654e38b8f6083f5012abd7]). Expected version 2 got 0
I20260810 11:30:24.821031 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:24.821409 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a0284718f694a0591888e81357721b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.821275 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:24.821748 27326 catalog_manager.cc:5495] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:24.822383 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet fbe0a0ab82a147a3b6164904b135d1ab (table default.Table_61d778388656489cb2e7fe8312b8ac6e [id=b52c11bd73cd4d1f8f9dfc32562718a2]). Expected version 2 got 0
I20260810 11:30:24.822716 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:24.822963 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:24.823361 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a87f6835f0dc4ad4b3a23b297726100d (table default.Table_cbf7fb0f0585465a9be24fa7e70d68d2 [id=82041e96f8de4fae85baf690bbbfc7a3]). Expected version 1 got 0
I20260810 11:30:24.823817 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet db59523b71224370bf5fce6b56592f71 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:24.824198 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 1 got 0
I20260810 11:30:24.824826 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_359f619c6e054a89898040e2f0d379c3 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 1 got 0
I20260810 11:30:24.826715 26748 tablet_service.cc:1467] Processing CreateTablet for tablet 3a0284718f694a0591888e81357721b0 (DEFAULT_TABLE table=default.Table_ddaa0e35d54b49c894cbf994bb7fbbab [id=ed36f07f53e04f308770145b0d7435ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.829867 26734 tablet_service.cc:1467] Processing CreateTablet for tablet 501defb075d142ec8b22e5e8236a009c (DEFAULT_TABLE table=default.Table_a48c8668e73f4919a9c32c9c3e95f485 [id=46bda36574e1430dbada751ccf16703c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.840157 27026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 501defb075d142ec8b22e5e8236a009c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.870779 27321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_4d9bc84fc41e4b87ac2f6432852e5d61" } modify_external_catalogs: true
I20260810 11:30:24.871130 27321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_4d9bc84fc41e4b87ac2f6432852e5d61" } modify_external_catalogs: true
I20260810 11:30:24.872617 26735 tablet_service.cc:1467] Processing CreateTablet for tablet ee803ddf27594d2b9e19fe440fc269c7 (DEFAULT_TABLE table=default.Table_67580ad3fe7a47d6a051e7da7005c171 [id=5ae9efa77fb54cf58ff2a1662eee03f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.875499 26746 tablet_service.cc:1467] Processing CreateTablet for tablet c60baf810a544a4a90dccd2337a39043 (DEFAULT_TABLE table=default.Table_e58ae45f9ea949a2a0d7bf7f0e862647 [id=76b87112ac8e4024965d44a9b62b8c1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.891976 27222 tablet_bootstrap.cc:492] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:24.893847 27222 ts_tablet_manager.cc:1397] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.566s user 0.032s sys 0.057s
I20260810 11:30:24.896809 26742 tablet_service.cc:1467] Processing CreateTablet for tablet c4124999339e4133b2bd47b3739da373 (DEFAULT_TABLE table=default.Table_9efdfb09fd194dc2a9cbdc9a87749126 [id=8afbc0cc8e704a03a064974937b5a36b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.896898 27222 raft_consensus.cc:348] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.897382 27222 raft_consensus.cc:374] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:24.897714 27222 raft_consensus.cc:729] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:24.898114 27222 consensus_queue.cc:260] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.899276 27222 ts_tablet_manager.cc:1428] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.005s user 0.001s sys 0.003s
I20260810 11:30:24.899870 27222 tablet_bootstrap.cc:492] T fdbe21b4f124411988dd35a0b864f868 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:24.902261 26737 tablet_service.cc:1467] Processing CreateTablet for tablet b6395bce17ee40c2822669246ce7eb42 (DEFAULT_TABLE table=default.Table_44e5f0610f934d889eaf76d00116f0e2 [id=801df0b567d947db90abd034d997ed3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.903270 26733 tablet_service.cc:1467] Processing CreateTablet for tablet 3853603eac544d769cef8cff9a008784 (DEFAULT_TABLE table=default.Table_56b4699099fd417496e71ccbed272638 [id=72829be151bc48dba287b32c7028caf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.903422 26729 tablet_service.cc:1467] Processing CreateTablet for tablet 2da86554bc51486e91f1ea5995a245b5 (DEFAULT_TABLE table=default.Table_a0630a37a4e44862b8947cd848615cdb [id=f7931f3f7e9c45fba1aff648c50250f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.904471 26731 tablet_service.cc:1467] Processing CreateTablet for tablet cc76d30f37094391b75076c92ccc277f (DEFAULT_TABLE table=default.Table_03a616a243fc4350b4a01d7f5bb86949 [id=4e2dc56dde3346a0917e58c6c7e921eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.904677 26744 tablet_service.cc:1467] Processing CreateTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 (DEFAULT_TABLE table=default.Table_2d6c3a53213a458aaee6bd445240041c [id=097ff3abe81b415799933e50feab6c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.905992 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 00d52e5c77d94854b8ba0b38c63ad015 (DEFAULT_TABLE table=default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.906391 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 5ca5c88585394dba87e201696afa6934 (table default.Table_5895dc74894a4711bf78dd8b259cfc40 [id=696fdd9a822c4e40930fc333e3f3d725]) successfully deleted
I20260810 11:30:24.906602 26743 tablet_service.cc:1467] Processing CreateTablet for tablet fa14fea852c24cd7bb3d57094af2e178 (DEFAULT_TABLE table=default.Table_6d8b58857bb84e579c8c308dcb0800f0 [id=f0f8365d722447a090e236fd1fcb0e98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:24.916522 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 501defb075d142ec8b22e5e8236a009c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.917167 26733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3853603eac544d769cef8cff9a008784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.917737 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e276b0fa124d42dfb3fe750d245e44d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.918780 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee803ddf27594d2b9e19fe440fc269c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.919250 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00d52e5c77d94854b8ba0b38c63ad015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.925310 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4124999339e4133b2bd47b3739da373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.925310 27526 raft_consensus.cc:482] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:24.925817 27526 raft_consensus.cc:504] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.927037 27526 leader_election.cc:288] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:24.927160 27708 raft_consensus.cc:482] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:24.948822 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4124999339e4133b2bd47b3739da373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.949692 26729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2da86554bc51486e91f1ea5995a245b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.956642 27999 ts_tablet_manager.cc:1918] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:24.960724 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6395bce17ee40c2822669246ce7eb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.961253 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c60baf810a544a4a90dccd2337a39043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.962613 27974 ts_tablet_manager.cc:1918] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:24.968386 27526 raft_consensus.cc:482] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:24.968694 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a0284718f694a0591888e81357721b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.971388 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa14fea852c24cd7bb3d57094af2e178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.976692 27526 raft_consensus.cc:504] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:24.977072 26731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc76d30f37094391b75076c92ccc277f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.979755 27974 log.cc:1196] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/d91a02b22044429fb3e25840c7947a02
I20260810 11:30:24.981874 27526 leader_election.cc:288] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:24.991695 27708 raft_consensus.cc:504] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:24.992722 27708 leader_election.cc:288] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:24.992916 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c60baf810a544a4a90dccd2337a39043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:24.993340 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb51618d37ac488fa7e3d23e5f85ec36" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:24.995159 27027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6395bce17ee40c2822669246ce7eb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.013000 27222 tablet_bootstrap.cc:654] T fdbe21b4f124411988dd35a0b864f868 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:25.021852 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b15cc8669b549a2b4461dccd66a0c5a" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:25.022787 27024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee803ddf27594d2b9e19fe440fc269c7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:25.024109 26702 leader_election.cc:341] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:25.024524 26702 leader_election.cc:341] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:25.032650 27999 log.cc:1196] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/4b15cc8669b549a2b4461dccd66a0c5a
I20260810 11:30:25.045099 27974 ts_tablet_manager.cc:1939] T d91a02b22044429fb3e25840c7947a02 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:25.048506 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:25.052709 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet d91a02b22044429fb3e25840c7947a02 (table default.Table_ed278fa8f2db4fe8a3215e71eb2d3f9f [id=0b49f313222c437d921a10d967a953de]) successfully deleted
I20260810 11:30:25.055546 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:25.055842 27974 tablet_replica.cc:330] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
W20260810 11:30:25.055871 27718 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.523s user 0.009s sys 0.011s
I20260810 11:30:25.056160 27974 raft_consensus.cc:2229] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:25.056842 27718 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.524s user 0.009s sys 0.011s
W20260810 11:30:25.056937 26993 leader_election.cc:341] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 7e3707ae32624f6483866208321eefde
W20260810 11:30:25.058247 27058 thread.cc:636] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.523s user 0.019s sys 0.040s
I20260810 11:30:25.057675 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:25.059149 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
W20260810 11:30:25.058509 27058 thread.cc:602] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.524s user 0.019s sys 0.040s
I20260810 11:30:25.060207 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a87f6835f0dc4ad4b3a23b297726100d (table default.Table_cbf7fb0f0585465a9be24fa7e70d68d2 [id=82041e96f8de4fae85baf690bbbfc7a3]). Expected version 1 got 0
I20260810 11:30:25.060619 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:25.060901 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]). Expected version 1 got 0
I20260810 11:30:25.063263 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet db59523b71224370bf5fce6b56592f71 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:25.063763 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 1 got 0
I20260810 11:30:25.064158 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d722b93fe27f4c08a592bc393046b6bd (table default.Table_60e35bdf23f74306a9b5299e927771de [id=0faf073b01654e38b8f6083f5012abd7]). Expected version 2 got 0
I20260810 11:30:25.064946 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:25.071974 27526 raft_consensus.cc:482] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:25.072188 27526 raft_consensus.cc:504] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.071712 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]). Expected version 1 got 0
I20260810 11:30:25.074908 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:25.076948 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:25.078846 27974 raft_consensus.cc:2258] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:25.078884 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb01e54d817c4b0dbcc80f90f82923c0" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:25.078641 27322 catalog_manager.cc:5495] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:25.080314 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet fdbe21b4f124411988dd35a0b864f868 (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:25.081022 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 23637a02b6464e17aa2a69ea5cc4ddfe (table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85]). Expected version 1 got 0
I20260810 11:30:25.081632 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3ddb6e67c316416681074e454ab9b01e (table default.Table_1e1ca07e9c824349af23675b66b77321 [id=755202f095f04307a11ce87087df835c]). Expected version 2 got 0
I20260810 11:30:25.081979 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]). Expected version 2 got 0
I20260810 11:30:25.082726 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:25.083250 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet fbe0a0ab82a147a3b6164904b135d1ab (table default.Table_61d778388656489cb2e7fe8312b8ac6e [id=b52c11bd73cd4d1f8f9dfc32562718a2]). Expected version 2 got 0
I20260810 11:30:25.083657 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:25.084074 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_359f619c6e054a89898040e2f0d379c3 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 1 got 0
I20260810 11:30:25.084463 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]). Expected version 1 got 0
I20260810 11:30:25.085114 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 1 got 0
I20260810 11:30:25.085829 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:25.086189 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:25.087292 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:25.087826 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]). Expected version 1 got 0
I20260810 11:30:25.088220 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:25.088743 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]). Expected version 2 got 0
I20260810 11:30:25.089300 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]). Expected version 2 got 0
I20260810 11:30:25.089620 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 587c6ce242c0411b886404a0df03b1bb (table default.Table_8326a5b5a7544e828699f8b41fdee4d1 [id=1ae6d36bfe0e427a9a996dff3cdccc91]). Expected version 2 got 0
I20260810 11:30:25.090018 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:25.090703 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_e33c9849bbd34e6b9b72e69fd3a1ab1c [id=b206753d4f4142be82ee28150226bd53]). Expected version 1 got 0
I20260810 11:30:25.091645 27322 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:25.109894 27974 ts_tablet_manager.cc:1905] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:25.109894 26702 leader_election.cc:341] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:25.119781 27526 leader_election.cc:288] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:25.134447 27228 tablet_bootstrap.cc:654] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:25.136838 27021 tablet_service.cc:1467] Processing CreateTablet for tablet a4dde1d1eef74911b20498149e8c1785 (DEFAULT_TABLE table=default.Table_aa56bd03f9eb42468dce12fd81958879 [id=851eb82758954da2b3ec9bf0007880fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.137490 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4dde1d1eef74911b20498149e8c1785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.136838 27035 tablet_service.cc:1467] Processing CreateTablet for tablet ebaf046e524b485c8b3ebf419c8035bb (DEFAULT_TABLE table=default.Table_52c39be8057948a49dfd7394b4152265 [id=c48cb5a0af7b4f0483e799a49fd5d307]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.138473 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebaf046e524b485c8b3ebf419c8035bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.142882 27034 tablet_service.cc:1467] Processing CreateTablet for tablet 8400c601e9894ea9b68679f6d7927456 (DEFAULT_TABLE table=default.Table_ce10a5f4bedc411da7e7089a730e9cc8 [id=807b3a26a49f446797962bb532b4c58e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.143733 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8400c601e9894ea9b68679f6d7927456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.116941 26870 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:52546 (request call id 203) took 1064 ms. Trace:
I20260810 11:30:25.144811 26870 rpcz_store.cc:276] 0810 11:30:23.977247 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:23.977312 (+ 65us) service_pool.cc:227] Handling call
0810 11:30:24.030942 (+ 53630us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x61700009110c. stack: 00007f7f891ce66e 00007f7f891ce430 00007f7f882555ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f7f95baad6e 00007f7f959b415e 00007f7f982aea88 00007f7f92e1a016 00007f7f92e19d45 00007f7f8fd0a9be 00007f7f8fd0979e 00007f7f8fd0fb25 00007f7f8fd1054f 00007f7f8fd10378
0810 11:30:24.223118 (+192176us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x6150001b4024. stack: 00007f7f891ce66e 00007f7f891ce430 00007f7f882555ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f7f946d6630 00007f7f982aec7f 00007f7f92e1a016 00007f7f92e19d45 00007f7f8fd0a9be 00007f7f8fd0979e 00007f7f8fd0fb25 00007f7f8fd1054f 00007f7f8fd10378 00000000009edb7c
0810 11:30:24.248098 (+ 24980us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x6150000f7424. stack: 00007f7f891ce66e 00007f7f891ce430 00007f7f882555ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f7f946d6630 00007f7f982aec7f 00007f7f92e1a016 00007f7f92e19d45 00007f7f8fd0a9be 00007f7f8fd0979e 00007f7f8fd0fb25 00007f7f8fd1054f 00007f7f8fd10378 00000000009edb7c
0810 11:30:25.041164 (+793066us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":464517504}
I20260810 11:30:25.148624 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:25.149189 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:25.149432 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a87f6835f0dc4ad4b3a23b297726100d (table default.Table_cbf7fb0f0585465a9be24fa7e70d68d2 [id=82041e96f8de4fae85baf690bbbfc7a3]). Expected version 1 got 0
I20260810 11:30:25.149633 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet db59523b71224370bf5fce6b56592f71 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:25.149889 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d722b93fe27f4c08a592bc393046b6bd (table default.Table_60e35bdf23f74306a9b5299e927771de [id=0faf073b01654e38b8f6083f5012abd7]). Expected version 2 got 0
I20260810 11:30:25.150170 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:25.150518 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:25.150911 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:25.151125 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet fbe0a0ab82a147a3b6164904b135d1ab (table default.Table_61d778388656489cb2e7fe8312b8ac6e [id=b52c11bd73cd4d1f8f9dfc32562718a2]). Expected version 2 got 0
I20260810 11:30:25.151317 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:25.151522 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]). Expected version 1 got 0
I20260810 11:30:25.152136 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:25.152369 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:25.152908 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 23637a02b6464e17aa2a69ea5cc4ddfe (table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85]). Expected version 1 got 0
I20260810 11:30:25.153201 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet fdbe21b4f124411988dd35a0b864f868 (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:25.153692 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3ddb6e67c316416681074e454ab9b01e (table default.Table_1e1ca07e9c824349af23675b66b77321 [id=755202f095f04307a11ce87087df835c]). Expected version 2 got 0
I20260810 11:30:25.154049 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]). Expected version 2 got 0
I20260810 11:30:25.154295 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 1 got 0
I20260810 11:30:25.154651 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 1 got 0
I20260810 11:30:25.155098 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_359f619c6e054a89898040e2f0d379c3 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 1 got 0
I20260810 11:30:25.155386 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:25.155835 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]). Expected version 1 got 0
I20260810 11:30:25.156322 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]). Expected version 1 got 0
W20260810 11:30:25.165529 27291 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 587c6ce242c0411b886404a0df03b1bb (table default.Table_8326a5b5a7544e828699f8b41fdee4d1 [id=1ae6d36bfe0e427a9a996dff3cdccc91], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 587c6ce242c0411b886404a0df03b1bb consensus state has no leader
W20260810 11:30:25.174144 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 407009us
I20260810 11:30:25.185241 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 98de7ce411bb4b54ada2df3b78b72190 (DEFAULT_TABLE table=default.Table_6471724ce77d490abaf4ad26ff7ae126 [id=068f712315544485a6fae8452986a3fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.187621 27718 raft_consensus.cc:482] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:25.187866 27718 raft_consensus.cc:504] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:25.188292 27039 tablet_service.cc:1467] Processing CreateTablet for tablet 5a2e1b54043444989ac64c87f30ffc07 (DEFAULT_TABLE table=default.Table_341bf544f7b94ef2ba94afc342f8bc1f [id=193e8263e8a54ee798e1d4406074a52f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.190462 27718 leader_election.cc:288] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:25.190936 27020 tablet_service.cc:1467] Processing CreateTablet for tablet 77f0c916ccf24e86b0ec29de1ba54b84 (DEFAULT_TABLE table=default.Table_bbae9d833ed04fc89a867eb497163403 [id=822d8386d19c4a2bb83cc63fbc186792]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.193818 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:25.196090 27029 tablet_service.cc:1467] Processing CreateTablet for tablet 67364e1082184aad82a85c3fda850a26 (DEFAULT_TABLE table=default.Table_f3f00d1fa4db4cd4bbaaeefeef68897d [id=4cda0e139cc34db8ae99e56a074f5557]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.197227 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:25.196548 27025 tablet_service.cc:1467] Processing CreateTablet for tablet a74acd5078ec4a45987d68a1e4d138b9 (DEFAULT_TABLE table=default.Table_2d65cf26d2254f29a785321b186cb2c8 [id=c16570aaa0c7449191f68085a12017da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.198460 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:25.199186 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 98de7ce411bb4b54ada2df3b78b72190 (DEFAULT_TABLE table=default.Table_6471724ce77d490abaf4ad26ff7ae126 [id=068f712315544485a6fae8452986a3fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.200502 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98de7ce411bb4b54ada2df3b78b72190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.202080 26744 tablet_service.cc:1467] Processing CreateTablet for tablet ebaf046e524b485c8b3ebf419c8035bb (DEFAULT_TABLE table=default.Table_52c39be8057948a49dfd7394b4152265 [id=c48cb5a0af7b4f0483e799a49fd5d307]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.203956 27037 tablet_service.cc:1467] Processing CreateTablet for tablet c317ccebde05457d9e81c5c871638092 (DEFAULT_TABLE table=default.Table_0b6cd084cecf499e9091685515cb1a3b [id=7b4e4650915f4c16bef68adf43618b89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.205513 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebaf046e524b485c8b3ebf419c8035bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.207266 27033 tablet_service.cc:1467] Processing CreateTablet for tablet 17ff4152fc6a449db3a172c5d948168f (DEFAULT_TABLE table=default.Table_91c2ed7bba91469685ccb4e15fb5c174 [id=163ec39724a44b518f07abf5938fbcb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.206956 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:25.211334 27248 ts_tablet_manager.cc:1918] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:25.212011 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]). Expected version 1 got 0
I20260810 11:30:25.212213 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]). Expected version 2 got 0
I20260810 11:30:25.212463 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:25.216460 26729 tablet_service.cc:1467] Processing CreateTablet for tablet a4dde1d1eef74911b20498149e8c1785 (DEFAULT_TABLE table=default.Table_aa56bd03f9eb42468dce12fd81958879 [id=851eb82758954da2b3ec9bf0007880fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.216940 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]). Expected version 2 got 0
I20260810 11:30:25.217363 26729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4dde1d1eef74911b20498149e8c1785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.218477 26822 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:25.218788 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 587c6ce242c0411b886404a0df03b1bb (table default.Table_8326a5b5a7544e828699f8b41fdee4d1 [id=1ae6d36bfe0e427a9a996dff3cdccc91]). Expected version 2 got 0
I20260810 11:30:25.220083 26734 tablet_service.cc:1467] Processing CreateTablet for tablet 8400c601e9894ea9b68679f6d7927456 (DEFAULT_TABLE table=default.Table_ce10a5f4bedc411da7e7089a730e9cc8 [id=807b3a26a49f446797962bb532b4c58e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.220386 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_e33c9849bbd34e6b9b72e69fd3a1ab1c [id=b206753d4f4142be82ee28150226bd53]). Expected version 1 got 0
I20260810 11:30:25.215775 27999 ts_tablet_manager.cc:1939] T 4b15cc8669b549a2b4461dccd66a0c5a P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:25.222167 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:25.224817 27318 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:25.227290 27336 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_2c4f303b1d1c47c9a4c089efccdd1d37" } modify_external_catalogs: true
I20260810 11:30:25.227622 27336 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_2c4f303b1d1c47c9a4c089efccdd1d37" } modify_external_catalogs: true
W20260810 11:30:25.228996 27331 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8083fa130cd04dae9d61aeed977c1c63 consensus state has no leader
I20260810 11:30:25.229259 27331 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:49152 (request call id 46) took 1563 ms. Trace:
I20260810 11:30:25.229460 27331 rpcz_store.cc:276] 0810 11:30:23.665837 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.095952 (+430115us) service_pool.cc:227] Handling call
0810 11:30:24.096436 (+ 484us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:24.096831 (+ 395us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:24.097074 (+ 243us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:24.097208 (+ 134us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:24.296044 (+198836us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:25.229186 (+933142us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:24.269150 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:24.274003 (+ 4853us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:24.274013 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:24.274018 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:24.274165 (+ 147us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:24.274182 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:24.274190 (+ 8us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:24.274286 (+ 96us) tablet.cc:699] Row locks acquired
0810 11:30:24.274291 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:24.274346 (+ 55us) write_op.cc:270] Start()
0810 11:30:24.274412 (+ 66us) write_op.cc:276] Timestamp: P: 1786361424274286 usec, L: 0
0810 11:30:24.274418 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:24.290588 (+ 16170us) log.cc:842] Serialized 405 byte log entry
0810 11:30:24.292941 (+ 2353us) op_driver.cc:444] REPLICATION: finished
0810 11:30:24.293943 (+ 1002us) write_op.cc:301] APPLY: starting
0810 11:30:24.293956 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:24.293995 (+ 39us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:24.294077 (+ 82us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:24.294126 (+ 49us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:24.294162 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:24.294172 (+ 10us) write_op.cc:312] APPLY: finished
0810 11:30:24.294238 (+ 66us) log.cc:842] Serialized 23 byte log entry
0810 11:30:24.294284 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:24.294303 (+ 19us) write_op.cc:454] Released schema lock
0810 11:30:24.294309 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:24.294372 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:24.294378 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":961,"apply.run_cpu_time_us":483,"apply.run_wall_time_us":481,"num_ops":1,"prepare.queue_time_us":171385,"prepare.run_cpu_time_us":1249,"prepare.run_wall_time_us":39540,"raft.queue_time_us":54,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":137,"replication_time_us":18496}]]}
I20260810 11:30:25.230823 27331 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_340e7b53369c44cda0cb60ddbb328ccc" } modify_external_catalogs: true
I20260810 11:30:25.231035 27331 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_340e7b53369c44cda0cb60ddbb328ccc" } modify_external_catalogs: true
W20260810 11:30:25.232488 27319 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d3e78dcaa55491393f529ea33007786 consensus state has no leader
I20260810 11:30:25.232818 27319 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:49152 (request call id 48) took 1566 ms. Trace:
I20260810 11:30:25.232823 28007 raft_consensus.cc:482] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:25.233060 27319 rpcz_store.cc:276] 0810 11:30:23.666372 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.109174 (+442802us) service_pool.cc:227] Handling call
0810 11:30:24.109659 (+ 485us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:24.109962 (+ 303us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:24.110176 (+ 214us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:24.110259 (+ 83us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:24.391216 (+280957us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:25.232708 (+841492us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:24.365678 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:24.367244 (+ 1566us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:24.367446 (+ 202us) write_op.cc:435] Acquired schema lock
0810 11:30:24.367452 (+ 6us) tablet.cc:660] Decoding operations
0810 11:30:24.370155 (+ 2703us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:24.370452 (+ 297us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:24.370467 (+ 15us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:24.372235 (+ 1768us) tablet.cc:699] Row locks acquired
0810 11:30:24.372240 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:24.372982 (+ 742us) write_op.cc:270] Start()
0810 11:30:24.373691 (+ 709us) write_op.cc:276] Timestamp: P: 1786361424372659 usec, L: 0
0810 11:30:24.373698 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:24.378607 (+ 4909us) log.cc:842] Serialized 405 byte log entry
0810 11:30:24.390207 (+ 11600us) op_driver.cc:444] REPLICATION: finished
0810 11:30:24.390441 (+ 234us) write_op.cc:301] APPLY: starting
0810 11:30:24.390464 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:24.390510 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:24.390604 (+ 94us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:24.390676 (+ 72us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:24.390716 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:24.390727 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:24.390874 (+ 147us) log.cc:842] Serialized 23 byte log entry
0810 11:30:24.390941 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:24.390965 (+ 24us) write_op.cc:454] Released schema lock
0810 11:30:24.390973 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:24.391058 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:24.391063 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":173,"apply.run_cpu_time_us":691,"apply.run_wall_time_us":691,"num_ops":1,"prepare.queue_time_us":185105,"prepare.run_cpu_time_us":2141,"prepare.run_wall_time_us":32163,"raft.queue_time_us":896,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":335,"replication_time_us":16479}]]}
I20260810 11:30:25.234282 27319 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_0d634c04e624422da8830e84abf1339f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:25.233060 28007 raft_consensus.cc:504] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.234977 26733 tablet_service.cc:1467] Processing CreateTablet for tablet 5a2e1b54043444989ac64c87f30ffc07 (DEFAULT_TABLE table=default.Table_341bf544f7b94ef2ba94afc342f8bc1f [id=193e8263e8a54ee798e1d4406074a52f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:25.235185 27319 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d634c04e624422da8830e84abf1339f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:25.235436 26735 tablet_service.cc:1467] Processing CreateTablet for tablet 77f0c916ccf24e86b0ec29de1ba54b84 (DEFAULT_TABLE table=default.Table_bbae9d833ed04fc89a867eb497163403 [id=822d8386d19c4a2bb83cc63fbc186792]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.236694 28007 leader_election.cc:288] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:25.238207 27362 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 256ad2e2d8e54a4caa1b5091bab60dd5 consensus state has no leader
I20260810 11:30:25.238848 27362 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_2a7d8b62f0814dcb99b674089d4fd0c7" } new_table_name: "default.Table_376e60b3deca4fd2a33be856f0457166" modify_external_catalogs: true
I20260810 11:30:25.239110 26742 tablet_service.cc:1467] Processing CreateTablet for tablet a74acd5078ec4a45987d68a1e4d138b9 (DEFAULT_TABLE table=default.Table_2d65cf26d2254f29a785321b186cb2c8 [id=c16570aaa0c7449191f68085a12017da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.241777 27039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a2e1b54043444989ac64c87f30ffc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.242447 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 17ff4152fc6a449db3a172c5d948168f (DEFAULT_TABLE table=default.Table_91c2ed7bba91469685ccb4e15fb5c174 [id=163ec39724a44b518f07abf5938fbcb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.244130 26732 tablet_service.cc:1467] Processing CreateTablet for tablet 0bb01711769f457aa0696bb59582166d (DEFAULT_TABLE table=default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.244632 27334 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet 725d2e70e1d441b497d56a278e1de0ad
I20260810 11:30:25.245046 26740 tablet_service.cc:1467] Processing CreateTablet for tablet c317ccebde05457d9e81c5c871638092 (DEFAULT_TABLE table=default.Table_0b6cd084cecf499e9091685515cb1a3b [id=7b4e4650915f4c16bef68adf43618b89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.245977 27334 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_e18fcf91bf3b4fa0a993bc1aa1471e62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:25.246707 27334 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e18fcf91bf3b4fa0a993bc1aa1471e62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:25.247347 27031 tablet_service.cc:1467] Processing CreateTablet for tablet 0bb01711769f457aa0696bb59582166d (DEFAULT_TABLE table=default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.252980 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8400c601e9894ea9b68679f6d7927456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.255487 27020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77f0c916ccf24e86b0ec29de1ba54b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.257682 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bb01711769f457aa0696bb59582166d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.258956 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17ff4152fc6a449db3a172c5d948168f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.259932 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a74acd5078ec4a45987d68a1e4d138b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.260267 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c317ccebde05457d9e81c5c871638092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.260761 27031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bb01711769f457aa0696bb59582166d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.261379 27248 log.cc:1196] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/2fc76603bf8843dab18c95fdab9a8be0
I20260810 11:30:25.262197 27029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67364e1082184aad82a85c3fda850a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.264405 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c317ccebde05457d9e81c5c871638092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.265506 26733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a2e1b54043444989ac64c87f30ffc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.266753 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77f0c916ccf24e86b0ec29de1ba54b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.267949 27033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17ff4152fc6a449db3a172c5d948168f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.268288 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a74acd5078ec4a45987d68a1e4d138b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.257427 26748 tablet_service.cc:1467] Processing CreateTablet for tablet 67364e1082184aad82a85c3fda850a26 (DEFAULT_TABLE table=default.Table_f3f00d1fa4db4cd4bbaaeefeef68897d [id=4cda0e139cc34db8ae99e56a074f5557]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.269742 27526 consensus_queue.cc:1035] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:25.270098 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67364e1082184aad82a85c3fda850a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.271551 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet 725d2e70e1d441b497d56a278e1de0ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:25.276968 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98de7ce411bb4b54ada2df3b78b72190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.278026 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587c6ce242c0411b886404a0df03b1bb" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:25.278978 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet 725d2e70e1d441b497d56a278e1de0ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:32816
W20260810 11:30:25.281565 26993 leader_election.cc:341] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: ec788db5b0ca40f1811b6660276d0254
I20260810 11:30:25.286702 26910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb01e54d817c4b0dbcc80f90f82923c0" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:25.291429 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb51618d37ac488fa7e3d23e5f85ec36" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:25.306094 27866 raft_consensus.cc:482] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:25.306355 27866 raft_consensus.cc:504] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.307391 27866 leader_election.cc:288] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:25.309767 26764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "750950c424184d08bf6777774db3a0b2" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:25.316061 26700 leader_election.cc:341] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 4b15cc8669b549a2b4461dccd66a0c5a
I20260810 11:30:25.316675 26700 leader_election.cc:302] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:25.316867 27248 ts_tablet_manager.cc:1939] T 2fc76603bf8843dab18c95fdab9a8be0 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:25.317126 27763 raft_consensus.cc:2726] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:25.319898 26849 leader_election.cc:341] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:25.317759 26700 leader_election.cc:341] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:25.320539 27999 tablet_replica.cc:330] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:25.320746 26700 leader_election.cc:302] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:25.320845 27999 raft_consensus.cc:2229] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:25.321300 27763 raft_consensus.cc:2726] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:25.322569 26700 leader_election.cc:341] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:25.322829 26700 leader_election.cc:302] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:25.323395 27763 raft_consensus.cc:2726] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:25.331225 27999 raft_consensus.cc:2258] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:25.332070 27999 ts_tablet_manager.cc:1905] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:25.332183 26993 consensus_peers.cc:487] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:25.338326 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 50451.5us
I20260810 11:30:25.339536 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 331) took 5121 ms. Trace:
W20260810 11:30:25.339797 26993 consensus_peers.cc:487] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d91a02b22044429fb3e25840c7947a02. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:25.339645 27248 rpcz_store.cc:276] 0810 11:30:20.213149 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:20.213300 (+ 151us) service_pool.cc:227] Handling call
0810 11:30:24.386294 (+4172994us) ts_tablet_manager.cc:1145] Deleting tablet 2fc76603bf8843dab18c95fdab9a8be0
0810 11:30:24.386310 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:24.936031 (+549721us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.211169 (+275138us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.334451 (+123282us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7263,"tablet-delete.queue_time_us":4169053}
W20260810 11:30:25.341876 26993 leader_election.cc:341] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:25.342034 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 331) could send its response
I20260810 11:30:25.342985 27248 tablet_replica.cc:330] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:25.346619 26912 raft_consensus.cc:3037] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:25.348918 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587c6ce242c0411b886404a0df03b1bb" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:25.349723 26913 raft_consensus.cc:2454] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:25.354966 27248 raft_consensus.cc:2229] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:25.334036 28029 consensus_queue.cc:1035] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.068s
I20260810 11:30:25.368541 27866 consensus_queue.cc:1035] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:25.369340 27718 consensus_queue.cc:1035] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260810 11:30:25.372627 26888 tablet_service.cc:1467] Processing CreateTablet for tablet 8400c601e9894ea9b68679f6d7927456 (DEFAULT_TABLE table=default.Table_ce10a5f4bedc411da7e7089a730e9cc8 [id=807b3a26a49f446797962bb532b4c58e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.373306 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8400c601e9894ea9b68679f6d7927456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.373910 27111 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
W20260810 11:30:25.369234 26991 leader_election.cc:341] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 7e3707ae32624f6483866208321eefde
I20260810 11:30:25.377938 27248 raft_consensus.cc:2258] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:25.378242 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 5a2e1b54043444989ac64c87f30ffc07 (DEFAULT_TABLE table=default.Table_341bf544f7b94ef2ba94afc342f8bc1f [id=193e8263e8a54ee798e1d4406074a52f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.378961 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a2e1b54043444989ac64c87f30ffc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.377821 26991 leader_election.cc:302] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:25.388939 27911 raft_consensus.cc:2726] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:25.385520 26877 tablet_service.cc:1467] Processing CreateTablet for tablet a74acd5078ec4a45987d68a1e4d138b9 (DEFAULT_TABLE table=default.Table_2d65cf26d2254f29a785321b186cb2c8 [id=c16570aaa0c7449191f68085a12017da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.390308 26877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a74acd5078ec4a45987d68a1e4d138b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.385402 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "750950c424184d08bf6777774db3a0b2" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:25.394330 26878 tablet_service.cc:1467] Processing CreateTablet for tablet 67364e1082184aad82a85c3fda850a26 (DEFAULT_TABLE table=default.Table_f3f00d1fa4db4cd4bbaaeefeef68897d [id=4cda0e139cc34db8ae99e56a074f5557]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.394892 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67364e1082184aad82a85c3fda850a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.400784 27248 ts_tablet_manager.cc:1905] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:25.403375 26894 tablet_service.cc:1467] Processing CreateTablet for tablet ebaf046e524b485c8b3ebf419c8035bb (DEFAULT_TABLE table=default.Table_52c39be8057948a49dfd7394b4152265 [id=c48cb5a0af7b4f0483e799a49fd5d307]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.404040 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebaf046e524b485c8b3ebf419c8035bb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:25.405961 26991 leader_election.cc:341] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: ec788db5b0ca40f1811b6660276d0254
I20260810 11:30:25.407610 26991 leader_election.cc:302] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:25.408171 26991 leader_election.cc:302] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:25.409032 26889 tablet_service.cc:1467] Processing CreateTablet for tablet a4dde1d1eef74911b20498149e8c1785 (DEFAULT_TABLE table=default.Table_aa56bd03f9eb42468dce12fd81958879 [id=851eb82758954da2b3ec9bf0007880fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.410154 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4dde1d1eef74911b20498149e8c1785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.411723 27708 raft_consensus.cc:2726] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:25.415261 27718 raft_consensus.cc:2781] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:25.415416 27718 raft_consensus.cc:482] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:25.417110 27718 raft_consensus.cc:3037] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:25.419715 26890 tablet_service.cc:1467] Processing CreateTablet for tablet 77f0c916ccf24e86b0ec29de1ba54b84 (DEFAULT_TABLE table=default.Table_bbae9d833ed04fc89a867eb497163403 [id=822d8386d19c4a2bb83cc63fbc186792]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.420478 26890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77f0c916ccf24e86b0ec29de1ba54b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.425803 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 17ff4152fc6a449db3a172c5d948168f (DEFAULT_TABLE table=default.Table_91c2ed7bba91469685ccb4e15fb5c174 [id=163ec39724a44b518f07abf5938fbcb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.426523 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17ff4152fc6a449db3a172c5d948168f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.433560 26882 tablet_service.cc:1467] Processing CreateTablet for tablet c317ccebde05457d9e81c5c871638092 (DEFAULT_TABLE table=default.Table_0b6cd084cecf499e9091685515cb1a3b [id=7b4e4650915f4c16bef68adf43618b89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.435221 26882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c317ccebde05457d9e81c5c871638092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.438889 27718 raft_consensus.cc:504] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.450039 27718 leader_election.cc:288] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:25.457943 27248 ts_tablet_manager.cc:1918] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:25.458190 27248 log.cc:1196] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/949f31fa0c124eefbee695cfc7f50cbe
I20260810 11:30:25.459792 27248 ts_tablet_manager.cc:1939] T 949f31fa0c124eefbee695cfc7f50cbe P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:25.460223 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 332) took 5245 ms. Trace:
I20260810 11:30:25.460403 27248 rpcz_store.cc:276] 0810 11:30:20.214621 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:20.214688 (+ 67us) service_pool.cc:227] Handling call
0810 11:30:25.340462 (+5125774us) ts_tablet_manager.cc:1145] Deleting tablet 949f31fa0c124eefbee695cfc7f50cbe
0810 11:30:25.340473 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.418866 (+ 78393us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.446574 (+ 27708us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.460185 (+ 13611us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5111236}
W20260810 11:30:25.460749 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 332) could send its response
I20260810 11:30:25.461256 26879 tablet_service.cc:1467] Processing CreateTablet for tablet 98de7ce411bb4b54ada2df3b78b72190 (DEFAULT_TABLE table=default.Table_6471724ce77d490abaf4ad26ff7ae126 [id=068f712315544485a6fae8452986a3fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.462631 26879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98de7ce411bb4b54ada2df3b78b72190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.464828 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 333) took 5237 ms. Trace:
I20260810 11:30:25.465000 27248 rpcz_store.cc:276] 0810 11:30:20.227056 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:20.227118 (+ 62us) service_pool.cc:227] Handling call
0810 11:30:25.464604 (+5237486us) ts_tablet_manager.cc:1145] Deleting tablet 34bd3c0edf6b49d1891c0ee9af344872
0810 11:30:25.464622 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.464781 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5223594}
W20260810 11:30:25.465345 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 333) could send its response
W20260810 11:30:25.466054 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 97955us
I20260810 11:30:25.467497 27248 tablet_replica.cc:330] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:25.468040 27248 raft_consensus.cc:2229] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:25.472494 27248 raft_consensus.cc:2258] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:25.474783 27333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet 8a1e2e624fff4692a22e29b293cd82d6
I20260810 11:30:25.475529 27333 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49152 (request call id 56) took 1200 ms. Trace:
W20260810 11:30:25.476130 26993 consensus_peers.cc:487] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:25.475675 27333 rpcz_store.cc:276] 0810 11:30:24.287436 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.287531 (+ 95us) service_pool.cc:227] Handling call
0810 11:30:24.297937 (+ 10406us) spinlock_profiling.cc:243] Waited 9.94 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dd2e6 00007f55f09d0126 00007f55f09cfe55 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:24.298647 (+ 710us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:24.298817 (+ 170us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:24.298911 (+ 94us) catalog_manager.cc:2761] Locking tablets
0810 11:30:24.454754 (+155843us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:24.740775 (+286021us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:24.740898 (+ 123us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:25.474627 (+733729us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:25.475474 (+ 847us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:24.617756 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:24.617902 (+ 146us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:24.617908 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:24.617912 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:24.618139 (+ 227us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:24.618154 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:24.618163 (+ 9us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:24.618342 (+ 179us) tablet.cc:699] Row locks acquired
0810 11:30:24.618347 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:24.618395 (+ 48us) write_op.cc:270] Start()
0810 11:30:24.618492 (+ 97us) write_op.cc:276] Timestamp: P: 1786361424618361 usec, L: 0
0810 11:30:24.618498 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:24.625553 (+ 7055us) log.cc:842] Serialized 734 byte log entry
0810 11:30:24.739100 (+113547us) op_driver.cc:444] REPLICATION: finished
0810 11:30:24.739397 (+ 297us) write_op.cc:301] APPLY: starting
0810 11:30:24.739423 (+ 26us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:24.739482 (+ 59us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:24.739518 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:24.739603 (+ 85us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:24.739653 (+ 50us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:24.739664 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:24.739782 (+ 118us) log.cc:842] Serialized 29 byte log entry
0810 11:30:24.739860 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:24.739887 (+ 27us) write_op.cc:454] Released schema lock
0810 11:30:24.739898 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:24.739971 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:24.739978 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":22863616,"child_traces":[["op",{"apply.queue_time_us":225,"apply.run_cpu_time_us":666,"apply.run_wall_time_us":664,"mutex_wait_us":761,"num_ops":2,"prepare.queue_time_us":162073,"prepare.run_cpu_time_us":1355,"prepare.run_wall_time_us":9729,"raft.queue_time_us":667,"raft.run_cpu_time_us":10,"raft.run_wall_time_us":9,"replication_time_us":120476}]]}
I20260810 11:30:25.476639 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a1e2e624fff4692a22e29b293cd82d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:25.477878 27248 ts_tablet_manager.cc:1905] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:25.480577 27231 tablet_bootstrap.cc:492] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:25.480859 27231 ts_tablet_manager.cc:1397] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 1.029s user 0.007s sys 0.017s
I20260810 11:30:25.481506 26964 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
W20260810 11:30:25.483913 27362 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b200bdb394d3439b86fff48494be8e3d consensus state has no leader
I20260810 11:30:25.484406 27362 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:49152 (request call id 66) took 1045 ms. Trace:
I20260810 11:30:25.484591 27362 rpcz_store.cc:276] 0810 11:30:24.439146 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.238510 (+799364us) service_pool.cc:227] Handling call
0810 11:30:25.239098 (+ 588us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:25.239347 (+ 249us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:25.239577 (+ 230us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:25.239681 (+ 104us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:25.267219 (+ 27538us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:25.484317 (+217098us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:25.240412 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:25.240519 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:25.240526 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:25.240529 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:25.240680 (+ 151us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:25.240693 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:25.240698 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:25.240796 (+ 98us) tablet.cc:699] Row locks acquired
0810 11:30:25.240800 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:25.240855 (+ 55us) write_op.cc:270] Start()
0810 11:30:25.240900 (+ 45us) write_op.cc:276] Timestamp: P: 1786361425240796 usec, L: 0
0810 11:30:25.240906 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:25.241148 (+ 242us) log.cc:842] Serialized 405 byte log entry
0810 11:30:25.254475 (+ 13327us) op_driver.cc:444] REPLICATION: finished
0810 11:30:25.254752 (+ 277us) write_op.cc:301] APPLY: starting
0810 11:30:25.254768 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:25.254808 (+ 40us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:25.254839 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:25.254905 (+ 66us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:25.254948 (+ 43us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:25.254960 (+ 12us) write_op.cc:312] APPLY: finished
0810 11:30:25.255048 (+ 88us) log.cc:842] Serialized 23 byte log entry
0810 11:30:25.255131 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.255151 (+ 20us) write_op.cc:454] Released schema lock
0810 11:30:25.255158 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:25.255219 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.255226 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":223,"apply.run_cpu_time_us":530,"apply.run_wall_time_us":529,"num_ops":1,"prepare.queue_time_us":195,"prepare.run_cpu_time_us":858,"prepare.run_wall_time_us":858,"replication_time_us":13542}]]}
I20260810 11:30:25.485584 27362 master_service.cc:946] ReplaceTablet: received request to replace tablet 256ad2e2d8e54a4caa1b5091bab60dd5 from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:25.488654 27333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_23ac53b1a7794ddda0a697254fff0ede"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:25.489766 27333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23ac53b1a7794ddda0a697254fff0ede in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:25.491430 27334 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_a827339eadbd440bb3c0bfa6c52512ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:25.492959 27319 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_b6e82fe7918d4a13bc1fdc1e66287cda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:25.493793 27319 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6e82fe7918d4a13bc1fdc1e66287cda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:25.495210 27231 raft_consensus.cc:348] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:25.495711 27286 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.253:34547, user_credentials={real_user=slave}} blocked reactor thread for 120165us
I20260810 11:30:25.495770 27231 raft_consensus.cc:374] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 11:30:25.495715 27334 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a827339eadbd440bb3c0bfa6c52512ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:25.495965 27231 raft_consensus.cc:729] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:25.496515 27231 consensus_queue.cc:260] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.502826 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 4b15cc8669b549a2b4461dccd66a0c5a (table default.Table_16866d33f78041fd9fdfdd14a4daf75e [id=3ed241516c2f474c818b0b4e77ae4bbc]) successfully deleted
I20260810 11:30:25.504204 27231 ts_tablet_manager.cc:1428] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.012s user 0.000s sys 0.003s
I20260810 11:30:25.504998 27231 tablet_bootstrap.cc:492] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
W20260810 11:30:25.505046 26848 consensus_peers.cc:487] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7dc4000f1dde46a3b881a9fa8e9a6e3e. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:25.507484 27231 tablet_bootstrap.cc:654] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:25.509759 27526 consensus_queue.cc:1035] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260810 11:30:25.520030 27228 tablet_bootstrap.cc:492] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:25.520267 26890 tablet_service.cc:1514] Processing DeleteTablet for tablet 725d2e70e1d441b497d56a278e1de0ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:25.535908 27333 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 70) took 1017 ms. Trace:
I20260810 11:30:25.536108 27333 rpcz_store.cc:276] 0810 11:30:24.518927 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.476560 (+957633us) service_pool.cc:227] Handling call
0810 11:30:25.488479 (+ 11919us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dc313 00007f55f09ce466 00007f55f09ce195 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:25.489903 (+ 1424us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:25.490416 (+ 513us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:25.535608 (+ 45192us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:25.535731 (+ 123us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:25.535834 (+ 103us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:25.491113 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:25.491252 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:25.491260 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:25.491265 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:25.491442 (+ 177us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:25.491460 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:25.491468 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:25.491570 (+ 102us) tablet.cc:699] Row locks acquired
0810 11:30:25.491572 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:25.491616 (+ 44us) write_op.cc:270] Start()
0810 11:30:25.491654 (+ 38us) write_op.cc:276] Timestamp: P: 1786361425491602 usec, L: 0
0810 11:30:25.491658 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:25.491893 (+ 235us) log.cc:842] Serialized 433 byte log entry
0810 11:30:25.533580 (+ 41687us) op_driver.cc:444] REPLICATION: finished
0810 11:30:25.533900 (+ 320us) write_op.cc:301] APPLY: starting
0810 11:30:25.533919 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:25.533966 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:25.533997 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:25.534135 (+ 138us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:25.534174 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:25.534179 (+ 5us) write_op.cc:312] APPLY: finished
0810 11:30:25.534292 (+ 113us) log.cc:842] Serialized 29 byte log entry
0810 11:30:25.534369 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.534391 (+ 22us) write_op.cc:454] Released schema lock
0810 11:30:25.534399 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:25.534463 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.534466 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":26703616,"child_traces":[["op",{"apply.queue_time_us":264,"apply.run_cpu_time_us":621,"apply.run_wall_time_us":620,"num_ops":2,"prepare.queue_time_us":63,"prepare.run_cpu_time_us":886,"prepare.run_wall_time_us":885,"replication_time_us":41878}]]}
I20260810 11:30:25.543380 27334 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 68) took 1103 ms. Trace:
I20260810 11:30:25.545748 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587c6ce242c0411b886404a0df03b1bb" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:25.546924 27319 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 69) took 1049 ms. Trace:
I20260810 11:30:25.548125 27222 tablet_bootstrap.cc:492] T fdbe21b4f124411988dd35a0b864f868 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:25.548157 27319 rpcz_store.cc:276] 0810 11:30:24.495983 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.269367 (+773384us) service_pool.cc:227] Handling call
0810 11:30:25.492838 (+223471us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dc313 00007f55f09ce466 00007f55f09ce195 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:25.494246 (+ 1408us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:25.494799 (+ 553us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:25.544812 (+ 50013us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:25.545064 (+ 252us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:25.545175 (+ 111us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:25.497683 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:25.497801 (+ 118us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:25.497808 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:25.497811 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:25.497904 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:25.497916 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:25.497921 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:25.498014 (+ 93us) tablet.cc:699] Row locks acquired
0810 11:30:25.498017 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:25.498062 (+ 45us) write_op.cc:270] Start()
0810 11:30:25.498102 (+ 40us) write_op.cc:276] Timestamp: P: 1786361425498045 usec, L: 0
0810 11:30:25.498107 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:25.498326 (+ 219us) log.cc:842] Serialized 433 byte log entry
0810 11:30:25.533662 (+ 35336us) op_driver.cc:444] REPLICATION: finished
0810 11:30:25.534574 (+ 912us) write_op.cc:301] APPLY: starting
0810 11:30:25.534586 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:25.534619 (+ 33us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:25.534662 (+ 43us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:25.534839 (+ 177us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:25.534870 (+ 31us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:25.534877 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:25.534936 (+ 59us) log.cc:842] Serialized 29 byte log entry
0810 11:30:25.534979 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.534993 (+ 14us) write_op.cc:454] Released schema lock
0810 11:30:25.534998 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:25.535053 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.535058 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":513137024,"child_traces":[["op",{"apply.queue_time_us":868,"apply.run_cpu_time_us":545,"apply.run_wall_time_us":544,"num_ops":2,"prepare.queue_time_us":2329,"prepare.run_cpu_time_us":748,"prepare.run_wall_time_us":748,"replication_time_us":35540}]]}
I20260810 11:30:25.545553 27334 rpcz_store.cc:276] 0810 11:30:24.439796 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.268056 (+828260us) service_pool.cc:227] Handling call
0810 11:30:25.491187 (+223131us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dc313 00007f55f09ce466 00007f55f09ce195 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:25.496011 (+ 4824us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:25.496511 (+ 500us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:25.543049 (+ 46538us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:25.543185 (+ 136us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:25.543284 (+ 99us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:25.498475 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:25.498581 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:25.498589 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:25.498593 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:25.498726 (+ 133us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:25.498737 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:25.498744 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:25.498832 (+ 88us) tablet.cc:699] Row locks acquired
0810 11:30:25.498836 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:25.498873 (+ 37us) write_op.cc:270] Start()
0810 11:30:25.498907 (+ 34us) write_op.cc:276] Timestamp: P: 1786361425498858 usec, L: 0
0810 11:30:25.498913 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:25.499123 (+ 210us) log.cc:842] Serialized 433 byte log entry
0810 11:30:25.533699 (+ 34576us) op_driver.cc:444] REPLICATION: finished
0810 11:30:25.535148 (+ 1449us) write_op.cc:301] APPLY: starting
0810 11:30:25.535161 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:25.535195 (+ 34us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:25.535218 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:25.535302 (+ 84us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:25.535328 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:25.535334 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:25.535385 (+ 51us) log.cc:842] Serialized 29 byte log entry
0810 11:30:25.535423 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.535435 (+ 12us) write_op.cc:454] Released schema lock
0810 11:30:25.535440 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:25.535484 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.535487 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":506098944,"child_traces":[["op",{"apply.queue_time_us":1414,"apply.run_cpu_time_us":381,"apply.run_wall_time_us":380,"num_ops":2,"prepare.queue_time_us":1378,"prepare.run_cpu_time_us":731,"prepare.run_wall_time_us":730,"replication_time_us":34773,"threads_started":1}]]}
I20260810 11:30:25.553818 27222 ts_tablet_manager.cc:1397] T fdbe21b4f124411988dd35a0b864f868 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.649s user 0.009s sys 0.021s
I20260810 11:30:25.556186 27222 raft_consensus.cc:348] T fdbe21b4f124411988dd35a0b864f868 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.558841 27321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet 10210204d5ff4e5e97c98fd255f674a5
I20260810 11:30:25.559551 27321 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49152 (request call id 62) took 1164 ms. Trace:
I20260810 11:30:25.559706 27321 rpcz_store.cc:276] 0810 11:30:24.395050 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.870453 (+475403us) service_pool.cc:227] Handling call
0810 11:30:24.871295 (+ 842us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:24.871527 (+ 232us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:24.871611 (+ 84us) catalog_manager.cc:2761] Locking tablets
0810 11:30:25.502293 (+630682us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:25.558321 (+ 56028us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:25.558454 (+ 133us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:25.558528 (+ 74us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:25.559486 (+ 958us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:25.503220 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:25.503380 (+ 160us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:25.503388 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:25.503392 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:25.503874 (+ 482us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:25.503893 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:25.503900 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:25.504134 (+ 234us) tablet.cc:699] Row locks acquired
0810 11:30:25.504136 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:25.504231 (+ 95us) write_op.cc:270] Start()
0810 11:30:25.504287 (+ 56us) write_op.cc:276] Timestamp: P: 1786361425504200 usec, L: 0
0810 11:30:25.504291 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:25.506153 (+ 1862us) log.cc:842] Serialized 734 byte log entry
0810 11:30:25.555975 (+ 49822us) op_driver.cc:444] REPLICATION: finished
0810 11:30:25.556490 (+ 515us) write_op.cc:301] APPLY: starting
0810 11:30:25.556514 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:25.556601 (+ 87us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:25.556634 (+ 33us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:25.556717 (+ 83us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:25.556758 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:25.556765 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:25.556862 (+ 97us) log.cc:842] Serialized 29 byte log entry
0810 11:30:25.556952 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.556977 (+ 25us) write_op.cc:454] Released schema lock
0810 11:30:25.556985 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:25.557055 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.557060 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":119,"child_traces":[["op",{"apply.queue_time_us":438,"apply.run_cpu_time_us":637,"apply.run_wall_time_us":637,"num_ops":2,"prepare.queue_time_us":74,"prepare.run_cpu_time_us":1613,"prepare.run_wall_time_us":3080,"replication_time_us":51654}]]}
I20260810 11:30:25.561146 27331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet 43fee1a9a6f9482fbbe6ab6599c27fb9
I20260810 11:30:25.561650 27331 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49152 (request call id 64) took 1166 ms. Trace:
I20260810 11:30:25.561832 27331 rpcz_store.cc:276] 0810 11:30:24.395529 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.230622 (+835093us) service_pool.cc:227] Handling call
0810 11:30:25.231163 (+ 541us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:25.231315 (+ 152us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:25.231389 (+ 74us) catalog_manager.cc:2761] Locking tablets
0810 11:30:25.513030 (+281641us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:25.560917 (+ 47887us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:25.561013 (+ 96us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:25.561065 (+ 52us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:25.561591 (+ 526us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:25.514168 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:25.514316 (+ 148us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:25.514324 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:25.514327 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:25.514459 (+ 132us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:25.514473 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:25.514479 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:25.514630 (+ 151us) tablet.cc:699] Row locks acquired
0810 11:30:25.514634 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:25.514685 (+ 51us) write_op.cc:270] Start()
0810 11:30:25.514725 (+ 40us) write_op.cc:276] Timestamp: P: 1786361425514668 usec, L: 0
0810 11:30:25.514729 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:25.515166 (+ 437us) log.cc:842] Serialized 734 byte log entry
0810 11:30:25.556116 (+ 40950us) op_driver.cc:444] REPLICATION: finished
0810 11:30:25.557885 (+ 1769us) write_op.cc:301] APPLY: starting
0810 11:30:25.557926 (+ 41us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:25.557961 (+ 35us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:25.557984 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:25.558079 (+ 95us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:25.558108 (+ 29us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:25.558114 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:25.558170 (+ 56us) log.cc:842] Serialized 29 byte log entry
0810 11:30:25.558210 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.558224 (+ 14us) write_op.cc:454] Released schema lock
0810 11:30:25.558229 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1736,"num_ops":2,"prepare.queue_time_us":73,"prepare.run_cpu_time_us":1111,"prepare.run_wall_time_us":1112,"replication_time_us":41373}]]}
I20260810 11:30:25.566490 27336 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet d000f0ebaf0049a7bdaad93e307e16e2
I20260810 11:30:25.567186 27336 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49152 (request call id 63) took 1171 ms. Trace:
I20260810 11:30:25.567410 27336 rpcz_store.cc:276] 0810 11:30:24.395320 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.227100 (+831780us) service_pool.cc:227] Handling call
0810 11:30:25.227879 (+ 779us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:25.228063 (+ 184us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:25.228125 (+ 62us) catalog_manager.cc:2761] Locking tablets
0810 11:30:25.516766 (+288641us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:25.566226 (+ 49460us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:25.566340 (+ 114us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:25.566393 (+ 53us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:25.567071 (+ 678us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:25.517541 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:25.517653 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:25.517661 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:25.517665 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:25.517878 (+ 213us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:25.517895 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:25.517904 (+ 9us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:25.518135 (+ 231us) tablet.cc:699] Row locks acquired
0810 11:30:25.518139 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:25.518186 (+ 47us) write_op.cc:270] Start()
0810 11:30:25.518230 (+ 44us) write_op.cc:276] Timestamp: P: 1786361425518169 usec, L: 0
0810 11:30:25.518237 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:25.518477 (+ 240us) log.cc:842] Serialized 734 byte log entry
0810 11:30:25.556181 (+ 37704us) op_driver.cc:444] REPLICATION: finished
0810 11:30:25.563571 (+ 7390us) write_op.cc:301] APPLY: starting
0810 11:30:25.563608 (+ 37us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:25.563753 (+ 145us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:25.563817 (+ 64us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:25.563950 (+ 133us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:25.564015 (+ 65us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:25.564028 (+ 13us) write_op.cc:312] APPLY: finished
0810 11:30:25.565354 (+ 1326us) log.cc:842] Serialized 29 byte log entry
0810 11:30:25.565436 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.565463 (+ 27us) write_op.cc:454] Released schema lock
0810 11:30:25.565475 (+ 12us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":7181,"num_ops":2,"prepare.queue_time_us":64,"prepare.run_cpu_time_us":975,"prepare.run_wall_time_us":1014,"replication_time_us":37928,"threads_started":1}]]}
I20260810 11:30:25.569727 27362 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet 256ad2e2d8e54a4caa1b5091bab60dd5
I20260810 11:30:25.570925 27362 catalog_manager.cc:6565] ReplaceTablet: tablet 256ad2e2d8e54a4caa1b5091bab60dd5 deleted and replaced by tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7
I20260810 11:30:25.571189 27362 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:49152 (request call id 71) took 1048 ms. Trace:
I20260810 11:30:25.571799 27362 rpcz_store.cc:276] 0810 11:30:24.522909 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.485469 (+962560us) service_pool.cc:227] Handling call
0810 11:30:25.494140 (+ 8671us) spinlock_profiling.cc:243] Waited 8.23 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96e8527 00007f55f09dada7 00007f55f09daad5 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:25.571109 (+ 76969us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:25.506354 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:25.506509 (+ 155us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:25.506527 (+ 18us) write_op.cc:435] Acquired schema lock
0810 11:30:25.506530 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:25.506672 (+ 142us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:25.506687 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:25.506693 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:25.506805 (+ 112us) tablet.cc:699] Row locks acquired
0810 11:30:25.506808 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:25.506862 (+ 54us) write_op.cc:270] Start()
0810 11:30:25.506920 (+ 58us) write_op.cc:276] Timestamp: P: 1786361425506842 usec, L: 0
0810 11:30:25.506925 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:25.507169 (+ 244us) log.cc:842] Serialized 631 byte log entry
0810 11:30:25.556068 (+ 48899us) op_driver.cc:444] REPLICATION: finished
0810 11:30:25.557185 (+ 1117us) write_op.cc:301] APPLY: starting
0810 11:30:25.557198 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:25.557235 (+ 37us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:25.557388 (+ 153us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:25.557519 (+ 131us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:25.557583 (+ 64us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:25.557589 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:25.557664 (+ 75us) log.cc:842] Serialized 29 byte log entry
0810 11:30:25.557716 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.557733 (+ 17us) write_op.cc:454] Released schema lock
0810 11:30:25.557739 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:25.557796 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.557800 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":18935168,"child_traces":[["op",{"apply.queue_time_us":1077,"apply.run_cpu_time_us":664,"apply.run_wall_time_us":664,"num_ops":2,"prepare.queue_time_us":1994,"prepare.run_cpu_time_us":917,"prepare.run_wall_time_us":916,"replication_time_us":49126}]]}
I20260810 11:30:25.574947 27362 master_service.cc:946] ReplaceTablet: received request to replace tablet fdbe21b4f124411988dd35a0b864f868 from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:25.594328 27228 ts_tablet_manager.cc:1397] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.777s user 0.008s sys 0.000s
I20260810 11:30:25.597198 27228 raft_consensus.cc:348] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.598944 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:25.599304 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:25.599560 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet 10210204d5ff4e5e97c98fd255f674a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:25.623010 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a1e2e624fff4692a22e29b293cd82d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:25.622625 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:25.625106 27866 raft_consensus.cc:482] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:25.625363 27866 raft_consensus.cc:504] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:25.628170 27866 leader_election.cc:288] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:25.587424 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 0bb01711769f457aa0696bb59582166d (DEFAULT_TABLE table=default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.630860 26890 tablet_service.cc:1514] Processing DeleteTablet for tablet 10210204d5ff4e5e97c98fd255f674a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:25.631364 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a1e2e624fff4692a22e29b293cd82d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:32816
W20260810 11:30:25.631901 26848 consensus_peers.cc:487] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:25.633980 27331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_6efb1e8e65fa4f88ae25c9d2ebc6b4f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:25.634405 27974 ts_tablet_manager.cc:1918] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:25.634626 27974 log.cc:1196] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/31888ddeafe14738b818016a9c0a4ad3
W20260810 11:30:25.635104 27331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6efb1e8e65fa4f88ae25c9d2ebc6b4f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:25.644912 27334 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_174d1e3073a34beabbd10fd4f6d61bd4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:25.647451 27974 ts_tablet_manager.cc:1939] T 31888ddeafe14738b818016a9c0a4ad3 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:25.649149 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 6) took 1468 ms. Trace:
I20260810 11:30:25.649297 27222 raft_consensus.cc:374] T fdbe21b4f124411988dd35a0b864f868 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:25.649653 27974 rpcz_store.cc:276] 0810 11:30:24.180286 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.181061 (+ 775us) service_pool.cc:227] Handling call
0810 11:30:25.052259 (+871198us) ts_tablet_manager.cc:1145] Deleting tablet 31888ddeafe14738b818016a9c0a4ad3
0810 11:30:25.052277 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.179467 (+127190us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.619913 (+440446us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.649103 (+ 29190us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":870676}
I20260810 11:30:25.650799 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 4) took 1470 ms. Trace:
I20260810 11:30:25.651476 27222 raft_consensus.cc:729] T fdbe21b4f124411988dd35a0b864f868 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:25.651938 27228 raft_consensus.cc:374] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:25.652117 27228 raft_consensus.cc:729] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:25.652673 27974 rpcz_store.cc:276] 0810 11:30:24.180016 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.181768 (+ 1752us) service_pool.cc:227] Handling call
0810 11:30:25.650528 (+1468760us) ts_tablet_manager.cc:1145] Deleting tablet fc558690dce44e999e55e9bf1b6ca172
0810 11:30:25.650563 (+ 35us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.650716 (+ 153us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1468391}
I20260810 11:30:25.653560 27228 consensus_queue.cc:260] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.654276 27974 tablet_replica.cc:330] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:25.654305 26890 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:25.654052 27222 consensus_queue.cc:260] T fdbe21b4f124411988dd35a0b864f868 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.654935 27974 raft_consensus.cc:2229] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:25.655213 27974 pending_rounds.cc:62] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d: Trying to abort 1 pending ops.
I20260810 11:30:25.655378 27974 pending_rounds.cc:68] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936391489298432 op_type: NO_OP noop_request { }
I20260810 11:30:25.655604 27974 raft_consensus.cc:2866] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:25.655829 27974 raft_consensus.cc:2258] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:25.656723 27974 ts_tablet_manager.cc:1905] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:25.657521 27222 ts_tablet_manager.cc:1428] T fdbe21b4f124411988dd35a0b864f868 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.104s user 0.004s sys 0.000s
I20260810 11:30:25.664023 27222 tablet_bootstrap.cc:492] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:25.667023 27222 tablet_bootstrap.cc:654] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:25.668475 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 101306us
I20260810 11:30:25.669370 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:25.670521 26890 tablet_service.cc:1514] Processing DeleteTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:25.671356 27228 ts_tablet_manager.cc:1428] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.072s user 0.003s sys 0.000s
I20260810 11:30:25.673038 27974 ts_tablet_manager.cc:1918] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:25.673353 27974 log.cc:1196] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/08f6636df13548c49f35e1808a87c1f5
I20260810 11:30:25.674113 27974 ts_tablet_manager.cc:1939] T 08f6636df13548c49f35e1808a87c1f5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:25.674767 27228 tablet_bootstrap.cc:492] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:25.675925 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 9) took 1494 ms. Trace:
I20260810 11:30:25.676142 27974 rpcz_store.cc:276] 0810 11:30:24.181292 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.182206 (+ 914us) service_pool.cc:227] Handling call
0810 11:30:25.653300 (+1471094us) ts_tablet_manager.cc:1145] Deleting tablet 08f6636df13548c49f35e1808a87c1f5
0810 11:30:25.653313 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.667416 (+ 14103us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.672813 (+ 5397us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.675855 (+ 3042us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1470848}
I20260810 11:30:25.676363 27999 ts_tablet_manager.cc:1918] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:25.681763 27999 log.cc:1196] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/31888ddeafe14738b818016a9c0a4ad3
I20260810 11:30:25.687238 27974 tablet_replica.cc:330] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:25.687556 27974 raft_consensus.cc:2229] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:25.687808 27974 raft_consensus.cc:2258] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:25.688544 27974 ts_tablet_manager.cc:1905] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:25.691720 27222 tablet_bootstrap.cc:492] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:25.691928 27222 ts_tablet_manager.cc:1397] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.001s
I20260810 11:30:25.693090 27222 raft_consensus.cc:348] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.693459 27222 raft_consensus.cc:374] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:25.693610 27222 raft_consensus.cc:729] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:25.699680 27999 ts_tablet_manager.cc:1939] T 31888ddeafe14738b818016a9c0a4ad3 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:25.704912 27222 consensus_queue.cc:260] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.708050 27222 ts_tablet_manager.cc:1428] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.016s user 0.003s sys 0.000s
I20260810 11:30:25.714293 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 8) took 1286 ms. Trace:
I20260810 11:30:25.716807 27974 ts_tablet_manager.cc:1918] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:25.717166 27974 log.cc:1196] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/7aa16654b7f34f9baf856bf724cece8f
I20260810 11:30:25.718207 27974 ts_tablet_manager.cc:1939] T 7aa16654b7f34f9baf856bf724cece8f P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:25.719094 27222 tablet_bootstrap.cc:492] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:25.719374 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 10) took 1537 ms. Trace:
I20260810 11:30:25.719507 27974 rpcz_store.cc:276] 0810 11:30:24.181504 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.319378 (+137874us) service_pool.cc:227] Handling call
0810 11:30:25.687119 (+1367741us) ts_tablet_manager.cc:1145] Deleting tablet 7aa16654b7f34f9baf856bf724cece8f
0810 11:30:25.687136 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.696185 (+ 9049us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.716609 (+ 20424us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.719294 (+ 2685us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1361738}
I20260810 11:30:25.719991 27974 tablet_replica.cc:330] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:25.727970 27974 raft_consensus.cc:2229] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:25.728384 27974 raft_consensus.cc:2258] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:25.723924 27222 tablet_bootstrap.cc:654] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:25.729182 27974 ts_tablet_manager.cc:1905] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:25.647437 27321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_5d3880885d6342738dd22e168d08e660"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:25.648423 27336 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_971ac96924ee4a09bc7bc1befdb296d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:25.650290 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 31888ddeafe14738b818016a9c0a4ad3 (table default.Table_5763dcd0b2ae40b4945a6966bfd23099 [id=9ec5a85bb4b34875b465a5ee221ab4f9]) successfully deleted
I20260810 11:30:25.702271 27322 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: default.Table_abbbb80ecbe4491d98912dcdcaab5dd3 [id=ba999b4084c84b2f8e0313b96849b169] alter complete (version 4)
I20260810 11:30:25.702419 27326 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda] alter complete (version 1)
I20260810 11:30:25.739126 27974 ts_tablet_manager.cc:1918] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:25.739358 27974 log.cc:1196] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/5adcec593b8c4d40997c8911e9f77c85
I20260810 11:30:25.740209 27974 ts_tablet_manager.cc:1939] T 5adcec593b8c4d40997c8911e9f77c85 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:25.741843 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 12) took 1422 ms. Trace:
I20260810 11:30:25.742013 27974 rpcz_store.cc:276] 0810 11:30:24.319596 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.319645 (+ 49us) service_pool.cc:227] Handling call
0810 11:30:25.719832 (+1400187us) ts_tablet_manager.cc:1145] Deleting tablet 5adcec593b8c4d40997c8911e9f77c85
0810 11:30:25.719845 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.734621 (+ 14776us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.738824 (+ 4203us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.741762 (+ 2938us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":25,"tablet-delete.queue_time_us":1394447}
I20260810 11:30:25.742484 27974 tablet_replica.cc:330] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
W20260810 11:30:25.742727 27336 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_971ac96924ee4a09bc7bc1befdb296d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:25.742789 27974 raft_consensus.cc:2229] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:25.743013 27974 raft_consensus.cc:2258] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:25.743804 27974 ts_tablet_manager.cc:1905] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:25.748700 27321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d3880885d6342738dd22e168d08e660 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:25.749050 27290 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 87239.3us
W20260810 11:30:25.749681 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet fc558690dce44e999e55e9bf1b6ca172 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc558690dce44e999e55e9bf1b6ca172 already in progress: creating tablet
I20260810 11:30:25.750034 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 08f6636df13548c49f35e1808a87c1f5 (table default.Table_ea17bd161fdb4c2c9603590515c75bf4 [id=66896ad6c415489da386ea5ab2702ad6]) successfully deleted
I20260810 11:30:25.750247 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 7aa16654b7f34f9baf856bf724cece8f (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]) successfully deleted
I20260810 11:30:25.750424 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 5adcec593b8c4d40997c8911e9f77c85 (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]) successfully deleted
I20260810 11:30:25.750357 26733 tablet_service.cc:1467] Processing CreateTablet for tablet 00e63f994ff84941852b0cfee763c303 (DEFAULT_TABLE table=default.Table_b2381e8587204bffa96b34e428682d5d [id=d4074ee00ab24054b4121d5c9c74d9a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.750850 26733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00e63f994ff84941852b0cfee763c303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.752952 26748 tablet_service.cc:1467] Processing CreateTablet for tablet ba9d15002e6a40f58a7be07f46e7c328 (DEFAULT_TABLE table=default.Table_d4313ebe5ce04c1aa10d064712cbf3ab [id=5f6080c52e46443e9b4ba99dd4352b12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.753475 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba9d15002e6a40f58a7be07f46e7c328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.651381 27319 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_b15d6127087043a186b912230d2fe666"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:25.754787 27319 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b15d6127087043a186b912230d2fe666 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:25.697788 28093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.195.253:34547 every 8 connection(s)
I20260810 11:30:25.762763 27747 rpc_server.cc:307] RPC server started. Bound to: 127.25.195.253:34547
I20260810 11:30:25.765422 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet 10210204d5ff4e5e97c98fd255f674a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:25.766522 27718 consensus_queue.cc:1035] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.176s
W20260810 11:30:25.776119 26993 leader_election.cc:341] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:25.777570 27974 ts_tablet_manager.cc:1918] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:25.777783 27974 log.cc:1196] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/f3884736eec74c8992b8d51b37465875
I20260810 11:30:25.778277 27974 ts_tablet_manager.cc:1939] T f3884736eec74c8992b8d51b37465875 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:25.779121 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 11) took 1459 ms. Trace:
I20260810 11:30:25.779264 27974 rpcz_store.cc:276] 0810 11:30:24.319453 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.320904 (+ 1451us) service_pool.cc:227] Handling call
0810 11:30:25.742404 (+1421500us) ts_tablet_manager.cc:1145] Deleting tablet f3884736eec74c8992b8d51b37465875
0810 11:30:25.742420 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.749952 (+ 7532us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.777411 (+ 27459us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.779051 (+ 1640us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1416935}
I20260810 11:30:25.779624 27974 tablet_replica.cc:330] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:25.779850 27974 raft_consensus.cc:2229] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:25.781198 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:25.781776 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:25.782294 27033 tablet_service.cc:1467] Processing CreateTablet for tablet 00e63f994ff84941852b0cfee763c303 (DEFAULT_TABLE table=default.Table_b2381e8587204bffa96b34e428682d5d [id=d4074ee00ab24054b4121d5c9c74d9a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.782506 27999 rpcz_store.cc:276] 0810 11:30:24.427700 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.428094 (+ 394us) service_pool.cc:227] Handling call
0810 11:30:25.295063 (+866969us) ts_tablet_manager.cc:1145] Deleting tablet 31888ddeafe14738b818016a9c0a4ad3
0810 11:30:25.295077 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.358999 (+ 63922us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.627367 (+268368us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.714247 (+ 86880us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":865253}
I20260810 11:30:25.782790 27033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00e63f994ff84941852b0cfee763c303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.783358 27248 ts_tablet_manager.cc:1918] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:25.783550 27248 log.cc:1196] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/ec788db5b0ca40f1811b6660276d0254
I20260810 11:30:25.784118 27248 ts_tablet_manager.cc:1939] T ec788db5b0ca40f1811b6660276d0254 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:25.784889 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:25.784986 27999 tablet_replica.cc:330] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:25.784933 27031 tablet_service.cc:1467] Processing CreateTablet for tablet ba9d15002e6a40f58a7be07f46e7c328 (DEFAULT_TABLE table=default.Table_d4313ebe5ce04c1aa10d064712cbf3ab [id=5f6080c52e46443e9b4ba99dd4352b12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.785311 27999 raft_consensus.cc:2229] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:25.785395 27031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba9d15002e6a40f58a7be07f46e7c328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.785720 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet f3884736eec74c8992b8d51b37465875 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]) successfully deleted
I20260810 11:30:25.785871 27999 raft_consensus.cc:2258] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:25.786628 27999 ts_tablet_manager.cc:1905] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:25.792668 28007 raft_consensus.cc:482] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:25.792945 28007 raft_consensus.cc:504] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.793704 28007 leader_election.cc:288] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:25.798425 27911 consensus_queue.cc:1035] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:25.802704 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 334) took 5422 ms. Trace:
I20260810 11:30:25.802906 27248 rpcz_store.cc:276] 0810 11:30:20.380496 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:20.380617 (+ 121us) service_pool.cc:227] Handling call
0810 11:30:25.467367 (+5086750us) ts_tablet_manager.cc:1145] Deleting tablet ec788db5b0ca40f1811b6660276d0254
0810 11:30:25.467379 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.511527 (+ 44148us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.783223 (+271696us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.802527 (+ 19304us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5086428}
W20260810 11:30:25.803256 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 334) could send its response
I20260810 11:30:25.803836 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 345) took 4721 ms. Trace:
I20260810 11:30:25.803977 27248 rpcz_store.cc:276] 0810 11:30:21.082130 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:21.082229 (+ 99us) service_pool.cc:227] Handling call
0810 11:30:25.803523 (+4721294us) ts_tablet_manager.cc:1145] Deleting tablet 8228600e3f6b4f9993dd25e4ceb57e4d
0810 11:30:25.803547 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.803683 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4709886}
W20260810 11:30:25.804261 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 345) could send its response
W20260810 11:30:25.804415 26993 consensus_peers.cc:487] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3884736eec74c8992b8d51b37465875. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:25.804948 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 346) took 4720 ms. Trace:
I20260810 11:30:25.805271 27248 rpcz_store.cc:276] 0810 11:30:21.084524 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:21.084676 (+ 152us) service_pool.cc:227] Handling call
0810 11:30:25.804599 (+4719923us) ts_tablet_manager.cc:1145] Deleting tablet f6e264e8507446809f3c386fdb3c34ae
0810 11:30:25.804612 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.804817 (+ 205us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":162,"tablet-delete.queue_time_us":4710041}
W20260810 11:30:25.805787 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 346) could send its response
I20260810 11:30:25.808223 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 347) took 4721 ms. Trace:
I20260810 11:30:25.809283 27248 rpcz_store.cc:276] 0810 11:30:21.086467 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:21.086582 (+ 115us) service_pool.cc:227] Handling call
0810 11:30:25.806479 (+4719897us) ts_tablet_manager.cc:1145] Deleting tablet 1aa4562a2247405187d9dbd1baa48f39
0810 11:30:25.806496 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.807329 (+ 833us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":272,"tablet-delete.queue_time_us":4711929}
I20260810 11:30:25.813674 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b15cc8669b549a2b4461dccd66a0c5a" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:25.814118 26762 raft_consensus.cc:2454] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:25.816113 26993 leader_election.cc:302] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:25.814374 27974 raft_consensus.cc:2258] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:25.819430 27718 raft_consensus.cc:2781] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:25.819576 27718 raft_consensus.cc:482] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:25.819746 27718 raft_consensus.cc:3037] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:25.822602 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 347) could send its response
W20260810 11:30:25.825489 27334 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_174d1e3073a34beabbd10fd4f6d61bd4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:25.826395 27222 tablet_bootstrap.cc:492] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:25.826642 27222 ts_tablet_manager.cc:1397] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.108s user 0.006s sys 0.006s
I20260810 11:30:25.827091 27718 raft_consensus.cc:504] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.827744 27222 raft_consensus.cc:348] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.828101 27222 raft_consensus.cc:374] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:25.828209 27222 raft_consensus.cc:729] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:25.829109 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b15cc8669b549a2b4461dccd66a0c5a" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:25.829340 26762 raft_consensus.cc:3037] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:25.829514 27974 ts_tablet_manager.cc:1905] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:25.830999 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 348) took 4727 ms. Trace:
I20260810 11:30:25.831138 27248 rpcz_store.cc:276] 0810 11:30:21.095437 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:21.095552 (+ 115us) service_pool.cc:227] Handling call
0810 11:30:25.822567 (+4727015us) ts_tablet_manager.cc:1145] Deleting tablet 603fe104b7ab485eab6b225a58bddc1c
0810 11:30:25.822585 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.822726 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4724382}
W20260810 11:30:25.831458 26994 connection.cc:441] server connection from 127.0.0.1:35790 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35790 (request call id 348) could send its response
I20260810 11:30:25.832056 27231 tablet_bootstrap.cc:492] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:25.832255 27231 ts_tablet_manager.cc:1397] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.327s user 0.007s sys 0.022s
I20260810 11:30:25.833199 26762 raft_consensus.cc:2454] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:25.833316 27231 raft_consensus.cc:348] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.833698 27231 raft_consensus.cc:374] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:25.833900 26993 leader_election.cc:302] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:25.833959 27231 raft_consensus.cc:729] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:25.834260 27911 raft_consensus.cc:2781] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:25.834523 27911 raft_consensus.cc:686] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:25.834908 27911 consensus_queue.cc:237] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.841193 27718 leader_election.cc:288] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:25.840839 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 0) took 1573 ms. Trace:
W20260810 11:30:25.727705 26849 leader_election.cc:341] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 7bd67ebf23694ae7b0ede6c5d1a06f88
W20260810 11:30:25.841892 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 114194us
I20260810 11:30:25.843253 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet 2801709d53614916abac370f7ae5e913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:25.845705 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 31888ddeafe14738b818016a9c0a4ad3 (table default.Table_5763dcd0b2ae40b4945a6966bfd23099 [id=9ec5a85bb4b34875b465a5ee221ab4f9]) successfully deleted
I20260810 11:30:25.730468 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bb01711769f457aa0696bb59582166d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:25.730579 26848 leader_election.cc:341] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:25.841553 27248 rpcz_store.cc:276] 0810 11:30:24.258509 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.258584 (+ 75us) service_pool.cc:227] Handling call
0810 11:30:25.831751 (+1573167us) ts_tablet_manager.cc:1145] Deleting tablet f7ada1df82eb44ecb9a6c615b5410e6f
0810 11:30:25.831761 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.831899 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1572869}
I20260810 11:30:25.848734 26848 leader_election.cc:302] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:25.849133 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 1) took 1590 ms. Trace:
W20260810 11:30:25.849203 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet f7ada1df82eb44ecb9a6c615b5410e6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7ada1df82eb44ecb9a6c615b5410e6f already in progress: creating tablet
W20260810 11:30:25.849439 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 180109us
I20260810 11:30:25.849255 27248 rpcz_store.cc:276] 0810 11:30:24.259055 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.259105 (+ 50us) service_pool.cc:227] Handling call
0810 11:30:25.848908 (+1589803us) ts_tablet_manager.cc:1145] Deleting tablet 110b5acc36bd4d6bba13735e5daec75f
0810 11:30:25.848925 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.849057 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1589541}
I20260810 11:30:25.849998 27718 consensus_queue.cc:1035] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:25.850168 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 110b5acc36bd4d6bba13735e5daec75f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 110b5acc36bd4d6bba13735e5daec75f already in progress: creating tablet
I20260810 11:30:25.852967 27228 tablet_bootstrap.cc:654] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:25.853780 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 3) took 1589 ms. Trace:
I20260810 11:30:25.854647 28094 raft_consensus.cc:2726] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:25.856858 27222 consensus_queue.cc:260] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.868463 26383 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu as pid 27747
I20260810 11:30:25.884367 27222 ts_tablet_manager.cc:1428] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.042s user 0.002s sys 0.003s
I20260810 11:30:25.884964 27222 tablet_bootstrap.cc:492] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:25.718364 27318 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 372b49dc083d46538442fcbfdfeb3545 consensus state has no leader
W20260810 11:30:25.884395 27326 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 65756c37fe514194bebe76921419653c consensus state has no leader
W20260810 11:30:25.888520 27318 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet b4a37afa17d04e3181e7513ac8d23c24 consensus state has no leader
I20260810 11:30:25.889366 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:25.890036 27248 rpcz_store.cc:276] 0810 11:30:24.263087 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.263478 (+ 391us) service_pool.cc:227] Handling call
0810 11:30:25.849881 (+1586403us) ts_tablet_manager.cc:1145] Deleting tablet 3ae27bf110114b70a3e3f6cf64f31b98
0810 11:30:25.852250 (+ 2369us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.852961 (+ 711us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1586065}
I20260810 11:30:25.890846 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 4) took 1627 ms. Trace:
I20260810 11:30:25.890996 27248 rpcz_store.cc:276] 0810 11:30:24.263250 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.263923 (+ 673us) service_pool.cc:227] Handling call
0810 11:30:25.890596 (+1626673us) ts_tablet_manager.cc:1145] Deleting tablet 318d5b8453fe4c438d0fa32cb91c409e
0810 11:30:25.890612 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.890765 (+ 153us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1626322}
I20260810 11:30:25.891824 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 5) took 1627 ms. Trace:
I20260810 11:30:25.892086 27248 rpcz_store.cc:276] 0810 11:30:24.264576 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.264631 (+ 55us) service_pool.cc:227] Handling call
0810 11:30:25.891550 (+1626919us) ts_tablet_manager.cc:1145] Deleting tablet fc558690dce44e999e55e9bf1b6ca172
0810 11:30:25.891565 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.891721 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1618574}
I20260810 11:30:25.892902 27248 tablet_replica.cc:330] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:25.867805 27747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data/info.pb
W20260810 11:30:25.890671 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 3ae27bf110114b70a3e3f6cf64f31b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae27bf110114b70a3e3f6cf64f31b98 already in progress: creating tablet
I20260810 11:30:25.912459 27248 raft_consensus.cc:2229] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:25.913120 27248 raft_consensus.cc:2258] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:25.914036 27248 ts_tablet_manager.cc:1905] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:25.907662 27319 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 72) took 1107 ms. Trace:
I20260810 11:30:25.908246 27362 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet fdbe21b4f124411988dd35a0b864f868
I20260810 11:30:25.923794 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet fc558690dce44e999e55e9bf1b6ca172 with delete_type TABLET_DATA_DELETED (replaced by tablet 0bb01711769f457aa0696bb59582166d) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:25.927953 27974 ts_tablet_manager.cc:1918] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:25.928601 27974 log.cc:1196] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/725d2e70e1d441b497d56a278e1de0ad
I20260810 11:30:25.929519 27974 ts_tablet_manager.cc:1939] T 725d2e70e1d441b497d56a278e1de0ad P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:25.932400 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet fdbe21b4f124411988dd35a0b864f868 with delete_type TABLET_DATA_DELETED (replaced by tablet f756689d4c99489885a0cd59f84a6e8a) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:25.934077 28103 tablet.cc:1722] T d722b93fe27f4c08a592bc393046b6bd P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 11:30:25.939170 27974 tablet_replica.cc:330] T fdbe21b4f124411988dd35a0b864f868 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:25.939625 27974 raft_consensus.cc:2229] T fdbe21b4f124411988dd35a0b864f868 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:25.940615 27974 raft_consensus.cc:2258] T fdbe21b4f124411988dd35a0b864f868 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:25.898914 28102 tablet.cc:1722] T d722b93fe27f4c08a592bc393046b6bd P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 11:30:25.894513 27231 consensus_queue.cc:260] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.950234 27231 ts_tablet_manager.cc:1428] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.118s user 0.003s sys 0.000s
I20260810 11:30:25.950654 27231 tablet_bootstrap.cc:492] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:25.952886 27231 tablet_bootstrap.cc:654] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:25.955693 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 725d2e70e1d441b497d56a278e1de0ad (table default.Table_59ed990b31964d6080614081ee46a6de [id=6d8fc88a491140548a45c7fbb403bb36]) successfully deleted
I20260810 11:30:25.956473 27362 catalog_manager.cc:6565] ReplaceTablet: tablet fdbe21b4f124411988dd35a0b864f868 deleted and replaced by tablet f756689d4c99489885a0cd59f84a6e8a
I20260810 11:30:25.957261 27222 tablet_bootstrap.cc:654] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:25.957207 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 318d5b8453fe4c438d0fa32cb91c409e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 318d5b8453fe4c438d0fa32cb91c409e already in progress: creating tablet
W20260810 11:30:25.957638 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet fc558690dce44e999e55e9bf1b6ca172 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc558690dce44e999e55e9bf1b6ca172 already in progress: creating tablet
W20260810 11:30:25.958853 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 256ad2e2d8e54a4caa1b5091bab60dd5 already in progress: creating tablet
W20260810 11:30:25.959688 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet d000f0ebaf0049a7bdaad93e307e16e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d000f0ebaf0049a7bdaad93e307e16e2 already in progress: creating tablet
W20260810 11:30:25.959978 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 10210204d5ff4e5e97c98fd255f674a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10210204d5ff4e5e97c98fd255f674a5 already in progress: creating tablet
W20260810 11:30:25.964860 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 already in progress: creating tablet
W20260810 11:30:25.965304 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 8a1e2e624fff4692a22e29b293cd82d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a1e2e624fff4692a22e29b293cd82d6 already in progress: creating tablet
I20260810 11:30:25.965737 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587c6ce242c0411b886404a0df03b1bb" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:25.966133 27999 ts_tablet_manager.cc:1918] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:25.966583 27033 tablet_service.cc:1514] Processing DeleteTablet for tablet fdbe21b4f124411988dd35a0b864f868 with delete_type TABLET_DATA_DELETED (replaced by tablet f756689d4c99489885a0cd59f84a6e8a) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:25.952656 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 00e63f994ff84941852b0cfee763c303 (DEFAULT_TABLE table=default.Table_b2381e8587204bffa96b34e428682d5d [id=d4074ee00ab24054b4121d5c9c74d9a4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:25.967334 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 34bd3c0edf6b49d1891c0ee9af344872 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34bd3c0edf6b49d1891c0ee9af344872 already in progress: creating tablet
W20260810 11:30:25.956872 27318 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet a87f6835f0dc4ad4b3a23b297726100d (table default.Table_cbf7fb0f0585465a9be24fa7e70d68d2 [id=82041e96f8de4fae85baf690bbbfc7a3], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a87f6835f0dc4ad4b3a23b297726100d consensus state has no leader
W20260810 11:30:25.967650 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet fc558690dce44e999e55e9bf1b6ca172 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc558690dce44e999e55e9bf1b6ca172 already in progress: creating tablet
I20260810 11:30:25.971614 26916 raft_consensus.cc:3037] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:25.971642 26878 tablet_service.cc:1467] Processing CreateTablet for tablet ba9d15002e6a40f58a7be07f46e7c328 (DEFAULT_TABLE table=default.Table_d4313ebe5ce04c1aa10d064712cbf3ab [id=5f6080c52e46443e9b4ba99dd4352b12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:25.974581 26890 tablet_service.cc:1514] Processing DeleteTablet for tablet 3851d39aeb3142938a5ac558ab438c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:25.975072 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 0938a2f3688246a2b46978eeb7d5d521 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:25.975298 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet b7a3b877457c4a2489d397f3f864d6b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:25.975544 26882 tablet_service.cc:1514] Processing DeleteTablet for tablet 49db12565dbc4187b78a98ed35c40fed with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1e46f80f7f4e3a84638421892e6236) from {username='slave'} at 127.0.0.1:50850
W20260810 11:30:25.976485 27326 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a consensus state has no leader
I20260810 11:30:25.960490 27319 rpcz_store.cc:276] 0810 11:30:24.800021 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.552084 (+752063us) service_pool.cc:227] Handling call
0810 11:30:25.651214 (+ 99130us) spinlock_profiling.cc:243] Waited 98.7 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dc313 00007f55f09ce466 00007f55f09ce195 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:25.754904 (+103690us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:25.755497 (+ 593us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:25.863144 (+107647us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:25.907455 (+ 44311us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:25.907575 (+ 120us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:25.855236 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:25.855415 (+ 179us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:25.855425 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:25.855430 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:25.855607 (+ 177us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:25.855628 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:25.855636 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:25.855831 (+ 195us) tablet.cc:699] Row locks acquired
0810 11:30:25.855835 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:25.855895 (+ 60us) write_op.cc:270] Start()
0810 11:30:25.855948 (+ 53us) write_op.cc:276] Timestamp: P: 1786361425855841 usec, L: 0
0810 11:30:25.855955 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:25.856277 (+ 322us) log.cc:842] Serialized 433 byte log entry
0810 11:30:25.861816 (+ 5539us) op_driver.cc:444] REPLICATION: finished
0810 11:30:25.861943 (+ 127us) write_op.cc:301] APPLY: starting
0810 11:30:25.861963 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:25.862013 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:25.862044 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:25.862251 (+ 207us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:25.862294 (+ 43us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:25.862300 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:25.862547 (+ 247us) log.cc:842] Serialized 29 byte log entry
0810 11:30:25.862638 (+ 91us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.862660 (+ 22us) write_op.cc:454] Released schema lock
0810 11:30:25.862668 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:25.862740 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.862743 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":227122560,"child_traces":[["op",{"apply.queue_time_us":37,"apply.run_cpu_time_us":790,"apply.run_wall_time_us":883,"num_ops":2,"prepare.queue_time_us":99045,"prepare.run_cpu_time_us":1229,"prepare.run_wall_time_us":1228,"raft.queue_time_us":483,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":340,"replication_time_us":5824}]]}
I20260810 11:30:25.979913 27319 master_service.cc:946] ReplaceTablet: received request to replace tablet db59523b71224370bf5fce6b56592f71 from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:25.980121 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d5e146eeec4fe0be33c1c169d32e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:25.980618 27999 log.cc:1196] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/a28849649c704f2fbdec1aced9ce01b1
I20260810 11:30:25.976621 27362 master_service.cc:946] ReplaceTablet: received request to replace tablet 7d3406f12d9c492cbd0d86fa7a57de82 from {username='slave'} at 127.0.0.1:49152
W20260810 11:30:25.970466 27318 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet db59523b71224370bf5fce6b56592f71 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet db59523b71224370bf5fce6b56592f71 consensus state has no leader
W20260810 11:30:25.985559 27326 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_e33c9849bbd34e6b9b72e69fd3a1ab1c [id=b206753d4f4142be82ee28150226bd53], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 9e329b95fc8e41c3967079896294942a consensus state has no leader
I20260810 11:30:25.986460 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:32816
W20260810 11:30:25.987260 27326 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0], current schema version=4): Not found: failed to reset TS proxy: No leader found: Tablet 1f64d4b9320c4cb39f57573d781a47d3 consensus state has no leader
I20260810 11:30:25.987612 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b5a7f67ec5b48c2b5a510add0282a76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:25.987762 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 2634beb347714fc7a2e05865adb34a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:25.988008 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet b28f3dcbd6d74559b372d3452e13ce9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:25.990448 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00e63f994ff84941852b0cfee763c303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:25.992529 28065 raft_consensus.cc:482] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:25.992749 28065 raft_consensus.cc:504] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:25.993573 28065 leader_election.cc:288] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:25.993934 27326 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 39beb126ac324842b7e387c46bcb4099 consensus state has no leader
W20260810 11:30:25.994176 27326 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 720ef9404cb44551aaf39687f0cf94c9 consensus state has no leader
W20260810 11:30:25.994367 27326 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet d512c335e340437fa32f2dc16dca6812 consensus state has no leader
I20260810 11:30:25.994506 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed0e2bead85466ca99cfb34e155a391" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:25.994799 27061 raft_consensus.cc:2454] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
W20260810 11:30:25.995056 27326 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a45422addab84e9083df8665a0cf9322 consensus state has no leader
W20260810 11:30:25.995380 27326 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 00c4599256684f5dbc745c9283f31a08 consensus state has no leader
I20260810 11:30:25.995628 26702 leader_election.cc:302] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:25.996352 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet 64818ca5827e41d99428903ddb8688d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:25.996536 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ada1df82eb44ecb9a6c615b5410e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:32816
W20260810 11:30:25.986775 27318 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 5deec04c1be64473accf8b9df14bd22e consensus state has no leader
I20260810 11:30:25.997756 27763 raft_consensus.cc:2781] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:25.997872 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 318d5b8453fe4c438d0fa32cb91c409e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:25.997951 27763 raft_consensus.cc:482] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:25.998154 27763 raft_consensus.cc:3037] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:26.000015 26877 tablet_service.cc:1514] Processing DeleteTablet for tablet fdbe21b4f124411988dd35a0b864f868 with delete_type TABLET_DATA_DELETED (replaced by tablet f756689d4c99489885a0cd59f84a6e8a) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.000517 27999 ts_tablet_manager.cc:1939] T a28849649c704f2fbdec1aced9ce01b1 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:26.001056 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba9d15002e6a40f58a7be07f46e7c328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.002319 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 834c9c99ec424bb39e8a003e9204b2bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.002411 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.002390 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 3) took 1573 ms. Trace:
I20260810 11:30:26.002612 27999 rpcz_store.cc:276] 0810 11:30:24.427087 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.427979 (+ 892us) service_pool.cc:227] Handling call
0810 11:30:25.784896 (+1356917us) ts_tablet_manager.cc:1145] Deleting tablet a28849649c704f2fbdec1aced9ce01b1
0810 11:30:25.784911 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:25.852759 (+ 67848us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:25.939276 (+ 86517us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:26.001013 (+ 61737us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1354893}
I20260810 11:30:26.002931 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet ac4b1821ac30452cbe7a8f844d9b37e5 with delete_type TABLET_DATA_DELETED (replaced by tablet a45422addab84e9083df8665a0cf9322) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.003751 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet a8a65a0e8b1f4e4b8d9a82059b766cda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.004009 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 83631b421a614796bdf76335f1437e00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.003999 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.004652 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet f2b555f18c1e485d9af7b08f98543c80 with delete_type TABLET_DATA_DELETED (replaced by tablet 1801d3af4a4548dba8b0d8ea2fecf5ba) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.004719 26877 tablet_service.cc:1514] Processing DeleteTablet for tablet f6e264e8507446809f3c386fdb3c34ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.004818 27763 raft_consensus.cc:504] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.006218 27763 leader_election.cc:288] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:26.006794 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed0e2bead85466ca99cfb34e155a391" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:26.007077 27061 raft_consensus.cc:3037] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:26.006451 27318 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet bd6b328baa2346afbbe9f513ae4db3df consensus state has no leader
W20260810 11:30:26.008535 27322 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 983916da755d4d14b7a3d43bb7cbc9c4 consensus state has no leader
I20260810 11:30:26.009143 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:33500
W20260810 11:30:26.009555 27322 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 760aeada57464892ae3b9013a761c509 consensus state has no leader
W20260810 11:30:26.009790 27322 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 6c715bdcff8c4cdabfddf871f6fdc388 consensus state has no leader
I20260810 11:30:26.010176 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet 110b5acc36bd4d6bba13735e5daec75f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.010393 27061 raft_consensus.cc:2454] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:26.010768 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet b7a3b877457c4a2489d397f3f864d6b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:33500
W20260810 11:30:26.010774 27322 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a3079a68c1c74b64bf13877bd0ee68c3 consensus state has no leader
I20260810 11:30:26.010958 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 0033d61d07d84262a98b0ebc54bd7960 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.011121 26702 leader_election.cc:302] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:26.011224 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fc76603bf8843dab18c95fdab9a8be0 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ffc2c43885841d2a6a4cce52eaf7129) from {username='slave'} at 127.0.0.1:33500
W20260810 11:30:26.011325 27322 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet cd3575197c464c7fb51f9592831959bb consensus state has no leader
I20260810 11:30:26.011420 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet ac4b1821ac30452cbe7a8f844d9b37e5 with delete_type TABLET_DATA_DELETED (replaced by tablet a45422addab84e9083df8665a0cf9322) from {username='slave'} at 127.0.0.1:33500
W20260810 11:30:26.012410 27322 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 72209a805e3e4b4ea1bf99508e0f75db consensus state has no leader
I20260810 11:30:26.014042 27763 raft_consensus.cc:2781] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:26.014811 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet a18cb43b4dc04a1290a6bade7ac1f3cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.015146 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet db5adccd80a04e328e13793b461c38b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.015420 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 60d56e162b4b41e2867ac845e524aca4 with delete_type TABLET_DATA_DELETED (replaced by tablet 10210204d5ff4e5e97c98fd255f674a5) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.015688 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.016103 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 49db12565dbc4187b78a98ed35c40fed with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1e46f80f7f4e3a84638421892e6236) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.016330 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.016752 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e0a8513171f4c39b74c08760a139d9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.017000 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet 0938a2f3688246a2b46978eeb7d5d521 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.017225 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 7eae49e1c6554ba2ae831831ff4bb45c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.017632 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet f6e264e8507446809f3c386fdb3c34ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.018049 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.018290 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet 9311943eebaa4824bde96b4cb09f1e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.018798 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.018841 27763 raft_consensus.cc:686] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:26.019201 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet db5adccd80a04e328e13793b461c38b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.019219 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet 70f6017d4d01463398cb347779dacf90 with delete_type TABLET_DATA_DELETED (replaced by tablet 110b5acc36bd4d6bba13735e5daec75f) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.019294 27763 consensus_queue.cc:237] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.019660 26882 tablet_service.cc:1514] Processing DeleteTablet for tablet f3884736eec74c8992b8d51b37465875 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f64d4b9320c4cb39f57573d781a47d3) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.019865 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet ec788db5b0ca40f1811b6660276d0254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.020123 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.020498 27999 tablet_replica.cc:330] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:26.020540 26882 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.020517 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet eb51618d37ac488fa7e3d23e5f85ec36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.020709 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet 2917f1ffb5214a80b19810540602df35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.020905 27999 raft_consensus.cc:2229] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:26.021044 27033 tablet_service.cc:1514] Processing DeleteTablet for tablet b28f3dcbd6d74559b372d3452e13ce9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.021528 26916 raft_consensus.cc:2454] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:26.021572 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet 7eae49e1c6554ba2ae831831ff4bb45c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.023164 27974 ts_tablet_manager.cc:1905] T fdbe21b4f124411988dd35a0b864f868 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:26.023521 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet a28849649c704f2fbdec1aced9ce01b1 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]) successfully deleted
I20260810 11:30:26.026512 26877 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bd67ebf23694ae7b0ede6c5d1a06f88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.027963 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.028102 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed0e2bead85466ca99cfb34e155a391" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:26.032459 27750 consensus_queue.cc:1035] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:26.034274 26991 leader_election.cc:341] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 4b15cc8669b549a2b4461dccd66a0c5a
W20260810 11:30:26.034813 26991 leader_election.cc:341] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 4b15cc8669b549a2b4461dccd66a0c5a
I20260810 11:30:26.037737 26991 leader_election.cc:302] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:26.038304 27750 raft_consensus.cc:2781] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:26.038585 27750 raft_consensus.cc:686] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:26.038879 27750 consensus_queue.cc:237] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:26.039785 27326 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e8dc3dece9d84d47a638707d10de6fd4 consensus state has no leader
W20260810 11:30:26.040514 27326 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 83992214ba314d3fa674e00d8eaddec6 consensus state has no leader
I20260810 11:30:26.045821 27231 tablet_bootstrap.cc:492] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:26.046573 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed0e2bead85466ca99cfb34e155a391" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:26.045440 27318 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 1801d3af4a4548dba8b0d8ea2fecf5ba consensus state has no leader
I20260810 11:30:26.048194 27231 ts_tablet_manager.cc:1397] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.098s user 0.000s sys 0.005s
W20260810 11:30:26.049468 26991 consensus_peers.cc:487] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 31888ddeafe14738b818016a9c0a4ad3. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:26.053243 27999 raft_consensus.cc:2258] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:26.054008 27321 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 74) took 1239 ms. Trace:
I20260810 11:30:26.054205 27321 rpcz_store.cc:276] 0810 11:30:24.814957 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.560538 (+745581us) service_pool.cc:227] Handling call
0810 11:30:25.647098 (+ 86560us) spinlock_profiling.cc:243] Waited 73.6 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dc313 00007f55f09ce466 00007f55f09ce195 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:25.748884 (+101786us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:25.780261 (+ 31377us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:25.868629 (+ 88368us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:26.053792 (+185163us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:26.053944 (+ 152us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:25.856449 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:25.856581 (+ 132us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:25.856586 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:25.856588 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:25.856700 (+ 112us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:25.856713 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:25.856721 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:25.856822 (+ 101us) tablet.cc:699] Row locks acquired
0810 11:30:25.856826 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:25.856864 (+ 38us) write_op.cc:270] Start()
0810 11:30:25.856894 (+ 30us) write_op.cc:276] Timestamp: P: 1786361425856818 usec, L: 0
0810 11:30:25.856900 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:25.857134 (+ 234us) log.cc:842] Serialized 433 byte log entry
0810 11:30:25.865843 (+ 8709us) op_driver.cc:444] REPLICATION: finished
0810 11:30:25.867645 (+ 1802us) write_op.cc:301] APPLY: starting
0810 11:30:25.867665 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:25.867707 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:25.867749 (+ 42us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:25.867866 (+ 117us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:25.867904 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:25.867914 (+ 10us) write_op.cc:312] APPLY: finished
0810 11:30:25.868003 (+ 89us) log.cc:842] Serialized 29 byte log entry
0810 11:30:25.868293 (+ 290us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.868314 (+ 21us) write_op.cc:454] Released schema lock
0810 11:30:25.868321 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:25.868387 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.868390 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":169236352,"child_traces":[["op",{"apply.queue_time_us":1730,"apply.run_cpu_time_us":600,"apply.run_wall_time_us":811,"mutex_wait_us":74316,"num_ops":2,"prepare.queue_time_us":75588,"prepare.run_cpu_time_us":758,"prepare.run_wall_time_us":757,"replication_time_us":8912}]]}
I20260810 11:30:26.055922 27321 master_service.cc:946] ReplaceTablet: received request to replace tablet d729baae40a64e6e8c23e6870f230afb from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:26.059158 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (DEFAULT_TABLE table=default.Table_a827339eadbd440bb3c0bfa6c52512ca [id=b457cccecbf24d6dab4e74bf16bb68eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.059927 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bfed03f765f4c5aa77604ebf2e211b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.060986 27031 tablet_service.cc:1467] Processing CreateTablet for tablet 518c777e40ec40dcb3484c0374384959 (DEFAULT_TABLE table=default.Table_0d634c04e624422da8830e84abf1339f [id=eefabebedc4b4002b527bea100cc632e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.062335 27031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 518c777e40ec40dcb3484c0374384959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.062901 27334 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 73) took 1248 ms. Trace:
I20260810 11:30:26.063956 27334 rpcz_store.cc:276] 0810 11:30:24.814256 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.554789 (+740533us) service_pool.cc:227] Handling call
0810 11:30:25.644727 (+ 89938us) spinlock_profiling.cc:243] Waited 89.5 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dc313 00007f55f09ce466 00007f55f09ce195 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:25.908073 (+263346us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:25.908887 (+ 814us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:25.979821 (+ 70934us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:26.062668 (+ 82847us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:26.062812 (+ 144us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:25.909602 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:25.909779 (+ 177us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:25.909786 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:25.909789 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:25.909908 (+ 119us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:25.909926 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:25.909932 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:25.910028 (+ 96us) tablet.cc:699] Row locks acquired
0810 11:30:25.910031 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:25.910074 (+ 43us) write_op.cc:270] Start()
0810 11:30:25.910114 (+ 40us) write_op.cc:276] Timestamp: P: 1786361425910020 usec, L: 0
0810 11:30:25.910119 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:25.910333 (+ 214us) log.cc:842] Serialized 433 byte log entry
0810 11:30:25.917190 (+ 6857us) op_driver.cc:444] REPLICATION: finished
0810 11:30:25.931667 (+ 14477us) write_op.cc:301] APPLY: starting
0810 11:30:25.931707 (+ 40us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:25.931776 (+ 69us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:25.959393 (+ 27617us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:25.973485 (+ 14092us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:25.973548 (+ 63us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:25.973570 (+ 22us) write_op.cc:312] APPLY: finished
0810 11:30:25.973731 (+ 161us) log.cc:842] Serialized 29 byte log entry
0810 11:30:25.977149 (+ 3418us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.977271 (+ 122us) write_op.cc:454] Released schema lock
0810 11:30:25.977374 (+ 103us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:25.977654 (+ 280us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.977658 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":205835136,"child_traces":[["op",{"apply.queue_time_us":12611,"apply.run_cpu_time_us":1518,"apply.run_wall_time_us":47922,"num_ops":2,"prepare.queue_time_us":64,"prepare.run_cpu_time_us":869,"prepare.run_wall_time_us":869,"raft.queue_time_us":57,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":317,"replication_time_us":7028}]]}
I20260810 11:30:26.065492 27334 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_aaaed930df2544b3a6c30fbbcd3a637d" } new_table_name: "default.Table_e9f0bd7bcd1441cbbb1e927313ee6335" modify_external_catalogs: true
I20260810 11:30:26.065555 27028 tablet_service.cc:1467] Processing CreateTablet for tablet b6eb6dc4b6f34e598933853717b86866 (DEFAULT_TABLE table=default.Table_e18fcf91bf3b4fa0a993bc1aa1471e62 [id=de3117675bb34e7c91a3eb51e015b7c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.066358 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6eb6dc4b6f34e598933853717b86866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.075914 27231 raft_consensus.cc:348] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.078541 27228 tablet_bootstrap.cc:492] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
W20260810 11:30:26.079070 26848 leader_election.cc:341] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 7bd67ebf23694ae7b0ede6c5d1a06f88
I20260810 11:30:26.079402 27231 raft_consensus.cc:374] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:26.080190 26848 leader_election.cc:302] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:26.081043 27033 tablet_service.cc:1467] Processing CreateTablet for tablet 997cff3351724953bd9c792085a38364 (DEFAULT_TABLE table=default.Table_b6e82fe7918d4a13bc1fdc1e66287cda [id=363de84151b04f18917c36bd9fd499b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.081663 27033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 997cff3351724953bd9c792085a38364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.078578 26916 raft_consensus.cc:2454] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:26.079841 27999 ts_tablet_manager.cc:1905] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:26.083250 28040 raft_consensus.cc:2726] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:26.084947 27231 raft_consensus.cc:729] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:26.085207 27228 ts_tablet_manager.cc:1397] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.408s user 0.008s sys 0.027s
I20260810 11:30:26.085616 27231 consensus_queue.cc:260] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.086416 27231 ts_tablet_manager.cc:1428] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.038s user 0.003s sys 0.001s
I20260810 11:30:26.086911 27231 tablet_bootstrap.cc:492] T cd3575197c464c7fb51f9592831959bb P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:26.090349 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c595e0892634348b64418ae9dbbd4c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:32816
W20260810 11:30:26.090632 27322 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet f85c0767ad164075b87ba672cafafb47 consensus state has no leader
I20260810 11:30:26.095657 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e0a8513171f4c39b74c08760a139d9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.095644 26877 tablet_service.cc:1514] Processing DeleteTablet for tablet 66908164ff2a4ee5b55da6158699e0c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.096947 26882 tablet_service.cc:1514] Processing DeleteTablet for tablet 08f6636df13548c49f35e1808a87c1f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.097467 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet eb51618d37ac488fa7e3d23e5f85ec36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.104009 28116 sys_catalog.cc:263] Verifying existing consensus state
I20260810 11:30:26.107129 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet 70f6017d4d01463398cb347779dacf90 with delete_type TABLET_DATA_DELETED (replaced by tablet 110b5acc36bd4d6bba13735e5daec75f) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.107517 27228 raft_consensus.cc:348] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.107797 27228 raft_consensus.cc:374] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 11:30:26.109217 27322 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 592be61b7e524941931264125b33d92c (table default.Table_359f619c6e054a89898040e2f0d379c3 [id=1c6a2d6a4fa2472a9aff02fecc10077a], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 592be61b7e524941931264125b33d92c consensus state has no leader
W20260810 11:30:26.109696 27322 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 524c8d37d3964e368695d182883b0bd5 consensus state has no leader
I20260810 11:30:26.113098 27321 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_e33c9849bbd34e6b9b72e69fd3a1ab1c" } new_table_name: "default.Table_7a4ecd0031184ff1907aafdfb64b2085" modify_external_catalogs: true
I20260810 11:30:26.114711 27228 raft_consensus.cc:729] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:26.115168 27228 consensus_queue.cc:260] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:26.116034 27326 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.193:39107 (request call id 80) took 1929 ms (client timeout 1000 ms). Trace:
I20260810 11:30:26.116153 27228 ts_tablet_manager.cc:1428] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.031s user 0.001s sys 0.002s
I20260810 11:30:26.116504 27228 tablet_bootstrap.cc:492] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:26.121573 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.124013 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet e31b380f99854eb8b63e1f9eede1fc7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.126283 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet 10e6c41db71a4146840f06c5b7412d9c with delete_type TABLET_DATA_DELETED (replaced by tablet 72209a805e3e4b4ea1bf99508e0f75db) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.127858 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet ff9b649e43a9456fa51cf3330290bb91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.127512 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 2801709d53614916abac370f7ae5e913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.129940 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 3851d39aeb3142938a5ac558ab438c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.130400 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet cb6805a5dd264939850ea2cd9a850a1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.130807 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a83391804894d268d0e603f4feb1745 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.130952 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 91b6078efadf496fb252f725bdf56b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:32816
W20260810 11:30:26.131958 27322 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.195:58893 (request call id 77) took 1813 ms (client timeout 1000 ms). Trace:
W20260810 11:30:26.132223 27322 rpcz_store.cc:269] 0810 11:30:24.318844 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.318945 (+ 101us) service_pool.cc:227] Handling call
0810 11:30:24.333915 (+ 14970us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96d6d8f 00007f55f09cb946 00007f55f09cb675 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:26.131842 (+1797927us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:25.093786 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:25.093940 (+ 154us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:25.093950 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:25.093954 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:25.094094 (+ 140us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:25.094113 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:25.094121 (+ 8us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:25.094212 (+ 91us) tablet.cc:699] Row locks acquired
0810 11:30:25.094217 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:25.094260 (+ 43us) write_op.cc:270] Start()
0810 11:30:25.094302 (+ 42us) write_op.cc:276] Timestamp: P: 1786361425094215 usec, L: 0
0810 11:30:25.094309 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:25.094558 (+ 249us) log.cc:842] Serialized 536 byte log entry
0810 11:30:25.100079 (+ 5521us) op_driver.cc:444] REPLICATION: finished
0810 11:30:25.100239 (+ 160us) write_op.cc:301] APPLY: starting
0810 11:30:25.100258 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:25.100301 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:25.100328 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:25.100394 (+ 66us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:25.100432 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:25.100438 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:25.100639 (+ 201us) log.cc:842] Serialized 23 byte log entry
0810 11:30:25.100730 (+ 91us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.100754 (+ 24us) write_op.cc:454] Released schema lock
0810 11:30:25.100763 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:25.100840 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.100845 (+ 5us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:25.565872 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:25.566033 (+ 161us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:25.566039 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:25.566042 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:25.566170 (+ 128us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:25.566188 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:25.566195 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:25.566276 (+ 81us) tablet.cc:699] Row locks acquired
0810 11:30:25.566279 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:25.566323 (+ 44us) write_op.cc:270] Start()
0810 11:30:25.566363 (+ 40us) write_op.cc:276] Timestamp: P: 1786361425566300 usec, L: 0
0810 11:30:25.566367 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:25.632964 (+ 66597us) log.cc:842] Serialized 356 byte log entry
0810 11:30:25.633335 (+ 371us) spinlock_profiling.cc:243] Waited 66.2 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f55f1bb4d02 00007f55f2ee77f1 00007f55f2ee6359 00007f55f2eee1bb 00007f55f2eee038 00000000009edb7c 00007f55e66ec344 00007f55e66ef91b 00007f55e66ef798 00000000009edb7c
0810 11:30:25.694919 (+ 61584us) op_driver.cc:444] REPLICATION: finished
0810 11:30:25.700704 (+ 5785us) write_op.cc:301] APPLY: starting
0810 11:30:25.700733 (+ 29us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:25.700788 (+ 55us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:25.700793 (+ 5us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:25.700889 (+ 96us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:25.700934 (+ 45us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:25.700946 (+ 12us) write_op.cc:312] APPLY: finished
0810 11:30:25.701068 (+ 122us) log.cc:842] Serialized 23 byte log entry
0810 11:30:25.701162 (+ 94us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.701188 (+ 26us) write_op.cc:454] Released schema lock
0810 11:30:25.701198 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:25.701285 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.701292 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":175,"spinlock_wait_cycles":9022336,"child_traces":[["op",{"apply.queue_time_us":103,"apply.run_cpu_time_us":666,"apply.run_wall_time_us":665,"num_ops":1,"prepare.queue_time_us":65,"prepare.run_cpu_time_us":939,"prepare.run_wall_time_us":939,"raft.queue_time_us":1382,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":348,"replication_time_us":5674}],["op",{"apply.queue_time_us":5676,"apply.run_cpu_time_us":680,"apply.run_wall_time_us":682,"num_ops":1,"prepare.queue_time_us":4894,"prepare.run_cpu_time_us":2342,"prepare.run_wall_time_us":67551,"raft.queue_time_us":1177,"raft.run_cpu_time_us":10,"raft.run_wall_time_us":12,"replication_time_us":128516,"spinlock_wait_cycles":152161536}]]}
I20260810 11:30:26.133949 27322 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_64f83258168749f88b4697bfee40bc2f" } new_table_name: "default.Table_d18775ce6afa40d8841110e330d32273" modify_external_catalogs: true
I20260810 11:30:26.135388 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:26.137221 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:26.137801 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
W20260810 11:30:26.116168 27326 rpcz_store.cc:269] 0810 11:30:24.186911 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.187230 (+ 319us) service_pool.cc:227] Handling call
0810 11:30:24.198452 (+ 11222us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96d6d8f 00007f55f09cb946 00007f55f09cb675 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:26.115957 (+1917505us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:24.826572 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:24.826730 (+ 158us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:24.826740 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:24.826745 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:24.826923 (+ 178us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:24.826950 (+ 27us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:24.826957 (+ 7us) tablet.cc:683] Acquiring locks for 3 operations
0810 11:30:24.827075 (+ 118us) tablet.cc:699] Row locks acquired
0810 11:30:24.827078 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:24.827127 (+ 49us) write_op.cc:270] Start()
0810 11:30:24.827170 (+ 43us) write_op.cc:276] Timestamp: P: 1786361424827068 usec, L: 0
0810 11:30:24.827176 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:24.827487 (+ 311us) log.cc:842] Serialized 1302 byte log entry
0810 11:30:24.986009 (+158522us) op_driver.cc:444] REPLICATION: finished
0810 11:30:24.986166 (+ 157us) write_op.cc:301] APPLY: starting
0810 11:30:24.986185 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:24.986237 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:24.986267 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:24.986357 (+ 90us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:24.986394 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0810 11:30:24.986400 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:24.986510 (+ 110us) log.cc:842] Serialized 35 byte log entry
0810 11:30:24.986575 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:24.986601 (+ 26us) write_op.cc:454] Released schema lock
0810 11:30:24.986608 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:24.986675 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:24.986678 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:25.633486 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:25.633689 (+ 203us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:25.633699 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:25.633704 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:25.633908 (+ 204us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:25.633958 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:25.633966 (+ 8us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:25.634070 (+ 104us) tablet.cc:699] Row locks acquired
0810 11:30:25.634074 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:25.634130 (+ 56us) write_op.cc:270] Start()
0810 11:30:25.634183 (+ 53us) write_op.cc:276] Timestamp: P: 1786361425634099 usec, L: 0
0810 11:30:25.634190 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:25.634425 (+ 235us) log.cc:842] Serialized 356 byte log entry
0810 11:30:25.695011 (+ 60586us) op_driver.cc:444] REPLICATION: finished
0810 11:30:25.701429 (+ 6418us) write_op.cc:301] APPLY: starting
0810 11:30:25.701444 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:25.701481 (+ 37us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:25.701573 (+ 92us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:25.701629 (+ 56us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:25.701845 (+ 216us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:25.701861 (+ 16us) write_op.cc:312] APPLY: finished
0810 11:30:25.702028 (+ 167us) log.cc:842] Serialized 23 byte log entry
0810 11:30:25.702132 (+ 104us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.702159 (+ 27us) write_op.cc:454] Released schema lock
0810 11:30:25.702167 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:25.702274 (+ 107us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:25.702281 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":164,"spinlock_wait_cycles":13310208,"child_traces":[["op",{"apply.queue_time_us":106,"apply.run_cpu_time_us":569,"apply.run_wall_time_us":568,"num_ops":3,"prepare.queue_time_us":83,"prepare.run_cpu_time_us":1194,"prepare.run_wall_time_us":1194,"raft.queue_time_us":158,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":7,"replication_time_us":158797}],["op",{"apply.queue_time_us":6359,"apply.run_cpu_time_us":944,"apply.run_wall_time_us":940,"num_ops":1,"prepare.queue_time_us":67675,"prepare.run_cpu_time_us":1075,"prepare.run_wall_time_us":1086,"raft.queue_time_us":149,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":3,"replication_time_us":60797}]]}
I20260810 11:30:26.139312 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a87f6835f0dc4ad4b3a23b297726100d (table default.Table_cbf7fb0f0585465a9be24fa7e70d68d2 [id=82041e96f8de4fae85baf690bbbfc7a3]). Expected version 1 got 0
I20260810 11:30:26.140446 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:26.142377 28116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Bootstrap starting.
I20260810 11:30:26.140118 27326 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_bd17aa8dfcdf4c09b68660896911a2ee" } new_table_name: "default.Table_3e5423642f624ac59254222ea8d0a520" modify_external_catalogs: true
I20260810 11:30:26.142875 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]). Expected version 1 got 0
I20260810 11:30:26.147857 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet db59523b71224370bf5fce6b56592f71 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:26.148334 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 1 got 0
I20260810 11:30:26.149662 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d722b93fe27f4c08a592bc393046b6bd (table default.Table_99cbe48a0bd54425b588a46ae1132cad [id=0faf073b01654e38b8f6083f5012abd7]). Expected version 3 got 2
I20260810 11:30:26.153085 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]). Expected version 1 got 0
I20260810 11:30:26.153744 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]). Expected version 1 got 0
I20260810 11:30:26.154155 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]). Expected version 2 got 0
I20260810 11:30:26.154501 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:26.154924 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3ddb6e67c316416681074e454ab9b01e (table default.Table_1e1ca07e9c824349af23675b66b77321 [id=755202f095f04307a11ce87087df835c]). Expected version 2 got 0
I20260810 11:30:26.155313 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 23637a02b6464e17aa2a69ea5cc4ddfe (table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85]). Expected version 1 got 0
I20260810 11:30:26.155737 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:26.160177 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:26.160842 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:26.162088 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:26.163100 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:26.163502 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:26.164194 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:26.164528 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:26.165263 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet fbe0a0ab82a147a3b6164904b135d1ab (table default.Table_61d778388656489cb2e7fe8312b8ac6e [id=b52c11bd73cd4d1f8f9dfc32562718a2]). Expected version 2 got 0
I20260810 11:30:26.166680 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:26.169550 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_359f619c6e054a89898040e2f0d379c3 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 1 got 0
I20260810 11:30:26.169907 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]). Expected version 1 got 0
I20260810 11:30:26.170344 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 1 got 0
I20260810 11:30:26.170720 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_aaaed930df2544b3a6c30fbbcd3a637d [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 1 got 0
I20260810 11:30:26.171111 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:26.171444 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:26.171847 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]). Expected version 1 got 0
I20260810 11:30:26.174676 26882 tablet_service.cc:1467] Processing CreateTablet for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (DEFAULT_TABLE table=default.Table_a827339eadbd440bb3c0bfa6c52512ca [id=b457cccecbf24d6dab4e74bf16bb68eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.175189 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:26.175662 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]). Expected version 2 got 0
I20260810 11:30:26.176239 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]). Expected version 2 got 0
I20260810 11:30:26.176666 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 587c6ce242c0411b886404a0df03b1bb (table default.Table_8326a5b5a7544e828699f8b41fdee4d1 [id=1ae6d36bfe0e427a9a996dff3cdccc91]). Expected version 2 got 0
W20260810 11:30:26.176774 27291 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet db59523b71224370bf5fce6b56592f71 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet db59523b71224370bf5fce6b56592f71 consensus state has no leader
I20260810 11:30:26.177105 27231 tablet_bootstrap.cc:654] T cd3575197c464c7fb51f9592831959bb P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:26.177253 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:26.177552 26882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bfed03f765f4c5aa77604ebf2e211b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.177723 27333 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_e33c9849bbd34e6b9b72e69fd3a1ab1c [id=b206753d4f4142be82ee28150226bd53]). Expected version 1 got 0
I20260810 11:30:26.177858 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f24c84cdd945b78f39f24015eb1e43 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b95f3ec8ff34c89a68cd1edf8391f9b) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.167610 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet a3406dc345e3429fb4bce5a59643b686 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.186503 27037 tablet_service.cc:1467] Processing CreateTablet for tablet ea66da5bc20e4718901ffc473677421c (DEFAULT_TABLE table=default.Table_23ac53b1a7794ddda0a697254fff0ede [id=80a1649fe2d74dd4bf5aa5e07a762de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.187170 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea66da5bc20e4718901ffc473677421c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.189731 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet 43e42cc642544f779bb79cee7479c4f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.190625 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet 0713f4f14a284050a7774a70ab974f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.197149 27362 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet 7d3406f12d9c492cbd0d86fa7a57de82
I20260810 11:30:26.197794 27362 catalog_manager.cc:6565] ReplaceTablet: tablet 7d3406f12d9c492cbd0d86fa7a57de82 deleted and replaced by tablet 72e0b69e7c7e4343b309d16c030d4306
I20260810 11:30:26.198225 27362 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_3d15fcde44db49a7ba17fd166381299f" } modify_external_catalogs: true
I20260810 11:30:26.198518 27362 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_3d15fcde44db49a7ba17fd166381299f" } modify_external_catalogs: true
I20260810 11:30:26.200297 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 0118ff9d21924aefa8c6c32977c10453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.201891 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca5c88585394dba87e201696afa6934 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.202143 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet 478c0c39658349c39e3afa1aa1653e82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.200819 27025 tablet_service.cc:1467] Processing CreateTablet for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (DEFAULT_TABLE table=default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.202750 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 31888ddeafe14738b818016a9c0a4ad3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.213467 27112 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:26.213949 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.217192 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b15cc8669b549a2b4461dccd66a0c5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.223217 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet f3884736eec74c8992b8d51b37465875 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f64d4b9320c4cb39f57573d781a47d3) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.223637 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet a3406dc345e3429fb4bce5a59643b686 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.224982 27319 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet db59523b71224370bf5fce6b56592f71
I20260810 11:30:26.225455 27319 catalog_manager.cc:6565] ReplaceTablet: tablet db59523b71224370bf5fce6b56592f71 deleted and replaced by tablet bd34a4de1b93402c8a4bce1215660e77
I20260810 11:30:26.225922 27319 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_9633fc0dda2b422baa0de7b537dc5479"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:26.226547 27319 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9633fc0dda2b422baa0de7b537dc5479 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:26.228219 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 0713f4f14a284050a7774a70ab974f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.228464 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet e25ae21cc8cc4749a507fcab5ee225a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.228709 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d8ce485cb84495a6e964b6d5977f0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.228888 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet eb9394f9ca2c44de93354e23973cf902 with delete_type TABLET_DATA_DELETED (replaced by tablet db59523b71224370bf5fce6b56592f71) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.229293 26877 tablet_service.cc:1467] Processing CreateTablet for tablet 518c777e40ec40dcb3484c0374384959 (DEFAULT_TABLE table=default.Table_0d634c04e624422da8830e84abf1339f [id=eefabebedc4b4002b527bea100cc632e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.229825 26877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 518c777e40ec40dcb3484c0374384959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.220183 26888 tablet_service.cc:1467] Processing CreateTablet for tablet 997cff3351724953bd9c792085a38364 (DEFAULT_TABLE table=default.Table_b6e82fe7918d4a13bc1fdc1e66287cda [id=363de84151b04f18917c36bd9fd499b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.234570 26879 tablet_service.cc:1467] Processing CreateTablet for tablet b6eb6dc4b6f34e598933853717b86866 (DEFAULT_TABLE table=default.Table_e18fcf91bf3b4fa0a993bc1aa1471e62 [id=de3117675bb34e7c91a3eb51e015b7c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.237203 27319 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_645b3efca425434da139268167fec99f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:26.237917 27319 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_645b3efca425434da139268167fec99f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:26.238441 26879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6eb6dc4b6f34e598933853717b86866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.242446 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet cb01e54d817c4b0dbcc80f90f82923c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5deec04c1be64473accf8b9df14bd22e) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.247146 27319 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_a0630a37a4e44862b8947cd848615cdb" } modify_external_catalogs: true
I20260810 11:30:26.251060 27228 tablet_bootstrap.cc:654] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:26.247470 27319 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_a0630a37a4e44862b8947cd848615cdb" } modify_external_catalogs: true
I20260810 11:30:26.253013 28029 raft_consensus.cc:482] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:26.242879 28125 tablet.cc:1722] T d722b93fe27f4c08a592bc393046b6bd P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 11:30:26.254292 28029 raft_consensus.cc:504] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.255013 28029 leader_election.cc:288] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:26.263017 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet 31cafb7c691d40a48a40f7d4190c4f8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.265407 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 997cff3351724953bd9c792085a38364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.267132 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet cb01e54d817c4b0dbcc80f90f82923c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5deec04c1be64473accf8b9df14bd22e) from {username='slave'} at 127.0.0.1:32816
W20260810 11:30:26.267470 26991 consensus_peers.cc:487] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a28849649c704f2fbdec1aced9ce01b1. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:26.272059 26735 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aa16654b7f34f9baf856bf724cece8f with delete_type TABLET_DATA_DELETED (replaced by tablet 760aeada57464892ae3b9013a761c509) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.274175 27248 ts_tablet_manager.cc:1918] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:26.274374 27248 log.cc:1196] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/f3884736eec74c8992b8d51b37465875
I20260810 11:30:26.274876 27248 ts_tablet_manager.cc:1939] T f3884736eec74c8992b8d51b37465875 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:26.275350 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 6) took 2007 ms. Trace:
I20260810 11:30:26.275490 27248 rpcz_store.cc:276] 0810 11:30:24.267986 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.268049 (+ 63us) service_pool.cc:227] Handling call
0810 11:30:25.892684 (+1624635us) ts_tablet_manager.cc:1145] Deleting tablet f3884736eec74c8992b8d51b37465875
0810 11:30:25.892699 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:26.055337 (+162638us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:26.273923 (+218586us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:26.275312 (+ 1389us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1611878}
I20260810 11:30:26.275914 27248 tablet_replica.cc:330] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:26.276217 27248 raft_consensus.cc:2229] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:26.276173 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b15cc8669b549a2b4461dccd66a0c5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.276453 27248 raft_consensus.cc:2258] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:26.276798 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 0033d61d07d84262a98b0ebc54bd7960 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.277056 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 08f6636df13548c49f35e1808a87c1f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.277320 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet eb51618d37ac488fa7e3d23e5f85ec36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.277650 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 70f6017d4d01463398cb347779dacf90 with delete_type TABLET_DATA_DELETED (replaced by tablet 110b5acc36bd4d6bba13735e5daec75f) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.277947 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.279569 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 31888ddeafe14738b818016a9c0a4ad3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.279980 27222 tablet_bootstrap.cc:492] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:26.280182 27222 ts_tablet_manager.cc:1397] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.395s user 0.015s sys 0.000s
I20260810 11:30:26.281320 27222 raft_consensus.cc:348] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.281669 27222 raft_consensus.cc:374] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:26.281802 27222 raft_consensus.cc:729] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:26.282105 27222 consensus_queue.cc:260] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.282897 27222 ts_tablet_manager.cc:1428] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 11:30:26.282912 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d8ce485cb84495a6e964b6d5977f0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.283310 27222 tablet_bootstrap.cc:492] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:26.284706 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:32816
W20260810 11:30:26.285260 27318 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.194:38225 (request call id 86) took 1834 ms (client timeout 1000 ms). Trace:
W20260810 11:30:26.285385 27318 rpcz_store.cc:269] 0810 11:30:24.450332 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.590852 (+140520us) service_pool.cc:227] Handling call
0810 11:30:24.613866 (+ 23014us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96d6d8f 00007f55f09cb946 00007f55f09cb675 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:26.285169 (+1671303us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1772,"reported_tablets":178,"spinlock_wait_cycles":37817600}
I20260810 11:30:26.286041 26740 tablet_service.cc:1514] Processing DeleteTablet for tablet 0938a2f3688246a2b46978eeb7d5d521 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.287148 27318 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_359f619c6e054a89898040e2f0d379c3" } new_table_name: "default.Table_d131ea1f8baf4495af3322c319b9b4e1" modify_external_catalogs: true
I20260810 11:30:26.289819 26731 tablet_service.cc:1467] Processing CreateTablet for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (DEFAULT_TABLE table=default.Table_a827339eadbd440bb3c0bfa6c52512ca [id=b457cccecbf24d6dab4e74bf16bb68eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.290411 26731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bfed03f765f4c5aa77604ebf2e211b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.291185 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_aaaed930df2544b3a6c30fbbcd3a637d [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 1 got 0
I20260810 11:30:26.291441 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:26.291779 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:26.292438 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a87f6835f0dc4ad4b3a23b297726100d (table default.Table_cbf7fb0f0585465a9be24fa7e70d68d2 [id=82041e96f8de4fae85baf690bbbfc7a3]). Expected version 1 got 0
I20260810 11:30:26.292860 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d722b93fe27f4c08a592bc393046b6bd (table default.Table_99cbe48a0bd54425b588a46ae1132cad [id=0faf073b01654e38b8f6083f5012abd7]). Expected version 3 got 2
I20260810 11:30:26.293123 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:26.293519 27763 raft_consensus.cc:482] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:26.293684 27763 raft_consensus.cc:504] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.294380 27763 leader_election.cc:288] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:26.295338 27974 ts_tablet_manager.cc:1918] T fdbe21b4f124411988dd35a0b864f868 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:26.295512 27974 log.cc:1196] T fdbe21b4f124411988dd35a0b864f868 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/fdbe21b4f124411988dd35a0b864f868
I20260810 11:30:26.295832 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:26.295853 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "524c8d37d3964e368695d182883b0bd5" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:26.296155 27974 ts_tablet_manager.cc:1939] T fdbe21b4f124411988dd35a0b864f868 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:26.296188 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]). Expected version 1 got 0
I20260810 11:30:26.296454 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet e31b380f99854eb8b63e1f9eede1fc7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:33500
W20260810 11:30:26.296633 26702 leader_election.cc:341] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:26.296684 26735 tablet_service.cc:1514] Processing DeleteTablet for tablet bb0357271cfd46478867a3cc0660bcdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.296911 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet 478c0c39658349c39e3afa1aa1653e82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.297354 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]). Expected version 2 got 0
I20260810 11:30:26.297572 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:26.297853 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 23637a02b6464e17aa2a69ea5cc4ddfe (table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85]). Expected version 1 got 0
I20260810 11:30:26.298172 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:26.296790 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02ff6a9bc02441ddb7f307d6b3df31bd" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:26.298626 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 1 got 0
I20260810 11:30:26.299458 26823 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:26.299423 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:26.299882 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:26.300221 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]). Expected version 1 got 0
I20260810 11:30:26.300532 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:26.301085 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:26.301465 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet fbe0a0ab82a147a3b6164904b135d1ab (table default.Table_61d778388656489cb2e7fe8312b8ac6e [id=b52c11bd73cd4d1f8f9dfc32562718a2]). Expected version 2 got 0
I20260810 11:30:26.301695 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:26.301982 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:26.302212 27033 tablet_service.cc:1514] Processing DeleteTablet for tablet ffeb0373c6124af291336ca9da50c318 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.302289 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 1 got 0
I20260810 11:30:26.302628 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_359f619c6e054a89898040e2f0d379c3 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 1 got 0
I20260810 11:30:26.302901 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:26.303923 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e3707ae32624f6483866208321eefde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.305075 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 997cff3351724953bd9c792085a38364 (DEFAULT_TABLE table=default.Table_b6e82fe7918d4a13bc1fdc1e66287cda [id=363de84151b04f18917c36bd9fd499b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.305251 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]). Expected version 1 got 0
I20260810 11:30:26.305619 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]). Expected version 1 got 0
I20260810 11:30:26.305684 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 997cff3351724953bd9c792085a38364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.305867 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:26.306125 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:26.306474 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:26.306740 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]). Expected version 1 got 0
I20260810 11:30:26.306998 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]). Expected version 2 got 0
I20260810 11:30:26.307323 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:26.307641 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]). Expected version 2 got 0
I20260810 11:30:26.308221 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 587c6ce242c0411b886404a0df03b1bb (table default.Table_8326a5b5a7544e828699f8b41fdee4d1 [id=1ae6d36bfe0e427a9a996dff3cdccc91]). Expected version 2 got 0
I20260810 11:30:26.308634 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_e33c9849bbd34e6b9b72e69fd3a1ab1c [id=b206753d4f4142be82ee28150226bd53]). Expected version 1 got 0
I20260810 11:30:26.308918 27336 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:26.310122 26734 tablet_service.cc:1467] Processing CreateTablet for tablet 518c777e40ec40dcb3484c0374384959 (DEFAULT_TABLE table=default.Table_0d634c04e624422da8830e84abf1339f [id=eefabebedc4b4002b527bea100cc632e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.310736 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 518c777e40ec40dcb3484c0374384959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.313764 26740 tablet_service.cc:1467] Processing CreateTablet for tablet ea66da5bc20e4718901ffc473677421c (DEFAULT_TABLE table=default.Table_23ac53b1a7794ddda0a697254fff0ede [id=80a1649fe2d74dd4bf5aa5e07a762de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.313961 26735 tablet_service.cc:1467] Processing CreateTablet for tablet b6eb6dc4b6f34e598933853717b86866 (DEFAULT_TABLE table=default.Table_e18fcf91bf3b4fa0a993bc1aa1471e62 [id=de3117675bb34e7c91a3eb51e015b7c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.314249 26740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea66da5bc20e4718901ffc473677421c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.313529 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a83391804894d268d0e603f4feb1745 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.315572 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6eb6dc4b6f34e598933853717b86866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.317003 26742 tablet_service.cc:1467] Processing CreateTablet for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (DEFAULT_TABLE table=default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.320775 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.325314 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet eb9394f9ca2c44de93354e23973cf902 with delete_type TABLET_DATA_DELETED (replaced by tablet db59523b71224370bf5fce6b56592f71) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.325852 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet a18cb43b4dc04a1290a6bade7ac1f3cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.326519 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 31cafb7c691d40a48a40f7d4190c4f8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.327235 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e829d4bffeb4289a54b4d3d7a53c44e with delete_type TABLET_DATA_DELETED (replaced by tablet 00d52e5c77d94854b8ba0b38c63ad015) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.330405 27033 tablet_service.cc:1514] Processing DeleteTablet for tablet 8798892eb4604ee8ac9c95e64dbb14e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.330479 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 60d56e162b4b41e2867ac845e524aca4 with delete_type TABLET_DATA_DELETED (replaced by tablet 10210204d5ff4e5e97c98fd255f674a5) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.247663 26895 tablet_service.cc:1467] Processing CreateTablet for tablet ea66da5bc20e4718901ffc473677421c (DEFAULT_TABLE table=default.Table_23ac53b1a7794ddda0a697254fff0ede [id=80a1649fe2d74dd4bf5aa5e07a762de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.333462 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.333779 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet 0118ff9d21924aefa8c6c32977c10453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.338025 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet bb0357271cfd46478867a3cc0660bcdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.341328 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet 43e42cc642544f779bb79cee7479c4f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.350407 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet 603fe104b7ab485eab6b225a58bddc1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.350800 27248 ts_tablet_manager.cc:1905] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:26.352174 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e0a8513171f4c39b74c08760a139d9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.353293 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet 603fe104b7ab485eab6b225a58bddc1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.354173 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet 8798892eb4604ee8ac9c95e64dbb14e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.354606 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet d91a02b22044429fb3e25840c7947a02 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ba5191082814a4f8cf821354416e1d3) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.355432 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet 9311943eebaa4824bde96b4cb09f1e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.356065 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.356769 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet f6e264e8507446809f3c386fdb3c34ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.357443 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet 5adcec593b8c4d40997c8911e9f77c85 with delete_type TABLET_DATA_DELETED (replaced by tablet 10e6c41db71a4146840f06c5b7412d9c) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.358048 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet 49db12565dbc4187b78a98ed35c40fed with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1e46f80f7f4e3a84638421892e6236) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.358793 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca5c88585394dba87e201696afa6934 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.359133 27033 tablet_service.cc:1514] Processing DeleteTablet for tablet cb6805a5dd264939850ea2cd9a850a1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.359390 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet ac4b1821ac30452cbe7a8f844d9b37e5 with delete_type TABLET_DATA_DELETED (replaced by tablet a45422addab84e9083df8665a0cf9322) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.359436 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 91b6078efadf496fb252f725bdf56b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.359917 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet 110b5acc36bd4d6bba13735e5daec75f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.360402 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 3851d39aeb3142938a5ac558ab438c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.360702 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet 10e6c41db71a4146840f06c5b7412d9c with delete_type TABLET_DATA_DELETED (replaced by tablet 72209a805e3e4b4ea1bf99508e0f75db) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.360723 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.362094 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet ff9b649e43a9456fa51cf3330290bb91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.363554 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 2801709d53614916abac370f7ae5e913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.371856 27974 tablet_replica.cc:330] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:26.372301 27974 raft_consensus.cc:2229] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:26.376855 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea66da5bc20e4718901ffc473677421c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.385315 27222 tablet_bootstrap.cc:654] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:26.387020 26702 consensus_peers.cc:487] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:26.395076 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 64818ca5827e41d99428903ddb8688d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.397604 28116 log.cc:824] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Log is configured to *not* fsync() on all Append() calls
I20260810 11:30:26.399991 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 318d5b8453fe4c438d0fa32cb91c409e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.400614 26965 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:26.401384 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet a7a2cb1d2e8e40f58144908e34438d53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.402124 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 83631b421a614796bdf76335f1437e00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.402556 27222 tablet_bootstrap.cc:492] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:26.402865 27222 ts_tablet_manager.cc:1397] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.120s user 0.007s sys 0.007s
I20260810 11:30:26.406028 27222 raft_consensus.cc:348] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.406572 27222 raft_consensus.cc:374] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:26.406692 27222 raft_consensus.cc:729] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:26.406937 27222 consensus_queue.cc:260] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.407776 27222 ts_tablet_manager.cc:1428] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.005s user 0.002s sys 0.002s
I20260810 11:30:26.408171 27222 tablet_bootstrap.cc:492] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:26.410329 27222 tablet_bootstrap.cc:654] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:26.416800 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c595e0892634348b64418ae9dbbd4c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.419476 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet a8a65a0e8b1f4e4b8d9a82059b766cda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.422638 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet d91a02b22044429fb3e25840c7947a02 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ba5191082814a4f8cf821354416e1d3) from {username='slave'} at 127.0.0.1:33500
W20260810 11:30:26.429931 26848 leader_election.cc:341] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:26.443114 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet f2b555f18c1e485d9af7b08f98543c80 with delete_type TABLET_DATA_DELETED (replaced by tablet 1801d3af4a4548dba8b0d8ea2fecf5ba) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.445309 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.445847 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.446491 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b5a7f67ec5b48c2b5a510add0282a76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.446771 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet 2634beb347714fc7a2e05865adb34a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.447039 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ada1df82eb44ecb9a6c615b5410e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.449014 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3406f12d9c492cbd0d86fa7a57de82 with delete_type TABLET_DATA_DELETED (replaced by tablet 72e0b69e7c7e4343b309d16c030d4306) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.449662 26732 tablet_service.cc:1467] Processing CreateTablet for tablet 262656cbd3944702ac0ce04222cda500 (DEFAULT_TABLE table=default.Table_174d1e3073a34beabbd10fd4f6d61bd4 [id=d538eb7fe6224d6895190c79c041b76f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.450207 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 262656cbd3944702ac0ce04222cda500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.450371 26730 tablet_service.cc:1467] Processing CreateTablet for tablet dc10f61181794e2bba099ca46881e94d (DEFAULT_TABLE table=default.Table_971ac96924ee4a09bc7bc1befdb296d1 [id=cbb462ed5c1f4adf9363f7ac03b78c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.450757 26730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc10f61181794e2bba099ca46881e94d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.453208 26741 tablet_service.cc:1467] Processing CreateTablet for tablet 72e0b69e7c7e4343b309d16c030d4306 (DEFAULT_TABLE table=default.Table_c32d1cb0b9e744fbacbd00c8736fad21 [id=f54b49f28880453aa7bc67b9c36a219b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.453512 26737 tablet_service.cc:1467] Processing CreateTablet for tablet faff8489499e4e318b127d9c1b19d2e4 (DEFAULT_TABLE table=default.Table_6efb1e8e65fa4f88ae25c9d2ebc6b4f4 [id=d83083bfedd542398d132e4bac9a7f12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.453768 26741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72e0b69e7c7e4343b309d16c030d4306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.454129 26748 tablet_service.cc:1467] Processing CreateTablet for tablet f756689d4c99489885a0cd59f84a6e8a (DEFAULT_TABLE table=default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.454449 26744 tablet_service.cc:1467] Processing CreateTablet for tablet fdeba015c2364ec385e8b06c18a2a9d2 (DEFAULT_TABLE table=default.Table_5d3880885d6342738dd22e168d08e660 [id=31e5d2935c2f44e4b272255fbd4c948a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.455063 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet faff8489499e4e318b127d9c1b19d2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.457167 26745 tablet_service.cc:1467] Processing CreateTablet for tablet bd34a4de1b93402c8a4bce1215660e77 (DEFAULT_TABLE table=default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.457937 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_aaaed930df2544b3a6c30fbbcd3a637d [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 1 got 0
I20260810 11:30:26.458514 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 1 got 0
I20260810 11:30:26.458897 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a87f6835f0dc4ad4b3a23b297726100d (table default.Table_cbf7fb0f0585465a9be24fa7e70d68d2 [id=82041e96f8de4fae85baf690bbbfc7a3]). Expected version 1 got 0
I20260810 11:30:26.459060 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 046fede13acf44e294fde386f78446a5 (DEFAULT_TABLE table=default.Table_b15d6127087043a186b912230d2fe666 [id=ac5dd73c5e8e40108a8b663241887081]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.459199 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:26.459357 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:26.459470 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet db59523b71224370bf5fce6b56592f71 with delete_type TABLET_DATA_DELETED (replaced by tablet bd34a4de1b93402c8a4bce1215660e77) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.459694 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet fbe0a0ab82a147a3b6164904b135d1ab (table default.Table_61d778388656489cb2e7fe8312b8ac6e [id=b52c11bd73cd4d1f8f9dfc32562718a2]). Expected version 2 got 0
I20260810 11:30:26.459923 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:26.460156 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:26.460191 26738 tablet_service.cc:1467] Processing CreateTablet for tablet 7c203cd90d2f472fa27cfabed5b87119 (DEFAULT_TABLE table=default.Table_9633fc0dda2b422baa0de7b537dc5479 [id=7885e7f1ab9f452a8b58aabdf808e0e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.460875 26745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd34a4de1b93402c8a4bce1215660e77. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:26.461210 27290 catalog_manager.cc:4914] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): alter failed for tablet 725d2e70e1d441b497d56a278e1de0ad (table default.Table_59ed990b31964d6080614081ee46a6de [id=6d8fc88a491140548a45c7fbb403bb36]),no further retry: Not found: Tablet not found: 725d2e70e1d441b497d56a278e1de0ad
I20260810 11:30:26.461223 26746 tablet_service.cc:1467] Processing CreateTablet for tablet 16101a5784394d3aa570f4ecd8f2ac56 (DEFAULT_TABLE table=default.Table_645b3efca425434da139268167fec99f [id=51dc04b8252b4142a7ac67c5fc0dd1ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.463291 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet fdbe21b4f124411988dd35a0b864f868 (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]) successfully deleted
I20260810 11:30:26.463608 26733 tablet_service.cc:1514] Processing DeleteTablet for tablet ffeb0373c6124af291336ca9da50c318 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
W20260810 11:30:26.463937 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 44d5e146eeec4fe0be33c1c169d32e68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44d5e146eeec4fe0be33c1c169d32e68 already in progress: creating tablet
W20260810 11:30:26.464643 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 already in progress: creating tablet
W20260810 11:30:26.465339 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 4b5a7f67ec5b48c2b5a510add0282a76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b5a7f67ec5b48c2b5a510add0282a76 already in progress: creating tablet
W20260810 11:30:26.465996 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2634beb347714fc7a2e05865adb34a22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2634beb347714fc7a2e05865adb34a22 already in progress: creating tablet
I20260810 11:30:26.466683 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16101a5784394d3aa570f4ecd8f2ac56. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:26.466672 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 64818ca5827e41d99428903ddb8688d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64818ca5827e41d99428903ddb8688d9 already in progress: creating tablet
W20260810 11:30:26.467290 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet f7ada1df82eb44ecb9a6c615b5410e6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7ada1df82eb44ecb9a6c615b5410e6f already in progress: creating tablet
W20260810 11:30:26.467942 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 318d5b8453fe4c438d0fa32cb91c409e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 318d5b8453fe4c438d0fa32cb91c409e already in progress: creating tablet
I20260810 11:30:26.460496 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d722b93fe27f4c08a592bc393046b6bd (table default.Table_99cbe48a0bd54425b588a46ae1132cad [id=0faf073b01654e38b8f6083f5012abd7]). Expected version 3 got 2
I20260810 11:30:26.468451 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
W20260810 11:30:26.468654 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 834c9c99ec424bb39e8a003e9204b2bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 834c9c99ec424bb39e8a003e9204b2bc already in progress: creating tablet
I20260810 11:30:26.468815 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]). Expected version 1 got 0
W20260810 11:30:26.469519 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ff5b980ce4e41d7a6e1ca0e740b739c already in progress: creating tablet
I20260810 11:30:26.448760 26729 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f24c84cdd945b78f39f24015eb1e43 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b95f3ec8ff34c89a68cd1edf8391f9b) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.470180 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f756689d4c99489885a0cd59f84a6e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.470479 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 046fede13acf44e294fde386f78446a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.470753 26738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c203cd90d2f472fa27cfabed5b87119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.471163 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdeba015c2364ec385e8b06c18a2a9d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.472108 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet db59523b71224370bf5fce6b56592f71 with delete_type TABLET_DATA_DELETED (replaced by tablet bd34a4de1b93402c8a4bce1215660e77) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.472846 27231 tablet_bootstrap.cc:492] T cd3575197c464c7fb51f9592831959bb P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:26.472889 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 23637a02b6464e17aa2a69ea5cc4ddfe (table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85]). Expected version 1 got 0
I20260810 11:30:26.473311 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:26.473666 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]). Expected version 1 got 0
I20260810 11:30:26.473982 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 834c9c99ec424bb39e8a003e9204b2bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.474392 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 1 got 0
I20260810 11:30:26.474351 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet fc558690dce44e999e55e9bf1b6ca172 with delete_type TABLET_DATA_DELETED (replaced by tablet 0bb01711769f457aa0696bb59582166d) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.474897 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:26.474890 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 43e42cc642544f779bb79cee7479c4f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.475201 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3406f12d9c492cbd0d86fa7a57de82 with delete_type TABLET_DATA_DELETED (replaced by tablet 72e0b69e7c7e4343b309d16c030d4306) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.475486 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]). Expected version 1 got 0
I20260810 11:30:26.475952 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]). Expected version 2 got 0
I20260810 11:30:26.476158 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:26.476183 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d5e146eeec4fe0be33c1c169d32e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.476483 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:26.476733 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_359f619c6e054a89898040e2f0d379c3 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 1 got 0
I20260810 11:30:26.476967 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]). Expected version 1 got 0
I20260810 11:30:26.476984 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 262656cbd3944702ac0ce04222cda500 (DEFAULT_TABLE table=default.Table_174d1e3073a34beabbd10fd4f6d61bd4 [id=d538eb7fe6224d6895190c79c041b76f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.477140 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:26.477432 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:26.477727 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
W20260810 11:30:26.477804 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet a8a65a0e8b1f4e4b8d9a82059b766cda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8a65a0e8b1f4e4b8d9a82059b766cda already in progress: creating tablet
I20260810 11:30:26.478220 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]). Expected version 1 got 0
I20260810 11:30:26.478497 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:26.478785 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:26.479053 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]). Expected version 2 got 0
I20260810 11:30:26.474396 26731 tablet_service.cc:1514] Processing DeleteTablet for tablet a7a2cb1d2e8e40f58144908e34438d53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.479032 26735 tablet_service.cc:1514] Processing DeleteTablet for tablet e31b380f99854eb8b63e1f9eede1fc7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:26.479265 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]). Expected version 2 got 0
I20260810 11:30:26.481352 27974 raft_consensus.cc:2258] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:26.482120 27974 ts_tablet_manager.cc:1905] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:26.482985 27231 ts_tablet_manager.cc:1397] T cd3575197c464c7fb51f9592831959bb P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.388s user 0.010s sys 0.008s
W20260810 11:30:26.483805 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 83631b421a614796bdf76335f1437e00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 83631b421a614796bdf76335f1437e00 already in progress: creating tablet
I20260810 11:30:26.484342 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 262656cbd3944702ac0ce04222cda500. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:26.485257 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet f2b555f18c1e485d9af7b08f98543c80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2b555f18c1e485d9af7b08f98543c80 already in progress: creating tablet
W20260810 11:30:26.485757 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 4c595e0892634348b64418ae9dbbd4c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c595e0892634348b64418ae9dbbd4c2 already in progress: creating tablet
W20260810 11:30:26.486202 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 10e6c41db71a4146840f06c5b7412d9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10e6c41db71a4146840f06c5b7412d9c already in progress: creating tablet
W20260810 11:30:26.486625 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ff9b649e43a9456fa51cf3330290bb91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff9b649e43a9456fa51cf3330290bb91 already in progress: creating tablet
W20260810 11:30:26.487139 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2801709d53614916abac370f7ae5e913 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2801709d53614916abac370f7ae5e913 already in progress: creating tablet
W20260810 11:30:26.487762 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 3851d39aeb3142938a5ac558ab438c21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3851d39aeb3142938a5ac558ab438c21 already in progress: creating tablet
W20260810 11:30:26.488231 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet cb6805a5dd264939850ea2cd9a850a1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb6805a5dd264939850ea2cd9a850a1f already in progress: creating tablet
W20260810 11:30:26.488826 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 1a83391804894d268d0e603f4feb1745 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a83391804894d268d0e603f4feb1745 already in progress: creating tablet
I20260810 11:30:26.496464 28102 tablet.cc:1722] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:26.498754 26883 tablet_service.cc:1467] Processing CreateTablet for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (DEFAULT_TABLE table=default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.501483 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet d729baae40a64e6e8c23e6870f230afb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.502189 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 587c6ce242c0411b886404a0df03b1bb (table default.Table_8326a5b5a7544e828699f8b41fdee4d1 [id=1ae6d36bfe0e427a9a996dff3cdccc91]). Expected version 2 got 0
I20260810 11:30:26.502287 27034 tablet_service.cc:1467] Processing CreateTablet for tablet f756689d4c99489885a0cd59f84a6e8a (DEFAULT_TABLE table=default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.502790 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f756689d4c99489885a0cd59f84a6e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.502732 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:26.503221 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_e33c9849bbd34e6b9b72e69fd3a1ab1c [id=b206753d4f4142be82ee28150226bd53]). Expected version 1 got 0
I20260810 11:30:26.503666 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:26.504061 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:26.504406 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:26.504527 27025 tablet_service.cc:1467] Processing CreateTablet for tablet 046fede13acf44e294fde386f78446a5 (DEFAULT_TABLE table=default.Table_b15d6127087043a186b912230d2fe666 [id=ac5dd73c5e8e40108a8b663241887081]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.504753 26877 tablet_service.cc:1514] Processing DeleteTablet for tablet 478c0c39658349c39e3afa1aa1653e82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:50850
W20260810 11:30:26.505465 27334 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8083fa130cd04dae9d61aeed977c1c63 consensus state has no leader
W20260810 11:30:26.505980 27318 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 592be61b7e524941931264125b33d92c consensus state has no leader
I20260810 11:30:26.506196 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 046fede13acf44e294fde386f78446a5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:26.506356 27321 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e329b95fc8e41c3967079896294942a consensus state has no leader
W20260810 11:30:26.506673 27322 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 460a679219cb4a7f9aecfec58a98238b consensus state has no leader
I20260810 11:30:26.506844 27362 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet 7e78fb1bf0534deca5cc5a603fd77592
W20260810 11:30:26.507287 27326 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 271a0607ec28441c91bac32c2f2bf44b consensus state has no leader
I20260810 11:30:26.507833 27319 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet 2da86554bc51486e91f1ea5995a245b5
I20260810 11:30:26.509186 27031 tablet_service.cc:1467] Processing CreateTablet for tablet faff8489499e4e318b127d9c1b19d2e4 (DEFAULT_TABLE table=default.Table_6efb1e8e65fa4f88ae25c9d2ebc6b4f4 [id=d83083bfedd542398d132e4bac9a7f12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.509833 27031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet faff8489499e4e318b127d9c1b19d2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.515883 27022 tablet_service.cc:1467] Processing CreateTablet for tablet dc10f61181794e2bba099ca46881e94d (DEFAULT_TABLE table=default.Table_971ac96924ee4a09bc7bc1befdb296d1 [id=cbb462ed5c1f4adf9363f7ac03b78c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.516232 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet 0713f4f14a284050a7774a70ab974f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.525336 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc10f61181794e2bba099ca46881e94d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.528795 27037 tablet_service.cc:1467] Processing CreateTablet for tablet fdeba015c2364ec385e8b06c18a2a9d2 (DEFAULT_TABLE table=default.Table_5d3880885d6342738dd22e168d08e660 [id=31e5d2935c2f44e4b272255fbd4c948a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.523900 27228 tablet_bootstrap.cc:492] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:26.524712 26890 tablet_service.cc:1514] Processing DeleteTablet for tablet a3406dc345e3429fb4bce5a59643b686 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.525684 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.533684 27763 raft_consensus.cc:482] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:26.534812 27763 raft_consensus.cc:504] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.535637 27763 leader_election.cc:288] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:26.536413 27228 ts_tablet_manager.cc:1397] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.414s user 0.022s sys 0.042s
I20260810 11:30:26.532917 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f24c84cdd945b78f39f24015eb1e43 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b95f3ec8ff34c89a68cd1edf8391f9b) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.539798 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca5c88585394dba87e201696afa6934 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.552368 27248 ts_tablet_manager.cc:1918] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:26.553321 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdeba015c2364ec385e8b06c18a2a9d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.559921 27111 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:26.563885 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet cb01e54d817c4b0dbcc80f90f82923c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5deec04c1be64473accf8b9df14bd22e) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.564013 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet ffeb0373c6124af291336ca9da50c318 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.564231 26880 tablet_service.cc:1514] Processing DeleteTablet for tablet f3c6bd6803c245b7bb3d78423de482b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.564309 26887 tablet_service.cc:1514] Processing DeleteTablet for tablet 8798892eb4604ee8ac9c95e64dbb14e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.564632 26876 tablet_service.cc:1514] Processing DeleteTablet for tablet 949f31fa0c124eefbee695cfc7f50cbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.564496 26877 tablet_service.cc:1514] Processing DeleteTablet for tablet e25ae21cc8cc4749a507fcab5ee225a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.568177 26890 tablet_service.cc:1514] Processing DeleteTablet for tablet 31888ddeafe14738b818016a9c0a4ad3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.565145 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 72e0b69e7c7e4343b309d16c030d4306 (DEFAULT_TABLE table=default.Table_c32d1cb0b9e744fbacbd00c8736fad21 [id=f54b49f28880453aa7bc67b9c36a219b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.570217 26879 tablet_service.cc:1514] Processing DeleteTablet for tablet 0033d61d07d84262a98b0ebc54bd7960 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.570806 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet eb9394f9ca2c44de93354e23973cf902 with delete_type TABLET_DATA_DELETED (replaced by tablet db59523b71224370bf5fce6b56592f71) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.570976 26891 tablet_service.cc:1514] Processing DeleteTablet for tablet 31cafb7c691d40a48a40f7d4190c4f8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.567449 27231 raft_consensus.cc:348] T cd3575197c464c7fb51f9592831959bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.571125 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b15cc8669b549a2b4461dccd66a0c5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.571409 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet bb0357271cfd46478867a3cc0660bcdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.572489 27039 tablet_service.cc:1467] Processing CreateTablet for tablet 7c203cd90d2f472fa27cfabed5b87119 (DEFAULT_TABLE table=default.Table_9633fc0dda2b422baa0de7b537dc5479 [id=7885e7f1ab9f452a8b58aabdf808e0e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.571815 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e2c9112462f442e8de5b4a944cfdc6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.572893 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 603fe104b7ab485eab6b225a58bddc1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.573980 26887 tablet_service.cc:1514] Processing DeleteTablet for tablet 0118ff9d21924aefa8c6c32977c10453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.574198 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a83391804894d268d0e603f4feb1745 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.575446 26878 tablet_service.cc:1514] Processing DeleteTablet for tablet a18cb43b4dc04a1290a6bade7ac1f3cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.577304 27231 raft_consensus.cc:374] T cd3575197c464c7fb51f9592831959bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:26.578194 27033 tablet_service.cc:1467] Processing CreateTablet for tablet bd34a4de1b93402c8a4bce1215660e77 (DEFAULT_TABLE table=default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.578645 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 10e6c41db71a4146840f06c5b7412d9c with delete_type TABLET_DATA_DELETED (replaced by tablet 72209a805e3e4b4ea1bf99508e0f75db) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.578927 27974 ts_tablet_manager.cc:1918] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:26.579102 27974 log.cc:1196] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/e25ae21cc8cc4749a507fcab5ee225a3
I20260810 11:30:26.579208 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd3575197c464c7fb51f9592831959bb" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:26.579850 27974 ts_tablet_manager.cc:1939] T e25ae21cc8cc4749a507fcab5ee225a3 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:26.579908 28102 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:33500 (request call id 45) took 1207 ms. Trace:
I20260810 11:30:26.581010 26878 tablet_service.cc:1514] Processing DeleteTablet for tablet cb6805a5dd264939850ea2cd9a850a1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.581912 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet a7a2cb1d2e8e40f58144908e34438d53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.582494 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 83631b421a614796bdf76335f1437e00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.582962 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c595e0892634348b64418ae9dbbd4c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.583225 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72e0b69e7c7e4343b309d16c030d4306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.583712 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet a8a65a0e8b1f4e4b8d9a82059b766cda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.584313 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3406f12d9c492cbd0d86fa7a57de82 with delete_type TABLET_DATA_DELETED (replaced by tablet 72e0b69e7c7e4343b309d16c030d4306) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.585044 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet db59523b71224370bf5fce6b56592f71 with delete_type TABLET_DATA_DELETED (replaced by tablet bd34a4de1b93402c8a4bce1215660e77) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.585368 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet a28849649c704f2fbdec1aced9ce01b1 with delete_type TABLET_DATA_DELETED (replaced by tablet eb9394f9ca2c44de93354e23973cf902) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.585925 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet d91a02b22044429fb3e25840c7947a02 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ba5191082814a4f8cf821354416e1d3) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.586625 26885 tablet_service.cc:1467] Processing CreateTablet for tablet 262656cbd3944702ac0ce04222cda500 (DEFAULT_TABLE table=default.Table_174d1e3073a34beabbd10fd4f6d61bd4 [id=d538eb7fe6224d6895190c79c041b76f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.587201 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 262656cbd3944702ac0ce04222cda500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.580065 28102 rpcz_store.cc:276] 0810 11:30:25.351753 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.353146 (+ 1393us) service_pool.cc:227] Handling call
0810 11:30:26.558877 (+1205731us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:25.395893 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0810 11:30:25.396009 (+ 116us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 11:30:25.396022 (+ 13us) alter_schema_op.cc:65] Acquired schema lock
0810 11:30:25.396030 (+ 8us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0810 11:30:25.396069 (+ 39us) alter_schema_op.cc:126] START. Timestamp: 1786361425396038
0810 11:30:25.396074 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:25.396258 (+ 184us) log.cc:842] Serialized 173 byte log entry
0810 11:30:26.496243 (+1099985us) op_driver.cc:444] REPLICATION: finished
0810 11:30:26.496381 (+ 138us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0810 11:30:26.496997 (+ 616us) log.cc:842] Serialized 5 byte log entry
0810 11:30:26.558006 (+ 61009us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:26.558316 (+ 310us) log.cc:842] Serialized 14 byte log entry
0810 11:30:26.558820 (+ 504us) alter_schema_op.cc:71] Released schema lock
0810 11:30:26.558824 (+ 4us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":84,"prepare.queue_time_us":17520,"prepare.run_cpu_time_us":8392,"prepare.run_wall_time_us":97299,"raft.queue_time_us":47,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":1100134,"thread_start_us":230931,"threads_started":2,"wal-append.queue_time_us":97391}]]}
I20260810 11:30:26.588009 27033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd34a4de1b93402c8a4bce1215660e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.588855 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 046fede13acf44e294fde386f78446a5 (DEFAULT_TABLE table=default.Table_b15d6127087043a186b912230d2fe666 [id=ac5dd73c5e8e40108a8b663241887081]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.589383 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 046fede13acf44e294fde386f78446a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.590981 26878 tablet_service.cc:1514] Processing DeleteTablet for tablet ff9b649e43a9456fa51cf3330290bb91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.591528 26886 tablet_service.cc:1467] Processing CreateTablet for tablet faff8489499e4e318b127d9c1b19d2e4 (DEFAULT_TABLE table=default.Table_6efb1e8e65fa4f88ae25c9d2ebc6b4f4 [id=d83083bfedd542398d132e4bac9a7f12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.592144 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet faff8489499e4e318b127d9c1b19d2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.592981 27039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c203cd90d2f472fa27cfabed5b87119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.594405 26878 tablet_service.cc:1467] Processing CreateTablet for tablet fdeba015c2364ec385e8b06c18a2a9d2 (DEFAULT_TABLE table=default.Table_5d3880885d6342738dd22e168d08e660 [id=31e5d2935c2f44e4b272255fbd4c948a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.594928 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdeba015c2364ec385e8b06c18a2a9d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.598860 27038 tablet_service.cc:1467] Processing CreateTablet for tablet 16101a5784394d3aa570f4ecd8f2ac56 (DEFAULT_TABLE table=default.Table_645b3efca425434da139268167fec99f [id=51dc04b8252b4142a7ac67c5fc0dd1ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.603181 26881 tablet_service.cc:1467] Processing CreateTablet for tablet f756689d4c99489885a0cd59f84a6e8a (DEFAULT_TABLE table=default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.603781 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f756689d4c99489885a0cd59f84a6e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.605743 26891 tablet_service.cc:1467] Processing CreateTablet for tablet dc10f61181794e2bba099ca46881e94d (DEFAULT_TABLE table=default.Table_971ac96924ee4a09bc7bc1befdb296d1 [id=cbb462ed5c1f4adf9363f7ac03b78c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.606333 26891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc10f61181794e2bba099ca46881e94d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.606877 27020 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e78fb1bf0534deca5cc5a603fd77592 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.607913 27231 raft_consensus.cc:729] T cd3575197c464c7fb51f9592831959bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:26.608312 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet 64818ca5827e41d99428903ddb8688d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.615403 27999 ts_tablet_manager.cc:1918] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:26.615625 27999 log.cc:1196] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/6e829d4bffeb4289a54b4d3d7a53c44e
I20260810 11:30:26.616226 27999 ts_tablet_manager.cc:1939] T 6e829d4bffeb4289a54b4d3d7a53c44e P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:26.617470 28136 tablet.cc:1722] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:26.618393 27020 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da86554bc51486e91f1ea5995a245b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.621270 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet f3884736eec74c8992b8d51b37465875 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]) successfully deleted
I20260810 11:30:26.622170 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16101a5784394d3aa570f4ecd8f2ac56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.620381 27231 consensus_queue.cc:260] T cd3575197c464c7fb51f9592831959bb P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.623286 27228 raft_consensus.cc:348] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.623714 27228 raft_consensus.cc:374] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:26.623869 27228 raft_consensus.cc:729] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:26.624248 27228 consensus_queue.cc:260] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.629277 26822 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:26.633790 27059 raft_consensus.cc:2454] T cd3575197c464c7fb51f9592831959bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:26.626034 27228 ts_tablet_manager.cc:1428] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.089s user 0.000s sys 0.003s
I20260810 11:30:26.583998 26887 tablet_service.cc:1514] Processing DeleteTablet for tablet 91b6078efadf496fb252f725bdf56b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.638715 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 5) took 2211 ms. Trace:
I20260810 11:30:26.639638 27999 rpcz_store.cc:276] 0810 11:30:24.427325 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.428025 (+ 700us) service_pool.cc:227] Handling call
0810 11:30:26.004288 (+1576263us) ts_tablet_manager.cc:1145] Deleting tablet 6e829d4bffeb4289a54b4d3d7a53c44e
0810 11:30:26.004305 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:26.504083 (+499778us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:26.615218 (+111135us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:26.638586 (+ 23368us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1574110}
I20260810 11:30:26.640161 27999 tablet_replica.cc:330] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:26.644959 26702 leader_election.cc:302] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:26.646015 27763 raft_consensus.cc:2781] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:26.646147 27763 raft_consensus.cc:482] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:26.646258 27763 raft_consensus.cc:3037] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:26.649885 27763 raft_consensus.cc:504] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.651928 27763 leader_election.cc:288] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:26.652961 27228 tablet_bootstrap.cc:492] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:26.656828 27999 raft_consensus.cc:2229] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:26.657496 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b5a7f67ec5b48c2b5a510add0282a76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.658154 27999 raft_consensus.cc:2258] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:26.661031 27321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_7d84624ac4e94437acb400decf3bb21b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:26.661885 27322 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_8326a5b5a7544e828699f8b41fdee4d1" } modify_external_catalogs: true
W20260810 11:30:26.662082 27321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d84624ac4e94437acb400decf3bb21b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:26.661962 28125 tablet.cc:1722] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:26.662173 27322 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_8326a5b5a7544e828699f8b41fdee4d1" } modify_external_catalogs: true
I20260810 11:30:26.662530 27362 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_cbf7fb0f0585465a9be24fa7e70d68d2" } modify_external_catalogs: true
I20260810 11:30:26.662820 27318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_fee5e058d63849c189e798c232542ad2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:26.663410 27318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fee5e058d63849c189e798c232542ad2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:26.665182 27999 ts_tablet_manager.cc:1905] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:26.665143 27326 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_61d778388656489cb2e7fe8312b8ac6e" } modify_external_catalogs: true
I20260810 11:30:26.665338 27334 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_8589a61b5c4e42c0a92a80a3576db8ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:26.665952 27334 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8589a61b5c4e42c0a92a80a3576db8ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:26.666507 27319 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_4eef50b9dbea413f91b6b6a35c997283"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:26.667131 27319 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4eef50b9dbea413f91b6b6a35c997283 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:26.667830 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 91b6078efadf496fb252f725bdf56b02 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91b6078efadf496fb252f725bdf56b02 already in progress: creating tablet
W20260810 11:30:26.668264 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet f3884736eec74c8992b8d51b37465875 because the tablet was not found. No further retry: Not found: Tablet not found: f3884736eec74c8992b8d51b37465875
W20260810 11:30:26.668599 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet a3406dc345e3429fb4bce5a59643b686 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3406dc345e3429fb4bce5a59643b686 already in progress: creating tablet
W20260810 11:30:26.668874 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 0713f4f14a284050a7774a70ab974f30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0713f4f14a284050a7774a70ab974f30 already in progress: creating tablet
I20260810 11:30:26.669792 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet f2b555f18c1e485d9af7b08f98543c80 with delete_type TABLET_DATA_DELETED (replaced by tablet 1801d3af4a4548dba8b0d8ea2fecf5ba) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.674577 27362 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_cbf7fb0f0585465a9be24fa7e70d68d2" } modify_external_catalogs: true
I20260810 11:30:26.675933 27326 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_61d778388656489cb2e7fe8312b8ac6e" } modify_external_catalogs: true
I20260810 11:30:26.679872 27222 tablet_bootstrap.cc:492] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:26.680356 27222 ts_tablet_manager.cc:1397] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.272s user 0.007s sys 0.007s
I20260810 11:30:26.681565 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 834c9c99ec424bb39e8a003e9204b2bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.682158 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd3575197c464c7fb51f9592831959bb" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:26.682458 27059 raft_consensus.cc:3037] T cd3575197c464c7fb51f9592831959bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:26.684054 28102 tablet.cc:1722] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:26.687676 27248 log.cc:1196] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/6e829d4bffeb4289a54b4d3d7a53c44e
I20260810 11:30:26.689131 27231 ts_tablet_manager.cc:1428] T cd3575197c464c7fb51f9592831959bb P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.204s user 0.005s sys 0.000s
I20260810 11:30:26.689131 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 96cae4eb16c84410926a317af70e44f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.693681 27231 tablet_bootstrap.cc:492] T 3ddb6e67c316416681074e454ab9b01e P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:26.694020 27059 raft_consensus.cc:2454] T cd3575197c464c7fb51f9592831959bb P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:26.694669 26702 leader_election.cc:302] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:26.687312 27222 raft_consensus.cc:348] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.698342 27222 raft_consensus.cc:374] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:26.699195 27763 raft_consensus.cc:2781] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:26.699126 27222 raft_consensus.cc:729] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:26.699682 27763 raft_consensus.cc:686] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:26.700070 27763 consensus_queue.cc:237] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.700619 27222 consensus_queue.cc:260] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.705377 27222 ts_tablet_manager.cc:1428] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.024s user 0.000s sys 0.004s
I20260810 11:30:26.715538 27336 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: default.Table_1e1ca07e9c824349af23675b66b77321 [id=755202f095f04307a11ce87087df835c] alter complete (version 2)
I20260810 11:30:26.751200 27228 tablet_bootstrap.cc:654] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:26.752903 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.767376 28029 raft_consensus.cc:482] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:26.767849 28029 raft_consensus.cc:504] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:26.777141 27321 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 92) took 1016 ms. Trace:
I20260810 11:30:26.777328 27321 rpcz_store.cc:276] 0810 11:30:25.760887 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.506541 (+745654us) service_pool.cc:227] Handling call
0810 11:30:26.660782 (+154241us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dc313 00007f55f09ce466 00007f55f09ce195 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:26.672801 (+ 12019us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:26.673766 (+ 965us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:26.776741 (+102975us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:26.776891 (+ 150us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:26.777016 (+ 125us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:26.675063 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:26.675179 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:26.675186 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:26.675188 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:26.675314 (+ 126us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:26.675325 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:26.675330 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:26.675441 (+ 111us) tablet.cc:699] Row locks acquired
0810 11:30:26.675444 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:26.675485 (+ 41us) write_op.cc:270] Start()
0810 11:30:26.675519 (+ 34us) write_op.cc:276] Timestamp: P: 1786361426675453 usec, L: 0
0810 11:30:26.675523 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:26.675737 (+ 214us) log.cc:842] Serialized 433 byte log entry
0810 11:30:26.775465 (+ 99728us) op_driver.cc:444] REPLICATION: finished
0810 11:30:26.775578 (+ 113us) write_op.cc:301] APPLY: starting
0810 11:30:26.775599 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:26.775661 (+ 62us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:26.775762 (+ 101us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:26.775925 (+ 163us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:26.775976 (+ 51us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:26.775983 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:26.776104 (+ 121us) log.cc:842] Serialized 29 byte log entry
0810 11:30:26.776184 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:26.776209 (+ 25us) write_op.cc:454] Released schema lock
0810 11:30:26.776220 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:26.776296 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:26.776302 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":354087936,"child_traces":[["op",{"apply.queue_time_us":45,"apply.run_cpu_time_us":788,"apply.run_wall_time_us":787,"mutex_wait_us":2308,"num_ops":2,"prepare.queue_time_us":685,"prepare.run_cpu_time_us":760,"prepare.run_wall_time_us":760,"replication_time_us":99905}]]}
I20260810 11:30:26.780411 27334 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 90) took 1033 ms. Trace:
I20260810 11:30:26.780582 27334 rpcz_store.cc:276] 0810 11:30:25.746480 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.505881 (+759401us) service_pool.cc:227] Handling call
0810 11:30:26.665094 (+159213us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dc313 00007f55f09ce466 00007f55f09ce195 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:26.672911 (+ 7817us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:26.673766 (+ 855us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:26.780072 (+106306us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:26.780213 (+ 141us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:26.780337 (+ 124us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:26.678178 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:26.678288 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:26.678297 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:26.678301 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:26.678397 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:26.678408 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:26.678412 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:26.678548 (+ 136us) tablet.cc:699] Row locks acquired
0810 11:30:26.678551 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:26.678593 (+ 42us) write_op.cc:270] Start()
0810 11:30:26.678628 (+ 35us) write_op.cc:276] Timestamp: P: 1786361426678559 usec, L: 0
0810 11:30:26.678632 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:26.678806 (+ 174us) log.cc:842] Serialized 433 byte log entry
0810 11:30:26.779190 (+100384us) op_driver.cc:444] REPLICATION: finished
0810 11:30:26.779301 (+ 111us) write_op.cc:301] APPLY: starting
0810 11:30:26.779319 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:26.779378 (+ 59us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:26.779425 (+ 47us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:26.779567 (+ 142us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:26.779614 (+ 47us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:26.779624 (+ 10us) write_op.cc:312] APPLY: finished
0810 11:30:26.779727 (+ 103us) log.cc:842] Serialized 29 byte log entry
0810 11:30:26.779822 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:26.779844 (+ 22us) write_op.cc:454] Released schema lock
0810 11:30:26.779855 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:26.779925 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:26.779931 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":365363328,"child_traces":[["op",{"apply.queue_time_us":48,"apply.run_cpu_time_us":687,"apply.run_wall_time_us":687,"mutex_wait_us":65,"num_ops":2,"prepare.queue_time_us":3816,"prepare.run_cpu_time_us":697,"prepare.run_wall_time_us":696,"replication_time_us":100525}]]}
I20260810 11:30:26.781781 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet 2634beb347714fc7a2e05865adb34a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.792831 28029 leader_election.cc:288] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:26.793538 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.798668 27248 ts_tablet_manager.cc:1939] T 6e829d4bffeb4289a54b4d3d7a53c44e P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
W20260810 11:30:26.800294 26848 leader_election.cc:341] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 2917f1ffb5214a80b19810540602df35
W20260810 11:30:26.803684 26991 consensus_peers.cc:487] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b15cc8669b549a2b4461dccd66a0c5a. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:26.820300 27231 tablet_bootstrap.cc:654] T 3ddb6e67c316416681074e454ab9b01e P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:26.820676 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 8) took 2517 ms. Trace:
I20260810 11:30:26.820940 27248 rpcz_store.cc:276] 0810 11:30:24.282424 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.282520 (+ 96us) service_pool.cc:227] Handling call
0810 11:30:26.275793 (+1993273us) ts_tablet_manager.cc:1145] Deleting tablet 6e829d4bffeb4289a54b4d3d7a53c44e
0810 11:30:26.275805 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:26.433247 (+157442us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:26.552230 (+118983us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:26.799349 (+247119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1992740}
I20260810 11:30:26.822484 27248 tablet_replica.cc:330] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:26.822495 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 6e829d4bffeb4289a54b4d3d7a53c44e (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]) successfully deleted
I20260810 11:30:26.822753 27248 raft_consensus.cc:2229] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:26.823477 27248 raft_consensus.cc:2258] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:26.824250 27248 ts_tablet_manager.cc:1905] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:26.827419 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 72e0b69e7c7e4343b309d16c030d4306 (DEFAULT_TABLE table=default.Table_c32d1cb0b9e744fbacbd00c8736fad21 [id=f54b49f28880453aa7bc67b9c36a219b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.828192 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72e0b69e7c7e4343b309d16c030d4306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.850828 26893 tablet_service.cc:1467] Processing CreateTablet for tablet bd34a4de1b93402c8a4bce1215660e77 (DEFAULT_TABLE table=default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.851684 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd34a4de1b93402c8a4bce1215660e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.867630 26878 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d5e146eeec4fe0be33c1c169d32e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.889684 27248 ts_tablet_manager.cc:1918] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:26.890795 27231 tablet_bootstrap.cc:492] T 3ddb6e67c316416681074e454ab9b01e P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:26.891222 27231 ts_tablet_manager.cc:1397] T 3ddb6e67c316416681074e454ab9b01e P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.202s user 0.009s sys 0.000s
I20260810 11:30:26.892551 27231 raft_consensus.cc:348] T 3ddb6e67c316416681074e454ab9b01e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.893119 27231 raft_consensus.cc:374] T 3ddb6e67c316416681074e454ab9b01e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:26.893352 27231 raft_consensus.cc:729] T 3ddb6e67c316416681074e454ab9b01e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:26.893862 27231 consensus_queue.cc:260] T 3ddb6e67c316416681074e454ab9b01e P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:26.908849 27231 ts_tablet_manager.cc:1428] T 3ddb6e67c316416681074e454ab9b01e P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.017s user 0.003s sys 0.000s
I20260810 11:30:26.914347 27231 tablet_bootstrap.cc:492] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:26.918082 27248 log.cc:1196] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/96cae4eb16c84410926a317af70e44f7
I20260810 11:30:26.918859 27248 ts_tablet_manager.cc:1939] T 96cae4eb16c84410926a317af70e44f7 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:26.930958 26885 tablet_service.cc:1467] Processing CreateTablet for tablet 7c203cd90d2f472fa27cfabed5b87119 (DEFAULT_TABLE table=default.Table_9633fc0dda2b422baa0de7b537dc5479 [id=7885e7f1ab9f452a8b58aabdf808e0e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:26.933868 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c203cd90d2f472fa27cfabed5b87119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:26.937536 27231 tablet_bootstrap.cc:654] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:26.939937 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 9) took 2653 ms. Trace:
I20260810 11:30:26.940196 27248 rpcz_store.cc:276] 0810 11:30:24.283007 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.283070 (+ 63us) service_pool.cc:227] Handling call
0810 11:30:26.821790 (+2538720us) ts_tablet_manager.cc:1145] Deleting tablet 96cae4eb16c84410926a317af70e44f7
0810 11:30:26.821811 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:26.880792 (+ 58981us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:26.889519 (+ 8727us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:26.936330 (+ 46811us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2538250}
I20260810 11:30:26.941064 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 96cae4eb16c84410926a317af70e44f7 (table default.Table_bd735fb392144c6b97d5678685645108 [id=b471e1c958484bbc95c4cbb4c79bea91]) successfully deleted
I20260810 11:30:26.943099 27248 tablet_replica.cc:330] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:26.943789 27322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet 587c6ce242c0411b886404a0df03b1bb
I20260810 11:30:26.945008 27248 raft_consensus.cc:2229] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:26.945572 27248 raft_consensus.cc:2258] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:26.946287 27911 consensus_queue.cc:1035] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:26.946626 27248 ts_tablet_manager.cc:1905] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:26.947170 27322 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49152 (request call id 93) took 1168 ms. Trace:
I20260810 11:30:26.947166 27319 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 96) took 1003 ms. Trace:
I20260810 11:30:26.948660 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 587c6ce242c0411b886404a0df03b1bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.953128 27319 rpcz_store.cc:276] 0810 11:30:25.942819 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.508264 (+565445us) service_pool.cc:227] Handling call
0810 11:30:26.666400 (+158136us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dc313 00007f55f09ce466 00007f55f09ce195 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:26.675003 (+ 8603us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:26.675453 (+ 450us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:26.945666 (+270213us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:26.945803 (+ 137us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:26.945931 (+ 128us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:26.679503 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:26.679604 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:26.679608 (+ 4us) write_op.cc:435] Acquired schema lock
0810 11:30:26.679612 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:26.679686 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:26.679693 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:26.679697 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:26.679760 (+ 63us) tablet.cc:699] Row locks acquired
0810 11:30:26.679762 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:26.679789 (+ 27us) write_op.cc:270] Start()
0810 11:30:26.679813 (+ 24us) write_op.cc:276] Timestamp: P: 1786361426679759 usec, L: 0
0810 11:30:26.679816 (+ 3us) op_driver.cc:331] REPLICATION: starting
0810 11:30:26.679948 (+ 132us) log.cc:842] Serialized 433 byte log entry
0810 11:30:26.943570 (+263622us) op_driver.cc:444] REPLICATION: finished
0810 11:30:26.943679 (+ 109us) write_op.cc:301] APPLY: starting
0810 11:30:26.943699 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:26.943748 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:26.945094 (+ 1346us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:26.945252 (+ 158us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:26.945293 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:26.945300 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:26.945405 (+ 105us) log.cc:842] Serialized 29 byte log entry
0810 11:30:26.945486 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:26.945513 (+ 27us) write_op.cc:454] Released schema lock
0810 11:30:26.945522 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:26.945633 (+ 111us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:26.945638 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":363006848,"child_traces":[["op",{"apply.queue_time_us":50,"apply.run_cpu_time_us":739,"apply.run_wall_time_us":2024,"num_ops":2,"prepare.queue_time_us":3666,"prepare.run_cpu_time_us":495,"prepare.run_wall_time_us":493,"replication_time_us":263720}]]}
I20260810 11:30:26.956444 27362 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet a87f6835f0dc4ad4b3a23b297726100d
I20260810 11:30:26.957538 27362 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49152 (request call id 94) took 1152 ms. Trace:
I20260810 11:30:26.957751 27362 rpcz_store.cc:276] 0810 11:30:25.805593 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.507396 (+701803us) service_pool.cc:227] Handling call
0810 11:30:26.662427 (+155031us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dd2e6 00007f55f09d0126 00007f55f09cfe55 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:26.674832 (+ 12405us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:26.674987 (+ 155us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:26.675044 (+ 57us) catalog_manager.cc:2761] Locking tablets
0810 11:30:26.675193 (+ 149us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:26.946862 (+271669us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:26.946969 (+ 107us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:26.947022 (+ 53us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:26.957300 (+ 10278us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:26.680041 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:26.680132 (+ 91us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:26.680136 (+ 4us) write_op.cc:435] Acquired schema lock
0810 11:30:26.680138 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:26.680235 (+ 97us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:26.680244 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:26.680250 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:26.680370 (+ 120us) tablet.cc:699] Row locks acquired
0810 11:30:26.680373 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:26.680402 (+ 29us) write_op.cc:270] Start()
0810 11:30:26.680429 (+ 27us) write_op.cc:276] Timestamp: P: 1786361426680372 usec, L: 0
0810 11:30:26.680433 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:26.682401 (+ 1968us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x6160000c13a0. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f1b035bb 00007f55f1b02c7e 00007f55f1bb3e45 00007f55f1bb4cd9 00007f55f2ee77f1 00007f55f2ee6359 00007f55f2eee1bb 00007f55f2eee038 00000000009edb7c 00007f55e66ec344
0810 11:30:26.682536 (+ 135us) log.cc:842] Serialized 765 byte log entry
0810 11:30:26.943810 (+261274us) op_driver.cc:444] REPLICATION: finished
0810 11:30:26.945788 (+ 1978us) write_op.cc:301] APPLY: starting
0810 11:30:26.945805 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:26.945865 (+ 60us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:26.945868 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:26.946197 (+ 329us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:26.946233 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:26.946239 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:26.946320 (+ 81us) log.cc:842] Serialized 29 byte log entry
0810 11:30:26.946385 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:26.946401 (+ 16us) write_op.cc:454] Released schema lock
0810 11:30:26.946408 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:26.946465 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:26.946469 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":351695616,"child_traces":[["op",{"apply.queue_time_us":1928,"apply.run_cpu_time_us":524,"apply.run_wall_time_us":737,"num_ops":2,"prepare.queue_time_us":3789,"prepare.run_cpu_time_us":1063,"prepare.run_wall_time_us":2581,"replication_time_us":263356,"spinlock_wait_cycles":3796736,"threads_started":1}]]}
W20260810 11:30:26.960202 27331 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 00d52e5c77d94854b8ba0b38c63ad015 consensus state has no leader
I20260810 11:30:26.961225 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da86554bc51486e91f1ea5995a245b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:26.953092 27322 rpcz_store.cc:276] 0810 11:30:25.776979 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.506906 (+729927us) service_pool.cc:227] Handling call
0810 11:30:26.661809 (+154903us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dd2e6 00007f55f09d0126 00007f55f09cfe55 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:26.662309 (+ 500us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:26.674008 (+ 11699us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:26.674102 (+ 94us) catalog_manager.cc:2761] Locking tablets
0810 11:30:26.674241 (+ 139us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:26.942555 (+268314us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:26.942911 (+ 356us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:26.943070 (+ 159us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:26.945013 (+ 1943us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:26.678907 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:26.679003 (+ 96us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:26.679008 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:26.679010 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:26.679114 (+ 104us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:26.679125 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:26.679129 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:26.679216 (+ 87us) tablet.cc:699] Row locks acquired
0810 11:30:26.679218 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:26.679249 (+ 31us) write_op.cc:270] Start()
0810 11:30:26.679276 (+ 27us) write_op.cc:276] Timestamp: P: 1786361426679217 usec, L: 0
0810 11:30:26.679280 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:26.679418 (+ 138us) log.cc:842] Serialized 765 byte log entry
0810 11:30:26.783908 (+104490us) op_driver.cc:444] REPLICATION: finished
0810 11:30:26.941772 (+157864us) write_op.cc:301] APPLY: starting
0810 11:30:26.941804 (+ 32us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:26.941881 (+ 77us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:26.941929 (+ 48us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:26.942042 (+ 113us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:26.942097 (+ 55us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:26.942108 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:26.942249 (+ 141us) log.cc:842] Serialized 29 byte log entry
0810 11:30:26.942349 (+ 100us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:26.942376 (+ 27us) write_op.cc:454] Released schema lock
0810 11:30:26.942386 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:26.942491 (+ 105us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:26.942510 (+ 19us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":488,"spinlock_wait_cycles":355617152,"child_traces":[["op",{"apply.queue_time_us":157753,"apply.run_cpu_time_us":833,"apply.run_wall_time_us":833,"num_ops":2,"prepare.queue_time_us":3908,"prepare.run_cpu_time_us":561,"prepare.run_wall_time_us":558,"replication_time_us":104595}]]}
I20260810 11:30:26.966960 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 6e829d4bffeb4289a54b4d3d7a53c44e (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]) successfully deleted
W20260810 11:30:26.968362 27331 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.193:39107 (request call id 81) took 1340 ms (client timeout 1000 ms). Trace:
I20260810 11:30:26.973181 28029 raft_consensus.cc:482] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:26.973744 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 16101a5784394d3aa570f4ecd8f2ac56 (DEFAULT_TABLE table=default.Table_645b3efca425434da139268167fec99f [id=51dc04b8252b4142a7ac67c5fc0dd1ad]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:26.973881 27331 rpcz_store.cc:269] 0810 11:30:25.628007 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.716352 (+ 88345us) service_pool.cc:227] Handling call
0810 11:30:26.968269 (+1251917us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":77451,"reported_tablets":174}
I20260810 11:30:26.978096 28029 raft_consensus.cc:504] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:26.978729 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet a87f6835f0dc4ad4b3a23b297726100d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:26.978994 28029 leader_election.cc:288] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:26.985091 27334 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_e91c3002bfab499aad3c1d686b4f4437"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:26.985956 27334 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e91c3002bfab499aad3c1d686b4f4437 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:26.987694 27326 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet fbe0a0ab82a147a3b6164904b135d1ab
I20260810 11:30:26.988430 27326 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49152 (request call id 95) took 1182 ms. Trace:
I20260810 11:30:26.996683 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "524c8d37d3964e368695d182883b0bd5" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:26.996809 27222 tablet_bootstrap.cc:492] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:26.997219 27322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_44f89aa654e84f22a77580060f057750"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:26.996485 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet fbe0a0ab82a147a3b6164904b135d1ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:33500
W20260810 11:30:26.997116 26848 leader_election.cc:341] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 66908164ff2a4ee5b55da6158699e0c6
I20260810 11:30:27.011211 27974 tablet_replica.cc:330] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:27.017211 27248 ts_tablet_manager.cc:1918] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:27.017470 27248 log.cc:1196] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/a28849649c704f2fbdec1aced9ce01b1
I20260810 11:30:27.018167 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02ff6a9bc02441ddb7f307d6b3df31bd" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:27.018642 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16101a5784394d3aa570f4ecd8f2ac56. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:27.020915 27322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44f89aa654e84f22a77580060f057750 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:26.998116 27362 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_9a25589f61c844cab9a7d2db84a7eba2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:27.035064 27231 tablet_bootstrap.cc:492] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:27.035337 27231 ts_tablet_manager.cc:1397] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.121s user 0.009s sys 0.005s
I20260810 11:30:27.040838 27999 ts_tablet_manager.cc:1918] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:27.020967 27321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_a406a8172095498abc9c54697f00f4a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:27.048748 27318 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 91) took 1231 ms. Trace:
W20260810 11:30:27.049387 27321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a406a8172095498abc9c54697f00f4a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:26.994380 27326 rpcz_store.cc:276] 0810 11:30:25.805793 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.507513 (+701720us) service_pool.cc:227] Handling call
0810 11:30:26.665049 (+157536us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dd2e6 00007f55f09d0126 00007f55f09cfe55 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:26.676169 (+ 11120us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:26.676344 (+ 175us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:26.676403 (+ 59us) catalog_manager.cc:2761] Locking tablets
0810 11:30:26.676540 (+ 137us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:26.986684 (+310144us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:26.986799 (+ 115us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:26.986913 (+ 114us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:26.988378 (+ 1465us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:26.690654 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:26.690796 (+ 142us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:26.690804 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:26.690806 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:26.690962 (+ 156us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:26.690991 (+ 29us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:26.690997 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:26.691141 (+ 144us) tablet.cc:699] Row locks acquired
0810 11:30:26.691144 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:26.691191 (+ 47us) write_op.cc:270] Start()
0810 11:30:26.691231 (+ 40us) write_op.cc:276] Timestamp: P: 1786361426691155 usec, L: 0
0810 11:30:26.691244 (+ 13us) op_driver.cc:331] REPLICATION: starting
0810 11:30:26.691494 (+ 250us) log.cc:842] Serialized 799 byte log entry
0810 11:30:26.983846 (+292352us) op_driver.cc:444] REPLICATION: finished
0810 11:30:26.984476 (+ 630us) write_op.cc:301] APPLY: starting
0810 11:30:26.984504 (+ 28us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:26.984608 (+ 104us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:26.984657 (+ 49us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:26.984772 (+ 115us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:26.984988 (+ 216us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:26.985001 (+ 13us) write_op.cc:312] APPLY: finished
0810 11:30:26.985143 (+ 142us) log.cc:842] Serialized 29 byte log entry
0810 11:30:26.985243 (+ 100us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:26.985273 (+ 30us) write_op.cc:454] Released schema lock
0810 11:30:26.985285 (+ 12us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:26.985368 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:26.985375 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":361472384,"child_traces":[["op",{"apply.queue_time_us":481,"apply.run_cpu_time_us":1007,"apply.run_wall_time_us":1007,"num_ops":2,"prepare.queue_time_us":5537,"prepare.run_cpu_time_us":933,"prepare.run_wall_time_us":934,"replication_time_us":292574}]]}
I20260810 11:30:27.048983 27318 rpcz_store.cc:276] 0810 11:30:25.755652 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.506266 (+750614us) service_pool.cc:227] Handling call
0810 11:30:26.662536 (+156270us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dc313 00007f55f09ce466 00007f55f09ce195 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:26.677239 (+ 14703us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:26.677689 (+ 450us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:26.986996 (+309307us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:26.987102 (+ 106us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:26.987198 (+ 96us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:26.691611 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:26.691698 (+ 87us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:26.691703 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:26.691705 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:26.691776 (+ 71us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:26.691783 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:26.691788 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:26.691862 (+ 74us) tablet.cc:699] Row locks acquired
0810 11:30:26.691864 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:26.691892 (+ 28us) write_op.cc:270] Start()
0810 11:30:26.691915 (+ 23us) write_op.cc:276] Timestamp: P: 1786361426691861 usec, L: 0
0810 11:30:26.691919 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:26.692073 (+ 154us) log.cc:842] Serialized 433 byte log entry
0810 11:30:26.983931 (+291858us) op_driver.cc:444] REPLICATION: finished
0810 11:30:26.985515 (+ 1584us) write_op.cc:301] APPLY: starting
0810 11:30:26.985532 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:26.985581 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:26.985615 (+ 34us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:26.985782 (+ 167us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:26.985901 (+ 119us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:26.985913 (+ 12us) write_op.cc:312] APPLY: finished
0810 11:30:26.986013 (+ 100us) log.cc:842] Serialized 29 byte log entry
0810 11:30:26.986085 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:26.986109 (+ 24us) write_op.cc:454] Released schema lock
0810 11:30:26.986118 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:26.986189 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:26.986195 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":358689152,"child_traces":[["op",{"apply.queue_time_us":1542,"apply.run_cpu_time_us":737,"apply.run_wall_time_us":737,"num_ops":2,"prepare.queue_time_us":13489,"prepare.run_cpu_time_us":575,"prepare.run_wall_time_us":574,"replication_time_us":291998,"spinlock_wait_cycles":103680}]]}
I20260810 11:30:27.056244 27318 master_service.cc:946] ReplaceTablet: received request to replace tablet 70f6017d4d01463398cb347779dacf90 from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:27.056885 27326 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_094455b6d4f745fa83445cfc650e43b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:27.058197 27326 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_094455b6d4f745fa83445cfc650e43b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:27.059134 26848 consensus_peers.cc:487] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96cae4eb16c84410926a317af70e44f7. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:27.050855 27911 raft_consensus.cc:482] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:27.060338 27331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_14f7e10124574ccdb41f7b14117603c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:27.060806 27362 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a25589f61c844cab9a7d2db84a7eba2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:27.060756 27911 raft_consensus.cc:504] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.061959 27911 leader_election.cc:288] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:27.062211 27331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14f7e10124574ccdb41f7b14117603c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:27.036454 27231 raft_consensus.cc:348] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.062911 27231 raft_consensus.cc:374] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:27.063017 27231 raft_consensus.cc:729] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:27.062204 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e78fb1bf0534deca5cc5a603fd77592 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:27.065001 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd3575197c464c7fb51f9592831959bb" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:27.066632 27999 log.cc:1196] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/7aa16654b7f34f9baf856bf724cece8f
I20260810 11:30:27.069940 28102 tablet.cc:1722] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:27.071866 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd3575197c464c7fb51f9592831959bb" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:27.072464 26914 raft_consensus.cc:2454] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:27.078155 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb51618d37ac488fa7e3d23e5f85ec36" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:27.079438 26914 raft_consensus.cc:2454] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:27.080856 26991 leader_election.cc:302] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:27.081348 27708 raft_consensus.cc:2781] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:27.081563 27708 raft_consensus.cc:482] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:27.081686 27708 raft_consensus.cc:3037] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:27.085307 28136 tablet.cc:1722] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:27.087255 27318 master_service.cc:946] ReplaceTablet: received request to replace tablet f7ada1df82eb44ecb9a6c615b5410e6f from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:27.087167 27708 raft_consensus.cc:504] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.088439 27708 leader_election.cc:288] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:27.092247 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb51618d37ac488fa7e3d23e5f85ec36" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:27.092947 26912 raft_consensus.cc:3037] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:27.091542 27248 ts_tablet_manager.cc:1939] T a28849649c704f2fbdec1aced9ce01b1 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:27.093969 27999 ts_tablet_manager.cc:1939] T 7aa16654b7f34f9baf856bf724cece8f P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:27.099401 27318 master_service.cc:946] ReplaceTablet: received request to replace tablet 70f6017d4d01463398cb347779dacf90 from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:27.100102 26912 raft_consensus.cc:2454] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:27.100346 27334 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_b6e82fe7918d4a13bc1fdc1e66287cda" } new_table_name: "default.Table_a3eeadc0a55545c9a6af769a972a62d5" modify_external_catalogs: true
I20260810 11:30:27.100769 26991 leader_election.cc:302] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:27.101269 27911 raft_consensus.cc:2781] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:27.101516 27911 raft_consensus.cc:686] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:27.101847 27911 consensus_queue.cc:237] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.102973 27322 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_a88d168f91f6427e898a55cb391840af" } new_table_name: "default.Table_acbcb3a347b647a19e81cfcf5636677f" modify_external_catalogs: true
I20260810 11:30:27.106779 28040 raft_consensus.cc:482] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:27.107257 28040 raft_consensus.cc:504] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.108891 28040 leader_election.cc:288] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:27.110381 27333 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet a87f6835f0dc4ad4b3a23b297726100d (table default.Table_cbf7fb0f0585465a9be24fa7e70d68d2 [id=82041e96f8de4fae85baf690bbbfc7a3], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a87f6835f0dc4ad4b3a23b297726100d consensus state has no leader
I20260810 11:30:27.110997 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2126d95992e549b7b2b3e662b0d39a36" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:27.112334 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet a87f6835f0dc4ad4b3a23b297726100d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:50850
W20260810 11:30:27.112366 26848 leader_election.cc:341] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:27.113480 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet fbe0a0ab82a147a3b6164904b135d1ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:27.113981 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 587c6ce242c0411b886404a0df03b1bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:27.119792 26965 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
W20260810 11:30:27.123301 27336 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.194:38225 (request call id 87) took 1277 ms (client timeout 1000 ms). Trace:
W20260810 11:30:27.123525 27336 rpcz_store.cc:269] 0810 11:30:25.845491 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.907699 (+ 62208us) service_pool.cc:227] Handling call
0810 11:30:27.123234 (+1215535us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:26.601985 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:26.602100 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:26.602108 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:26.602111 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:26.602243 (+ 132us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:26.602257 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:26.602263 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:26.602330 (+ 67us) tablet.cc:699] Row locks acquired
0810 11:30:26.602333 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:26.602380 (+ 47us) write_op.cc:270] Start()
0810 11:30:26.602416 (+ 36us) write_op.cc:276] Timestamp: P: 1786361426602352 usec, L: 0
0810 11:30:26.602421 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:26.664417 (+ 61996us) log.cc:842] Serialized 356 byte log entry
0810 11:30:26.664670 (+ 253us) spinlock_profiling.cc:243] Waited 61.7 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f55f1bb4d02 00007f55f2ee77f1 00007f55f2ee6359 00007f55f2eee1bb 00007f55f2eee038 00000000009edb7c 00007f55e66ec344 00007f55e66ef91b 00007f55e66ef798 00000000009edb7c
0810 11:30:26.704423 (+ 39753us) op_driver.cc:444] REPLICATION: finished
0810 11:30:26.704813 (+ 390us) write_op.cc:301] APPLY: starting
0810 11:30:26.704837 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:26.704895 (+ 58us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:26.704901 (+ 6us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:26.704978 (+ 77us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:26.705021 (+ 43us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:26.705032 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:26.705145 (+ 113us) log.cc:842] Serialized 23 byte log entry
0810 11:30:26.705242 (+ 97us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:26.705266 (+ 24us) write_op.cc:454] Released schema lock
0810 11:30:26.705277 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:26.705368 (+ 91us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:26.705373 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":800,"reported_tablets":194,"child_traces":[["op",{"apply.queue_time_us":303,"apply.run_cpu_time_us":632,"apply.run_wall_time_us":631,"num_ops":1,"prepare.queue_time_us":75,"prepare.run_cpu_time_us":2020,"prepare.run_wall_time_us":62771,"raft.queue_time_us":1148,"raft.run_cpu_time_us":508,"raft.run_wall_time_us":1755,"replication_time_us":101965,"spinlock_wait_cycles":142011776}]]}
I20260810 11:30:27.124807 26771 raft_consensus.cc:2454] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:27.129333 27321 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 97) took 1005 ms. Trace:
I20260810 11:30:27.129493 27228 tablet_bootstrap.cc:492] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:27.129674 27228 ts_tablet_manager.cc:1397] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.490s user 0.008s sys 0.012s
I20260810 11:30:27.129522 27321 rpcz_store.cc:276] 0810 11:30:26.123449 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.778293 (+654844us) service_pool.cc:227] Handling call
0810 11:30:26.994837 (+216544us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dc313 00007f55f09ce466 00007f55f09ce195 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:27.084645 (+ 89808us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:27.085447 (+ 802us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:27.128844 (+ 43397us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:27.128996 (+ 152us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:27.129198 (+ 202us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:27.087763 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:27.087890 (+ 127us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:27.087899 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:27.087904 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:27.088111 (+ 207us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:27.088131 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:27.088138 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:27.088240 (+ 102us) tablet.cc:699] Row locks acquired
0810 11:30:27.088245 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:27.088294 (+ 49us) write_op.cc:270] Start()
0810 11:30:27.088337 (+ 43us) write_op.cc:276] Timestamp: P: 1786361427088267 usec, L: 0
0810 11:30:27.088343 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:27.088600 (+ 257us) log.cc:842] Serialized 433 byte log entry
0810 11:30:27.111915 (+ 23315us) op_driver.cc:444] REPLICATION: finished
0810 11:30:27.112376 (+ 461us) write_op.cc:301] APPLY: starting
0810 11:30:27.112398 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:27.112447 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:27.112481 (+ 34us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:27.112685 (+ 204us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:27.112743 (+ 58us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:27.112754 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:27.112884 (+ 130us) log.cc:842] Serialized 29 byte log entry
0810 11:30:27.113022 (+ 138us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:27.113050 (+ 28us) write_op.cc:454] Released schema lock
0810 11:30:27.113060 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:27.113147 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:27.113154 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":487727360,"child_traces":[["op",{"apply.queue_time_us":388,"apply.run_cpu_time_us":854,"apply.run_wall_time_us":855,"num_ops":2,"prepare.queue_time_us":65,"prepare.run_cpu_time_us":939,"prepare.run_wall_time_us":940,"replication_time_us":23542}]]}
I20260810 11:30:27.132690 27228 raft_consensus.cc:348] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.133039 27228 raft_consensus.cc:374] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:27.133142 27228 raft_consensus.cc:729] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:27.133509 27228 consensus_queue.cc:260] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.134363 27228 ts_tablet_manager.cc:1428] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260810 11:30:27.135339 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet f3884736eec74c8992b8d51b37465875 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f64d4b9320c4cb39f57573d781a47d3) from {username='slave'} at 127.0.0.1:33500
W20260810 11:30:27.139988 27333 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.195:58893 (request call id 78) took 1624 ms (client timeout 1000 ms). Trace:
W20260810 11:30:27.140254 27333 rpcz_store.cc:269] 0810 11:30:25.515094 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.536954 (+ 21860us) service_pool.cc:227] Handling call
0810 11:30:25.649698 (+112744us) spinlock_profiling.cc:243] Waited 99.8 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96d6d8f 00007f55f09cb946 00007f55f09cb675 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:27.139845 (+1490147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":70710,"reported_tablets":189,"spinlock_wait_cycles":229455104}
I20260810 11:30:27.146200 27112 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:27.148186 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e829d4bffeb4289a54b4d3d7a53c44e with delete_type TABLET_DATA_DELETED (replaced by tablet 00d52e5c77d94854b8ba0b38c63ad015) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:27.152851 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 96cae4eb16c84410926a317af70e44f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:27.153607 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 10) took 2818 ms. Trace:
I20260810 11:30:27.153846 27248 rpcz_store.cc:276] 0810 11:30:24.283552 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.283640 (+ 88us) service_pool.cc:227] Handling call
0810 11:30:26.942973 (+2659333us) ts_tablet_manager.cc:1145] Deleting tablet a28849649c704f2fbdec1aced9ce01b1
0810 11:30:26.942993 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:26.974656 (+ 31663us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.017071 (+ 42415us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.102372 (+ 85301us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2659036}
I20260810 11:30:27.154857 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet a28849649c704f2fbdec1aced9ce01b1 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]) successfully deleted
I20260810 11:30:27.156111 27248 tablet_replica.cc:330] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:27.155915 27231 consensus_queue.cc:260] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.157199 27336 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_0d634c04e624422da8830e84abf1339f" } modify_external_catalogs: true
I20260810 11:30:27.157464 27362 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_55d0eefc94274462b82269e97b4969a9" } new_table_name: "default.Table_4685fd339d3a48e28d9ef36812b6dac7" modify_external_catalogs: true
I20260810 11:30:27.157618 27336 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_0d634c04e624422da8830e84abf1339f" } modify_external_catalogs: true
I20260810 11:30:27.158403 27318 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_a22c355b17404952bced99698472d57e" } new_table_name: "default.Table_e3bd143020ca4c18a396c5db56a85efc" modify_external_catalogs: true
I20260810 11:30:27.158849 27326 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_93969ba1aad24adfb712d718540eaae2" } new_table_name: "default.Table_77ec2f167ce54c869f280c782936aabc" modify_external_catalogs: true
I20260810 11:30:27.161839 27331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_711dc900ac3b45b8897cd1fbc2964dec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:27.163017 27331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_711dc900ac3b45b8897cd1fbc2964dec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:27.165514 27333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_12d15f4d2bd3426788aadc76beeff465"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:27.166966 27333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12d15f4d2bd3426788aadc76beeff465 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:27.168970 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e829d4bffeb4289a54b4d3d7a53c44e with delete_type TABLET_DATA_DELETED (replaced by tablet 00d52e5c77d94854b8ba0b38c63ad015) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:27.175202 26964 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
W20260810 11:30:27.176873 27286 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cd3575197c464c7fb51f9592831959bb consensus state has no leader
I20260810 11:30:27.188959 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet e25ae21cc8cc4749a507fcab5ee225a3 (table default.Table_dc355f349bc9426eb26a69cf93c089cf [id=68a29d5ebf8140198fbf4da3cd974847]) successfully deleted
I20260810 11:30:27.189918 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb51618d37ac488fa7e3d23e5f85ec36" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:27.192736 27321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_1c6221759f954488a1e7df4252c2a6ae" } modify_external_catalogs: true
I20260810 11:30:27.192782 26764 raft_consensus.cc:3037] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:27.193131 27321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_1c6221759f954488a1e7df4252c2a6ae" } modify_external_catalogs: true
I20260810 11:30:27.195183 26767 raft_consensus.cc:2454] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:27.200215 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb51618d37ac488fa7e3d23e5f85ec36" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:27.200712 26771 raft_consensus.cc:3037] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:27.207072 26771 raft_consensus.cc:2454] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:27.218087 27222 tablet_bootstrap.cc:654] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:27.213205 27974 raft_consensus.cc:2229] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:27.156437 27248 raft_consensus.cc:2229] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:27.220526 27763 consensus_queue.cc:1035] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260810 11:30:27.222126 27911 raft_consensus.cc:482] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:27.180971 27037 tablet_service.cc:1467] Processing CreateTablet for tablet 5eff8ccaa3ad4187aa00c33abd7131ae (DEFAULT_TABLE table=default.Table_8589a61b5c4e42c0a92a80a3576db8ac [id=0d2a77edfa664f679468b8b3cac2d9ee]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:27.222860 26849 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.25.195.254:41125, user_credentials={real_user=slave}} blocked reactor thread for 51036.4us
I20260810 11:30:27.181962 27031 tablet_service.cc:1467] Processing CreateTablet for tablet 3604b43dcdfc469db476f3d0e2f900bb (DEFAULT_TABLE table=default.Table_7d84624ac4e94437acb400decf3bb21b [id=0f6c3eaa5abb4fc5a07a723ed77c2e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.183000 27708 raft_consensus.cc:482] T 3ddb6e67c316416681074e454ab9b01e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:27.223729 27248 raft_consensus.cc:2258] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:27.224596 27248 ts_tablet_manager.cc:1905] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:27.225241 26849 leader_election.cc:341] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 2917f1ffb5214a80b19810540602df35
I20260810 11:30:27.222754 27911 raft_consensus.cc:504] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.226142 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eff8ccaa3ad4187aa00c33abd7131ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.226068 26849 leader_election.cc:302] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:27.226697 28029 raft_consensus.cc:2726] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 11:30:27.186789 26993 consensus_peers.cc:487] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7aa16654b7f34f9baf856bf724cece8f. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:27.194592 27025 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb3dd7bd54c485d9ea0c2186f799d0f (DEFAULT_TABLE table=default.Table_4eef50b9dbea413f91b6b6a35c997283 [id=6eb74fbbf5db4f2f8434c3c9a83188b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.195612 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 0cc17c55109b47eeb91920c3ed8178e0 (DEFAULT_TABLE table=default.Table_fee5e058d63849c189e798c232542ad2 [id=2c6a659407bc4d8dad087cb73c16e229]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.229442 27031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3604b43dcdfc469db476f3d0e2f900bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.235384 26849 leader_election.cc:302] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:27.230512 27708 raft_consensus.cc:504] T 3ddb6e67c316416681074e454ab9b01e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.240083 28040 raft_consensus.cc:2781] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:27.240228 28040 raft_consensus.cc:482] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:27.240366 28040 raft_consensus.cc:3037] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:27.242326 27708 leader_election.cc:288] T 3ddb6e67c316416681074e454ab9b01e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:27.242558 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb3dd7bd54c485d9ea0c2186f799d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.244256 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cc17c55109b47eeb91920c3ed8178e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.245267 28040 raft_consensus.cc:504] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.246335 28040 leader_election.cc:288] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:27.251345 27911 leader_election.cc:288] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:27.253419 27974 raft_consensus.cc:2258] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:27.254683 27974 ts_tablet_manager.cc:1905] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:27.258020 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb01e54d817c4b0dbcc80f90f82923c0" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:27.264639 28157 log.cc:924] Time spent T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d: Append to log took a long time: real 0.090s user 0.000s sys 0.001s
I20260810 11:30:27.266777 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ddb6e67c316416681074e454ab9b01e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:27.267908 27974 ts_tablet_manager.cc:1918] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260810 11:30:27.271095 26991 leader_election.cc:341] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:27.271993 27974 log.cc:1196] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/23d8ce485cb84495a6e964b6d5977f0d
I20260810 11:30:27.271977 26893 tablet_service.cc:1467] Processing CreateTablet for tablet 5eff8ccaa3ad4187aa00c33abd7131ae (DEFAULT_TABLE table=default.Table_8589a61b5c4e42c0a92a80a3576db8ac [id=0d2a77edfa664f679468b8b3cac2d9ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.272711 27974 ts_tablet_manager.cc:1939] T 23d8ce485cb84495a6e964b6d5977f0d P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:27.273010 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 3604b43dcdfc469db476f3d0e2f900bb (DEFAULT_TABLE table=default.Table_7d84624ac4e94437acb400decf3bb21b [id=0f6c3eaa5abb4fc5a07a723ed77c2e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.274124 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb3dd7bd54c485d9ea0c2186f799d0f (DEFAULT_TABLE table=default.Table_4eef50b9dbea413f91b6b6a35c997283 [id=6eb74fbbf5db4f2f8434c3c9a83188b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.274097 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02ff6a9bc02441ddb7f307d6b3df31bd" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:27.275575 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 0cc17c55109b47eeb91920c3ed8178e0 (DEFAULT_TABLE table=default.Table_fee5e058d63849c189e798c232542ad2 [id=2c6a659407bc4d8dad087cb73c16e229]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.282749 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2126d95992e549b7b2b3e662b0d39a36" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:27.283649 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02ff6a9bc02441ddb7f307d6b3df31bd" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:27.283913 26762 raft_consensus.cc:3037] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:27.289953 27333 master_service.cc:946] ReplaceTablet: received request to replace tablet 1860e56467624dcdb288e13b004f78cc from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:27.290553 27057 raft_consensus.cc:3037] T 3ddb6e67c316416681074e454ab9b01e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:27.299074 26700 leader_election.cc:341] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:27.299605 26700 leader_election.cc:302] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
W20260810 11:30:27.301043 26700 consensus_peers.cc:487] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e829d4bffeb4289a54b4d3d7a53c44e. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:27.303409 26762 raft_consensus.cc:2454] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:27.305341 28164 raft_consensus.cc:2726] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:27.308256 27228 tablet_bootstrap.cc:492] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:27.309831 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eff8ccaa3ad4187aa00c33abd7131ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.310774 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3604b43dcdfc469db476f3d0e2f900bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.311547 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cc17c55109b47eeb91920c3ed8178e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.312919 26823 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:27.313516 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb3dd7bd54c485d9ea0c2186f799d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.315014 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e78fb1bf0534deca5cc5a603fd77592 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.315575 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da86554bc51486e91f1ea5995a245b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.316210 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 587c6ce242c0411b886404a0df03b1bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.316756 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet a87f6835f0dc4ad4b3a23b297726100d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.317402 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 2801709d53614916abac370f7ae5e913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.318581 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.319700 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 3851d39aeb3142938a5ac558ab438c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.320374 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet f3884736eec74c8992b8d51b37465875 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f64d4b9320c4cb39f57573d781a47d3) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.320973 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.323113 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 80) took 1146 ms. Trace:
I20260810 11:30:27.323285 27974 rpcz_store.cc:276] 0810 11:30:26.146789 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.147316 (+ 527us) service_pool.cc:227] Handling call
0810 11:30:26.993314 (+845998us) ts_tablet_manager.cc:1145] Deleting tablet 23d8ce485cb84495a6e964b6d5977f0d
0810 11:30:26.998867 (+ 5553us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.221640 (+222773us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x6150000f4224. stack: 00007f81b1fa466e 00007f81b1fa4430 00007f81b102b5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f81bd4dc04d 00007f81be7805ec 00007f81c110f2e6 00007f81c1141404 00007f81c1122870 00007f81c11225fd 00000000009edb7c 00007f81b1fea344 00007f81b1fed91b 00007f81b1fed798
0810 11:30:27.261403 (+ 39763us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.267763 (+ 6360us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.293226 (+ 25463us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":463280000,"tablet-delete.queue_time_us":764496}
I20260810 11:30:27.324218 28102 tablet.cc:1722] T 3ddb6e67c316416681074e454ab9b01e P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:27.326354 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 70) took 1178 ms. Trace:
I20260810 11:30:27.326339 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 4) took 2899 ms. Trace:
I20260810 11:30:27.326467 27974 rpcz_store.cc:276] 0810 11:30:26.145521 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.147385 (+ 1864us) service_pool.cc:227] Handling call
0810 11:30:27.323681 (+1176296us) ts_tablet_manager.cc:1145] Deleting tablet eb9394f9ca2c44de93354e23973cf902
0810 11:30:27.323694 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.323864 (+ 170us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1094693}
I20260810 11:30:27.326488 27999 rpcz_store.cc:276] 0810 11:30:24.427208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.428001 (+ 793us) service_pool.cc:227] Handling call
0810 11:30:26.640039 (+2212038us) ts_tablet_manager.cc:1145] Deleting tablet 7aa16654b7f34f9baf856bf724cece8f
0810 11:30:26.640050 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:26.846121 (+206071us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.012915 (+166794us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.326240 (+313325us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2209616}
I20260810 11:30:27.326851 27974 tablet_replica.cc:330] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:27.326884 27999 tablet_replica.cc:330] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:27.327090 27999 raft_consensus.cc:2229] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:27.327109 27974 raft_consensus.cc:2229] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:27.327437 27999 raft_consensus.cc:2258] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:27.327478 27974 raft_consensus.cc:2258] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:27.338781 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet fdbe21b4f124411988dd35a0b864f868 with delete_type TABLET_DATA_DELETED (replaced by tablet f756689d4c99489885a0cd59f84a6e8a) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.338785 27999 ts_tablet_manager.cc:1905] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:27.339624 27974 ts_tablet_manager.cc:1905] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:27.341511 27231 ts_tablet_manager.cc:1428] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.303s user 0.005s sys 0.001s
I20260810 11:30:27.342006 27231 tablet_bootstrap.cc:492] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:27.342893 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b5a7f67ec5b48c2b5a510add0282a76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.344465 27231 tablet_bootstrap.cc:654] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:27.346042 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 0713f4f14a284050a7774a70ab974f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.350255 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet a3406dc345e3429fb4bce5a59643b686 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.352916 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet cb6805a5dd264939850ea2cd9a850a1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.356156 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:32816
W20260810 11:30:27.313304 26848 leader_election.cc:341] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:27.365453 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 58140.3us
W20260810 11:30:27.368486 26849 leader_election.cc:341] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 66908164ff2a4ee5b55da6158699e0c6
I20260810 11:30:27.378496 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:27.379354 27231 tablet_bootstrap.cc:492] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:27.382535 26849 leader_election.cc:302] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:27.383200 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 91b6078efadf496fb252f725bdf56b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.386181 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet ff9b649e43a9456fa51cf3330290bb91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.387952 28040 raft_consensus.cc:2726] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:27.391319 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 10e6c41db71a4146840f06c5b7412d9c with delete_type TABLET_DATA_DELETED (replaced by tablet 72209a805e3e4b4ea1bf99508e0f75db) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.393230 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c595e0892634348b64418ae9dbbd4c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.394712 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet a8a65a0e8b1f4e4b8d9a82059b766cda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.400584 27231 ts_tablet_manager.cc:1397] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.002s
I20260810 11:30:27.403026 27231 raft_consensus.cc:348] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.403653 27231 raft_consensus.cc:374] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:27.403852 27231 raft_consensus.cc:729] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:27.404600 27231 consensus_queue.cc:260] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.406009 27231 ts_tablet_manager.cc:1428] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20260810 11:30:27.406479 27231 tablet_bootstrap.cc:492] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:27.408774 27231 tablet_bootstrap.cc:654] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:27.409283 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 76940.6us
I20260810 11:30:27.418825 27231 tablet_bootstrap.cc:492] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:27.419129 27231 ts_tablet_manager.cc:1397] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.005s
I20260810 11:30:27.420308 27228 tablet_bootstrap.cc:654] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:27.420177 27231 raft_consensus.cc:348] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:27.420735 26849 leader_election.cc:341] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:27.420734 27231 raft_consensus.cc:374] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:27.421150 27231 raft_consensus.cc:729] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:27.421510 27231 consensus_queue.cc:260] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.422760 27231 ts_tablet_manager.cc:1428] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 11:30:27.425235 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:27.426220 27231 tablet_bootstrap.cc:492] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:27.427204 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:27.427492 27222 tablet_bootstrap.cc:492] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:27.428615 27231 tablet_bootstrap.cc:654] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:27.432753 27222 ts_tablet_manager.cc:1397] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.449s user 0.010s sys 0.010s
I20260810 11:30:27.430754 27248 ts_tablet_manager.cc:1918] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:27.433115 27248 log.cc:1196] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/3ff4e19071fc435fbae4490799325e37
I20260810 11:30:27.434326 27248 ts_tablet_manager.cc:1939] T 3ff4e19071fc435fbae4490799325e37 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:27.435561 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:27.436444 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 11) took 3152 ms. Trace:
I20260810 11:30:27.436717 27248 rpcz_store.cc:276] 0810 11:30:24.284162 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.284215 (+ 53us) service_pool.cc:227] Handling call
0810 11:30:27.155537 (+2871322us) ts_tablet_manager.cc:1145] Deleting tablet 3ff4e19071fc435fbae4490799325e37
0810 11:30:27.155790 (+ 253us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.313787 (+157997us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.423519 (+109732us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.436395 (+ 12876us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2870761}
I20260810 11:30:27.437180 27248 tablet_replica.cc:330] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:27.437467 27248 raft_consensus.cc:2229] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:27.437697 27248 raft_consensus.cc:2258] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:27.438431 27248 ts_tablet_manager.cc:1905] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:27.439770 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 3ff4e19071fc435fbae4490799325e37 (table default.Table_22360b2c6a9e46f99bbc036074cb7441 [id=80c0857a46a84400aa9ce1e7f2e39d25]) successfully deleted
I20260810 11:30:27.439745 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
I20260810 11:30:27.438135 26849 leader_election.cc:302] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:27.443310 28040 raft_consensus.cc:2726] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:27.444680 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 1 got 0
I20260810 11:30:27.446935 26849 leader_election.cc:302] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:27.447274 28040 raft_consensus.cc:2781] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:27.447822 28040 raft_consensus.cc:686] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:27.447645 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]). Expected version 1 got 0
I20260810 11:30:27.448310 28040 consensus_queue.cc:237] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.449158 27231 tablet_bootstrap.cc:492] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:27.449586 27231 ts_tablet_manager.cc:1397] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.005s
I20260810 11:30:27.451012 27231 raft_consensus.cc:348] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.451748 27231 raft_consensus.cc:374] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:27.451905 27231 raft_consensus.cc:729] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:27.452329 27231 consensus_queue.cc:260] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.454947 27231 ts_tablet_manager.cc:1428] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260810 11:30:27.455421 27231 tablet_bootstrap.cc:492] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:27.457626 27231 tablet_bootstrap.cc:654] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:27.458493 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]). Expected version 1 got 0
I20260810 11:30:27.459533 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]). Expected version 2 got 0
I20260810 11:30:27.461048 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:27.462734 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3ddb6e67c316416681074e454ab9b01e (table default.Table_1e1ca07e9c824349af23675b66b77321 [id=755202f095f04307a11ce87087df835c]). Expected version 2 got 0
I20260810 11:30:27.464515 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:27.465768 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:27.478811 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:27.485285 27248 ts_tablet_manager.cc:1918] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:27.485519 27248 log.cc:1196] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/5adcec593b8c4d40997c8911e9f77c85
I20260810 11:30:27.486148 27248 ts_tablet_manager.cc:1939] T 5adcec593b8c4d40997c8911e9f77c85 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:27.487388 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 7) took 3206 ms. Trace:
I20260810 11:30:27.487591 27248 rpcz_store.cc:276] 0810 11:30:24.281080 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.281229 (+ 149us) service_pool.cc:227] Handling call
0810 11:30:27.437092 (+3155863us) ts_tablet_manager.cc:1145] Deleting tablet 5adcec593b8c4d40997c8911e9f77c85
0810 11:30:27.437106 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.459886 (+ 22780us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.484546 (+ 24660us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.487178 (+ 2632us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3149572}
I20260810 11:30:27.487370 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:27.490231 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 5adcec593b8c4d40997c8911e9f77c85 (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]) successfully deleted
I20260810 11:30:27.490516 26914 raft_consensus.cc:3037] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:27.491400 27248 tablet_replica.cc:330] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:27.492617 27248 raft_consensus.cc:2229] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:27.493394 27248 raft_consensus.cc:2258] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:27.493956 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 7aa16654b7f34f9baf856bf724cece8f (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]) successfully deleted
I20260810 11:30:27.494536 27248 ts_tablet_manager.cc:1905] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:27.499727 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 83631b421a614796bdf76335f1437e00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.503439 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 318d5b8453fe4c438d0fa32cb91c409e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.502564 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:27.504257 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 725d2e70e1d441b497d56a278e1de0ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.505998 26738 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.507072 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet f2b555f18c1e485d9af7b08f98543c80 with delete_type TABLET_DATA_DELETED (replaced by tablet 1801d3af4a4548dba8b0d8ea2fecf5ba) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.508744 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a1e2e624fff4692a22e29b293cd82d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.509052 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet fc558690dce44e999e55e9bf1b6ca172 with delete_type TABLET_DATA_DELETED (replaced by tablet 0bb01711769f457aa0696bb59582166d) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.509225 26738 tablet_service.cc:1514] Processing DeleteTablet for tablet 10210204d5ff4e5e97c98fd255f674a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.509277 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 64818ca5827e41d99428903ddb8688d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.509507 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ada1df82eb44ecb9a6c615b5410e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.509871 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 2634beb347714fc7a2e05865adb34a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.510131 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d5e146eeec4fe0be33c1c169d32e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.510676 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.510676 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 834c9c99ec424bb39e8a003e9204b2bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.512284 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.512596 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a83391804894d268d0e603f4feb1745 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.511961 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:27.514803 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:27.517164 26730 tablet_service.cc:1467] Processing CreateTablet for tablet 5eff8ccaa3ad4187aa00c33abd7131ae (DEFAULT_TABLE table=default.Table_8589a61b5c4e42c0a92a80a3576db8ac [id=0d2a77edfa664f679468b8b3cac2d9ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.517722 26730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eff8ccaa3ad4187aa00c33abd7131ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.518311 26732 tablet_service.cc:1467] Processing CreateTablet for tablet 3604b43dcdfc469db476f3d0e2f900bb (DEFAULT_TABLE table=default.Table_7d84624ac4e94437acb400decf3bb21b [id=0f6c3eaa5abb4fc5a07a723ed77c2e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.518769 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3604b43dcdfc469db476f3d0e2f900bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.519788 27231 tablet_bootstrap.cc:492] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:27.519976 27231 ts_tablet_manager.cc:1397] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.065s user 0.007s sys 0.007s
I20260810 11:30:27.520828 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet fbe0a0ab82a147a3b6164904b135d1ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.521085 27231 raft_consensus.cc:348] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.521610 27231 raft_consensus.cc:374] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:27.521589 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb3dd7bd54c485d9ea0c2186f799d0f (DEFAULT_TABLE table=default.Table_4eef50b9dbea413f91b6b6a35c997283 [id=6eb74fbbf5db4f2f8434c3c9a83188b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.521767 27231 raft_consensus.cc:729] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:27.521978 27231 consensus_queue.cc:260] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.522147 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb3dd7bd54c485d9ea0c2186f799d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.522678 27231 ts_tablet_manager.cc:1428] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:27.523010 27231 tablet_bootstrap.cc:492] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:27.526072 27248 ts_tablet_manager.cc:1918] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:27.530284 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 0cc17c55109b47eeb91920c3ed8178e0 (DEFAULT_TABLE table=default.Table_fee5e058d63849c189e798c232542ad2 [id=2c6a659407bc4d8dad087cb73c16e229]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.530879 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cc17c55109b47eeb91920c3ed8178e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.531314 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 23d8ce485cb84495a6e964b6d5977f0d (table default.Table_1ff9ed629e8b465e9ac5588ad616105a [id=75fe62ca5f6448c38b7f9f683cb932b5]) successfully deleted
W20260810 11:30:27.531646 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet eb9394f9ca2c44de93354e23973cf902 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb9394f9ca2c44de93354e23973cf902 already in progress: creating tablet
I20260810 11:30:27.531993 28164 raft_consensus.cc:482] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:27.532182 28164 raft_consensus.cc:504] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.532730 27248 log.cc:1196] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/d729baae40a64e6e8c23e6870f230afb
I20260810 11:30:27.533164 28164 leader_election.cc:288] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:27.533593 27231 tablet_bootstrap.cc:654] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:27.534247 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ddb6e67c316416681074e454ab9b01e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:27.534986 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb01e54d817c4b0dbcc80f90f82923c0" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:27.535202 26763 raft_consensus.cc:2454] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:27.534149 27248 ts_tablet_manager.cc:1939] T d729baae40a64e6e8c23e6870f230afb P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:27.536410 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 12) took 3248 ms. Trace:
I20260810 11:30:27.536597 27248 rpcz_store.cc:276] 0810 11:30:24.287668 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.289852 (+ 2184us) service_pool.cc:227] Handling call
0810 11:30:27.490854 (+3201002us) ts_tablet_manager.cc:1145] Deleting tablet d729baae40a64e6e8c23e6870f230afb
0810 11:30:27.490870 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.499676 (+ 8806us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.525884 (+ 26208us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.536361 (+ 10477us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3200718}
I20260810 11:30:27.537307 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet d729baae40a64e6e8c23e6870f230afb (table default.Table_d297e25211404611a6ba6a454c9dd5fd [id=093a9315d9f14cb28b5da3f910c28b0e]) successfully deleted
I20260810 11:30:27.537609 27911 consensus_queue.cc:1035] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:27.537957 27750 consensus_queue.cc:1035] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:27.538645 27248 tablet_replica.cc:330] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:27.539103 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587c6ce242c0411b886404a0df03b1bb" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:27.539083 27248 raft_consensus.cc:2229] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:27.540213 27248 raft_consensus.cc:2258] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:27.541177 27248 ts_tablet_manager.cc:1905] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:27.550381 26993 leader_election.cc:302] T 3ddb6e67c316416681074e454ab9b01e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:27.550948 26993 leader_election.cc:302] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:27.551616 27750 raft_consensus.cc:2726] T 3ddb6e67c316416681074e454ab9b01e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:27.551822 27750 raft_consensus.cc:2781] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:27.551923 27750 raft_consensus.cc:482] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:27.552027 27750 raft_consensus.cc:3037] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:27.555052 27750 raft_consensus.cc:504] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.555912 27750 leader_election.cc:288] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:27.563037 27228 tablet_bootstrap.cc:492] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:27.566144 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb01e54d817c4b0dbcc80f90f82923c0" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:27.566464 26767 raft_consensus.cc:3037] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:27.568089 28181 tablet.cc:1722] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:27.574807 26767 raft_consensus.cc:2454] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:27.579634 28183 tablet.cc:1722] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:27.579890 27248 ts_tablet_manager.cc:1918] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:27.580083 27248 log.cc:1196] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/7aa16654b7f34f9baf856bf724cece8f
I20260810 11:30:27.581311 26993 leader_election.cc:302] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:27.583413 27248 ts_tablet_manager.cc:1939] T 7aa16654b7f34f9baf856bf724cece8f P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:27.583751 27911 raft_consensus.cc:2781] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:27.584120 27911 raft_consensus.cc:686] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:27.584578 27911 consensus_queue.cc:237] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.585099 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 13) took 3294 ms. Trace:
I20260810 11:30:27.585222 27248 rpcz_store.cc:276] 0810 11:30:24.290287 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.290335 (+ 48us) service_pool.cc:227] Handling call
0810 11:30:27.538511 (+3248176us) ts_tablet_manager.cc:1145] Deleting tablet 7aa16654b7f34f9baf856bf724cece8f
0810 11:30:27.538524 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.564610 (+ 26086us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.579743 (+ 15133us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.585039 (+ 5296us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3247949}
I20260810 11:30:27.585737 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 7aa16654b7f34f9baf856bf724cece8f (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]) successfully deleted
I20260810 11:30:27.587182 27248 tablet_replica.cc:330] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:27.587857 27248 raft_consensus.cc:2229] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:27.588351 27248 raft_consensus.cc:2258] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:27.591627 27248 ts_tablet_manager.cc:1905] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:27.591475 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 23637a02b6464e17aa2a69ea5cc4ddfe (table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85]). Expected version 1 got 0
I20260810 11:30:27.597627 27222 raft_consensus.cc:348] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.600003 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]). Expected version 1 got 0
I20260810 11:30:27.601382 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:27.603273 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:27.605343 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:27.607434 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:27.608733 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 2 got 0
I20260810 11:30:27.610706 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]). Expected version 1 got 0
I20260810 11:30:27.612478 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 1 got 0
I20260810 11:30:27.613826 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb01e54d817c4b0dbcc80f90f82923c0" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:27.614845 26991 leader_election.cc:341] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:27.614777 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_e9f0bd7bcd1441cbbb1e927313ee6335 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 2 got 0
I20260810 11:30:27.616542 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:27.617955 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587c6ce242c0411b886404a0df03b1bb" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:27.618472 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:27.619881 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]). Expected version 1 got 0
I20260810 11:30:27.621212 27248 ts_tablet_manager.cc:1918] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:27.621038 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:27.622550 27248 log.cc:1196] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/e25ae21cc8cc4749a507fcab5ee225a3
I20260810 11:30:27.622571 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:27.623618 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]). Expected version 2 got 0
I20260810 11:30:27.626137 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]). Expected version 2 got 0
I20260810 11:30:27.627372 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:27.628448 27319 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:27.629254 27248 ts_tablet_manager.cc:1939] T e25ae21cc8cc4749a507fcab5ee225a3 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:27.630496 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 14) took 3339 ms. Trace:
I20260810 11:30:27.631237 27248 rpcz_store.cc:276] 0810 11:30:24.290812 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.290860 (+ 48us) service_pool.cc:227] Handling call
0810 11:30:27.587080 (+3296220us) ts_tablet_manager.cc:1145] Deleting tablet e25ae21cc8cc4749a507fcab5ee225a3
0810 11:30:27.587094 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.604440 (+ 17346us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.621013 (+ 16573us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.630455 (+ 9442us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3296003}
I20260810 11:30:27.632232 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet e25ae21cc8cc4749a507fcab5ee225a3 (table default.Table_dc355f349bc9426eb26a69cf93c089cf [id=68a29d5ebf8140198fbf4da3cd974847]) successfully deleted
I20260810 11:30:27.632855 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 15) took 3341 ms. Trace:
I20260810 11:30:27.633453 27248 rpcz_store.cc:276] 0810 11:30:24.291252 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.291297 (+ 45us) service_pool.cc:227] Handling call
0810 11:30:27.632694 (+3341397us) ts_tablet_manager.cc:1145] Deleting tablet 949f31fa0c124eefbee695cfc7f50cbe
0810 11:30:27.632707 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.632814 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3341015}
W20260810 11:30:27.634697 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 949f31fa0c124eefbee695cfc7f50cbe because the tablet was not found. No further retry: Not found: Tablet not found: 949f31fa0c124eefbee695cfc7f50cbe
I20260810 11:30:27.635318 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 16) took 3343 ms. Trace:
I20260810 11:30:27.637018 27248 rpcz_store.cc:276] 0810 11:30:24.292116 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.292298 (+ 182us) service_pool.cc:227] Handling call
0810 11:30:27.635141 (+3342843us) ts_tablet_manager.cc:1145] Deleting tablet 66908164ff2a4ee5b55da6158699e0c6
0810 11:30:27.635155 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.635256 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3342518}
W20260810 11:30:27.638052 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 66908164ff2a4ee5b55da6158699e0c6 because the tablet was not found. No further retry: Not found: Tablet not found: 66908164ff2a4ee5b55da6158699e0c6
I20260810 11:30:27.639024 27248 tablet_replica.cc:330] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:27.639648 27248 raft_consensus.cc:2229] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:27.640372 27248 raft_consensus.cc:2258] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:27.641426 27248 ts_tablet_manager.cc:1905] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:27.645637 27228 ts_tablet_manager.cc:1397] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.275s user 0.011s sys 0.000s
I20260810 11:30:27.646909 27333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet 1860e56467624dcdb288e13b004f78cc
I20260810 11:30:27.647436 27333 catalog_manager.cc:6565] ReplaceTablet: tablet 1860e56467624dcdb288e13b004f78cc deleted and replaced by tablet 214be3356fda4c8484596196c0985721
I20260810 11:30:27.658308 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet 1860e56467624dcdb288e13b004f78cc with delete_type TABLET_DATA_DELETED (replaced by tablet 214be3356fda4c8484596196c0985721) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:27.664170 27231 tablet_bootstrap.cc:492] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:27.664413 27231 ts_tablet_manager.cc:1397] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.141s user 0.023s sys 0.011s
I20260810 11:30:27.665258 27231 raft_consensus.cc:348] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.665702 27231 raft_consensus.cc:374] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:27.665860 27231 raft_consensus.cc:729] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:27.666262 27231 consensus_queue.cc:260] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.669896 27231 ts_tablet_manager.cc:1428] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260810 11:30:27.670428 27231 tablet_bootstrap.cc:492] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:27.672683 27718 raft_consensus.cc:482] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:27.672854 27718 raft_consensus.cc:504] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.673571 27718 leader_election.cc:288] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:27.676445 27231 tablet_bootstrap.cc:654] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:27.682662 27248 ts_tablet_manager.cc:1918] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:27.682963 26700 leader_election.cc:302] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:27.683120 27248 log.cc:1196] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/725d2e70e1d441b497d56a278e1de0ad
I20260810 11:30:27.683943 27248 ts_tablet_manager.cc:1939] T 725d2e70e1d441b497d56a278e1de0ad P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:27.685226 27222 raft_consensus.cc:374] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:27.685405 27222 raft_consensus.cc:729] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:27.686070 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 1860e56467624dcdb288e13b004f78cc with delete_type TABLET_DATA_DELETED (replaced by tablet 214be3356fda4c8484596196c0985721) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:27.682484 27999 ts_tablet_manager.cc:1918] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:27.689260 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 44) took 2443 ms. Trace:
I20260810 11:30:27.690312 27231 tablet_bootstrap.cc:492] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:27.690613 27231 ts_tablet_manager.cc:1397] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.004s
I20260810 11:30:27.691726 28159 raft_consensus.cc:2726] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:27.691949 27248 rpcz_store.cc:276] 0810 11:30:25.246158 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.246340 (+ 182us) service_pool.cc:227] Handling call
0810 11:30:27.638933 (+2392593us) ts_tablet_manager.cc:1145] Deleting tablet 725d2e70e1d441b497d56a278e1de0ad
0810 11:30:27.638947 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.660494 (+ 21547us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.682495 (+ 22001us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.689174 (+ 6679us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2367158}
I20260810 11:30:27.692009 28164 consensus_queue.cc:1035] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.079s
I20260810 11:30:27.692924 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 725d2e70e1d441b497d56a278e1de0ad (table default.Table_59ed990b31964d6080614081ee46a6de [id=6d8fc88a491140548a45c7fbb403bb36]) successfully deleted
I20260810 11:30:27.696892 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 46) took 2221 ms. Trace:
I20260810 11:30:27.697626 27248 rpcz_store.cc:276] 0810 11:30:25.475832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.476488 (+ 656us) service_pool.cc:227] Handling call
0810 11:30:27.696639 (+2220151us) ts_tablet_manager.cc:1145] Deleting tablet 8a1e2e624fff4692a22e29b293cd82d6
0810 11:30:27.696655 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.696803 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2219855}
W20260810 11:30:27.698312 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 8a1e2e624fff4692a22e29b293cd82d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a1e2e624fff4692a22e29b293cd82d6 already in progress: creating tablet
I20260810 11:30:27.697319 27231 raft_consensus.cc:348] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.699158 27231 raft_consensus.cc:374] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:27.699334 27231 raft_consensus.cc:729] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:27.700527 27231 consensus_queue.cc:260] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.688086 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0938a2f3688246a2b46978eeb7d5d521" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:27.701341 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 47) took 1936 ms. Trace:
W20260810 11:30:27.701591 26991 leader_election.cc:341] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:27.701553 27228 raft_consensus.cc:348] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.701983 27231 ts_tablet_manager.cc:1428] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260810 11:30:27.702353 27231 tablet_bootstrap.cc:492] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:27.704393 27708 raft_consensus.cc:482] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:27.704744 27708 raft_consensus.cc:504] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.705382 27231 tablet_bootstrap.cc:654] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:27.705551 27708 leader_election.cc:288] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:27.701520 27248 rpcz_store.cc:276] 0810 11:30:25.764977 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.765283 (+ 306us) service_pool.cc:227] Handling call
0810 11:30:27.701095 (+1935812us) ts_tablet_manager.cc:1145] Deleting tablet 10210204d5ff4e5e97c98fd255f674a5
0810 11:30:27.701112 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.701280 (+ 168us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1935423}
W20260810 11:30:27.709189 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 10210204d5ff4e5e97c98fd255f674a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10210204d5ff4e5e97c98fd255f674a5 already in progress: creating tablet
I20260810 11:30:27.715901 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0938a2f3688246a2b46978eeb7d5d521" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:27.718422 27222 consensus_queue.cc:260] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.722982 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 48) took 1943 ms. Trace:
I20260810 11:30:27.725749 28164 consensus_queue.cc:1035] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:27.730360 27222 ts_tablet_manager.cc:1428] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.291s user 0.002s sys 0.002s
I20260810 11:30:27.730175 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70f6017d4d01463398cb347779dacf90" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:27.732717 27222 tablet_bootstrap.cc:492] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:27.736267 27222 tablet_bootstrap.cc:654] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:27.727210 26993 leader_election.cc:341] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:27.738262 26993 leader_election.cc:302] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
W20260810 11:30:27.739148 26993 leader_election.cc:341] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:27.740247 27911 raft_consensus.cc:2726] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:27.742050 27248 rpcz_store.cc:276] 0810 11:30:25.778950 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.779047 (+ 97us) service_pool.cc:227] Handling call
0810 11:30:27.709826 (+1930779us) ts_tablet_manager.cc:1145] Deleting tablet 43fee1a9a6f9482fbbe6ab6599c27fb9
0810 11:30:27.722097 (+ 12271us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.722614 (+ 517us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1928473}
W20260810 11:30:27.746110 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 already in progress: creating tablet
I20260810 11:30:27.750708 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 49) took 1968 ms. Trace:
I20260810 11:30:27.756708 27228 raft_consensus.cc:374] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:27.756949 27228 raft_consensus.cc:729] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:27.758765 27248 rpcz_store.cc:276] 0810 11:30:25.781308 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.781706 (+ 398us) service_pool.cc:227] Handling call
0810 11:30:27.748432 (+1966726us) ts_tablet_manager.cc:1145] Deleting tablet d000f0ebaf0049a7bdaad93e307e16e2
0810 11:30:27.749776 (+ 1344us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.750107 (+ 331us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1966119}
W20260810 11:30:27.759613 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet d000f0ebaf0049a7bdaad93e307e16e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d000f0ebaf0049a7bdaad93e307e16e2 already in progress: creating tablet
I20260810 11:30:27.760311 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 50) took 1978 ms. Trace:
I20260810 11:30:27.760576 27248 rpcz_store.cc:276] 0810 11:30:25.781431 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.784820 (+ 3389us) service_pool.cc:227] Handling call
0810 11:30:27.759501 (+1974681us) ts_tablet_manager.cc:1145] Deleting tablet 256ad2e2d8e54a4caa1b5091bab60dd5
0810 11:30:27.759516 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.760235 (+ 719us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1974453}
W20260810 11:30:27.761468 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 256ad2e2d8e54a4caa1b5091bab60dd5 already in progress: creating tablet
I20260810 11:30:27.761605 27999 log.cc:1196] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/60d56e162b4b41e2867ac845e524aca4
I20260810 11:30:27.762287 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70f6017d4d01463398cb347779dacf90" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:27.763833 26991 leader_election.cc:341] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:27.764247 26991 leader_election.cc:302] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:27.765074 27708 raft_consensus.cc:2726] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:27.766417 27248 tablet_replica.cc:330] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:27.766748 27248 raft_consensus.cc:2229] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:27.767174 27248 raft_consensus.cc:2258] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:27.768026 27248 ts_tablet_manager.cc:1905] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:27.770270 27228 consensus_queue.cc:260] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.771031 27228 ts_tablet_manager.cc:1428] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.125s user 0.001s sys 0.002s
I20260810 11:30:27.771464 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 1860e56467624dcdb288e13b004f78cc with delete_type TABLET_DATA_DELETED (replaced by tablet 214be3356fda4c8484596196c0985721) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:27.775137 27911 raft_consensus.cc:482] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:27.775368 27911 raft_consensus.cc:504] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.776621 27911 leader_election.cc:288] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:27.776960 26849 consensus_peers.cc:487] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:27.777103 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 67268.8us
I20260810 11:30:27.779345 26911 raft_consensus.cc:3037] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:27.780220 27228 tablet_bootstrap.cc:492] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:27.782039 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd6b328baa2346afbbe9f513ae4db3df" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:27.783149 26991 leader_election.cc:341] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:27.784088 27999 ts_tablet_manager.cc:1939] T 60d56e162b4b41e2867ac845e524aca4 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:27.784824 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 7) took 3357 ms. Trace:
I20260810 11:30:27.785424 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd6b328baa2346afbbe9f513ae4db3df" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:27.786182 26993 leader_election.cc:341] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:27.786355 26993 leader_election.cc:302] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:27.787315 27708 raft_consensus.cc:2726] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:27.787971 27999 rpcz_store.cc:276] 0810 11:30:24.427591 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.428067 (+ 476us) service_pool.cc:227] Handling call
0810 11:30:27.326785 (+2898718us) ts_tablet_manager.cc:1145] Deleting tablet 60d56e162b4b41e2867ac845e524aca4
0810 11:30:27.326797 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.471875 (+145078us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.497753 (+ 25878us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.784781 (+287028us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2885754}
I20260810 11:30:27.788502 27999 tablet_replica.cc:330] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:27.789448 28164 consensus_queue.cc:1035] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:27.802207 27228 tablet_bootstrap.cc:654] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:27.810801 27974 ts_tablet_manager.cc:1918] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:27.811203 27974 log.cc:1196] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/31cafb7c691d40a48a40f7d4190c4f8d
I20260810 11:30:27.811887 27111 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:27.811950 27974 ts_tablet_manager.cc:1939] T 31cafb7c691d40a48a40f7d4190c4f8d P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:27.821818 27999 raft_consensus.cc:2229] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:27.822338 27999 raft_consensus.cc:2258] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:27.823362 27999 ts_tablet_manager.cc:1905] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:27.834157 27025 tablet_service.cc:1467] Processing CreateTablet for tablet c3a5d7b8b0a14134ac55fa17a7dac21e (DEFAULT_TABLE table=default.Table_14f7e10124574ccdb41f7b14117603c6 [id=0cf740b2e59643899dac59acdf576fe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.835892 26736 tablet_service.cc:1467] Processing CreateTablet for tablet c3a5d7b8b0a14134ac55fa17a7dac21e (DEFAULT_TABLE table=default.Table_14f7e10124574ccdb41f7b14117603c6 [id=0cf740b2e59643899dac59acdf576fe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.836968 26732 tablet_service.cc:1467] Processing CreateTablet for tablet d3c31d08ddd74ee28948427c726ed130 (DEFAULT_TABLE table=default.Table_a406a8172095498abc9c54697f00f4a0 [id=34056ce268f8490c94a38351b43357a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.840205 27031 tablet_service.cc:1467] Processing CreateTablet for tablet d3c31d08ddd74ee28948427c726ed130 (DEFAULT_TABLE table=default.Table_a406a8172095498abc9c54697f00f4a0 [id=34056ce268f8490c94a38351b43357a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.842119 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3a5d7b8b0a14134ac55fa17a7dac21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.842851 27031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3c31d08ddd74ee28948427c726ed130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.844309 26883 tablet_service.cc:1467] Processing CreateTablet for tablet c3a5d7b8b0a14134ac55fa17a7dac21e (DEFAULT_TABLE table=default.Table_14f7e10124574ccdb41f7b14117603c6 [id=0cf740b2e59643899dac59acdf576fe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.845932 26894 tablet_service.cc:1467] Processing CreateTablet for tablet d3c31d08ddd74ee28948427c726ed130 (DEFAULT_TABLE table=default.Table_a406a8172095498abc9c54697f00f4a0 [id=34056ce268f8490c94a38351b43357a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.846738 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3a5d7b8b0a14134ac55fa17a7dac21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.847534 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3c31d08ddd74ee28948427c726ed130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.864837 27866 raft_consensus.cc:482] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:27.865163 27866 raft_consensus.cc:504] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.865456 27248 ts_tablet_manager.cc:1918] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:27.866048 27866 leader_election.cc:288] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:27.866856 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8798892eb4604ee8ac9c95e64dbb14e9" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:27.867635 26848 leader_election.cc:341] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:27.868171 27248 log.cc:1196] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/fdbe21b4f124411988dd35a0b864f868
I20260810 11:30:27.870772 27248 ts_tablet_manager.cc:1939] T fdbe21b4f124411988dd35a0b864f868 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:27.873644 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 53) took 1915 ms. Trace:
I20260810 11:30:27.873900 27248 rpcz_store.cc:276] 0810 11:30:25.958508 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.959333 (+ 825us) service_pool.cc:227] Handling call
0810 11:30:27.766284 (+1806951us) ts_tablet_manager.cc:1145] Deleting tablet fdbe21b4f124411988dd35a0b864f868
0810 11:30:27.766297 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.799197 (+ 32900us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.864379 (+ 65182us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.873595 (+ 9216us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1799073}
I20260810 11:30:27.874634 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet fdbe21b4f124411988dd35a0b864f868 (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]) successfully deleted
I20260810 11:30:27.874683 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 55) took 1865 ms. Trace:
I20260810 11:30:27.876809 27248 rpcz_store.cc:276] 0810 11:30:26.008960 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.009020 (+ 60us) service_pool.cc:227] Handling call
0810 11:30:27.874397 (+1865377us) ts_tablet_manager.cc:1145] Deleting tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e
0810 11:30:27.874414 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.874574 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1865095}
I20260810 11:30:27.877617 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 57) took 1867 ms. Trace:
W20260810 11:30:27.877774 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e because the tablet was not found. No further retry: Not found: Tablet not found: 7dc4000f1dde46a3b881a9fa8e9a6e3e
I20260810 11:30:27.877825 27248 rpcz_store.cc:276] 0810 11:30:26.009966 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.010061 (+ 95us) service_pool.cc:227] Handling call
0810 11:30:27.877343 (+1867282us) ts_tablet_manager.cc:1145] Deleting tablet 110b5acc36bd4d6bba13735e5daec75f
0810 11:30:27.877360 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.877539 (+ 179us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1867001}
I20260810 11:30:27.878342 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 60) took 1867 ms. Trace:
W20260810 11:30:27.878526 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 110b5acc36bd4d6bba13735e5daec75f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 110b5acc36bd4d6bba13735e5daec75f already in progress: creating tablet
I20260810 11:30:27.882608 27248 rpcz_store.cc:276] 0810 11:30:26.010499 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.010582 (+ 83us) service_pool.cc:227] Handling call
0810 11:30:27.878225 (+1867643us) ts_tablet_manager.cc:1145] Deleting tablet b7a3b877457c4a2489d397f3f864d6b2
0810 11:30:27.878235 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.878300 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1867296}
I20260810 11:30:27.883497 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 58) took 1873 ms. Trace:
W20260810 11:30:27.883705 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet b7a3b877457c4a2489d397f3f864d6b2 because the tablet was not found. No further retry: Not found: Tablet not found: b7a3b877457c4a2489d397f3f864d6b2
I20260810 11:30:27.883854 27248 rpcz_store.cc:276] 0810 11:30:26.010180 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.010792 (+ 612us) service_pool.cc:227] Handling call
0810 11:30:27.883167 (+1872375us) ts_tablet_manager.cc:1145] Deleting tablet 0033d61d07d84262a98b0ebc54bd7960
0810 11:30:27.883185 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.883372 (+ 187us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1872056}
I20260810 11:30:27.884298 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 59) took 1873 ms. Trace:
I20260810 11:30:27.884461 27248 rpcz_store.cc:276] 0810 11:30:26.010325 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.011152 (+ 827us) service_pool.cc:227] Handling call
0810 11:30:27.884177 (+1873025us) ts_tablet_manager.cc:1145] Deleting tablet 2fc76603bf8843dab18c95fdab9a8be0
0810 11:30:27.884187 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.884254 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1872857}
W20260810 11:30:27.884753 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 0033d61d07d84262a98b0ebc54bd7960 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0033d61d07d84262a98b0ebc54bd7960 already in progress: creating tablet
I20260810 11:30:27.884949 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 56) took 1875 ms. Trace:
I20260810 11:30:27.885203 27248 rpcz_store.cc:276] 0810 11:30:26.009843 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.011354 (+ 1511us) service_pool.cc:227] Handling call
0810 11:30:27.884733 (+1873379us) ts_tablet_manager.cc:1145] Deleting tablet ac4b1821ac30452cbe7a8f844d9b37e5
0810 11:30:27.884742 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.884820 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1873214}
I20260810 11:30:27.885676 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 64) took 1871 ms. Trace:
I20260810 11:30:27.885842 27248 rpcz_store.cc:276] 0810 11:30:26.013926 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.014663 (+ 737us) service_pool.cc:227] Handling call
0810 11:30:27.885467 (+1870804us) ts_tablet_manager.cc:1145] Deleting tablet a18cb43b4dc04a1290a6bade7ac1f3cf
0810 11:30:27.885476 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.885593 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1870479}
W20260810 11:30:27.885990 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 2fc76603bf8843dab18c95fdab9a8be0 because the tablet was not found. No further retry: Not found: Tablet not found: 2fc76603bf8843dab18c95fdab9a8be0
I20260810 11:30:27.886193 27248 tablet_replica.cc:330] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:27.886336 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet ac4b1821ac30452cbe7a8f844d9b37e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac4b1821ac30452cbe7a8f844d9b37e5 already in progress: creating tablet
I20260810 11:30:27.886607 27248 raft_consensus.cc:2229] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
W20260810 11:30:27.887034 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet a18cb43b4dc04a1290a6bade7ac1f3cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a18cb43b4dc04a1290a6bade7ac1f3cf already in progress: creating tablet
I20260810 11:30:27.887086 27248 raft_consensus.cc:2258] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:27.887918 27248 ts_tablet_manager.cc:1905] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:27.895434 27248 ts_tablet_manager.cc:1918] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:27.896734 27911 raft_consensus.cc:482] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:27.909955 27911 raft_consensus.cc:504] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.911414 27911 leader_election.cc:288] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:27.911461 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02ff6a9bc02441ddb7f307d6b3df31bd" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:27.912355 27248 log.cc:1196] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/db5adccd80a04e328e13793b461c38b1
I20260810 11:30:27.914295 27248 ts_tablet_manager.cc:1939] T db5adccd80a04e328e13793b461c38b1 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:27.916626 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 65) took 1902 ms. Trace:
I20260810 11:30:27.917083 27248 rpcz_store.cc:276] 0810 11:30:26.014106 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.015038 (+ 932us) service_pool.cc:227] Handling call
0810 11:30:27.886093 (+1871055us) ts_tablet_manager.cc:1145] Deleting tablet db5adccd80a04e328e13793b461c38b1
0810 11:30:27.886125 (+ 32us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.891677 (+ 5552us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.895294 (+ 3617us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.916489 (+ 21195us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1870835}
I20260810 11:30:27.918311 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet db5adccd80a04e328e13793b461c38b1 (table default.Table_baaf705869df4c36a233bb967b25455a [id=f325caa441054ab180909b9af9de3ba6]) successfully deleted
I20260810 11:30:27.919837 27248 tablet_replica.cc:330] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:27.920902 27248 raft_consensus.cc:2229] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:27.921836 27248 raft_consensus.cc:2258] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:27.923516 27248 ts_tablet_manager.cc:1905] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:27.924111 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8798892eb4604ee8ac9c95e64dbb14e9" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:27.924638 26764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02ff6a9bc02441ddb7f307d6b3df31bd" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:27.924928 26764 raft_consensus.cc:2379] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 482e605580be48cbbacce05a3e61c215 in current term 1: Already voted for candidate b6079090b1124d84aa4477974bb53700 in this term.
I20260810 11:30:27.926014 26993 leader_election.cc:302] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:27.926589 27911 raft_consensus.cc:3037] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:27.930919 27911 raft_consensus.cc:2726] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:27.932171 26849 leader_election.cc:341] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:27.932358 26849 leader_election.cc:302] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:27.933236 27866 raft_consensus.cc:2726] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:27.934965 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3c31d08ddd74ee28948427c726ed130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.937001 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3a5d7b8b0a14134ac55fa17a7dac21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.957486 27222 tablet_bootstrap.cc:492] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:27.957716 27222 ts_tablet_manager.cc:1397] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.227s user 0.003s sys 0.004s
I20260810 11:30:27.958959 27222 raft_consensus.cc:348] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.959273 27222 raft_consensus.cc:374] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:27.959462 27222 raft_consensus.cc:729] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:27.959750 27222 consensus_queue.cc:260] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.969707 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 728f273a89cd48f8bf0d8616645f5eed (DEFAULT_TABLE table=default.Table_9a25589f61c844cab9a7d2db84a7eba2 [id=744c7bf0857b476cabce9efa16d7d885]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.970323 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 728f273a89cd48f8bf0d8616645f5eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.973888 27718 raft_consensus.cc:482] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:27.974452 27718 raft_consensus.cc:504] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:27.975430 27718 leader_election.cc:288] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:27.979794 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43e42cc642544f779bb79cee7479c4f4" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:27.983008 26993 leader_election.cc:341] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:27.989562 27025 tablet_service.cc:1467] Processing CreateTablet for tablet 728f273a89cd48f8bf0d8616645f5eed (DEFAULT_TABLE table=default.Table_9a25589f61c844cab9a7d2db84a7eba2 [id=744c7bf0857b476cabce9efa16d7d885]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.989665 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 728f273a89cd48f8bf0d8616645f5eed (DEFAULT_TABLE table=default.Table_9a25589f61c844cab9a7d2db84a7eba2 [id=744c7bf0857b476cabce9efa16d7d885]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.990180 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 728f273a89cd48f8bf0d8616645f5eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.990197 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 728f273a89cd48f8bf0d8616645f5eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:27.992822 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43e42cc642544f779bb79cee7479c4f4" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:27.994294 26730 tablet_service.cc:1467] Processing CreateTablet for tablet cc032509e78c4a04bbe504f54e9d6c6b (DEFAULT_TABLE table=default.Table_44f89aa654e84f22a77580060f057750 [id=3cadcafa2d524a5892f6c315c30881ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:27.995033 26730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc032509e78c4a04bbe504f54e9d6c6b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:27.996742 26991 leader_election.cc:341] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:27.997025 26991 leader_election.cc:302] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:27.997381 27718 raft_consensus.cc:2726] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:27.999686 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_e9f0bd7bcd1441cbbb1e927313ee6335 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 2 got 0
I20260810 11:30:28.002586 27228 tablet_bootstrap.cc:492] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:28.002866 27228 ts_tablet_manager.cc:1397] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.228s user 0.006s sys 0.002s
I20260810 11:30:28.004630 27228 raft_consensus.cc:348] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.005052 27228 raft_consensus.cc:374] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:28.005309 27228 raft_consensus.cc:729] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:28.005713 27228 consensus_queue.cc:260] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.006667 27911 consensus_queue.cc:1035] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:28.006815 27228 ts_tablet_manager.cc:1428] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 11:30:28.016916 27031 tablet_service.cc:1467] Processing CreateTablet for tablet cc032509e78c4a04bbe504f54e9d6c6b (DEFAULT_TABLE table=default.Table_44f89aa654e84f22a77580060f057750 [id=3cadcafa2d524a5892f6c315c30881ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:28.017756 27031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc032509e78c4a04bbe504f54e9d6c6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:28.023185 27021 tablet_service.cc:1467] Processing CreateTablet for tablet e9732b90bc054f8a83fc17c0df9dfafe (DEFAULT_TABLE table=default.Table_094455b6d4f745fa83445cfc650e43b7 [id=c2f01a1417424ff6b61d8c4cb35a638a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:28.023020 26889 tablet_service.cc:1467] Processing CreateTablet for tablet e9732b90bc054f8a83fc17c0df9dfafe (DEFAULT_TABLE table=default.Table_094455b6d4f745fa83445cfc650e43b7 [id=c2f01a1417424ff6b61d8c4cb35a638a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:28.024154 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9732b90bc054f8a83fc17c0df9dfafe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:28.024194 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9732b90bc054f8a83fc17c0df9dfafe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:28.029502 27037 tablet_service.cc:1467] Processing CreateTablet for tablet 7c9e437989e54e459f74b49617dabf52 (DEFAULT_TABLE table=default.Table_e91c3002bfab499aad3c1d686b4f4437 [id=5f8a0b38bb0d428c8bf6253bfbf40650]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:28.030558 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c9e437989e54e459f74b49617dabf52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:28.034057 26883 tablet_service.cc:1467] Processing CreateTablet for tablet cc032509e78c4a04bbe504f54e9d6c6b (DEFAULT_TABLE table=default.Table_44f89aa654e84f22a77580060f057750 [id=3cadcafa2d524a5892f6c315c30881ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:28.036979 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc032509e78c4a04bbe504f54e9d6c6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:28.038760 26730 tablet_service.cc:1467] Processing CreateTablet for tablet 7c9e437989e54e459f74b49617dabf52 (DEFAULT_TABLE table=default.Table_e91c3002bfab499aad3c1d686b4f4437 [id=5f8a0b38bb0d428c8bf6253bfbf40650]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:28.039740 26730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c9e437989e54e459f74b49617dabf52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:28.057053 26743 tablet_service.cc:1467] Processing CreateTablet for tablet e9732b90bc054f8a83fc17c0df9dfafe (DEFAULT_TABLE table=default.Table_094455b6d4f745fa83445cfc650e43b7 [id=c2f01a1417424ff6b61d8c4cb35a638a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:28.058339 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9732b90bc054f8a83fc17c0df9dfafe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:28.085454 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 73) took 1922 ms. Trace:
I20260810 11:30:28.090644 27974 rpcz_store.cc:276] 0810 11:30:26.145932 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.147129 (+ 1197us) service_pool.cc:227] Handling call
0810 11:30:27.326744 (+1179615us) ts_tablet_manager.cc:1145] Deleting tablet 31cafb7c691d40a48a40f7d4190c4f8d
0810 11:30:27.326755 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.597239 (+270484us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:27.810583 (+213344us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.068005 (+257422us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4480,"tablet-delete.queue_time_us":1063503}
I20260810 11:30:28.093554 27974 tablet_replica.cc:330] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:28.098670 27228 tablet_bootstrap.cc:492] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:28.092007 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 31cafb7c691d40a48a40f7d4190c4f8d (table default.Table_891d3f4e3019401fbb1b13496065cb5c [id=7213c582179a43c1b80901a2266e5477]) successfully deleted
I20260810 11:30:28.113623 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:28.114733 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:28.115892 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:28.128911 26893 tablet_service.cc:1467] Processing CreateTablet for tablet 7c9e437989e54e459f74b49617dabf52 (DEFAULT_TABLE table=default.Table_e91c3002bfab499aad3c1d686b4f4437 [id=5f8a0b38bb0d428c8bf6253bfbf40650]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:28.129891 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c9e437989e54e459f74b49617dabf52. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:28.147923 26848 consensus_peers.cc:487] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d729baae40a64e6e8c23e6870f230afb. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:28.161253 27112 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:28.167758 27248 ts_tablet_manager.cc:1918] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260810 11:30:28.185616 27288 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a consensus state has no leader
I20260810 11:30:28.174553 27231 tablet_bootstrap.cc:492] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:28.187844 28165 raft_consensus.cc:482] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:28.185698 27718 consensus_queue.cc:1035] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260810 11:30:28.177165 27248 log.cc:1196] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/60d56e162b4b41e2867ac845e524aca4
I20260810 11:30:28.193512 27231 ts_tablet_manager.cc:1397] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.484s user 0.071s sys 0.131s
I20260810 11:30:28.188603 28165 raft_consensus.cc:504] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.195791 27231 raft_consensus.cc:348] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.196403 27231 raft_consensus.cc:374] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:28.196540 27231 raft_consensus.cc:729] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:28.197248 27231 consensus_queue.cc:260] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.198554 27231 ts_tablet_manager.cc:1428] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20260810 11:30:28.200223 27231 tablet_bootstrap.cc:492] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:28.202854 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a1e2e624fff4692a22e29b293cd82d6" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:28.209173 27231 tablet_bootstrap.cc:654] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:28.211467 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a1e2e624fff4692a22e29b293cd82d6" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:28.224658 28197 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 83cc8e39a3b9455f8242a6da6a54c38a)
W20260810 11:30:28.226298 26700 leader_election.cc:341] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:28.228294 26702 leader_election.cc:341] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:28.229852 26702 leader_election.cc:302] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:28.231165 28159 raft_consensus.cc:2726] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:28.231662 27248 ts_tablet_manager.cc:1939] T 60d56e162b4b41e2867ac845e524aca4 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:28.231984 28165 leader_election.cc:288] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:28.232460 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 66) took 2218 ms. Trace:
I20260810 11:30:28.232791 27248 rpcz_store.cc:276] 0810 11:30:26.014244 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.015296 (+ 1052us) service_pool.cc:227] Handling call
0810 11:30:27.919571 (+1904275us) ts_tablet_manager.cc:1145] Deleting tablet 60d56e162b4b41e2867ac845e524aca4
0810 11:30:27.919623 (+ 52us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.933190 (+ 13567us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.167354 (+234164us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.232404 (+ 65050us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1903984}
I20260810 11:30:28.233847 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 60d56e162b4b41e2867ac845e524aca4 (table default.Table_4d9bc84fc41e4b87ac2f6432852e5d61 [id=9b708c86ff534253961e7c29909eb1bd]) successfully deleted
I20260810 11:30:28.230450 28197 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:28.239045 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 67) took 2224 ms. Trace:
I20260810 11:30:28.239423 27248 rpcz_store.cc:276] 0810 11:30:26.014364 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.015611 (+ 1247us) service_pool.cc:227] Handling call
0810 11:30:28.237576 (+2221965us) ts_tablet_manager.cc:1145] Deleting tablet 1aa4562a2247405187d9dbd1baa48f39
0810 11:30:28.237612 (+ 36us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.238697 (+ 1085us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2221727}
W20260810 11:30:28.240523 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 1aa4562a2247405187d9dbd1baa48f39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1aa4562a2247405187d9dbd1baa48f39 already in progress: creating tablet
I20260810 11:30:28.241792 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 62) took 2228 ms. Trace:
I20260810 11:30:28.242354 27248 rpcz_store.cc:276] 0810 11:30:26.013042 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.016009 (+ 2967us) service_pool.cc:227] Handling call
0810 11:30:28.241256 (+2225247us) ts_tablet_manager.cc:1145] Deleting tablet 49db12565dbc4187b78a98ed35c40fed
0810 11:30:28.241276 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.241677 (+ 401us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2225025}
I20260810 11:30:28.243783 27974 raft_consensus.cc:2229] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:28.243834 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 49db12565dbc4187b78a98ed35c40fed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49db12565dbc4187b78a98ed35c40fed already in progress: creating tablet
I20260810 11:30:28.244313 27974 raft_consensus.cc:2258] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:28.245131 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 68) took 2229 ms. Trace:
I20260810 11:30:28.246466 28197 leader_election.cc:288] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547)
I20260810 11:30:28.247396 27379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac259bcf213a4aa297d1d8e73b262361" candidate_term: 4 candidate_status { last_received { term: 3 index: 581 } } ignore_live_leader: false dest_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" is_pre_election: true
I20260810 11:30:28.264906 27974 ts_tablet_manager.cc:1905] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:28.265878 27222 ts_tablet_manager.cc:1428] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.140s user 0.001s sys 0.003s
I20260810 11:30:28.271770 27222 tablet_bootstrap.cc:492] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:28.288292 27866 raft_consensus.cc:482] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 443ec871f1ed4232b932ecfb0b18510d)
I20260810 11:30:28.288852 27866 raft_consensus.cc:504] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.290635 27866 leader_election.cc:288] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:28.293493 27248 rpcz_store.cc:276] 0810 11:30:26.015967 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.016251 (+ 284us) service_pool.cc:227] Handling call
0810 11:30:28.244700 (+2228449us) ts_tablet_manager.cc:1145] Deleting tablet 809b5b6b65d244cd9186517e39494839
0810 11:30:28.244726 (+ 26us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.245052 (+ 326us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2228258}
W20260810 11:30:28.294737 26848 leader_election.cc:341] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 5adcec593b8c4d40997c8911e9f77c85
W20260810 11:30:28.295046 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 809b5b6b65d244cd9186517e39494839 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 809b5b6b65d244cd9186517e39494839 already in progress: creating tablet
I20260810 11:30:28.296008 27248 tablet_replica.cc:330] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:28.301188 27248 raft_consensus.cc:2229] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:28.301882 27248 raft_consensus.cc:2258] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:28.302450 27999 ts_tablet_manager.cc:1918] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:28.116743 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:28.303357 27248 ts_tablet_manager.cc:1905] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:28.303838 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
I20260810 11:30:28.316311 28116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=491 overwritten=0 applied=486 ignored=0} inserts{seen=455 ignored=0} mutations{seen=539 ignored=0} orphaned_commits=0. Pending: 5 replicates
I20260810 11:30:28.317198 27231 tablet_bootstrap.cc:492] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:28.317781 27231 ts_tablet_manager.cc:1397] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.118s user 0.004s sys 0.008s
I20260810 11:30:28.318409 28116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Bootstrap complete.
I20260810 11:30:28.320890 27231 raft_consensus.cc:348] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.321419 27231 raft_consensus.cc:374] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:28.328893 27231 raft_consensus.cc:729] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:28.335119 27231 consensus_queue.cc:260] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:28.347088 26849 leader_election.cc:341] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 5adcec593b8c4d40997c8911e9f77c85
I20260810 11:30:28.347543 26849 leader_election.cc:302] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:28.348541 28029 consensus_queue.cc:1035] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:28.349956 28029 raft_consensus.cc:2726] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:28.351336 27999 log.cc:1196] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/3ff4e19071fc435fbae4490799325e37
I20260810 11:30:28.351752 27248 ts_tablet_manager.cc:1918] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:28.352069 27248 log.cc:1196] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/1e0a8513171f4c39b74c08760a139d9e
I20260810 11:30:28.353732 27248 ts_tablet_manager.cc:1939] T 1e0a8513171f4c39b74c08760a139d9e P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:28.354743 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 63) took 2341 ms. Trace:
I20260810 11:30:28.355175 27248 rpcz_store.cc:276] 0810 11:30:26.013170 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.016673 (+ 3503us) service_pool.cc:227] Handling call
0810 11:30:28.295820 (+2279147us) ts_tablet_manager.cc:1145] Deleting tablet 1e0a8513171f4c39b74c08760a139d9e
0810 11:30:28.295853 (+ 33us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.344228 (+ 48375us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.351393 (+ 7165us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.354498 (+ 3105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2278894}
I20260810 11:30:28.356096 27248 tablet_replica.cc:330] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:28.356431 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 1e0a8513171f4c39b74c08760a139d9e (table default.Table_aa6798d7140e47fd8b1709e531dbbd10 [id=c62015a698ae48959d405f34503f5fb9]) successfully deleted
I20260810 11:30:28.356709 27248 raft_consensus.cc:2229] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:28.357107 27248 raft_consensus.cc:2258] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:28.358444 27248 ts_tablet_manager.cc:1905] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:28.359549 27231 ts_tablet_manager.cc:1428] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.041s user 0.002s sys 0.002s
I20260810 11:30:28.360411 27231 tablet_bootstrap.cc:492] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:28.351529 28040 raft_consensus.cc:482] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:28.364198 28040 raft_consensus.cc:504] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:28.365865 28040 leader_election.cc:288] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:28.366866 26848 leader_election.cc:341] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: f3884736eec74c8992b8d51b37465875
I20260810 11:30:28.367463 27999 ts_tablet_manager.cc:1939] T 3ff4e19071fc435fbae4490799325e37 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:28.368309 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 1) took 3941 ms. Trace:
I20260810 11:30:28.368539 27999 rpcz_store.cc:276] 0810 11:30:24.426823 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.427921 (+ 1098us) service_pool.cc:227] Handling call
0810 11:30:27.788400 (+3360479us) ts_tablet_manager.cc:1145] Deleting tablet 3ff4e19071fc435fbae4490799325e37
0810 11:30:27.788413 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:27.914655 (+126242us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.112389 (+197734us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.368217 (+255828us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3347138}
I20260810 11:30:28.369643 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 3ff4e19071fc435fbae4490799325e37 (table default.Table_22360b2c6a9e46f99bbc036074cb7441 [id=80c0857a46a84400aa9ce1e7f2e39d25]) successfully deleted
I20260810 11:30:28.370661 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 2) took 3942 ms. Trace:
I20260810 11:30:28.372140 26822 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
W20260810 11:30:28.375793 26388 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 61796.3us
I20260810 11:30:28.370385 27911 raft_consensus.cc:482] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:28.377351 27911 raft_consensus.cc:504] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:28.387832 26702 consensus_peers.cc:487] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1e0a8513171f4c39b74c08760a139d9e. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:28.388903 27911 leader_election.cc:288] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:28.375932 27231 tablet_bootstrap.cc:654] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:28.393006 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]). Expected version 1 got 0
I20260810 11:30:28.403090 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]). Expected version 1 got 0
I20260810 11:30:28.386140 28116 raft_consensus.cc:348] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 2 FOLLOWER]: Replica starting. Triggering 5 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:28.405659 26764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "524c8d37d3964e368695d182883b0bd5" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:28.406376 26764 raft_consensus.cc:2454] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:28.412989 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:28.375052 27228 tablet_bootstrap.cc:654] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:28.384033 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "524c8d37d3964e368695d182883b0bd5" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:28.392225 28040 raft_consensus.cc:482] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:28.419777 28040 raft_consensus.cc:504] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.417922 27999 rpcz_store.cc:276] 0810 11:30:24.426952 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.427951 (+ 999us) service_pool.cc:227] Handling call
0810 11:30:28.369606 (+3941655us) ts_tablet_manager.cc:1145] Deleting tablet 110b5acc36bd4d6bba13735e5daec75f
0810 11:30:28.369638 (+ 32us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.369819 (+ 181us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3918780}
I20260810 11:30:28.420982 28040 leader_election.cc:288] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:28.398926 26849 leader_election.cc:341] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: f3884736eec74c8992b8d51b37465875
I20260810 11:30:28.422870 26849 leader_election.cc:302] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:28.423378 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:28.424124 27866 raft_consensus.cc:2726] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 11:30:28.425411 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 110b5acc36bd4d6bba13735e5daec75f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 110b5acc36bd4d6bba13735e5daec75f already in progress: creating tablet
I20260810 11:30:28.433019 26993 leader_election.cc:302] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
W20260810 11:30:28.436085 26991 leader_election.cc:341] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:28.438630 27911 raft_consensus.cc:2781] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:28.439002 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 0) took 4012 ms. Trace:
I20260810 11:30:28.438912 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0033d61d07d84262a98b0ebc54bd7960" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:28.429456 26764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0033d61d07d84262a98b0ebc54bd7960" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:28.439288 27999 rpcz_store.cc:276] 0810 11:30:24.426695 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.427888 (+ 1193us) service_pool.cc:227] Handling call
0810 11:30:28.420605 (+3992717us) ts_tablet_manager.cc:1145] Deleting tablet f7ada1df82eb44ecb9a6c615b5410e6f
0810 11:30:28.426554 (+ 5949us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.438828 (+ 12274us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3963595}
W20260810 11:30:28.440917 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet f7ada1df82eb44ecb9a6c615b5410e6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7ada1df82eb44ecb9a6c615b5410e6f already in progress: creating tablet
W20260810 11:30:28.441846 26849 leader_election.cc:341] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:28.438930 27911 raft_consensus.cc:482] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:28.443008 27999 tablet_replica.cc:330] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700: stopping tablet replica
W20260810 11:30:28.445420 27291 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.252:34489, user_credentials={real_user=slave}} blocked reactor thread for 57601.1us
W20260810 11:30:28.443272 26848 leader_election.cc:341] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:28.461544 26848 leader_election.cc:302] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:28.463184 28029 raft_consensus.cc:2726] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:28.464247 27999 raft_consensus.cc:2229] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:28.467243 28116 raft_consensus.cc:729] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c40c76e125b44de181b88b7f63a566f7, State: Initialized, Role: FOLLOWER
I20260810 11:30:28.468498 27999 raft_consensus.cc:2258] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:28.424273 27331 catalog_manager.cc:5495] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:28.468891 28116 consensus_queue.cc:260] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 486, Last appended: 2.491, Last appended by leader: 491, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:28.470814 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]). Expected version 2 got 0
I20260810 11:30:28.472405 27999 ts_tablet_manager.cc:1905] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:28.473362 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:28.476817 27911 raft_consensus.cc:3037] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:28.476958 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:28.477634 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:28.478488 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:28.479450 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:28.479996 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:28.480393 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]). Expected version 2 got 0
I20260810 11:30:28.475834 27228 tablet_bootstrap.cc:492] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:28.489121 27228 ts_tablet_manager.cc:1397] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.391s user 0.007s sys 0.005s
I20260810 11:30:28.490664 28029 consensus_queue.cc:1035] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:28.490240 28207 sys_catalog.cc:455] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:28.492468 28207 sys_catalog.cc:458] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:28.494131 27228 raft_consensus.cc:348] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.496716 27228 raft_consensus.cc:374] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:28.496932 27228 raft_consensus.cc:729] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:28.497406 26823 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:28.497514 27222 tablet_bootstrap.cc:654] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:28.497452 27228 consensus_queue.cc:260] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.500888 28116 sys_catalog.cc:564] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 11:30:28.503207 27228 ts_tablet_manager.cc:1428] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.014s user 0.000s sys 0.004s
I20260810 11:30:28.503896 28034 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 2 FOLLOWER]: Advancing to term 3
I20260810 11:30:28.504505 28033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac259bcf213a4aa297d1d8e73b262361" candidate_term: 4 candidate_status { last_received { term: 3 index: 581 } } ignore_live_leader: false dest_uuid: "c40c76e125b44de181b88b7f63a566f7" is_pre_election: true
I20260810 11:30:28.506763 26564 leader_election.cc:302] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac259bcf213a4aa297d1d8e73b262361; no voters: 83cc8e39a3b9455f8242a6da6a54c38a, c40c76e125b44de181b88b7f63a566f7
I20260810 11:30:28.507473 28197 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260810 11:30:28.507755 27911 raft_consensus.cc:504] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.508936 27228 tablet_bootstrap.cc:492] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:28.511085 27248 ts_tablet_manager.cc:1918] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:28.515200 27248 log.cc:1196] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/0938a2f3688246a2b46978eeb7d5d521
I20260810 11:30:28.515239 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 1 got 0
I20260810 11:30:28.519263 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "524c8d37d3964e368695d182883b0bd5" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:28.519872 26771 raft_consensus.cc:3037] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:28.521255 27248 ts_tablet_manager.cc:1939] T 0938a2f3688246a2b46978eeb7d5d521 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:28.523881 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:28.527709 27228 tablet_bootstrap.cc:654] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:28.530557 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 61) took 2517 ms. Trace:
I20260810 11:30:28.533669 27248 rpcz_store.cc:276] 0810 11:30:26.012828 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.016927 (+ 4099us) service_pool.cc:227] Handling call
0810 11:30:28.355795 (+2338868us) ts_tablet_manager.cc:1145] Deleting tablet 0938a2f3688246a2b46978eeb7d5d521
0810 11:30:28.355845 (+ 50us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.390748 (+ 34903us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.510072 (+119324us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.530461 (+ 20389us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2338655}
I20260810 11:30:28.537806 27222 tablet_bootstrap.cc:492] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:28.538115 27222 ts_tablet_manager.cc:1397] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.271s user 0.009s sys 0.005s
I20260810 11:30:28.539285 27222 raft_consensus.cc:348] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.540361 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:28.542042 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]). Expected version 1 got 0
I20260810 11:30:28.542783 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 23637a02b6464e17aa2a69ea5cc4ddfe (table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85]). Expected version 1 got 0
I20260810 11:30:28.549384 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:28.531772 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "524c8d37d3964e368695d182883b0bd5" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:28.557199 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 1 got 0
I20260810 11:30:28.545442 26771 raft_consensus.cc:2454] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:28.558516 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:28.559234 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 2 got 0
I20260810 11:30:28.563866 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 0938a2f3688246a2b46978eeb7d5d521 (table default.Table_e15e0bcf194a490495cfd17ad551958b [id=45a883ca6cbe441bb7fffa52c88f423d]) successfully deleted
I20260810 11:30:28.563972 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]). Expected version 1 got 0
I20260810 11:30:28.566359 27999 ts_tablet_manager.cc:1918] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:28.567103 27999 log.cc:1196] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/9311943eebaa4824bde96b4cb09f1e2c
I20260810 11:30:28.539630 27222 raft_consensus.cc:374] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:28.568830 27222 raft_consensus.cc:729] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:28.568955 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:28.569864 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:28.570245 27222 consensus_queue.cc:260] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.571098 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:28.532155 28206 raft_consensus.cc:482] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:28.521853 27911 leader_election.cc:288] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:28.550423 26991 leader_election.cc:341] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:28.576192 27228 tablet_bootstrap.cc:492] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:28.576941 27228 ts_tablet_manager.cc:1397] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.068s user 0.006s sys 0.004s
I20260810 11:30:28.578649 27866 raft_consensus.cc:482] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:28.582155 27866 raft_consensus.cc:504] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.584264 27866 leader_election.cc:288] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:28.584087 28206 raft_consensus.cc:504] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.585673 26993 leader_election.cc:302] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:28.587139 27911 raft_consensus.cc:2781] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:28.589540 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd6b328baa2346afbbe9f513ae4db3df" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:28.590714 26849 leader_election.cc:341] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:28.590924 28209 log.cc:924] Time spent T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260810 11:30:28.595465 27228 raft_consensus.cc:348] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.600281 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0118ff9d21924aefa8c6c32977c10453" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:28.601084 28206 leader_election.cc:288] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:28.601657 26993 leader_election.cc:341] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:28.603116 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 69) took 2573 ms. Trace:
I20260810 11:30:28.603773 27248 rpcz_store.cc:276] 0810 11:30:26.016547 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.017161 (+ 614us) service_pool.cc:227] Handling call
0810 11:30:28.571592 (+2554431us) ts_tablet_manager.cc:1145] Deleting tablet 7eae49e1c6554ba2ae831831ff4bb45c
0810 11:30:28.571625 (+ 33us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.590299 (+ 18674us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2554265}
I20260810 11:30:28.605211 27974 ts_tablet_manager.cc:1918] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 11:30:28.605180 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7eae49e1c6554ba2ae831831ff4bb45c because the tablet was not found. No further retry: Not found: Tablet not found: 7eae49e1c6554ba2ae831831ff4bb45c
I20260810 11:30:28.607168 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]). Expected version 1 got 0
I20260810 11:30:28.607940 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 70) took 2590 ms. Trace:
I20260810 11:30:28.608839 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:28.608731 27248 rpcz_store.cc:276] 0810 11:30:26.017515 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.017556 (+ 41us) service_pool.cc:227] Handling call
0810 11:30:28.606985 (+2589429us) ts_tablet_manager.cc:1145] Deleting tablet f6e264e8507446809f3c386fdb3c34ae
0810 11:30:28.607006 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.607515 (+ 509us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2589221}
I20260810 11:30:28.597929 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0118ff9d21924aefa8c6c32977c10453" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:28.606971 27999 ts_tablet_manager.cc:1939] T 9311943eebaa4824bde96b4cb09f1e2c P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:28.611150 27222 ts_tablet_manager.cc:1428] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.034s user 0.001s sys 0.001s
I20260810 11:30:28.611097 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 13) took 4164 ms. Trace:
W20260810 11:30:28.611145 26991 leader_election.cc:341] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:28.611546 26991 leader_election.cc:302] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:28.612026 27999 rpcz_store.cc:276] 0810 11:30:24.446332 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.449031 (+ 2699us) service_pool.cc:227] Handling call
0810 11:30:28.442762 (+3993731us) ts_tablet_manager.cc:1145] Deleting tablet 9311943eebaa4824bde96b4cb09f1e2c
0810 11:30:28.442807 (+ 45us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.528913 (+ 86106us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.565744 (+ 36831us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.610994 (+ 45250us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3984220}
I20260810 11:30:28.612633 27222 tablet_bootstrap.cc:492] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:28.612663 27708 raft_consensus.cc:2726] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:28.613386 27228 raft_consensus.cc:374] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:28.592739 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd6b328baa2346afbbe9f513ae4db3df" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:28.613878 27228 raft_consensus.cc:729] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:28.613979 27057 raft_consensus.cc:2454] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:28.615264 26848 leader_election.cc:302] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
W20260810 11:30:28.610265 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet f6e264e8507446809f3c386fdb3c34ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6e264e8507446809f3c386fdb3c34ae already in progress: creating tablet
I20260810 11:30:28.613168 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 9311943eebaa4824bde96b4cb09f1e2c (table default.Table_547fe3fa37ab46aab94789c556ec37d7 [id=7413e4ae5b8b4ccd904917ec2adbf8f3]) successfully deleted
I20260810 11:30:28.616108 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:28.616364 27222 tablet_bootstrap.cc:654] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:28.616905 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:28.617532 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]). Expected version 2 got 0
I20260810 11:30:28.618714 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:28.621390 27331 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:28.627624 27866 raft_consensus.cc:2781] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:28.627872 27866 raft_consensus.cc:482] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:28.628417 27231 tablet_bootstrap.cc:492] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:28.628432 27866 raft_consensus.cc:3037] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:28.632376 27231 ts_tablet_manager.cc:1397] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.269s user 0.007s sys 0.011s
I20260810 11:30:28.632959 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 16) took 4180 ms. Trace:
I20260810 11:30:28.633697 26912 raft_consensus.cc:3037] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:28.634941 27231 raft_consensus.cc:348] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.635597 27231 raft_consensus.cc:374] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:28.635793 27231 raft_consensus.cc:729] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:28.636972 27974 log.cc:1196] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/cb01e54d817c4b0dbcc80f90f82923c0
I20260810 11:30:28.637310 27999 rpcz_store.cc:276] 0810 11:30:24.446691 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.449168 (+ 2477us) service_pool.cc:227] Handling call
0810 11:30:28.615743 (+4166575us) ts_tablet_manager.cc:1145] Deleting tablet fc558690dce44e999e55e9bf1b6ca172
0810 11:30:28.615756 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.627133 (+ 11377us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4154935}
I20260810 11:30:28.638794 27999 tablet_replica.cc:330] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:28.639336 27999 raft_consensus.cc:2229] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:28.640044 27999 raft_consensus.cc:2258] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:28.641216 27999 ts_tablet_manager.cc:1905] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:28.647012 27974 ts_tablet_manager.cc:1939] T cb01e54d817c4b0dbcc80f90f82923c0 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
W20260810 11:30:28.648316 26993 consensus_peers.cc:487] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:28.649268 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 81) took 2500 ms. Trace:
I20260810 11:30:28.649736 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 71) took 2631 ms. Trace:
I20260810 11:30:28.651347 27911 raft_consensus.cc:686] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:28.649693 27974 rpcz_store.cc:276] 0810 11:30:26.146890 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.147336 (+ 446us) service_pool.cc:227] Handling call
0810 11:30:28.093417 (+1946081us) ts_tablet_manager.cc:1145] Deleting tablet cb01e54d817c4b0dbcc80f90f82923c0
0810 11:30:28.093438 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.497015 (+403577us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.604139 (+107124us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.647701 (+ 43562us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3950,"tablet-delete.queue_time_us":1826005}
I20260810 11:30:28.652110 27911 consensus_queue.cc:237] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.653590 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 75) took 2507 ms. Trace:
I20260810 11:30:28.653865 27974 rpcz_store.cc:276] 0810 11:30:26.146175 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.147202 (+ 1027us) service_pool.cc:227] Handling call
0810 11:30:28.653007 (+2505805us) ts_tablet_manager.cc:1145] Deleting tablet 7aa16654b7f34f9baf856bf724cece8f
0810 11:30:28.653041 (+ 34us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.653224 (+ 183us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2380500}
I20260810 11:30:28.655987 26964 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:28.656733 27248 rpcz_store.cc:276] 0810 11:30:26.017855 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.018002 (+ 147us) service_pool.cc:227] Handling call
0810 11:30:28.649111 (+2631109us) ts_tablet_manager.cc:1145] Deleting tablet 34bd3c0edf6b49d1891c0ee9af344872
0810 11:30:28.649129 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.649516 (+ 387us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2630920}
I20260810 11:30:28.658499 27974 tablet_replica.cc:330] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:28.659797 27248 tablet_replica.cc:330] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:28.661029 27974 raft_consensus.cc:2229] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:28.661819 27974 raft_consensus.cc:2258] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:28.662397 27248 raft_consensus.cc:2229] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:28.668125 27866 raft_consensus.cc:504] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.669451 27974 ts_tablet_manager.cc:1905] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:28.665208 27231 consensus_queue.cc:260] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.671795 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd6b328baa2346afbbe9f513ae4db3df" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:28.676903 27059 raft_consensus.cc:3037] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:28.681051 27866 leader_election.cc:288] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:28.614634 27228 consensus_queue.cc:260] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.682585 27228 ts_tablet_manager.cc:1428] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.095s user 0.002s sys 0.005s
I20260810 11:30:28.682649 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd6b328baa2346afbbe9f513ae4db3df" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:28.683207 27228 tablet_bootstrap.cc:492] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
W20260810 11:30:28.683578 26849 leader_election.cc:341] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:28.681551 28213 consensus_queue.cc:1035] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260810 11:30:28.686468 27228 tablet_bootstrap.cc:654] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:28.687754 27059 raft_consensus.cc:2454] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:28.692394 27231 ts_tablet_manager.cc:1428] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.059s user 0.003s sys 0.002s
I20260810 11:30:28.696241 27248 raft_consensus.cc:2258] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:28.716899 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet fc558690dce44e999e55e9bf1b6ca172 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc558690dce44e999e55e9bf1b6ca172 already in progress: creating tablet
W20260810 11:30:28.717500 27286 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 79030.8us
I20260810 11:30:28.719664 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet cb01e54d817c4b0dbcc80f90f82923c0 (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]) successfully deleted
W20260810 11:30:28.720625 27290 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 66962.2us
W20260810 11:30:28.721606 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7aa16654b7f34f9baf856bf724cece8f because the tablet was not found. No further retry: Not found: Tablet not found: 7aa16654b7f34f9baf856bf724cece8f
W20260810 11:30:28.723812 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 34bd3c0edf6b49d1891c0ee9af344872 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34bd3c0edf6b49d1891c0ee9af344872 already in progress: creating tablet
W20260810 11:30:28.725371 27288 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 66077.9us
I20260810 11:30:28.727440 27231 tablet_bootstrap.cc:492] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:28.688838 26848 leader_election.cc:302] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:28.739116 27866 raft_consensus.cc:2781] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:28.746758 27866 raft_consensus.cc:686] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:28.749599 27248 ts_tablet_manager.cc:1905] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:28.750447 27222 tablet_bootstrap.cc:492] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:28.751053 27222 ts_tablet_manager.cc:1397] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.139s user 0.006s sys 0.015s
I20260810 11:30:28.759572 27866 consensus_queue.cc:237] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.765538 27222 raft_consensus.cc:348] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.766644 27222 raft_consensus.cc:374] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:28.767071 27222 raft_consensus.cc:729] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:28.767954 27222 consensus_queue.cc:260] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.777226 27231 tablet_bootstrap.cc:654] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:28.777292 27974 ts_tablet_manager.cc:1918] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:28.777843 27974 log.cc:1196] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/4b15cc8669b549a2b4461dccd66a0c5a
I20260810 11:30:28.780315 27974 ts_tablet_manager.cc:1939] T 4b15cc8669b549a2b4461dccd66a0c5a P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:28.781078 28165 raft_consensus.cc:482] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:28.781685 28165 raft_consensus.cc:504] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.783289 28165 leader_election.cc:288] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:28.784919 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87f6835f0dc4ad4b3a23b297726100d" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:28.786660 26702 leader_election.cc:341] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:28.790000 27222 ts_tablet_manager.cc:1428] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.039s user 0.007s sys 0.002s
I20260810 11:30:28.790673 27222 tablet_bootstrap.cc:492] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:28.820873 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87f6835f0dc4ad4b3a23b297726100d" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:28.833506 27999 ts_tablet_manager.cc:1918] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:28.837420 27999 log.cc:1196] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/23d8ce485cb84495a6e964b6d5977f0d
I20260810 11:30:28.839587 27999 ts_tablet_manager.cc:1939] T 23d8ce485cb84495a6e964b6d5977f0d P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:28.862699 28165 raft_consensus.cc:482] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:28.863400 28165 raft_consensus.cc:504] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.865648 28165 leader_election.cc:288] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:28.866827 26700 leader_election.cc:341] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:28.869696 26700 leader_election.cc:302] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
W20260810 11:30:28.870599 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 46825.7us
I20260810 11:30:28.874042 28165 raft_consensus.cc:2726] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:28.879309 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0938a2f3688246a2b46978eeb7d5d521" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:28.881312 26700 leader_election.cc:341] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:28.882531 27866 raft_consensus.cc:482] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:28.883253 27866 raft_consensus.cc:504] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.887116 27222 tablet_bootstrap.cc:654] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:28.887574 27866 leader_election.cc:288] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:28.888017 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43e42cc642544f779bb79cee7479c4f4" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:28.889750 26849 leader_election.cc:341] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:28.892854 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 85) took 2523 ms. Trace:
I20260810 11:30:28.893393 27974 rpcz_store.cc:276] 0810 11:30:26.274632 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.276012 (+ 1380us) service_pool.cc:227] Handling call
0810 11:30:28.658089 (+2382077us) ts_tablet_manager.cc:1145] Deleting tablet 4b15cc8669b549a2b4461dccd66a0c5a
0810 11:30:28.658114 (+ 25us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.719824 (+ 61710us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.776933 (+ 57109us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.798246 (+ 21313us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2381682}
I20260810 11:30:28.894865 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 4b15cc8669b549a2b4461dccd66a0c5a (table default.Table_16866d33f78041fd9fdfdd14a4daf75e [id=3ed241516c2f474c818b0b4e77ae4bbc]) successfully deleted
I20260810 11:30:28.898455 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43e42cc642544f779bb79cee7479c4f4" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:28.899029 27058 raft_consensus.cc:2454] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:28.899847 27111 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:28.901492 27911 raft_consensus.cc:482] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:28.901890 27911 raft_consensus.cc:504] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:28.902199 26702 leader_election.cc:341] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 0938a2f3688246a2b46978eeb7d5d521
I20260810 11:30:28.902698 26702 leader_election.cc:302] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:28.903455 27911 leader_election.cc:288] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:28.903486 28165 raft_consensus.cc:2726] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:28.906378 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c715bdcff8c4cdabfddf871f6fdc388" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:28.907692 26771 raft_consensus.cc:2454] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:28.908278 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 86) took 2633 ms. Trace:
I20260810 11:30:28.912002 26993 leader_election.cc:302] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:28.913085 27911 raft_consensus.cc:2781] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:28.913514 27911 raft_consensus.cc:482] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:28.913985 27911 raft_consensus.cc:3037] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:28.918193 26848 leader_election.cc:302] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:28.922022 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c715bdcff8c4cdabfddf871f6fdc388" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:28.923858 26991 leader_election.cc:341] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:28.925351 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 12) took 4457 ms. Trace:
I20260810 11:30:28.926321 27999 rpcz_store.cc:276] 0810 11:30:24.446216 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.449122 (+ 2906us) service_pool.cc:227] Handling call
0810 11:30:28.638615 (+4189493us) ts_tablet_manager.cc:1145] Deleting tablet 23d8ce485cb84495a6e964b6d5977f0d
0810 11:30:28.638643 (+ 28us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.765032 (+126389us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.833246 (+ 68214us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.903986 (+ 70740us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4176209}
I20260810 11:30:28.917047 27974 rpcz_store.cc:276] 0810 11:30:26.274853 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.276677 (+ 1824us) service_pool.cc:227] Handling call
0810 11:30:28.907759 (+2631082us) ts_tablet_manager.cc:1145] Deleting tablet 0033d61d07d84262a98b0ebc54bd7960
0810 11:30:28.907788 (+ 29us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.908007 (+ 219us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2630793}
I20260810 11:30:28.932164 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 23d8ce485cb84495a6e964b6d5977f0d (table default.Table_1ff9ed629e8b465e9ac5588ad616105a [id=75fe62ca5f6448c38b7f9f683cb932b5]) successfully deleted
W20260810 11:30:28.932988 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 0033d61d07d84262a98b0ebc54bd7960 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0033d61d07d84262a98b0ebc54bd7960 already in progress: creating tablet
I20260810 11:30:28.938037 27999 tablet_replica.cc:330] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:28.930191 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 87) took 2654 ms. Trace:
I20260810 11:30:28.939066 27974 rpcz_store.cc:276] 0810 11:30:26.275019 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.276990 (+ 1971us) service_pool.cc:227] Handling call
0810 11:30:28.929559 (+2652569us) ts_tablet_manager.cc:1145] Deleting tablet 08f6636df13548c49f35e1808a87c1f5
0810 11:30:28.929587 (+ 28us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.929821 (+ 234us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2652365}
I20260810 11:30:28.939459 27911 raft_consensus.cc:504] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.943436 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c715bdcff8c4cdabfddf871f6fdc388" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:28.944155 26771 raft_consensus.cc:3037] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:28.944438 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 08f6636df13548c49f35e1808a87c1f5 because the tablet was not found. No further retry: Not found: Tablet not found: 08f6636df13548c49f35e1808a87c1f5
I20260810 11:30:28.945554 27974 tablet_replica.cc:330] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:28.946271 27974 raft_consensus.cc:2229] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:28.947242 27974 raft_consensus.cc:2258] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:28.952917 27911 leader_election.cc:288] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:28.955631 26771 raft_consensus.cc:2454] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:28.956179 27228 tablet_bootstrap.cc:492] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:28.956383 27866 raft_consensus.cc:2781] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:28.956172 27999 raft_consensus.cc:2229] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:28.958781 27248 ts_tablet_manager.cc:1918] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:28.959291 27248 log.cc:1196] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/9311943eebaa4824bde96b4cb09f1e2c
I20260810 11:30:28.959743 27231 tablet_bootstrap.cc:492] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:28.960762 27231 ts_tablet_manager.cc:1397] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.261s user 0.027s sys 0.025s
I20260810 11:30:28.962867 27228 ts_tablet_manager.cc:1397] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.273s user 0.004s sys 0.007s
I20260810 11:30:28.965518 27222 tablet_bootstrap.cc:492] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:28.965598 27231 raft_consensus.cc:348] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.965664 27228 raft_consensus.cc:348] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.966061 27222 ts_tablet_manager.cc:1397] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.175s user 0.005s sys 0.007s
I20260810 11:30:28.966161 27231 raft_consensus.cc:374] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:28.966436 27231 raft_consensus.cc:729] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:28.973019 27999 raft_consensus.cc:2258] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:28.974426 27999 ts_tablet_manager.cc:1905] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:28.976354 27974 ts_tablet_manager.cc:1905] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:28.977295 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c715bdcff8c4cdabfddf871f6fdc388" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:28.977783 27866 raft_consensus.cc:482] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:28.978006 27866 raft_consensus.cc:3037] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:28.983296 27222 raft_consensus.cc:348] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:28.987525 28228 raft_consensus.cc:482] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 443ec871f1ed4232b932ecfb0b18510d)
I20260810 11:30:28.988221 28228 raft_consensus.cc:504] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:28.992101 28228 leader_election.cc:288] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:28.993177 26848 leader_election.cc:341] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 725d2e70e1d441b497d56a278e1de0ad
I20260810 11:30:28.993690 27222 raft_consensus.cc:374] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:28.993834 27222 raft_consensus.cc:729] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
W20260810 11:30:28.995471 26849 leader_election.cc:341] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 725d2e70e1d441b497d56a278e1de0ad
I20260810 11:30:28.995783 26849 leader_election.cc:302] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:28.991854 27228 raft_consensus.cc:374] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:28.998760 27228 raft_consensus.cc:729] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:28.998872 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_e9f0bd7bcd1441cbbb1e927313ee6335 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 2 got 0
I20260810 11:30:28.999742 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:29.000133 27228 consensus_queue.cc:260] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.001782 28228 raft_consensus.cc:2726] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:29.002040 28207 sys_catalog.cc:455] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83cc8e39a3b9455f8242a6da6a54c38a. Latest consensus state: current_term: 3 leader_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:29.003949 28207 sys_catalog.cc:458] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:29.004670 27222 consensus_queue.cc:260] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.006246 28242 sys_catalog.cc:455] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:29.007642 27222 ts_tablet_manager.cc:1428] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.041s user 0.006s sys 0.000s
I20260810 11:30:29.007664 28242 sys_catalog.cc:458] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:29.008612 27231 consensus_queue.cc:260] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.009099 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:28.961320 27248 ts_tablet_manager.cc:1939] T 9311943eebaa4824bde96b4cb09f1e2c P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
W20260810 11:30:28.986205 26991 leader_election.cc:341] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:29.016541 27231 ts_tablet_manager.cc:1428] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.049s user 0.005s sys 0.000s
I20260810 11:30:29.016233 28034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 0) took 2909 ms. Trace:
I20260810 11:30:29.017469 28213 raft_consensus.cc:482] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:29.021679 28213 raft_consensus.cc:504] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.025259 27866 raft_consensus.cc:504] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.024891 28213 leader_election.cc:288] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:29.026036 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 72) took 3003 ms. Trace:
I20260810 11:30:29.026116 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "750950c424184d08bf6777774db3a0b2" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:29.026286 27248 rpcz_store.cc:276] 0810 11:30:26.017969 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.018202 (+ 233us) service_pool.cc:227] Handling call
0810 11:30:28.658604 (+2640402us) ts_tablet_manager.cc:1145] Deleting tablet 9311943eebaa4824bde96b4cb09f1e2c
0810 11:30:28.659501 (+ 897us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:28.797895 (+138394us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:28.958548 (+160653us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:29.021446 (+ 62898us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2640166}
I20260810 11:30:29.027166 26764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "750950c424184d08bf6777774db3a0b2" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:29.030752 26912 raft_consensus.cc:2454] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
W20260810 11:30:29.033743 28234 log.cc:924] Time spent T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700: Append to log took a long time: real 0.087s user 0.001s sys 0.000s
I20260810 11:30:29.027410 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 9311943eebaa4824bde96b4cb09f1e2c (table default.Table_547fe3fa37ab46aab94789c556ec37d7 [id=7413e4ae5b8b4ccd904917ec2adbf8f3]) successfully deleted
I20260810 11:30:29.035029 27228 ts_tablet_manager.cc:1428] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.067s user 0.005s sys 0.001s
I20260810 11:30:29.035679 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:29.035902 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 73) took 3008 ms. Trace:
I20260810 11:30:29.037010 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:29.037415 26993 leader_election.cc:302] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:29.038029 27228 tablet_bootstrap.cc:492] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:29.038107 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
I20260810 11:30:29.036412 27248 rpcz_store.cc:276] 0810 11:30:26.018625 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.018670 (+ 45us) service_pool.cc:227] Handling call
0810 11:30:29.026962 (+3008292us) ts_tablet_manager.cc:1145] Deleting tablet 8228600e3f6b4f9993dd25e4ceb57e4d
0810 11:30:29.026994 (+ 32us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:29.027241 (+ 247us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3008012}
I20260810 11:30:29.039374 26991 leader_election.cc:302] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
W20260810 11:30:29.039630 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 8228600e3f6b4f9993dd25e4ceb57e4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8228600e3f6b4f9993dd25e4ceb57e4d already in progress: creating tablet
I20260810 11:30:29.040521 27248 tablet_replica.cc:330] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:29.041101 27248 raft_consensus.cc:2229] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:29.041617 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:29.041109 27911 raft_consensus.cc:2781] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:29.042752 28206 raft_consensus.cc:2781] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260810 11:30:29.043154 26993 leader_election.cc:341] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:29.044035 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]). Expected version 1 got 0
I20260810 11:30:29.044847 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43e42cc642544f779bb79cee7479c4f4" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:29.045627 27248 raft_consensus.cc:2258] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:29.046864 27231 tablet_bootstrap.cc:492] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:29.047097 28206 raft_consensus.cc:482] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:29.047861 28206 raft_consensus.cc:3037] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:29.049525 27248 ts_tablet_manager.cc:1905] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:29.056052 27222 tablet_bootstrap.cc:492] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:29.058421 27057 raft_consensus.cc:3037] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:29.065448 27911 raft_consensus.cc:686] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:29.072742 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43e42cc642544f779bb79cee7479c4f4" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
W20260810 11:30:29.077235 26849 leader_election.cc:341] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:29.080943 27057 raft_consensus.cc:2454] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:29.081674 28206 raft_consensus.cc:504] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.087266 26848 leader_election.cc:302] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:29.088145 27911 consensus_queue.cc:237] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.088665 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "750950c424184d08bf6777774db3a0b2" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:29.089911 26911 raft_consensus.cc:3037] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:29.094340 27866 leader_election.cc:288] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:29.095564 27974 ts_tablet_manager.cc:1918] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:29.096149 27974 log.cc:1196] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/eb51618d37ac488fa7e3d23e5f85ec36
I20260810 11:30:29.097740 28206 leader_election.cc:288] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:29.055735 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:29.098050 27222 tablet_bootstrap.cc:654] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:29.099390 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:29.100291 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:29.101447 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:29.102149 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:29.103163 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:29.103662 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]). Expected version 2 got 0
I20260810 11:30:29.104264 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:29.106387 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "750950c424184d08bf6777774db3a0b2" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
W20260810 11:30:29.108795 26993 leader_election.cc:341] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:29.110723 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 1 got 0
I20260810 11:30:29.116359 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:29.117434 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]). Expected version 1 got 0
I20260810 11:30:29.118350 27231 tablet_bootstrap.cc:654] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:29.118846 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:29.123664 28228 raft_consensus.cc:2781] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:29.128818 27974 ts_tablet_manager.cc:1939] T eb51618d37ac488fa7e3d23e5f85ec36 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:29.131661 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 88) took 2856 ms. Trace:
I20260810 11:30:29.132145 27974 rpcz_store.cc:276] 0810 11:30:26.275144 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.277197 (+ 2053us) service_pool.cc:227] Handling call
0810 11:30:28.945260 (+2668063us) ts_tablet_manager.cc:1145] Deleting tablet eb51618d37ac488fa7e3d23e5f85ec36
0810 11:30:28.945291 (+ 31us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:29.030241 (+ 84950us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:29.095377 (+ 65136us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:29.131240 (+ 35863us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2667803}
I20260810 11:30:29.133500 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet eb51618d37ac488fa7e3d23e5f85ec36 (table default.Table_7466a225b5ae492ab3ac3cf5d74a360f [id=696bbe0dbb864163b77ab537e2700f7d]) successfully deleted
I20260810 11:30:29.133975 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 90) took 2858 ms. Trace:
I20260810 11:30:29.119560 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:29.134348 27974 rpcz_store.cc:276] 0810 11:30:26.275415 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.277585 (+ 2170us) service_pool.cc:227] Handling call
0810 11:30:29.133297 (+2855712us) ts_tablet_manager.cc:1145] Deleting tablet 70f6017d4d01463398cb347779dacf90
0810 11:30:29.133324 (+ 27us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:29.133575 (+ 251us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2855402}
W20260810 11:30:29.136051 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 70f6017d4d01463398cb347779dacf90 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70f6017d4d01463398cb347779dacf90 already in progress: creating tablet
I20260810 11:30:29.137116 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]). Expected version 2 got 0
I20260810 11:30:29.138057 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:29.137312 28228 raft_consensus.cc:686] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:29.141067 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:29.142155 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:29.144043 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 1 got 0
I20260810 11:30:29.144687 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 2 got 0
I20260810 11:30:29.144273 28228 consensus_queue.cc:237] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.146034 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:29.147223 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]). Expected version 1 got 0
I20260810 11:30:29.148211 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]). Expected version 1 got 0
I20260810 11:30:29.149051 28242 raft_consensus.cc:482] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 83cc8e39a3b9455f8242a6da6a54c38a)
I20260810 11:30:29.150281 28242 raft_consensus.cc:504] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:29.160048 28242 leader_election.cc:288] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
I20260810 11:30:29.175736 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:29.178894 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:29.186019 27222 tablet_bootstrap.cc:492] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:29.186745 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:29.187472 27222 ts_tablet_manager.cc:1397] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.159s user 0.008s sys 0.010s
I20260810 11:30:29.189132 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]). Expected version 1 got 0
I20260810 11:30:29.201519 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 91) took 2925 ms. Trace:
I20260810 11:30:29.201915 27974 rpcz_store.cc:276] 0810 11:30:26.275540 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.277802 (+ 2262us) service_pool.cc:227] Handling call
0810 11:30:29.191036 (+2913234us) ts_tablet_manager.cc:1145] Deleting tablet 8228600e3f6b4f9993dd25e4ceb57e4d
0810 11:30:29.191073 (+ 37us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:29.200962 (+ 9889us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2912925}
I20260810 11:30:29.203186 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 83) took 2929 ms. Trace:
I20260810 11:30:29.203555 27974 rpcz_store.cc:276] 0810 11:30:26.274016 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.279441 (+ 5425us) service_pool.cc:227] Handling call
0810 11:30:29.202782 (+2923341us) ts_tablet_manager.cc:1145] Deleting tablet 31888ddeafe14738b818016a9c0a4ad3
0810 11:30:29.202809 (+ 27us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:29.202974 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2923037}
I20260810 11:30:29.204953 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 89) took 2929 ms. Trace:
I20260810 11:30:29.205258 27974 rpcz_store.cc:276] 0810 11:30:26.275285 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.277468 (+ 2183us) service_pool.cc:227] Handling call
0810 11:30:29.204437 (+2926969us) ts_tablet_manager.cc:1145] Deleting tablet 3ae27bf110114b70a3e3f6cf64f31b98
0810 11:30:29.204466 (+ 29us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:29.204734 (+ 268us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2919574}
I20260810 11:30:29.205855 27222 raft_consensus.cc:348] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:29.203049 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 8228600e3f6b4f9993dd25e4ceb57e4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8228600e3f6b4f9993dd25e4ceb57e4d already in progress: creating tablet
I20260810 11:30:29.207633 27228 tablet_bootstrap.cc:654] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:29.207712 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 31888ddeafe14738b818016a9c0a4ad3 because the tablet was not found. No further retry: Not found: Tablet not found: 31888ddeafe14738b818016a9c0a4ad3
W20260810 11:30:29.208302 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 3ae27bf110114b70a3e3f6cf64f31b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae27bf110114b70a3e3f6cf64f31b98 already in progress: creating tablet
I20260810 11:30:29.209635 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:29.214301 27974 tablet_replica.cc:330] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:29.206420 27222 raft_consensus.cc:374] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:29.214972 27974 raft_consensus.cc:2229] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:29.218586 27974 raft_consensus.cc:2258] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:29.215678 27222 raft_consensus.cc:729] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:29.220083 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:29.220041 27222 consensus_queue.cc:260] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.229549 27333 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]). Expected version 2 got 0
W20260810 11:30:29.236670 27326 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet afbe6ce99f7c4f7cb939bea086cd90be consensus state has no leader
I20260810 11:30:29.237164 27326 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:49152 (request call id 109) took 2523 ms. Trace:
I20260810 11:30:29.238034 27326 rpcz_store.cc:276] 0810 11:30:26.713432 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.114794 (+401362us) service_pool.cc:227] Handling call
0810 11:30:27.158703 (+ 43909us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96de586 00007f55f09d1de6 00007f55f09d1b15 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:27.159105 (+ 402us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:27.159338 (+ 233us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:27.159494 (+ 156us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:27.159587 (+ 93us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:27.188648 (+ 29061us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:29.237023 (+2048375us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:27.163685 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:27.164013 (+ 328us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:27.164023 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:27.164028 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:27.164198 (+ 170us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:27.164217 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:27.164226 (+ 9us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:27.164320 (+ 94us) tablet.cc:699] Row locks acquired
0810 11:30:27.164325 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:27.164385 (+ 60us) write_op.cc:270] Start()
0810 11:30:27.164435 (+ 50us) write_op.cc:276] Timestamp: P: 1786361427164347 usec, L: 0
0810 11:30:27.164440 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:27.164737 (+ 297us) log.cc:842] Serialized 405 byte log entry
0810 11:30:27.187878 (+ 23141us) op_driver.cc:444] REPLICATION: finished
0810 11:30:27.188005 (+ 127us) write_op.cc:301] APPLY: starting
0810 11:30:27.188022 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:27.188067 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:27.188156 (+ 89us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:27.188210 (+ 54us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:27.188248 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:27.188254 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:27.188325 (+ 71us) log.cc:842] Serialized 23 byte log entry
0810 11:30:27.188378 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:27.188395 (+ 17us) write_op.cc:454] Released schema lock
0810 11:30:27.188401 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:27.188466 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:27.188469 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":100304768,"child_traces":[["op",{"apply.queue_time_us":71,"apply.run_cpu_time_us":518,"apply.run_wall_time_us":517,"mutex_wait_us":1905,"num_ops":1,"prepare.queue_time_us":3578,"prepare.run_cpu_time_us":1143,"prepare.run_wall_time_us":1141,"replication_time_us":23415}]]}
W20260810 11:30:29.242162 27326 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.195:58893 (request call id 80) took 1403 ms (client timeout 1000 ms). Trace:
W20260810 11:30:29.242800 27326 rpcz_store.cc:269] 0810 11:30:27.838424 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.241891 (+1403467us) service_pool.cc:214] Skipping call since client already timed out
0810 11:30:29.241973 (+ 82us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260810 11:30:29.246892 27999 ts_tablet_manager.cc:1918] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:29.247419 27999 log.cc:1196] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/7dc4000f1dde46a3b881a9fa8e9a6e3e
W20260810 11:30:29.250372 27288 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 00d52e5c77d94854b8ba0b38c63ad015 consensus state has no leader
W20260810 11:30:29.253291 27334 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 997cff3351724953bd9c792085a38364 consensus state has no leader
I20260810 11:30:29.254101 27334 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:49152 (request call id 107) took 2540 ms. Trace:
I20260810 11:30:29.254635 27322 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:49152 (request call id 106) took 2541 ms. Trace:
I20260810 11:30:29.254881 27334 rpcz_store.cc:276] 0810 11:30:26.713221 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.098839 (+385618us) service_pool.cc:227] Handling call
0810 11:30:27.100594 (+ 1755us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:27.100803 (+ 209us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:27.101035 (+ 232us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:27.101259 (+ 224us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:27.149102 (+ 47843us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:29.253590 (+2104488us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:27.104620 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:27.104712 (+ 92us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:27.104717 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:27.104719 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:27.104825 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:27.104839 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:27.104847 (+ 8us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:27.104938 (+ 91us) tablet.cc:699] Row locks acquired
0810 11:30:27.104940 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:27.104980 (+ 40us) write_op.cc:270] Start()
0810 11:30:27.105017 (+ 37us) write_op.cc:276] Timestamp: P: 1786361427104952 usec, L: 0
0810 11:30:27.105021 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:27.105182 (+ 161us) log.cc:842] Serialized 405 byte log entry
0810 11:30:27.147312 (+ 42130us) op_driver.cc:444] REPLICATION: finished
0810 11:30:27.148255 (+ 943us) write_op.cc:301] APPLY: starting
0810 11:30:27.148268 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:27.148298 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:27.148366 (+ 68us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:27.148413 (+ 47us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:27.148446 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:27.148452 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:27.148538 (+ 86us) log.cc:842] Serialized 23 byte log entry
0810 11:30:27.148632 (+ 94us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:27.148646 (+ 14us) write_op.cc:454] Released schema lock
0810 11:30:27.148652 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:27.148709 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:27.148714 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":878,"apply.run_cpu_time_us":532,"apply.run_wall_time_us":531,"num_ops":1,"prepare.queue_time_us":2849,"prepare.run_cpu_time_us":632,"prepare.run_wall_time_us":632,"replication_time_us":42258}]]}
I20260810 11:30:29.257468 27334 master_service.cc:946] ReplaceTablet: received request to replace tablet 55c8749861874eca9b63d3db97afa2b1 from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:29.255076 27322 rpcz_store.cc:276] 0810 11:30:26.713116 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.098015 (+384899us) service_pool.cc:227] Handling call
0810 11:30:27.103202 (+ 5187us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:27.103570 (+ 368us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:27.103873 (+ 303us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:27.103959 (+ 86us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:27.154083 (+ 50124us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:29.254015 (+2099932us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:27.105284 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:27.105467 (+ 183us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:27.105472 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:27.105487 (+ 15us) tablet.cc:660] Decoding operations
0810 11:30:27.105580 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:27.105589 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:27.105593 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:27.105652 (+ 59us) tablet.cc:699] Row locks acquired
0810 11:30:27.105654 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:27.105684 (+ 30us) write_op.cc:270] Start()
0810 11:30:27.105720 (+ 36us) write_op.cc:276] Timestamp: P: 1786361427105659 usec, L: 0
0810 11:30:27.105725 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:27.105954 (+ 229us) log.cc:842] Serialized 405 byte log entry
0810 11:30:27.152976 (+ 47022us) op_driver.cc:444] REPLICATION: finished
0810 11:30:27.153457 (+ 481us) write_op.cc:301] APPLY: starting
0810 11:30:27.153479 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:27.153527 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:27.153620 (+ 93us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:27.153688 (+ 68us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:27.153727 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:27.153734 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:27.153881 (+ 147us) log.cc:842] Serialized 23 byte log entry
0810 11:30:27.153953 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:27.153972 (+ 19us) write_op.cc:454] Released schema lock
0810 11:30:27.153979 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:27.154192 (+ 213us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:27.154197 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":50,"child_traces":[["op",{"apply.queue_time_us":215,"apply.run_cpu_time_us":704,"apply.run_wall_time_us":824,"num_ops":1,"prepare.queue_time_us":793,"prepare.run_cpu_time_us":722,"prepare.run_wall_time_us":721,"replication_time_us":47205}]]}
I20260810 11:30:29.260251 27974 ts_tablet_manager.cc:1905] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:29.263669 27222 ts_tablet_manager.cc:1428] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.074s user 0.007s sys 0.000s
I20260810 11:30:29.261323 27322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_6e9cd3888b17405bad2475ba3da34507"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:29.267379 27322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e9cd3888b17405bad2475ba3da34507 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:29.280323 26911 raft_consensus.cc:2454] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
W20260810 11:30:29.289199 27318 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a22cdf7d273d427cb32b811aa5caa3a3 consensus state has no leader
I20260810 11:30:29.289676 27318 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:49152 (request call id 108) took 2576 ms. Trace:
I20260810 11:30:29.290165 27318 rpcz_store.cc:276] 0810 11:30:26.713341 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.100193 (+386852us) service_pool.cc:227] Handling call
0810 11:30:27.158263 (+ 58070us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96de586 00007f55f09d1de6 00007f55f09d1b15 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:27.159066 (+ 803us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:27.159547 (+ 481us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:27.160203 (+ 656us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:27.160320 (+ 117us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:27.186236 (+ 25916us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:29.289573 (+2103337us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:27.161967 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:27.162187 (+ 220us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:27.162195 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:27.162198 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:27.162351 (+ 153us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:27.162369 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:27.162376 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:27.162488 (+ 112us) tablet.cc:699] Row locks acquired
0810 11:30:27.162490 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:27.162540 (+ 50us) write_op.cc:270] Start()
0810 11:30:27.162641 (+ 101us) write_op.cc:276] Timestamp: P: 1786361427162506 usec, L: 0
0810 11:30:27.162647 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:27.163038 (+ 391us) log.cc:842] Serialized 405 byte log entry
0810 11:30:27.173605 (+ 10567us) op_driver.cc:444] REPLICATION: finished
0810 11:30:27.175516 (+ 1911us) write_op.cc:301] APPLY: starting
0810 11:30:27.175527 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:27.175555 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:27.175575 (+ 20us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:27.175610 (+ 35us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:27.175633 (+ 23us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:27.175639 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:27.175708 (+ 69us) log.cc:842] Serialized 23 byte log entry
0810 11:30:27.175810 (+ 102us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:27.175824 (+ 14us) write_op.cc:454] Released schema lock
0810 11:30:27.175829 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:27.175878 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:27.175882 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":100592512,"child_traces":[["op",{"apply.queue_time_us":1880,"apply.run_cpu_time_us":409,"apply.run_wall_time_us":410,"num_ops":1,"prepare.queue_time_us":368,"prepare.run_cpu_time_us":1244,"prepare.run_wall_time_us":1619,"raft.queue_time_us":1526,"raft.run_cpu_time_us":2,"raft.run_wall_time_us":3,"replication_time_us":10936}]]}
W20260810 11:30:29.296321 26993 consensus_peers.cc:487] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb51618d37ac488fa7e3d23e5f85ec36. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:29.296974 27322 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 117) took 2138 ms. Trace:
I20260810 11:30:29.297808 26991 leader_election.cc:302] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:29.297498 27322 rpcz_store.cc:276] 0810 11:30:27.158503 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.259669 (+2101166us) service_pool.cc:227] Handling call
0810 11:30:29.268149 (+ 8480us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:29.269186 (+ 1037us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:29.295642 (+ 26456us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:29.295913 (+ 271us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:29.296701 (+ 788us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:29.277826 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:29.278093 (+ 267us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:29.278107 (+ 14us) write_op.cc:435] Acquired schema lock
0810 11:30:29.278123 (+ 16us) tablet.cc:660] Decoding operations
0810 11:30:29.278454 (+ 331us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:29.278489 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:29.278517 (+ 28us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:29.278789 (+ 272us) tablet.cc:699] Row locks acquired
0810 11:30:29.278794 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:29.278870 (+ 76us) write_op.cc:270] Start()
0810 11:30:29.278976 (+ 106us) write_op.cc:276] Timestamp: P: 1786361429278812 usec, L: 0
0810 11:30:29.278983 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:29.279545 (+ 562us) log.cc:842] Serialized 433 byte log entry
0810 11:30:29.288370 (+ 8825us) op_driver.cc:444] REPLICATION: finished
0810 11:30:29.288840 (+ 470us) write_op.cc:301] APPLY: starting
0810 11:30:29.288872 (+ 32us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:29.288974 (+ 102us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:29.289033 (+ 59us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:29.289295 (+ 262us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:29.289381 (+ 86us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:29.289393 (+ 12us) write_op.cc:312] APPLY: finished
0810 11:30:29.289595 (+ 202us) log.cc:842] Serialized 29 byte log entry
0810 11:30:29.289766 (+ 171us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.289808 (+ 42us) write_op.cc:454] Released schema lock
0810 11:30:29.289833 (+ 25us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:29.289976 (+ 143us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.289985 (+ 9us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":326,"apply.run_cpu_time_us":1244,"apply.run_wall_time_us":1244,"num_ops":2,"prepare.queue_time_us":7076,"prepare.run_cpu_time_us":2015,"prepare.run_wall_time_us":2015,"replication_time_us":9317}]]}
I20260810 11:30:29.299108 27911 raft_consensus.cc:2781] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:29.303051 27911 raft_consensus.cc:686] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:29.306433 27911 consensus_queue.cc:237] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.307474 27222 tablet_bootstrap.cc:492] T 750950c424184d08bf6777774db3a0b2 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:29.309696 27322 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_44e5f0610f934d889eaf76d00116f0e2" } modify_external_catalogs: true
I20260810 11:30:29.311172 27231 tablet_bootstrap.cc:492] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:29.312674 27322 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_44e5f0610f934d889eaf76d00116f0e2" } modify_external_catalogs: true
I20260810 11:30:29.313158 27321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet 55c8749861874eca9b63d3db97afa2b1
I20260810 11:30:29.313441 27999 ts_tablet_manager.cc:1939] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:29.314508 27321 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49152 (request call id 112) took 2600 ms. Trace:
I20260810 11:30:29.315785 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 11) took 4869 ms. Trace:
I20260810 11:30:29.316187 27999 rpcz_store.cc:276] 0810 11:30:24.446005 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.449145 (+ 3140us) service_pool.cc:227] Handling call
0810 11:30:28.927196 (+4478051us) ts_tablet_manager.cc:1145] Deleting tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e
0810 11:30:28.927230 (+ 34us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:29.093353 (+166123us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:29.246457 (+153104us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:29.315702 (+ 69245us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4464446}
I20260810 11:30:29.319314 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 55c8749861874eca9b63d3db97afa2b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:29.315070 27321 rpcz_store.cc:276] 0810 11:30:26.713800 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.132352 (+418552us) service_pool.cc:227] Handling call
0810 11:30:27.192494 (+ 60142us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dd2e6 00007f55f09d0126 00007f55f09cfe55 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:27.193340 (+ 846us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:27.193516 (+ 176us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:27.193590 (+ 74us) catalog_manager.cc:2761] Locking tablets
0810 11:30:27.193754 (+ 164us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:27.211418 (+ 17664us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:27.289598 (+ 78180us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:29.312860 (+2023262us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:29.314293 (+ 1433us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:27.194842 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:27.195920 (+ 1078us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:27.195927 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:27.195930 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:27.196072 (+ 142us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:27.196087 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:27.196093 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:27.196202 (+ 109us) tablet.cc:699] Row locks acquired
0810 11:30:27.196205 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:27.196251 (+ 46us) write_op.cc:270] Start()
0810 11:30:27.196294 (+ 43us) write_op.cc:276] Timestamp: P: 1786361427196212 usec, L: 0
0810 11:30:27.196299 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:27.196710 (+ 411us) log.cc:842] Serialized 734 byte log entry
0810 11:30:27.203257 (+ 6547us) op_driver.cc:444] REPLICATION: finished
0810 11:30:27.204799 (+ 1542us) write_op.cc:301] APPLY: starting
0810 11:30:27.204829 (+ 30us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:27.204881 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:27.205045 (+ 164us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:27.205149 (+ 104us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:27.205197 (+ 48us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:27.205204 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:27.205315 (+ 111us) log.cc:842] Serialized 29 byte log entry
0810 11:30:27.205394 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:27.205425 (+ 31us) write_op.cc:454] Released schema lock
0810 11:30:27.205433 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:27.205505 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:27.205511 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":137494912,"child_traces":[["op",{"apply.queue_time_us":1223,"apply.run_cpu_time_us":794,"apply.run_wall_time_us":795,"num_ops":2,"prepare.queue_time_us":166,"prepare.run_cpu_time_us":1017,"prepare.run_wall_time_us":1974,"raft.queue_time_us":77,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":264,"replication_time_us":6929,"spinlock_wait_cycles":135552}]]}
I20260810 11:30:29.326201 27231 ts_tablet_manager.cc:1397] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.287s user 0.010s sys 0.009s
I20260810 11:30:29.328341 27231 raft_consensus.cc:348] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.329010 27321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_9633fc0dda2b422baa0de7b537dc5479" } modify_external_catalogs: true
I20260810 11:30:29.329927 27321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_9633fc0dda2b422baa0de7b537dc5479" } modify_external_catalogs: true
W20260810 11:30:29.345484 27362 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52a9367b7a8345739b5b9acf9ea1e6d8 consensus state has no leader
I20260810 11:30:29.346446 27362 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:49152 (request call id 111) took 2632 ms. Trace:
I20260810 11:30:29.347005 27362 rpcz_store.cc:276] 0810 11:30:26.713682 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.128101 (+414419us) service_pool.cc:227] Handling call
0810 11:30:27.157329 (+ 29228us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96de586 00007f55f09d1de6 00007f55f09d1b15 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:27.157750 (+ 421us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:27.158735 (+ 985us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:27.159162 (+ 427us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:27.159320 (+ 158us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:27.195624 (+ 36304us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:29.346071 (+2150447us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:27.160220 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:27.160339 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:27.160345 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:27.160348 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:27.160483 (+ 135us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:27.160497 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:27.160502 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:27.160657 (+ 155us) tablet.cc:699] Row locks acquired
0810 11:30:27.160660 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:27.160704 (+ 44us) write_op.cc:270] Start()
0810 11:30:27.160769 (+ 65us) write_op.cc:276] Timestamp: P: 1786361427160670 usec, L: 0
0810 11:30:27.160773 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:27.161001 (+ 228us) log.cc:842] Serialized 405 byte log entry
0810 11:30:27.173545 (+ 12544us) op_driver.cc:444] REPLICATION: finished
0810 11:30:27.174815 (+ 1270us) write_op.cc:301] APPLY: starting
0810 11:30:27.174834 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:27.174877 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:27.174984 (+ 107us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:27.175127 (+ 143us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:27.175173 (+ 46us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:27.175185 (+ 12us) write_op.cc:312] APPLY: finished
0810 11:30:27.175313 (+ 128us) log.cc:842] Serialized 23 byte log entry
0810 11:30:27.175362 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:27.175377 (+ 15us) write_op.cc:454] Released schema lock
0810 11:30:27.175383 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:27.175437 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:27.175441 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":66378496,"child_traces":[["op",{"apply.queue_time_us":1220,"apply.run_cpu_time_us":678,"apply.run_wall_time_us":678,"num_ops":1,"prepare.queue_time_us":199,"prepare.run_cpu_time_us":896,"prepare.run_wall_time_us":934,"raft.queue_time_us":3526,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":6,"replication_time_us":12754}]]}
I20260810 11:30:29.354859 27362 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_e58ae45f9ea949a2a0d7bf7f0e862647" } modify_external_catalogs: true
I20260810 11:30:29.355552 27362 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_e58ae45f9ea949a2a0d7bf7f0e862647" } modify_external_catalogs: true
I20260810 11:30:29.343884 28213 raft_consensus.cc:482] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 443ec871f1ed4232b932ecfb0b18510d)
I20260810 11:30:29.363591 28213 raft_consensus.cc:504] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.365268 28213 leader_election.cc:288] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:29.365991 27321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet 7c203cd90d2f472fa27cfabed5b87119
I20260810 11:30:29.366089 27231 raft_consensus.cc:374] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:29.367215 27231 raft_consensus.cc:729] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
W20260810 11:30:29.367800 26991 leader_election.cc:341] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 23d8ce485cb84495a6e964b6d5977f0d
I20260810 11:30:29.344614 27248 ts_tablet_manager.cc:1918] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:29.368983 27248 log.cc:1196] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/70f6017d4d01463398cb347779dacf90
I20260810 11:30:29.370990 27321 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49152 (request call id 119) took 2201 ms. Trace:
I20260810 11:30:29.371109 27231 consensus_queue.cc:260] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.373626 27321 rpcz_store.cc:276] 0810 11:30:27.169558 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.328118 (+2158560us) service_pool.cc:227] Handling call
0810 11:30:29.330662 (+ 2544us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:29.331315 (+ 653us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:29.331453 (+ 138us) catalog_manager.cc:2761] Locking tablets
0810 11:30:29.331713 (+ 260us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:29.365556 (+ 33843us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:29.365718 (+ 162us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:29.365775 (+ 57us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:29.370769 (+ 4994us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:29.336717 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:29.337027 (+ 310us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:29.337035 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:29.337039 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:29.337462 (+ 423us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:29.337520 (+ 58us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:29.337527 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:29.337928 (+ 401us) tablet.cc:699] Row locks acquired
0810 11:30:29.337932 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:29.338022 (+ 90us) write_op.cc:270] Start()
0810 11:30:29.338211 (+ 189us) write_op.cc:276] Timestamp: P: 1786361429337947 usec, L: 0
0810 11:30:29.338223 (+ 12us) op_driver.cc:331] REPLICATION: starting
0810 11:30:29.338713 (+ 490us) log.cc:842] Serialized 734 byte log entry
0810 11:30:29.357268 (+ 18555us) op_driver.cc:444] REPLICATION: finished
0810 11:30:29.357523 (+ 255us) write_op.cc:301] APPLY: starting
0810 11:30:29.357556 (+ 33us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:29.357626 (+ 70us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:29.357722 (+ 96us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:29.357863 (+ 141us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:29.358036 (+ 173us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:29.358046 (+ 10us) write_op.cc:312] APPLY: finished
0810 11:30:29.358241 (+ 195us) log.cc:842] Serialized 29 byte log entry
0810 11:30:29.358379 (+ 138us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.358427 (+ 48us) write_op.cc:454] Released schema lock
0810 11:30:29.358443 (+ 16us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:29.358574 (+ 131us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.358578 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":155,"apply.run_cpu_time_us":1182,"apply.run_wall_time_us":1182,"num_ops":2,"prepare.queue_time_us":3255,"prepare.run_cpu_time_us":2181,"prepare.run_wall_time_us":2181,"raft.queue_time_us":1316,"raft.run_cpu_time_us":959,"raft.run_wall_time_us":959,"replication_time_us":18990}]]}
I20260810 11:30:29.376150 27321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_dd41dff7d9584a46821b6a187e5c52a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:29.377192 27321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd41dff7d9584a46821b6a187e5c52a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:29.379871 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c203cd90d2f472fa27cfabed5b87119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:29.380429 27248 ts_tablet_manager.cc:1939] T 70f6017d4d01463398cb347779dacf90 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:29.345974 28257 raft_consensus.cc:482] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:29.382292 27231 ts_tablet_manager.cc:1428] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.047s user 0.005s sys 0.000s
I20260810 11:30:29.384943 28257 raft_consensus.cc:504] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.389382 28257 leader_election.cc:288] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:29.400187 27231 tablet_bootstrap.cc:492] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:29.400750 27336 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet 518c777e40ec40dcb3484c0374384959
I20260810 11:30:29.402335 27336 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49152 (request call id 110) took 2688 ms. Trace:
I20260810 11:30:29.402616 27336 rpcz_store.cc:276] 0810 11:30:26.713589 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.124373 (+410784us) service_pool.cc:227] Handling call
0810 11:30:27.157041 (+ 32668us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dd2e6 00007f55f09d0126 00007f55f09cfe55 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:27.157779 (+ 738us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:27.157954 (+ 175us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:27.158033 (+ 79us) catalog_manager.cc:2761] Locking tablets
0810 11:30:27.185039 (+ 27006us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:27.199524 (+ 14485us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:27.296636 (+ 97112us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:29.400356 (+2103720us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:29.401821 (+ 1465us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:27.187555 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:27.187669 (+ 114us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:27.187675 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:27.187677 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:27.187802 (+ 125us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:27.187815 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:27.187821 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:27.187973 (+ 152us) tablet.cc:699] Row locks acquired
0810 11:30:27.187976 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:27.188010 (+ 34us) write_op.cc:270] Start()
0810 11:30:27.188056 (+ 46us) write_op.cc:276] Timestamp: P: 1786361427187978 usec, L: 0
0810 11:30:27.188060 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:27.188290 (+ 230us) log.cc:842] Serialized 734 byte log entry
0810 11:30:27.197965 (+ 9675us) op_driver.cc:444] REPLICATION: finished
0810 11:30:27.199084 (+ 1119us) write_op.cc:301] APPLY: starting
0810 11:30:27.199094 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:27.199128 (+ 34us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:27.199167 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:27.199235 (+ 68us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:27.199274 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:27.199286 (+ 12us) write_op.cc:312] APPLY: finished
0810 11:30:27.199345 (+ 59us) log.cc:842] Serialized 29 byte log entry
0810 11:30:27.199384 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:27.199403 (+ 19us) write_op.cc:454] Released schema lock
0810 11:30:27.199411 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:27.199477 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:27.199480 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":74341632,"child_traces":[["op",{"apply.queue_time_us":1086,"apply.run_cpu_time_us":440,"apply.run_wall_time_us":439,"num_ops":2,"prepare.queue_time_us":1393,"prepare.run_cpu_time_us":807,"prepare.run_wall_time_us":806,"replication_time_us":9888}]]}
I20260810 11:30:29.402781 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 74) took 3383 ms. Trace:
I20260810 11:30:29.404623 27248 rpcz_store.cc:276] 0810 11:30:26.019100 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.019146 (+ 46us) service_pool.cc:227] Handling call
0810 11:30:29.040123 (+3020977us) ts_tablet_manager.cc:1145] Deleting tablet 70f6017d4d01463398cb347779dacf90
0810 11:30:29.040155 (+ 32us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:29.166409 (+126254us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:29.344277 (+177868us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:29.402610 (+ 58333us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3020698}
I20260810 11:30:29.407603 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 70f6017d4d01463398cb347779dacf90 (table default.Table_24bdc44050024c23aa90a182bdcecb50 [id=4ea7ee58aac74fba84dbbcc009017421]) successfully deleted
I20260810 11:30:29.408187 27336 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_f8b086b05e6b4174a3494b211543a5c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:29.409049 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 75) took 3389 ms. Trace:
I20260810 11:30:29.409315 27248 rpcz_store.cc:276] 0810 11:30:26.019549 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.019747 (+ 198us) service_pool.cc:227] Handling call
0810 11:30:29.408764 (+3389017us) ts_tablet_manager.cc:1145] Deleting tablet ec788db5b0ca40f1811b6660276d0254
0810 11:30:29.408779 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:29.408923 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3388755}
I20260810 11:30:29.409852 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 76) took 3390 ms. Trace:
W20260810 11:30:29.410365 27336 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8b086b05e6b4174a3494b211543a5c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:29.410272 27248 rpcz_store.cc:276] 0810 11:30:26.019695 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.020004 (+ 309us) service_pool.cc:227] Handling call
0810 11:30:29.409614 (+3389610us) ts_tablet_manager.cc:1145] Deleting tablet 3ae27bf110114b70a3e3f6cf64f31b98
0810 11:30:29.409624 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:29.409767 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3389370}
I20260810 11:30:29.410856 27248 tablet_replica.cc:330] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:29.411401 27248 raft_consensus.cc:2229] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:29.412227 27248 raft_consensus.cc:2258] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:29.419178 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 518c777e40ec40dcb3484c0374384959 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:33500
W20260810 11:30:29.419930 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet ec788db5b0ca40f1811b6660276d0254 because the tablet was not found. No further retry: Not found: Tablet not found: ec788db5b0ca40f1811b6660276d0254
W20260810 11:30:29.420655 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 3ae27bf110114b70a3e3f6cf64f31b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae27bf110114b70a3e3f6cf64f31b98 already in progress: creating tablet
I20260810 11:30:29.430707 27248 ts_tablet_manager.cc:1905] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:29.430721 27321 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 121) took 2169 ms. Trace:
I20260810 11:30:29.431952 27379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c40c76e125b44de181b88b7f63a566f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 537 } } ignore_live_leader: false dest_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" is_pre_election: true
I20260810 11:30:29.431134 27321 rpcz_store.cc:276] 0810 11:30:27.261047 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.375414 (+2114367us) service_pool.cc:227] Handling call
0810 11:30:29.377512 (+ 2098us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:29.394717 (+ 17205us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:29.429959 (+ 35242us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:29.430182 (+ 223us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:29.430344 (+ 162us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:29.396448 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:29.396678 (+ 230us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:29.396697 (+ 19us) write_op.cc:435] Acquired schema lock
0810 11:30:29.396701 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:29.396889 (+ 188us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:29.396918 (+ 29us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:29.396924 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:29.397094 (+ 170us) tablet.cc:699] Row locks acquired
0810 11:30:29.397098 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:29.397168 (+ 70us) write_op.cc:270] Start()
0810 11:30:29.397232 (+ 64us) write_op.cc:276] Timestamp: P: 1786361429397091 usec, L: 0
0810 11:30:29.397237 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:29.397585 (+ 348us) log.cc:842] Serialized 433 byte log entry
0810 11:30:29.426263 (+ 28678us) op_driver.cc:444] REPLICATION: finished
0810 11:30:29.426549 (+ 286us) write_op.cc:301] APPLY: starting
0810 11:30:29.426578 (+ 29us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:29.426691 (+ 113us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:29.426817 (+ 126us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:29.427079 (+ 262us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:29.427162 (+ 83us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:29.427194 (+ 32us) write_op.cc:312] APPLY: finished
0810 11:30:29.427439 (+ 245us) log.cc:842] Serialized 29 byte log entry
0810 11:30:29.427601 (+ 162us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.427679 (+ 78us) write_op.cc:454] Released schema lock
0810 11:30:29.427692 (+ 13us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:29.427847 (+ 155us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.427855 (+ 8us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":177,"apply.run_cpu_time_us":1429,"apply.run_wall_time_us":1429,"num_ops":2,"prepare.queue_time_us":736,"prepare.run_cpu_time_us":1336,"prepare.run_wall_time_us":1337,"raft.queue_time_us":7690,"raft.run_cpu_time_us":492,"raft.run_wall_time_us":492,"replication_time_us":28967}]]}
I20260810 11:30:29.431821 27231 tablet_bootstrap.cc:654] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:29.440145 27321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_2c7697ec19204b3d823f5684c30978e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:29.441203 27321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c7697ec19204b3d823f5684c30978e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:29.455525 26591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c40c76e125b44de181b88b7f63a566f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 537 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361" is_pre_election: true
I20260810 11:30:29.459462 27997 leader_election.cc:302] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c40c76e125b44de181b88b7f63a566f7; no voters: 83cc8e39a3b9455f8242a6da6a54c38a, ac259bcf213a4aa297d1d8e73b262361
I20260810 11:30:29.462707 28242 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260810 11:30:29.475826 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 55c8749861874eca9b63d3db97afa2b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:32816
W20260810 11:30:29.498010 26993 leader_election.cc:341] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 23d8ce485cb84495a6e964b6d5977f0d
I20260810 11:30:29.498490 26993 leader_election.cc:302] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:29.500105 27911 raft_consensus.cc:2726] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 11:30:29.504431 26993 consensus_peers.cc:487] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b15cc8669b549a2b4461dccd66a0c5a. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:29.530596 27248 ts_tablet_manager.cc:1918] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:29.531677 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet 518c777e40ec40dcb3484c0374384959 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:32816
W20260810 11:30:29.532436 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 56286.1us
I20260810 11:30:29.535310 27222 tablet_bootstrap.cc:654] T 750950c424184d08bf6777774db3a0b2 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:29.536233 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c203cd90d2f472fa27cfabed5b87119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:29.540441 27334 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:49152 (request call id 116) took 2397 ms. Trace:
I20260810 11:30:29.541757 27334 rpcz_store.cc:276] 0810 11:30:27.142958 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.256513 (+2113555us) service_pool.cc:227] Handling call
0810 11:30:29.540287 (+283774us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260810 11:30:29.542260 26848 leader_election.cc:341] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 0938a2f3688246a2b46978eeb7d5d521
I20260810 11:30:29.543197 27334 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_9c70c3590985497fbaae37e05c4db1e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:29.546655 27334 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c70c3590985497fbaae37e05c4db1e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:29.546655 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 143558us
I20260810 11:30:29.552861 27248 log.cc:1196] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/eb51618d37ac488fa7e3d23e5f85ec36
I20260810 11:30:29.553299 27999 tablet_replica.cc:330] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:29.559875 27999 raft_consensus.cc:2229] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:29.560752 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 55c8749861874eca9b63d3db97afa2b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:29.561926 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c203cd90d2f472fa27cfabed5b87119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:29.575475 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e (table default.Table_9b714db8cc714c0999f926e8182ca6e4 [id=b1d90eb4a63941fd83313166eed533dc]) successfully deleted
I20260810 11:30:29.586967 27999 raft_consensus.cc:2258] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:29.604683 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 518c777e40ec40dcb3484c0374384959 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:29.605113 27999 ts_tablet_manager.cc:1905] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:29.619906 27228 tablet_bootstrap.cc:492] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:29.620411 27228 ts_tablet_manager.cc:1397] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.585s user 0.065s sys 0.086s
I20260810 11:30:29.629815 27248 ts_tablet_manager.cc:1939] T eb51618d37ac488fa7e3d23e5f85ec36 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:29.630162 27228 raft_consensus.cc:348] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.631594 27228 raft_consensus.cc:374] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:29.632753 27228 raft_consensus.cc:729] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:29.633509 27228 consensus_queue.cc:260] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.635676 27228 ts_tablet_manager.cc:1428] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.015s user 0.001s sys 0.002s
I20260810 11:30:29.637463 27228 tablet_bootstrap.cc:492] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:29.640842 27999 ts_tablet_manager.cc:1918] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:29.641390 27999 log.cc:1196] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/5adcec593b8c4d40997c8911e9f77c85
I20260810 11:30:29.642937 27999 ts_tablet_manager.cc:1939] T 5adcec593b8c4d40997c8911e9f77c85 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:29.643375 28018 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "482e605580be48cbbacce05a3e61c215" instance_seqno: 1786361409040091) as {username='slave'} at 127.25.195.195:46391; Asking this server to re-register.
I20260810 11:30:29.650385 28165 raft_consensus.cc:482] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:29.649224 27112 heartbeater.cc:464] Registering TS with master...
I20260810 11:30:29.657337 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 77) took 3636 ms. Trace:
I20260810 11:30:29.657582 27248 rpcz_store.cc:276] 0810 11:30:26.020383 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.020427 (+ 44us) service_pool.cc:227] Handling call
0810 11:30:29.410753 (+3390326us) ts_tablet_manager.cc:1145] Deleting tablet eb51618d37ac488fa7e3d23e5f85ec36
0810 11:30:29.410763 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:29.463392 (+ 52629us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:29.530270 (+ 66878us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:29.657141 (+126871us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3390067}
I20260810 11:30:29.660548 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet eb51618d37ac488fa7e3d23e5f85ec36 (table default.Table_7466a225b5ae492ab3ac3cf5d74a360f [id=696bbe0dbb864163b77ab537e2700f7d]) successfully deleted
I20260810 11:30:29.660758 27231 tablet_bootstrap.cc:492] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:29.661082 27231 ts_tablet_manager.cc:1397] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.277s user 0.037s sys 0.048s
I20260810 11:30:29.667095 27231 raft_consensus.cc:348] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:29.667835 28017 ts_manager.cc:194] Registered new tserver with Master: 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:29.668383 27231 raft_consensus.cc:374] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:29.668787 27231 raft_consensus.cc:729] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:29.672111 28165 raft_consensus.cc:504] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.673481 27319 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: default.Table_99cbe48a0bd54425b588a46ae1132cad [id=0faf073b01654e38b8f6083f5012abd7] alter complete (version 3)
I20260810 11:30:29.673679 28165 leader_election.cc:288] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:29.674386 27231 consensus_queue.cc:260] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:29.676108 27231 ts_tablet_manager.cc:1428] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.015s user 0.003s sys 0.001s
I20260810 11:30:29.676914 27231 tablet_bootstrap.cc:492] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:29.681341 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 10) took 5222 ms. Trace:
I20260810 11:30:29.681943 27999 rpcz_store.cc:276] 0810 11:30:24.442085 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.442140 (+ 55us) service_pool.cc:227] Handling call
0810 11:30:29.386010 (+4943870us) ts_tablet_manager.cc:1145] Deleting tablet 5adcec593b8c4d40997c8911e9f77c85
0810 11:30:29.386040 (+ 30us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:29.621301 (+235261us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:29.628876 (+ 7575us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:29.664023 (+ 35147us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4922770}
W20260810 11:30:29.693640 26991 consensus_peers.cc:487] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:29.695904 27231 tablet_bootstrap.cc:654] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:29.701058 27248 tablet_replica.cc:330] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:29.703991 28257 consensus_queue.cc:1035] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 11:30:29.711618 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 5adcec593b8c4d40997c8911e9f77c85 (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]) successfully deleted
I20260810 11:30:29.732919 28213 raft_consensus.cc:482] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:29.733788 28213 raft_consensus.cc:504] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.735170 28213 leader_election.cc:288] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:29.734510 28016 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "b6079090b1124d84aa4477974bb53700" instance_seqno: 1786361408276910) as {username='slave'} at 127.25.195.194:32809; Asking this server to re-register.
I20260810 11:30:29.744653 27231 tablet_bootstrap.cc:492] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:29.745425 27231 ts_tablet_manager.cc:1397] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.068s user 0.010s sys 0.004s
I20260810 11:30:29.744841 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 15) took 5241 ms. Trace:
I20260810 11:30:29.747669 27231 raft_consensus.cc:348] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.754026 26965 heartbeater.cc:464] Registering TS with master...
I20260810 11:30:29.753048 27231 raft_consensus.cc:374] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:29.755004 27231 raft_consensus.cc:729] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
W20260810 11:30:29.767627 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 93793us
I20260810 11:30:29.720378 27248 raft_consensus.cc:2229] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:29.772729 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b555f18c1e485d9af7b08f98543c80" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:29.773923 27248 raft_consensus.cc:2258] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:29.775120 27248 ts_tablet_manager.cc:1905] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:29.778103 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0033d61d07d84262a98b0ebc54bd7960" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:29.778940 26914 raft_consensus.cc:2454] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:29.776018 27999 rpcz_store.cc:276] 0810 11:30:24.446579 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.448997 (+ 2418us) service_pool.cc:227] Handling call
0810 11:30:29.684331 (+5235334us) ts_tablet_manager.cc:1145] Deleting tablet 318d5b8453fe4c438d0fa32cb91c409e
0810 11:30:29.685403 (+ 1072us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:29.687604 (+ 2201us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5220845}
I20260810 11:30:29.781484 26991 leader_election.cc:302] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:29.782547 28213 raft_consensus.cc:2781] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:29.782817 28213 raft_consensus.cc:482] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:29.783164 28213 raft_consensus.cc:3037] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:29.780435 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b555f18c1e485d9af7b08f98543c80" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:29.785324 26911 raft_consensus.cc:2454] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:29.017206 28034 rpcz_store.cc:276] 0810 11:30:26.107161 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.108110 (+ 949us) service_pool.cc:227] Handling call
0810 11:30:28.501192 (+2393082us) raft_consensus.cc:1457] Updating replica for 46 ops
0810 11:30:28.638347 (+137155us) raft_consensus.cc:1520] Early marking committed up to index 491
0810 11:30:28.841504 (+203157us) raft_consensus.cc:1525] Triggering prepare for 46 ops
0810 11:30:28.842680 (+ 1176us) write_op.cc:270] Start()
0810 11:30:28.842792 (+ 112us) write_op.cc:276] Timestamp: P: 1786361423751415 usec, L: 0
0810 11:30:28.843556 (+ 764us) write_op.cc:270] Start()
0810 11:30:28.843659 (+ 103us) write_op.cc:276] Timestamp: P: 1786361423777244 usec, L: 0
0810 11:30:28.863691 (+ 20032us) write_op.cc:270] Start()
0810 11:30:28.863761 (+ 70us) write_op.cc:276] Timestamp: P: 1786361423790043 usec, L: 0
0810 11:30:28.865313 (+ 1552us) write_op.cc:270] Start()
0810 11:30:28.865385 (+ 72us) write_op.cc:276] Timestamp: P: 1786361423799470 usec, L: 0
0810 11:30:28.865735 (+ 350us) write_op.cc:270] Start()
0810 11:30:28.865770 (+ 35us) write_op.cc:276] Timestamp: P: 1786361423802519 usec, L: 0
0810 11:30:28.866085 (+ 315us) write_op.cc:270] Start()
0810 11:30:28.866110 (+ 25us) write_op.cc:276] Timestamp: P: 1786361423818964 usec, L: 0
0810 11:30:28.866263 (+ 153us) write_op.cc:270] Start()
0810 11:30:28.866408 (+ 145us) write_op.cc:276] Timestamp: P: 1786361423823134 usec, L: 0
0810 11:30:28.866717 (+ 309us) write_op.cc:270] Start()
0810 11:30:28.866742 (+ 25us) write_op.cc:276] Timestamp: P: 1786361424002257 usec, L: 0
0810 11:30:28.866955 (+ 213us) write_op.cc:270] Start()
0810 11:30:28.866985 (+ 30us) write_op.cc:276] Timestamp: P: 1786361424032870 usec, L: 0
0810 11:30:28.867150 (+ 165us) write_op.cc:270] Start()
0810 11:30:28.867172 (+ 22us) write_op.cc:276] Timestamp: P: 1786361424033768 usec, L: 0
0810 11:30:28.867466 (+ 294us) write_op.cc:270] Start()
0810 11:30:28.867490 (+ 24us) write_op.cc:276] Timestamp: P: 1786361424158084 usec, L: 0
0810 11:30:28.867718 (+ 228us) write_op.cc:270] Start()
0810 11:30:28.867743 (+ 25us) write_op.cc:276] Timestamp: P: 1786361424169952 usec, L: 0
0810 11:30:28.868144 (+ 401us) write_op.cc:270] Start()
0810 11:30:28.868174 (+ 30us) write_op.cc:276] Timestamp: P: 1786361424197617 usec, L: 0
0810 11:30:28.868465 (+ 291us) write_op.cc:270] Start()
0810 11:30:28.868507 (+ 42us) write_op.cc:276] Timestamp: P: 1786361424232917 usec, L: 0
0810 11:30:28.877420 (+ 8913us) write_op.cc:270] Start()
0810 11:30:28.877556 (+ 136us) write_op.cc:276] Timestamp: P: 1786361424247261 usec, L: 0
0810 11:30:28.878795 (+ 1239us) write_op.cc:270] Start()
0810 11:30:28.878884 (+ 89us) write_op.cc:276] Timestamp: P: 1786361424274286 usec, L: 0
0810 11:30:28.879482 (+ 598us) write_op.cc:270] Start()
0810 11:30:28.879551 (+ 69us) write_op.cc:276] Timestamp: P: 1786361424315699 usec, L: 0
0810 11:30:28.879879 (+ 328us) write_op.cc:270] Start()
0810 11:30:28.879937 (+ 58us) write_op.cc:276] Timestamp: P: 1786361424349219 usec, L: 0
0810 11:30:28.880290 (+ 353us) write_op.cc:270] Start()
0810 11:30:28.880317 (+ 27us) write_op.cc:276] Timestamp: P: 1786361424372659 usec, L: 0
0810 11:30:28.880660 (+ 343us) write_op.cc:270] Start()
0810 11:30:28.880700 (+ 40us) write_op.cc:276] Timestamp: P: 1786361424431820 usec, L: 0
0810 11:30:28.880944 (+ 244us) write_op.cc:270] Start()
0810 11:30:28.880977 (+ 33us) write_op.cc:276] Timestamp: P: 1786361424463486 usec, L: 0
0810 11:30:28.881174 (+ 197us) write_op.cc:270] Start()
0810 11:30:28.881198 (+ 24us) write_op.cc:276] Timestamp: P: 1786361424489699 usec, L: 0
0810 11:30:28.881374 (+ 176us) write_op.cc:270] Start()
0810 11:30:28.881407 (+ 33us) write_op.cc:276] Timestamp: P: 1786361424555980 usec, L: 0
0810 11:30:28.881603 (+ 196us) write_op.cc:270] Start()
0810 11:30:28.881630 (+ 27us) write_op.cc:276] Timestamp: P: 1786361424618361 usec, L: 0
0810 11:30:28.881874 (+ 244us) write_op.cc:270] Start()
0810 11:30:28.881939 (+ 65us) write_op.cc:276] Timestamp: P: 1786361424627964 usec, L: 0
0810 11:30:28.882137 (+ 198us) write_op.cc:270] Start()
0810 11:30:28.882211 (+ 74us) write_op.cc:276] Timestamp: P: 1786361424744384 usec, L: 0
0810 11:30:28.882440 (+ 229us) write_op.cc:270] Start()
0810 11:30:28.882473 (+ 33us) write_op.cc:276] Timestamp: P: 1786361424827068 usec, L: 0
0810 11:30:28.888597 (+ 6124us) write_op.cc:270] Start()
0810 11:30:28.888667 (+ 70us) write_op.cc:276] Timestamp: P: 1786361424990367 usec, L: 0
0810 11:30:28.889181 (+ 514us) write_op.cc:270] Start()
0810 11:30:28.889268 (+ 87us) write_op.cc:276] Timestamp: P: 1786361425094215 usec, L: 0
0810 11:30:28.889820 (+ 552us) write_op.cc:270] Start()
0810 11:30:28.889861 (+ 41us) write_op.cc:276] Timestamp: P: 1786361425120639 usec, L: 0
0810 11:30:28.890200 (+ 339us) write_op.cc:270] Start()
0810 11:30:28.890238 (+ 38us) write_op.cc:276] Timestamp: P: 1786361425238065 usec, L: 0
0810 11:30:28.890594 (+ 356us) write_op.cc:270] Start()
0810 11:30:28.890682 (+ 88us) write_op.cc:276] Timestamp: P: 1786361425240796 usec, L: 0
0810 11:30:28.890899 (+ 217us) write_op.cc:270] Start()
0810 11:30:28.890921 (+ 22us) write_op.cc:276] Timestamp: P: 1786361425248418 usec, L: 0
0810 11:30:28.891327 (+ 406us) write_op.cc:270] Start()
0810 11:30:28.891365 (+ 38us) write_op.cc:276] Timestamp: P: 1786361425491602 usec, L: 0
0810 11:30:28.891695 (+ 330us) write_op.cc:270] Start()
0810 11:30:28.891741 (+ 46us) write_op.cc:276] Timestamp: P: 1786361425498045 usec, L: 0
0810 11:30:28.892001 (+ 260us) write_op.cc:270] Start()
0810 11:30:28.892048 (+ 47us) write_op.cc:276] Timestamp: P: 1786361425498858 usec, L: 0
0810 11:30:28.892339 (+ 291us) write_op.cc:270] Start()
0810 11:30:28.892458 (+ 119us) write_op.cc:276] Timestamp: P: 1786361425504200 usec, L: 0
0810 11:30:28.906257 (+ 13799us) write_op.cc:270] Start()
0810 11:30:28.906320 (+ 63us) write_op.cc:276] Timestamp: P: 1786361425506842 usec, L: 0
0810 11:30:28.908486 (+ 2166us) write_op.cc:270] Start()
0810 11:30:28.908654 (+ 168us) write_op.cc:276] Timestamp: P: 1786361425514668 usec, L: 0
0810 11:30:28.910244 (+ 1590us) write_op.cc:270] Start()
0810 11:30:28.910322 (+ 78us) write_op.cc:276] Timestamp: P: 1786361425518169 usec, L: 0
0810 11:30:28.910773 (+ 451us) write_op.cc:270] Start()
0810 11:30:28.911787 (+ 1014us) write_op.cc:276] Timestamp: P: 1786361425566300 usec, L: 0
0810 11:30:28.913188 (+ 1401us) write_op.cc:270] Start()
0810 11:30:28.913279 (+ 91us) write_op.cc:276] Timestamp: P: 1786361425634099 usec, L: 0
0810 11:30:28.913751 (+ 472us) write_op.cc:270] Start()
0810 11:30:28.913784 (+ 33us) write_op.cc:276] Timestamp: P: 1786361425635066 usec, L: 0
0810 11:30:28.914345 (+ 561us) write_op.cc:270] Start()
0810 11:30:28.914399 (+ 54us) write_op.cc:276] Timestamp: P: 1786361425637436 usec, L: 0
0810 11:30:28.914814 (+ 415us) write_op.cc:270] Start()
0810 11:30:28.914863 (+ 49us) write_op.cc:276] Timestamp: P: 1786361425645525 usec, L: 0
0810 11:30:28.924171 (+ 9308us) log.cc:842] Serialized 33386 byte log entry
0810 11:30:28.931177 (+ 7006us) raft_consensus.cc:1631] Marking committed up to 537
0810 11:30:28.931468 (+ 291us) log.cc:842] Serialized 15 byte log entry
0810 11:30:28.998506 (+ 67038us) raft_consensus.cc:1683] Filling consensus response to leader.
0810 11:30:29.001679 (+ 3173us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x615000050b24. stack: 00007f51aca5666e 00007f51aca56430 00007f51abadd5ed 00000000008ea064 00000000008ea02d 00007f51bb16f27d 00007f51bb16f373 00007f51b7f91361 00007f51bfae6769 00007f51bfaf9565 00007f51bfaf9311 00007f51b926208d 00007f51b7fa168e 00007f51b7fa13dd 00000000009edb7c 00007f51aca9c344
0810 11:30:29.005796 (+ 4117us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x615000050b24. stack: 00007f51aca5666e 00007f51aca56430 00007f51abadd5ed 00000000008ea064 00000000008ea02d 00007f51bb16f27d 00007f51bb16f373 00007f51b7f91361 00007f51bfae6769 00007f51bfaf9565 00007f51bfaf9311 00007f51b926208d 00007f51b7fa168e 00007f51b7fa13dd 00000000009edb7c 00007f51aca9c344
0810 11:30:29.015787 (+ 9991us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0810 11:30:29.015861 (+ 74us) raft_consensus.cc:1671] finished
0810 11:30:29.015868 (+ 7us) raft_consensus.cc:1677] UpdateReplicas() finished
0810 11:30:29.016136 (+ 268us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:28.843112 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:28.843370 (+ 258us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:28.843380 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:28.843384 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:28.843599 (+ 215us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:28.843646 (+ 47us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:28.843652 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:28.843804 (+ 152us) tablet.cc:699] Row locks acquired
0810 11:30:28.843807 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:28.966950 (+123143us) op_driver.cc:444] REPLICATION: finished
0810 11:30:28.967326 (+ 376us) write_op.cc:301] APPLY: starting
0810 11:30:28.967360 (+ 34us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:28.967448 (+ 88us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:28.967462 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:28.967868 (+ 406us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:28.967928 (+ 60us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:28.967993 (+ 65us) write_op.cc:312] APPLY: finished
0810 11:30:28.968146 (+ 153us) log.cc:842] Serialized 29 byte log entry
0810 11:30:28.968250 (+ 104us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.968398 (+ 148us) write_op.cc:454] Released schema lock
0810 11:30:28.968418 (+ 20us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:28.968510 (+ 92us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.968528 (+ 18us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:28.843973 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:28.844218 (+ 245us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:28.844248 (+ 30us) write_op.cc:435] Acquired schema lock
0810 11:30:28.844250 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:28.844365 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:28.844379 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:28.844390 (+ 11us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:28.844855 (+ 465us) tablet.cc:699] Row locks acquired
0810 11:30:28.844859 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:28.967146 (+122287us) op_driver.cc:444] REPLICATION: finished
0810 11:30:28.967517 (+ 371us) write_op.cc:301] APPLY: starting
0810 11:30:28.967566 (+ 49us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:28.967657 (+ 91us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:28.967663 (+ 6us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:28.967773 (+ 110us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:28.967839 (+ 66us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:28.967924 (+ 85us) write_op.cc:312] APPLY: finished
0810 11:30:28.968099 (+ 175us) log.cc:842] Serialized 29 byte log entry
0810 11:30:28.968217 (+ 118us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.968243 (+ 26us) write_op.cc:454] Released schema lock
0810 11:30:28.968252 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:28.968309 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.968312 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:28.864200 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:28.864749 (+ 549us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:28.864780 (+ 31us) write_op.cc:435] Acquired schema lock
0810 11:30:28.864786 (+ 6us) tablet.cc:660] Decoding operations
0810 11:30:28.865135 (+ 349us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:28.865172 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:28.865182 (+ 10us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:28.865452 (+ 270us) tablet.cc:699] Row locks acquired
0810 11:30:28.865455 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:28.968870 (+103415us) op_driver.cc:444] REPLICATION: finished
0810 11:30:28.969041 (+ 171us) write_op.cc:301] APPLY: starting
0810 11:30:28.969059 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:28.969125 (+ 66us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:28.969127 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:28.969268 (+ 141us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:28.969344 (+ 76us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:28.969463 (+ 119us) write_op.cc:312] APPLY: finished
0810 11:30:28.969606 (+ 143us) log.cc:842] Serialized 29 byte log entry
0810 11:30:28.969710 (+ 104us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.969730 (+ 20us) write_op.cc:454] Released schema lock
0810 11:30:28.969738 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:28.969809 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.969827 (+ 18us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:28.866102 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:28.866217 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:28.866222 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:28.866225 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:28.866404 (+ 179us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:28.866421 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:28.866426 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:28.866589 (+ 163us) tablet.cc:699] Row locks acquired
0810 11:30:28.866603 (+ 14us) write_op.cc:260] PREPARE: finished
0810 11:30:28.970380 (+103777us) op_driver.cc:444] REPLICATION: finished
0810 11:30:28.970666 (+ 286us) write_op.cc:301] APPLY: starting
0810 11:30:28.970696 (+ 30us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:28.970751 (+ 55us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:28.970754 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:28.970873 (+ 119us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:28.970937 (+ 64us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:28.970998 (+ 61us) write_op.cc:312] APPLY: finished
0810 11:30:28.971132 (+ 134us) log.cc:842] Serialized 29 byte log entry
0810 11:30:28.971251 (+ 119us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.971285 (+ 34us) write_op.cc:454] Released schema lock
0810 11:30:28.971307 (+ 22us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:28.971358 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.971363 (+ 5us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:28.866717 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:28.866803 (+ 86us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:28.866808 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:28.866810 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:28.866921 (+ 111us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:28.866933 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:28.866938 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:28.867075 (+ 137us) tablet.cc:699] Row locks acquired
0810 11:30:28.867078 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:28.971880 (+104802us) op_driver.cc:444] REPLICATION: finished
0810 11:30:28.972124 (+ 244us) write_op.cc:301] APPLY: starting
0810 11:30:28.972141 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:28.972315 (+ 174us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:28.972318 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:28.972431 (+ 113us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:28.972480 (+ 49us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:28.972617 (+ 137us) write_op.cc:312] APPLY: finished
0810 11:30:28.972734 (+ 117us) log.cc:842] Serialized 29 byte log entry
0810 11:30:28.972863 (+ 129us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.972883 (+ 20us) write_op.cc:454] Released schema lock
0810 11:30:28.972892 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:28.972952 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.972964 (+ 12us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:28.867140 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:28.867220 (+ 80us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:28.867225 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:28.867228 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:28.867384 (+ 156us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:28.867396 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:28.867401 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:28.867479 (+ 78us) tablet.cc:699] Row locks acquired
0810 11:30:28.867481 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:28.973679 (+106198us) op_driver.cc:444] REPLICATION: finished
0810 11:30:28.973751 (+ 72us) write_op.cc:301] APPLY: starting
0810 11:30:28.973764 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:28.973829 (+ 65us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:28.973833 (+ 4us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:28.974141 (+ 308us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:28.974216 (+ 75us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:28.974298 (+ 82us) write_op.cc:312] APPLY: finished
0810 11:30:28.974459 (+ 161us) log.cc:842] Serialized 29 byte log entry
0810 11:30:28.974853 (+ 394us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.974874 (+ 21us) write_op.cc:454] Released schema lock
0810 11:30:28.974882 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:28.974935 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.974939 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:28.867546 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:28.867640 (+ 94us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:28.867645 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:28.867647 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:28.867779 (+ 132us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:28.867790 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:28.867796 (+ 6us) tablet.cc:683] Acquiring locks for 3 operations
0810 11:30:28.868117 (+ 321us) tablet.cc:699] Row locks acquired
0810 11:30:28.868122 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:28.975177 (+107055us) op_driver.cc:444] REPLICATION: finished
0810 11:30:28.975315 (+ 138us) write_op.cc:301] APPLY: starting
0810 11:30:28.975341 (+ 26us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:28.975417 (+ 76us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:28.975419 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:28.975550 (+ 131us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:28.975619 (+ 69us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0810 11:30:28.975653 (+ 34us) write_op.cc:312] APPLY: finished
0810 11:30:28.975924 (+ 271us) log.cc:842] Serialized 35 byte log entry
0810 11:30:28.976400 (+ 476us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.976418 (+ 18us) write_op.cc:454] Released schema lock
0810 11:30:28.976426 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:28.976492 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.976498 (+ 6us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:28.868200 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:28.868314 (+ 114us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:28.868319 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:28.868332 (+ 13us) tablet.cc:660] Decoding operations
0810 11:30:28.868526 (+ 194us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:28.868598 (+ 72us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:28.868604 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:28.868731 (+ 127us) tablet.cc:699] Row locks acquired
0810 11:30:28.868750 (+ 19us) write_op.cc:260] PREPARE: finished
0810 11:30:28.978882 (+110132us) op_driver.cc:444] REPLICATION: finished
0810 11:30:28.979143 (+ 261us) write_op.cc:301] APPLY: starting
0810 11:30:28.979178 (+ 35us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:28.979257 (+ 79us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:28.979269 (+ 12us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:28.979456 (+ 187us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:28.979582 (+ 126us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:28.979662 (+ 80us) write_op.cc:312] APPLY: finished
0810 11:30:28.979823 (+ 161us) log.cc:842] Serialized 29 byte log entry
0810 11:30:28.980354 (+ 531us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.980392 (+ 38us) write_op.cc:454] Released schema lock
0810 11:30:28.980415 (+ 23us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:28.980490 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.980496 (+ 6us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:28.868927 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:28.869423 (+ 496us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:28.869433 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:28.869438 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:28.869574 (+ 136us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:28.869594 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:28.869615 (+ 21us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:28.870119 (+ 504us) tablet.cc:699] Row locks acquired
0810 11:30:28.870125 (+ 6us) write_op.cc:260] PREPARE: finished
0810 11:30:28.980762 (+110637us) op_driver.cc:444] REPLICATION: finished
0810 11:30:28.981301 (+ 539us) write_op.cc:301] APPLY: starting
0810 11:30:28.981321 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:28.981387 (+ 66us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:28.981390 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:28.981638 (+ 248us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:28.981703 (+ 65us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:28.981760 (+ 57us) write_op.cc:312] APPLY: finished
0810 11:30:28.981859 (+ 99us) log.cc:842] Serialized 29 byte log entry
0810 11:30:28.981955 (+ 96us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.981975 (+ 20us) write_op.cc:454] Released schema lock
0810 11:30:28.981987 (+ 12us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:28.982052 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.982059 (+ 7us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:28.870303 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:28.870528 (+ 225us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:28.870533 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:28.870535 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:28.870705 (+ 170us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:28.870719 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:28.870725 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:28.870808 (+ 83us) tablet.cc:699] Row locks acquired
0810 11:30:28.870811 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:28.980887 (+110076us) op_driver.cc:444] REPLICATION: finished
0810 11:30:28.981986 (+ 1099us) write_op.cc:301] APPLY: starting
0810 11:30:28.982003 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:28.982050 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:28.982054 (+ 4us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:28.982136 (+ 82us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:28.982188 (+ 52us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:28.982248 (+ 60us) write_op.cc:312] APPLY: finished
0810 11:30:28.982335 (+ 87us) log.cc:842] Serialized 23 byte log entry
0810 11:30:28.982418 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.982435 (+ 17us) write_op.cc:454] Released schema lock
0810 11:30:28.982449 (+ 14us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:28.982492 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.982497 (+ 5us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:28.870925 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:28.871070 (+ 145us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:28.871075 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:28.871077 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:28.871271 (+ 194us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:28.871283 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:28.871300 (+ 17us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:28.871461 (+ 161us) tablet.cc:699] Row locks acquired
0810 11:30:28.871468 (+ 7us) write_op.cc:260] PREPARE: finished
0810 11:30:28.980995 (+109527us) op_driver.cc:444] REPLICATION: finished
0810 11:30:28.982449 (+ 1454us) write_op.cc:301] APPLY: starting
0810 11:30:28.982465 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:28.982518 (+ 53us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:28.982521 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:28.982610 (+ 89us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:28.982638 (+ 28us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:28.982673 (+ 35us) write_op.cc:312] APPLY: finished
0810 11:30:28.982734 (+ 61us) log.cc:842] Serialized 29 byte log entry
0810 11:30:28.982776 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.982788 (+ 12us) write_op.cc:454] Released schema lock
0810 11:30:28.982794 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:28.982822 (+ 28us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.982826 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:28.890110 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:28.890855 (+ 745us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:28.890869 (+ 14us) write_op.cc:435] Acquired schema lock
0810 11:30:28.890871 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:28.891149 (+ 278us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:28.891189 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:28.891195 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
I20260810 11:30:29.761157 27231 consensus_queue.cc:260] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.802829 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 14) took 5336 ms. Trace:
I20260810 11:30:29.803321 27999 rpcz_store.cc:276] 0810 11:30:24.446485 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:24.449067 (+ 2582us) service_pool.cc:227] Handling call
0810 11:30:29.780031 (+5330964us) ts_tablet_manager.cc:1145] Deleting tablet 3ae27bf110114b70a3e3f6cf64f31b98
0810 11:30:29.782656 (+ 2625us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x618000004d18. stack: 00007f7f891ce66e 00007f7f891ce430 00007f7f882555ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f7f891c40fd 00007f7f891c516e 00007f7f9c119cfd 00007f7f9c097883 00007f7f983376e6 00007f7f98338a37 00007f7f9836b404 00007f7f9834c870 00007f7f9834c5fd 00000000009edb7c
0810 11:30:29.782670 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:29.783170 (+ 500us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4986752,"tablet-delete.queue_time_us":5299775}
I20260810 11:30:29.804021 27058 raft_consensus.cc:2454] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:29.804052 27228 tablet_bootstrap.cc:654] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:29.804926 27999 tablet_replica.cc:330] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:29.805636 27999 raft_consensus.cc:2229] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:29.806432 27999 raft_consensus.cc:2258] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:29.806715 27231 ts_tablet_manager.cc:1428] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.061s user 0.003s sys 0.003s
W20260810 11:30:29.812028 26849 consensus_peers.cc:487] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:29.812613 27999 ts_tablet_manager.cc:1905] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:29.817152 26822 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:29.815887 28204 mvcc.cc:205] Tried to move back new op lower bound from 7316936399444070400 to 7316936384318218240. Current Snapshot: MvccSnapshot[applied={T|T < 7316936399444070400 or (T in {7316936399444070400})}]
W20260810 11:30:29.822288 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 318d5b8453fe4c438d0fa32cb91c409e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 318d5b8453fe4c438d0fa32cb91c409e already in progress: creating tablet
I20260810 11:30:29.824159 27222 tablet_bootstrap.cc:492] T 750950c424184d08bf6777774db3a0b2 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
W20260810 11:30:29.824620 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 3ae27bf110114b70a3e3f6cf64f31b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae27bf110114b70a3e3f6cf64f31b98 already in progress: creating tablet
I20260810 11:30:29.825402 28213 raft_consensus.cc:504] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.827405 27231 tablet_bootstrap.cc:492] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:29.828850 28213 leader_election.cc:288] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:29.833746 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0033d61d07d84262a98b0ebc54bd7960" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:29.834051 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0033d61d07d84262a98b0ebc54bd7960" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:29.834638 26911 raft_consensus.cc:3037] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:29.825219 26700 leader_election.cc:302] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:29.841461 27222 ts_tablet_manager.cc:1397] T 750950c424184d08bf6777774db3a0b2 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.548s user 0.004s sys 0.020s
I20260810 11:30:29.825084 26764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0938a2f3688246a2b46978eeb7d5d521" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:29.841670 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 50274us
I20260810 11:30:29.847653 26911 raft_consensus.cc:2454] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
W20260810 11:30:29.848549 26849 leader_election.cc:341] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: Tablet not RUNNING: STOPPED
I20260810 11:30:29.853724 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0033d61d07d84262a98b0ebc54bd7960" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:29.854104 28268 raft_consensus.cc:2781] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:29.855000 28267 raft_consensus.cc:482] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:29.848923 26991 leader_election.cc:302] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:29.855458 28267 raft_consensus.cc:504] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.855809 27321 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 123) took 2518 ms. Trace:
I20260810 11:30:29.843742 28279 tablet.cc:1722] T b6a3b1e37ac943e391d54640987136f8 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:29.856067 27321 rpcz_store.cc:276] 0810 11:30:27.329695 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.439175 (+2109480us) service_pool.cc:227] Handling call
0810 11:30:29.441518 (+ 2343us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:29.442301 (+ 783us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:29.719434 (+277133us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:29.848071 (+128637us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:29.848336 (+ 265us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:29.656260 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:29.656616 (+ 356us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:29.656633 (+ 17us) write_op.cc:435] Acquired schema lock
0810 11:30:29.656636 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:29.656763 (+ 127us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:29.656772 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:29.656777 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:29.656932 (+ 155us) tablet.cc:699] Row locks acquired
0810 11:30:29.656936 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:29.656991 (+ 55us) write_op.cc:270] Start()
0810 11:30:29.657043 (+ 52us) write_op.cc:276] Timestamp: P: 1786361429656945 usec, L: 0
0810 11:30:29.657048 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:29.657344 (+ 296us) log.cc:842] Serialized 433 byte log entry
0810 11:30:29.715727 (+ 58383us) op_driver.cc:444] REPLICATION: finished
0810 11:30:29.718252 (+ 2525us) write_op.cc:301] APPLY: starting
0810 11:30:29.718280 (+ 28us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:29.718472 (+ 192us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:29.718508 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:29.718737 (+ 229us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:29.718828 (+ 91us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:29.718841 (+ 13us) write_op.cc:312] APPLY: finished
0810 11:30:29.718992 (+ 151us) log.cc:842] Serialized 29 byte log entry
0810 11:30:29.719102 (+ 110us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.719131 (+ 29us) write_op.cc:454] Released schema lock
0810 11:30:29.719138 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:29.719226 (+ 88us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.719229 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":2436,"apply.run_cpu_time_us":1064,"apply.run_wall_time_us":1065,"mutex_wait_us":209914,"num_ops":2,"prepare.queue_time_us":211118,"prepare.run_cpu_time_us":1192,"prepare.run_wall_time_us":1192,"replication_time_us":58639,"thread_start_us":120661,"threads_started":1}]]}
I20260810 11:30:29.858477 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8798892eb4604ee8ac9c95e64dbb14e9" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:29.858965 28267 leader_election.cc:288] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:29.859349 28268 raft_consensus.cc:482] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:29.859723 28268 raft_consensus.cc:3037] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:29.859979 26993 leader_election.cc:341] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:29.860350 26702 leader_election.cc:341] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:29.861346 27336 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 122) took 2526 ms. Trace:
I20260810 11:30:29.861770 27336 rpcz_store.cc:276] 0810 11:30:27.328960 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.404229 (+2075269us) service_pool.cc:227] Handling call
0810 11:30:29.410766 (+ 6537us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:29.412139 (+ 1373us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:29.719434 (+307295us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:29.854988 (+135554us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:29.855407 (+ 419us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:29.655200 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:29.655385 (+ 185us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:29.655391 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:29.655394 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:29.655592 (+ 198us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:29.655601 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:29.655605 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:29.655715 (+ 110us) tablet.cc:699] Row locks acquired
0810 11:30:29.655718 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:29.655796 (+ 78us) write_op.cc:270] Start()
0810 11:30:29.655861 (+ 65us) write_op.cc:276] Timestamp: P: 1786361429655747 usec, L: 0
0810 11:30:29.655866 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:29.656052 (+ 186us) log.cc:842] Serialized 433 byte log entry
0810 11:30:29.715516 (+ 59464us) op_driver.cc:444] REPLICATION: finished
0810 11:30:29.716833 (+ 1317us) write_op.cc:301] APPLY: starting
0810 11:30:29.716879 (+ 46us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:29.716999 (+ 120us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:29.717131 (+ 132us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:29.717378 (+ 247us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:29.717483 (+ 105us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:29.717507 (+ 24us) write_op.cc:312] APPLY: finished
0810 11:30:29.717753 (+ 246us) log.cc:842] Serialized 29 byte log entry
0810 11:30:29.717910 (+ 157us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.717945 (+ 35us) write_op.cc:454] Released schema lock
0810 11:30:29.717954 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:29.718044 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.718050 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1131,"apply.run_cpu_time_us":1367,"apply.run_wall_time_us":1368,"mutex_wait_us":240698,"num_ops":2,"prepare.queue_time_us":241640,"prepare.run_cpu_time_us":989,"prepare.run_wall_time_us":998,"replication_time_us":59576}]]}
I20260810 11:30:29.863479 27222 raft_consensus.cc:348] T 750950c424184d08bf6777774db3a0b2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.864068 27222 raft_consensus.cc:374] T 750950c424184d08bf6777774db3a0b2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:29.864257 27222 raft_consensus.cc:729] T 750950c424184d08bf6777774db3a0b2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:29.865360 27718 raft_consensus.cc:2781] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:29.865114 27222 consensus_queue.cc:260] T 750950c424184d08bf6777774db3a0b2 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.865830 28206 consensus_queue.cc:1035] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:29.866386 27222 ts_tablet_manager.cc:1428] T 750950c424184d08bf6777774db3a0b2 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.024s user 0.004s sys 0.000s
I20260810 11:30:29.867139 27222 tablet_bootstrap.cc:492] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:29.869262 27718 raft_consensus.cc:686] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:29.869875 27718 consensus_queue.cc:237] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:29.877483 26993 leader_election.cc:341] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:29.880439 28268 raft_consensus.cc:504] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.891505 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b555f18c1e485d9af7b08f98543c80" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:29.892037 27059 raft_consensus.cc:3037] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:29.897943 27334 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 124) took 2568 ms. Trace:
I20260810 11:30:29.898347 27334 rpcz_store.cc:276] 0810 11:30:27.329855 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.542504 (+2212649us) service_pool.cc:227] Handling call
0810 11:30:29.547066 (+ 4562us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:29.548332 (+ 1266us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:29.897281 (+348949us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:29.897582 (+ 301us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:29.897825 (+ 243us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:29.657533 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:29.657673 (+ 140us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:29.657678 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:29.657681 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:29.657788 (+ 107us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:29.657797 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:29.657811 (+ 14us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:29.657920 (+ 109us) tablet.cc:699] Row locks acquired
0810 11:30:29.657923 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:29.657973 (+ 50us) write_op.cc:270] Start()
0810 11:30:29.658006 (+ 33us) write_op.cc:276] Timestamp: P: 1786361429657929 usec, L: 0
0810 11:30:29.658020 (+ 14us) op_driver.cc:331] REPLICATION: starting
0810 11:30:29.658224 (+ 204us) log.cc:842] Serialized 433 byte log entry
0810 11:30:29.836624 (+178400us) op_driver.cc:444] REPLICATION: finished
0810 11:30:29.894372 (+ 57748us) write_op.cc:301] APPLY: starting
0810 11:30:29.894448 (+ 76us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:29.894541 (+ 93us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:29.894651 (+ 110us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:29.895023 (+ 372us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:29.895122 (+ 99us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:29.895143 (+ 21us) write_op.cc:312] APPLY: finished
0810 11:30:29.895359 (+ 216us) log.cc:842] Serialized 29 byte log entry
0810 11:30:29.895506 (+ 147us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.895551 (+ 45us) write_op.cc:454] Released schema lock
0810 11:30:29.895563 (+ 12us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:29.895675 (+ 112us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.895681 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":57615,"apply.run_cpu_time_us":1418,"apply.run_wall_time_us":1420,"mutex_wait_us":162392,"num_ops":2,"prepare.queue_time_us":107647,"prepare.run_cpu_time_us":787,"prepare.run_wall_time_us":778,"replication_time_us":178570}]]}
I20260810 11:30:29.900678 27222 tablet_bootstrap.cc:654] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:29.900895 28268 leader_election.cc:288] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:29.903863 27059 raft_consensus.cc:2454] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:29.907909 26849 leader_election.cc:302] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:29.914000 28257 raft_consensus.cc:2726] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:29.914837 26702 leader_election.cc:302] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:29.916038 28268 raft_consensus.cc:2781] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:29.916936 28268 raft_consensus.cc:686] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
W20260810 11:30:29.916841 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 64535.8us
I20260810 11:30:29.919699 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8798892eb4604ee8ac9c95e64dbb14e9" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:29.920783 26911 raft_consensus.cc:2454] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:29.922261 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b555f18c1e485d9af7b08f98543c80" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:29.923101 26911 raft_consensus.cc:3037] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:29.925200 27334 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_bcf64628ba2c463ba5acce6617ec4324"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:29.930323 27334 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bcf64628ba2c463ba5acce6617ec4324 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:29.931907 26700 leader_election.cc:302] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:29.933404 28267 raft_consensus.cc:2781] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:29.934005 28267 raft_consensus.cc:482] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:29.934394 28267 raft_consensus.cc:3037] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:29.932694 27336 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_307bbf62894b4edc922e0fd4afa1a91f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:29.949384 27248 ts_tablet_manager.cc:1918] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:29.949723 27248 log.cc:1196] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/b28f3dcbd6d74559b372d3452e13ce9f
I20260810 11:30:29.949137 28202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:29.950501 28202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: This master's current role is: LEADER
I20260810 11:30:29.951305 27248 ts_tablet_manager.cc:1939] T b28f3dcbd6d74559b372d3452e13ce9f P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:29.953222 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 54) took 3944 ms. Trace:
I20260810 11:30:29.953744 27248 rpcz_store.cc:276] 0810 11:30:26.008539 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.020934 (+ 12395us) service_pool.cc:227] Handling call
0810 11:30:29.700422 (+3679488us) ts_tablet_manager.cc:1145] Deleting tablet b28f3dcbd6d74559b372d3452e13ce9f
0810 11:30:29.700539 (+ 117us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:29.875114 (+174575us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:29.949022 (+ 73908us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:29.953157 (+ 4135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3679200}
I20260810 11:30:29.974620 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet b28f3dcbd6d74559b372d3452e13ce9f (table default.Table_95523d7d33a4423099b179a2d91867f9 [id=01eb86f74b7e4434a2d6aae5dd94b3b5]) successfully deleted
I20260810 11:30:29.974784 28280 tablet.cc:1722] T b6a3b1e37ac943e391d54640987136f8 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:29.955483 27718 raft_consensus.cc:482] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:29.976070 27718 raft_consensus.cc:504] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.978358 27718 leader_election.cc:288] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:29.979394 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 83) took 3859 ms. Trace:
I20260810 11:30:29.917665 28268 consensus_queue.cc:237] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.981097 27248 rpcz_store.cc:276] 0810 11:30:26.120132 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.120199 (+ 67us) service_pool.cc:227] Handling call
0810 11:30:29.978877 (+3858678us) ts_tablet_manager.cc:1145] Deleting tablet 81f24c84cdd945b78f39f24015eb1e43
0810 11:30:29.978933 (+ 56us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:29.979184 (+ 251us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3800820}
W20260810 11:30:29.982283 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 81f24c84cdd945b78f39f24015eb1e43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81f24c84cdd945b78f39f24015eb1e43 already in progress: creating tablet
I20260810 11:30:29.987226 27231 tablet_bootstrap.cc:654] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:29.992383 27231 tablet_bootstrap.cc:492] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:29.992720 27231 ts_tablet_manager.cc:1397] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.186s user 0.009s sys 0.003s
I20260810 11:30:29.993027 26911 raft_consensus.cc:2454] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:29.994422 27231 raft_consensus.cc:348] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:29.994904 27231 raft_consensus.cc:374] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:29.995059 27231 raft_consensus.cc:729] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:29.995529 27231 consensus_queue.cc:260] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:30.007220 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a83391804894d268d0e603f4feb1745" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:30.014668 27334 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 126) took 2675 ms. Trace:
I20260810 11:30:30.015681 28257 raft_consensus.cc:482] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:30.016023 28257 raft_consensus.cc:504] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:30.016608 27336 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_307bbf62894b4edc922e0fd4afa1a91f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:30.017836 28257 leader_election.cc:288] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:30.030719 27974 ts_tablet_manager.cc:1918] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:30.031488 27974 log.cc:1196] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/0938a2f3688246a2b46978eeb7d5d521
I20260810 11:30:30.032878 28257 raft_consensus.cc:482] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 443ec871f1ed4232b932ecfb0b18510d)
I20260810 11:30:30.033347 28257 raft_consensus.cc:504] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:30.035353 28257 leader_election.cc:288] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:30.036875 27974 ts_tablet_manager.cc:1939] T 0938a2f3688246a2b46978eeb7d5d521 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:30.041280 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 713663be70014b17b17056a865e7db63 (DEFAULT_TABLE table=default.Table_12d15f4d2bd3426788aadc76beeff465 [id=ec7fc14fabfd4c83adcb3ea82f0087e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.041908 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a83391804894d268d0e603f4feb1745" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:30.014971 27334 rpcz_store.cc:276] 0810 11:30:27.339529 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.899661 (+2560132us) service_pool.cc:227] Handling call
0810 11:30:29.920407 (+ 20746us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dc313 00007f55f09ce466 00007f55f09ce195 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:29.942265 (+ 21858us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:29.943644 (+ 1379us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:30.014184 (+ 70540us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:30.014465 (+ 281us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:30.014591 (+ 126us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:29.992236 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:29.992615 (+ 379us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:29.992624 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:29.992626 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:29.992817 (+ 191us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:29.992850 (+ 33us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:29.992856 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:29.993026 (+ 170us) tablet.cc:699] Row locks acquired
0810 11:30:29.993029 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:29.993099 (+ 70us) write_op.cc:270] Start()
0810 11:30:29.993169 (+ 70us) write_op.cc:276] Timestamp: P: 1786361429993002 usec, L: 0
0810 11:30:29.993174 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:29.993704 (+ 530us) log.cc:842] Serialized 433 byte log entry
0810 11:30:30.005291 (+ 11587us) op_driver.cc:444] REPLICATION: finished
0810 11:30:30.012499 (+ 7208us) write_op.cc:301] APPLY: starting
0810 11:30:30.012525 (+ 26us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:30.012629 (+ 104us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:30.012762 (+ 133us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:30.013027 (+ 265us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:30.013086 (+ 59us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:30.013092 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:30.013298 (+ 206us) log.cc:842] Serialized 29 byte log entry
0810 11:30:30.013725 (+ 427us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.013773 (+ 48us) write_op.cc:454] Released schema lock
0810 11:30:30.013786 (+ 13us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:30.013906 (+ 120us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.013921 (+ 15us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":46422272,"child_traces":[["op",{"apply.queue_time_us":7079,"apply.run_cpu_time_us":1238,"apply.run_wall_time_us":1553,"num_ops":2,"prepare.queue_time_us":44250,"prepare.run_cpu_time_us":1701,"prepare.run_wall_time_us":2592,"raft.queue_time_us":169,"raft.run_cpu_time_us":517,"raft.run_wall_time_us":7185,"replication_time_us":12033}]]}
I20260810 11:30:30.057946 27334 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_e0aa1ad6dfda4ef2b7c441f45f74c0f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:30.081737 28159 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.540s user 0.023s sys 0.040s
W20260810 11:30:30.082647 28159 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.577s user 0.023s sys 0.040s
I20260810 11:30:30.084072 27228 tablet_bootstrap.cc:492] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:30.085510 28159 raft_consensus.cc:482] T 750950c424184d08bf6777774db3a0b2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:30.086071 28159 raft_consensus.cc:504] T 750950c424184d08bf6777774db3a0b2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:30.088251 28159 leader_election.cc:288] T 750950c424184d08bf6777774db3a0b2 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:30.089200 28277 tablet.cc:1722] T b6a3b1e37ac943e391d54640987136f8 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:30.091084 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "750950c424184d08bf6777774db3a0b2" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:30.091822 26912 raft_consensus.cc:2379] T 750950c424184d08bf6777774db3a0b2 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
I20260810 11:30:30.092438 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 713663be70014b17b17056a865e7db63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.097229 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 713663be70014b17b17056a865e7db63 (DEFAULT_TABLE table=default.Table_12d15f4d2bd3426788aadc76beeff465 [id=ec7fc14fabfd4c83adcb3ea82f0087e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.098085 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 713663be70014b17b17056a865e7db63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.108134 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 82) took 3985 ms. Trace:
W20260810 11:30:30.111104 26991 leader_election.cc:341] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:30.084657 27228 ts_tablet_manager.cc:1397] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.447s user 0.009s sys 0.010s
W20260810 11:30:30.113056 27334 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0aa1ad6dfda4ef2b7c441f45f74c0f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:30.114446 27037 tablet_service.cc:1467] Processing CreateTablet for tablet 713663be70014b17b17056a865e7db63 (DEFAULT_TABLE table=default.Table_12d15f4d2bd3426788aadc76beeff465 [id=ec7fc14fabfd4c83adcb3ea82f0087e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.115533 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 713663be70014b17b17056a865e7db63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.117372 27231 ts_tablet_manager.cc:1428] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260810 11:30:30.117767 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "750950c424184d08bf6777774db3a0b2" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:30.119481 27231 tablet_bootstrap.cc:492] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:30.122457 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 72) took 3902 ms. Trace:
I20260810 11:30:30.124186 27974 rpcz_store.cc:276] 0810 11:30:26.145835 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.147410 (+ 1575us) service_pool.cc:227] Handling call
0810 11:30:29.206694 (+3059284us) ts_tablet_manager.cc:1145] Deleting tablet 0938a2f3688246a2b46978eeb7d5d521
0810 11:30:29.207713 (+ 1019us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:29.651137 (+443424us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:30.030135 (+378998us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:30.048277 (+ 18142us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2920489}
I20260810 11:30:30.123832 27248 rpcz_store.cc:276] 0810 11:30:26.116871 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.116943 (+ 72us) service_pool.cc:227] Handling call
0810 11:30:29.984706 (+3867763us) ts_tablet_manager.cc:1145] Deleting tablet a3406dc345e3429fb4bce5a59643b686
0810 11:30:29.987624 (+ 2918us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:30.102372 (+114748us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3806575}
I20260810 11:30:30.128986 27248 tablet_replica.cc:330] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:30.129714 27248 raft_consensus.cc:2229] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:30.130172 27248 raft_consensus.cc:2258] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:30.135429 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 82) took 3857 ms. Trace:
W20260810 11:30:30.142586 26991 consensus_peers.cc:487] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:30.148273 27248 ts_tablet_manager.cc:1905] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:30.149549 26848 leader_election.cc:341] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: e25ae21cc8cc4749a507fcab5ee225a3
I20260810 11:30:30.126652 26702 leader_election.cc:302] T 750950c424184d08bf6777774db3a0b2 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:30.152733 27231 tablet_bootstrap.cc:654] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:30.152648 27974 rpcz_store.cc:276] 0810 11:30:26.273504 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.279793 (+ 6289us) service_pool.cc:227] Handling call
0810 11:30:30.124928 (+3845135us) ts_tablet_manager.cc:1145] Deleting tablet bb0357271cfd46478867a3cc0660bcdc
0810 11:30:30.124946 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:30.125791 (+ 845us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3828118}
I20260810 11:30:30.158207 27974 tablet_replica.cc:330] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
W20260810 11:30:30.160248 26848 leader_election.cc:341] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: db5adccd80a04e328e13793b461c38b1
I20260810 11:30:30.161796 27974 raft_consensus.cc:2229] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:30.162317 28267 raft_consensus.cc:504] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:30.162694 28029 consensus_queue.cc:1035] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:30.167392 26848 consensus_peers.cc:487] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:30.168309 27228 raft_consensus.cc:348] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:30.173597 27228 raft_consensus.cc:374] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:30.173806 27228 raft_consensus.cc:729] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:30.177753 27708 consensus_queue.cc:1035] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:30.184508 28267 leader_election.cc:288] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:30.212476 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 89599us
I20260810 11:30:30.214149 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8798892eb4604ee8ac9c95e64dbb14e9" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:30.217160 28267 raft_consensus.cc:3037] T 750950c424184d08bf6777774db3a0b2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:30.220582 26849 consensus_peers.cc:487] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:30.221159 26702 leader_election.cc:341] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:30.223973 27231 tablet_bootstrap.cc:492] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:30.224323 27231 ts_tablet_manager.cc:1397] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.105s user 0.010s sys 0.001s
I20260810 11:30:30.227977 27231 raft_consensus.cc:348] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:30.233162 28260 catalog_manager.cc:1259] Loaded cluster ID: 5081849c8420415b9be91728667896d5
I20260810 11:30:30.233353 28260 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: loading cluster ID for follower catalog manager: success
W20260810 11:30:30.239356 26849 leader_election.cc:341] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: e25ae21cc8cc4749a507fcab5ee225a3
I20260810 11:30:30.239885 26849 leader_election.cc:302] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:30.233238 27228 consensus_queue.cc:260] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:30.243049 28018 ts_manager.cc:194] Registered new tserver with Master: b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:30.245795 28017 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" instance_seqno: 1786361407549230) as {username='slave'} at 127.25.195.193:52999; Asking this server to re-register.
W20260810 11:30:30.256824 26849 leader_election.cc:341] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: db5adccd80a04e328e13793b461c38b1
I20260810 11:30:30.257308 26849 leader_election.cc:302] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
W20260810 11:30:30.257932 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet a3406dc345e3429fb4bce5a59643b686 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3406dc345e3429fb4bce5a59643b686 already in progress: creating tablet
W20260810 11:30:30.258277 27288 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 131198us
W20260810 11:30:30.260944 27288 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 65756c37fe514194bebe76921419653c consensus state has no leader
I20260810 11:30:30.259142 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:30.266472 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b6a3b1e37ac943e391d54640987136f8 (table default.Table_acbcb3a347b647a19e81cfcf5636677f [id=56dee621acfa4f73b3bd69fefa7cb7e1]). Expected version 1 got 0
I20260810 11:30:30.266790 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:30.267129 27334 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 127) took 2903 ms. Trace:
I20260810 11:30:30.268901 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:30.269734 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:30.270987 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:30.272100 27974 raft_consensus.cc:2258] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:30.272372 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
I20260810 11:30:30.274092 27334 rpcz_store.cc:276] 0810 11:30:27.351777 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.057467 (+2705690us) service_pool.cc:227] Handling call
0810 11:30:30.113359 (+ 55892us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:30.114414 (+ 1055us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:30.254978 (+140564us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:30.255237 (+ 259us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:30.255430 (+ 193us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:30.205612 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:30.206068 (+ 456us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:30.206075 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:30.206077 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:30.206260 (+ 183us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:30.206287 (+ 27us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:30.206294 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:30.206454 (+ 160us) tablet.cc:699] Row locks acquired
0810 11:30:30.206457 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:30.206634 (+ 177us) write_op.cc:270] Start()
0810 11:30:30.216436 (+ 9802us) write_op.cc:276] Timestamp: P: 1786361430206528 usec, L: 0
0810 11:30:30.216456 (+ 20us) op_driver.cc:331] REPLICATION: starting
0810 11:30:30.217028 (+ 572us) log.cc:842] Serialized 433 byte log entry
0810 11:30:30.232651 (+ 15623us) op_driver.cc:444] REPLICATION: finished
0810 11:30:30.232909 (+ 258us) write_op.cc:301] APPLY: starting
0810 11:30:30.232949 (+ 40us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:30.233175 (+ 226us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:30.233252 (+ 77us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:30.253649 (+ 20397us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:30.253713 (+ 64us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:30.253733 (+ 20us) write_op.cc:312] APPLY: finished
0810 11:30:30.253878 (+ 145us) log.cc:842] Serialized 29 byte log entry
0810 11:30:30.254115 (+ 237us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.254147 (+ 32us) write_op.cc:454] Released schema lock
0810 11:30:30.254170 (+ 23us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:30.254279 (+ 109us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.254284 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":126,"apply.run_cpu_time_us":1573,"apply.run_wall_time_us":21487,"num_ops":2,"prepare.queue_time_us":89485,"prepare.run_cpu_time_us":1842,"prepare.run_wall_time_us":12676,"raft.queue_time_us":5588,"raft.run_cpu_time_us":539,"raft.run_wall_time_us":10204,"replication_time_us":16125}]]}
I20260810 11:30:30.275878 27334 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_883ee52a6394446eb2ca688ec956d44b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:30.276702 28256 raft_consensus.cc:2726] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:30.278378 28029 raft_consensus.cc:2726] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 11:30:30.279484 27334 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_883ee52a6394446eb2ca688ec956d44b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:30.282052 26823 heartbeater.cc:464] Registering TS with master...
I20260810 11:30:30.284214 28267 raft_consensus.cc:2726] T 750950c424184d08bf6777774db3a0b2 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:30.285451 27974 ts_tablet_manager.cc:1905] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:30.289449 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:30.290218 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:30.291175 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]). Expected version 1 got 0
I20260810 11:30:30.293083 27228 ts_tablet_manager.cc:1428] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.140s user 0.000s sys 0.005s
I20260810 11:30:30.293843 27222 tablet_bootstrap.cc:492] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:30.294776 27222 ts_tablet_manager.cc:1397] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.427s user 0.007s sys 0.032s
I20260810 11:30:30.292388 27318 catalog_manager.cc:5495] T cd3575197c464c7fb51f9592831959bb P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } }
I20260810 11:30:30.304790 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]). Expected version 1 got 0
I20260810 11:30:30.305418 27318 catalog_manager.cc:5495] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } }
I20260810 11:30:30.306181 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:30.306717 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]). Expected version 2 got 0
I20260810 11:30:30.307219 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:30.307479 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:30.307549 27336 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 125) took 2968 ms. Trace:
I20260810 11:30:30.308022 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:30.307714 27336 rpcz_store.cc:276] 0810 11:30:27.339411 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.881968 (+2542557us) service_pool.cc:227] Handling call
0810 11:30:29.932021 (+ 50053us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dc313 00007f55f09ce466 00007f55f09ce195 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:30.016722 (+ 84701us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:30.121744 (+105022us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:30.307121 (+185377us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:30.307336 (+ 215us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:30.307443 (+ 107us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:30.259366 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:30.259635 (+ 269us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:30.259657 (+ 22us) write_op.cc:435] Acquired schema lock
0810 11:30:30.259660 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:30.259811 (+ 151us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:30.259840 (+ 29us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:30.259846 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:30.267269 (+ 7423us) tablet.cc:699] Row locks acquired
0810 11:30:30.267272 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:30.267320 (+ 48us) write_op.cc:270] Start()
0810 11:30:30.267359 (+ 39us) write_op.cc:276] Timestamp: P: 1786361430267240 usec, L: 0
0810 11:30:30.267363 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:30.267615 (+ 252us) log.cc:842] Serialized 433 byte log entry
0810 11:30:30.305041 (+ 37426us) op_driver.cc:444] REPLICATION: finished
0810 11:30:30.305640 (+ 599us) write_op.cc:301] APPLY: starting
0810 11:30:30.305673 (+ 33us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:30.305813 (+ 140us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:30.305883 (+ 70us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:30.306069 (+ 186us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:30.306122 (+ 53us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:30.306128 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:30.306481 (+ 353us) log.cc:842] Serialized 29 byte log entry
0810 11:30:30.306611 (+ 130us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.306643 (+ 32us) write_op.cc:454] Released schema lock
0810 11:30:30.306652 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:30.306736 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.306743 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":112700800,"child_traces":[["op",{"apply.queue_time_us":323,"apply.run_cpu_time_us":1229,"apply.run_wall_time_us":1229,"num_ops":2,"prepare.queue_time_us":1523,"prepare.run_cpu_time_us":1126,"prepare.run_wall_time_us":8346,"replication_time_us":37618}]]}
I20260810 11:30:30.310292 27336 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152:
name: "default.Table_84fd493f2b9e4a46aa2035a43a9069a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:30.311326 27336 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84fd493f2b9e4a46aa2035a43a9069a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:30.311239 27222 raft_consensus.cc:348] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:30.311625 27222 raft_consensus.cc:374] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:30.313259 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 0938a2f3688246a2b46978eeb7d5d521 (table default.Table_e15e0bcf194a490495cfd17ad551958b [id=45a883ca6cbe441bb7fffa52c88f423d]) successfully deleted
I20260810 11:30:30.313832 27334 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 128) took 2820 ms. Trace:
I20260810 11:30:30.314949 27222 raft_consensus.cc:729] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:30.314154 27334 rpcz_store.cc:276] 0810 11:30:27.493214 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.275357 (+2782143us) service_pool.cc:227] Handling call
0810 11:30:30.279703 (+ 4346us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:30.280761 (+ 1058us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:30.313354 (+ 32593us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:30.313599 (+ 245us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:30.313745 (+ 146us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:30.282276 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:30.282461 (+ 185us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:30.282467 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:30.282470 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:30.282710 (+ 240us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:30.282723 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:30.282777 (+ 54us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:30.282965 (+ 188us) tablet.cc:699] Row locks acquired
0810 11:30:30.282968 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:30.283037 (+ 69us) write_op.cc:270] Start()
0810 11:30:30.283097 (+ 60us) write_op.cc:276] Timestamp: P: 1786361430282951 usec, L: 0
0810 11:30:30.283113 (+ 16us) op_driver.cc:331] REPLICATION: starting
0810 11:30:30.283453 (+ 340us) log.cc:842] Serialized 433 byte log entry
0810 11:30:30.307287 (+ 23834us) op_driver.cc:444] REPLICATION: finished
0810 11:30:30.307428 (+ 141us) write_op.cc:301] APPLY: starting
0810 11:30:30.307443 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:30.307522 (+ 79us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:30.307601 (+ 79us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:30.307859 (+ 258us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:30.307951 (+ 92us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:30.307978 (+ 27us) write_op.cc:312] APPLY: finished
0810 11:30:30.308171 (+ 193us) log.cc:842] Serialized 29 byte log entry
0810 11:30:30.308316 (+ 145us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.308369 (+ 53us) write_op.cc:454] Released schema lock
0810 11:30:30.308381 (+ 12us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:30.308478 (+ 97us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.308485 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":86,"apply.run_cpu_time_us":1122,"apply.run_wall_time_us":1116,"num_ops":2,"prepare.queue_time_us":636,"prepare.run_cpu_time_us":1376,"prepare.run_wall_time_us":1367,"replication_time_us":24129}]]}
I20260810 11:30:30.315442 27222 consensus_queue.cc:260] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:30.318034 27334 master_service.cc:946] ReplaceTablet: received request to replace tablet 02ff6a9bc02441ddb7f307d6b3df31bd from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:30.322243 27222 ts_tablet_manager.cc:1428] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.022s user 0.002s sys 0.003s
I20260810 11:30:30.326678 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 499be709844f4a2cbc88e55dd628f985 (DEFAULT_TABLE table=default.Table_711dc900ac3b45b8897cd1fbc2964dec [id=5e0aa4c382c24a7d9380bec9f8a50ad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.328889 27222 tablet_bootstrap.cc:492] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:30.332103 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 499be709844f4a2cbc88e55dd628f985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.336030 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8798892eb4604ee8ac9c95e64dbb14e9" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:30.338423 26993 leader_election.cc:341] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:30.339609 26914 raft_consensus.cc:3037] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:30.339564 27222 tablet_bootstrap.cc:654] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:30.348146 27974 ts_tablet_manager.cc:1918] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:30.348318 28018 ts_manager.cc:194] Registered new tserver with Master: 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:30.348549 27974 log.cc:1196] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/478c0c39658349c39e3afa1aa1653e82
I20260810 11:30:30.349385 27974 ts_tablet_manager.cc:1939] T 478c0c39658349c39e3afa1aa1653e82 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:30.351271 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 78) took 4204 ms. Trace:
I20260810 11:30:30.351532 27974 rpcz_store.cc:276] 0810 11:30:26.146550 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.147272 (+ 722us) service_pool.cc:227] Handling call
0810 11:30:30.153109 (+4005837us) ts_tablet_manager.cc:1145] Deleting tablet 478c0c39658349c39e3afa1aa1653e82
0810 11:30:30.153128 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:30.300681 (+147553us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:30.348002 (+ 47321us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:30.351095 (+ 3093us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":54019,"tablet-delete.queue_time_us":3856055}
W20260810 11:30:30.365767 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet bb0357271cfd46478867a3cc0660bcdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb0357271cfd46478867a3cc0660bcdc already in progress: creating tablet
I20260810 11:30:30.365768 27999 ts_tablet_manager.cc:1918] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:30.366546 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 214be3356fda4c8484596196c0985721 (DEFAULT_TABLE table=default.Table_5a4c04e087c3490fae87a17247850531 [id=323f239c11f84a69beaf74e68c0cf50a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.367725 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 214be3356fda4c8484596196c0985721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.308403 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]). Expected version 2 got 0
I20260810 11:30:30.368093 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 478c0c39658349c39e3afa1aa1653e82 (table default.Table_38150fc48b7148a8bc17eb85f039d7b3 [id=b54ba03677734f2da90a534a0f5ff58e]) successfully deleted
I20260810 11:30:30.368692 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:30.369127 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:30.369629 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:30.370744 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:30.371425 27222 tablet_bootstrap.cc:492] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:30.371722 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:30.373035 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 499be709844f4a2cbc88e55dd628f985 (DEFAULT_TABLE table=default.Table_711dc900ac3b45b8897cd1fbc2964dec [id=5e0aa4c382c24a7d9380bec9f8a50ad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.374173 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 499be709844f4a2cbc88e55dd628f985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.377960 27222 ts_tablet_manager.cc:1397] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.043s user 0.007s sys 0.002s
I20260810 11:30:30.378456 27228 tablet_bootstrap.cc:492] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:30.377436 26730 tablet_service.cc:1467] Processing CreateTablet for tablet 214be3356fda4c8484596196c0985721 (DEFAULT_TABLE table=default.Table_5a4c04e087c3490fae87a17247850531 [id=323f239c11f84a69beaf74e68c0cf50a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.380896 26730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 214be3356fda4c8484596196c0985721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.382664 27999 log.cc:1196] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/725d2e70e1d441b497d56a278e1de0ad
I20260810 11:30:30.384620 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 98) took 4039 ms. Trace:
I20260810 11:30:30.384961 27974 rpcz_store.cc:276] 0810 11:30:26.313196 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.313450 (+ 254us) service_pool.cc:227] Handling call
0810 11:30:30.352141 (+4038691us) ts_tablet_manager.cc:1145] Deleting tablet a18cb43b4dc04a1290a6bade7ac1f3cf
0810 11:30:30.352158 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:30.352444 (+ 286us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4026057}
I20260810 11:30:30.387327 27999 ts_tablet_manager.cc:1939] T 725d2e70e1d441b497d56a278e1de0ad P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:30.387705 27974 tablet_replica.cc:330] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:30.388006 27974 raft_consensus.cc:2229] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:30.390859 27222 raft_consensus.cc:348] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:30.391237 27222 raft_consensus.cc:374] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:30.391395 27222 raft_consensus.cc:729] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:30.391817 27222 consensus_queue.cc:260] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:30.393581 27222 ts_tablet_manager.cc:1428] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.015s user 0.003s sys 0.002s
I20260810 11:30:30.394568 27222 tablet_bootstrap.cc:492] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:30.402325 27974 raft_consensus.cc:2258] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:30.403954 27974 ts_tablet_manager.cc:1905] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:30.405259 27248 ts_tablet_manager.cc:1918] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:30.406443 27708 raft_consensus.cc:482] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:30.407051 27708 raft_consensus.cc:504] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:30.408921 27037 tablet_service.cc:1467] Processing CreateTablet for tablet 499be709844f4a2cbc88e55dd628f985 (DEFAULT_TABLE table=default.Table_711dc900ac3b45b8897cd1fbc2964dec [id=5e0aa4c382c24a7d9380bec9f8a50ad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.409899 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 499be709844f4a2cbc88e55dd628f985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.410888 27222 tablet_bootstrap.cc:654] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:30.412483 26993 leader_election.cc:302] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
W20260810 11:30:30.413342 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 100800us
W20260810 11:30:30.415637 26993 consensus_peers.cc:487] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 478c0c39658349c39e3afa1aa1653e82. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:30.416491 28206 raft_consensus.cc:2726] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:30.417021 28206 consensus_queue.cc:1035] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:30.422932 27974 ts_tablet_manager.cc:1918] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:30.423875 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 214be3356fda4c8484596196c0985721 (DEFAULT_TABLE table=default.Table_5a4c04e087c3490fae87a17247850531 [id=323f239c11f84a69beaf74e68c0cf50a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.423496 27974 log.cc:1196] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/6e829d4bffeb4289a54b4d3d7a53c44e
I20260810 11:30:30.425415 27111 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:30.427035 27866 raft_consensus.cc:482] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:30.427383 27866 raft_consensus.cc:504] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:30.430743 27866 leader_election.cc:288] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:30.435652 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 43) took 4889 ms. Trace:
W20260810 11:30:30.386039 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet a18cb43b4dc04a1290a6bade7ac1f3cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a18cb43b4dc04a1290a6bade7ac1f3cf already in progress: creating tablet
I20260810 11:30:30.444923 27911 consensus_queue.cc:1035] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
W20260810 11:30:30.445487 27290 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 59429.9us
I20260810 11:30:30.445778 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:30.446084 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:30.446348 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]). Expected version 2 got 0
I20260810 11:30:30.446751 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 2 got 0
I20260810 11:30:30.447520 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:30.447992 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:30.398537 27336 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 129) took 2904 ms. Trace:
I20260810 11:30:30.450224 27336 rpcz_store.cc:276] 0810 11:30:27.493381 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.309704 (+2816323us) service_pool.cc:227] Handling call
0810 11:30:30.311434 (+ 1730us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:30.318650 (+ 7216us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:30.397937 (+ 79287us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:30.398155 (+ 218us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:30.398293 (+ 138us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:30.368630 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:30.368768 (+ 138us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:30.368776 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:30.368780 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:30.368892 (+ 112us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:30.368907 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:30.368911 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:30.369007 (+ 96us) tablet.cc:699] Row locks acquired
0810 11:30:30.369009 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:30.369062 (+ 53us) write_op.cc:270] Start()
0810 11:30:30.369104 (+ 42us) write_op.cc:276] Timestamp: P: 1786361430368970 usec, L: 0
0810 11:30:30.369125 (+ 21us) op_driver.cc:331] REPLICATION: starting
0810 11:30:30.369356 (+ 231us) log.cc:842] Serialized 433 byte log entry
0810 11:30:30.394651 (+ 25295us) op_driver.cc:444] REPLICATION: finished
0810 11:30:30.396341 (+ 1690us) write_op.cc:301] APPLY: starting
0810 11:30:30.396384 (+ 43us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:30.396463 (+ 79us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:30.396505 (+ 42us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:30.396829 (+ 324us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:30.396909 (+ 80us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:30.396918 (+ 9us) write_op.cc:312] APPLY: finished
0810 11:30:30.397078 (+ 160us) log.cc:842] Serialized 29 byte log entry
0810 11:30:30.397511 (+ 433us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.397583 (+ 72us) write_op.cc:454] Released schema lock
0810 11:30:30.397600 (+ 17us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:30.397893 (+ 293us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.397904 (+ 11us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1567,"apply.run_cpu_time_us":1689,"apply.run_wall_time_us":1690,"num_ops":2,"prepare.queue_time_us":183,"prepare.run_cpu_time_us":820,"prepare.run_wall_time_us":868,"replication_time_us":25477}]]}
I20260810 11:30:30.459827 27974 ts_tablet_manager.cc:1939] T 6e829d4bffeb4289a54b4d3d7a53c44e P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:30.460143 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87f6835f0dc4ad4b3a23b297726100d" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:30.460816 26763 raft_consensus.cc:2454] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:30.461740 27708 leader_election.cc:288] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:30.461964 26993 leader_election.cc:302] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:30.464253 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 214be3356fda4c8484596196c0985721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.466094 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 1 got 0
I20260810 11:30:30.467716 27248 log.cc:1196] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/43e42cc642544f779bb79cee7479c4f4
I20260810 11:30:30.471642 27708 raft_consensus.cc:2781] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:30.478310 27708 raft_consensus.cc:482] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:30.478762 27708 raft_consensus.cc:3037] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:30.479530 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]). Expected version 1 got 0
I20260810 11:30:30.480406 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:30.481369 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:30.487890 27248 ts_tablet_manager.cc:1939] T 43e42cc642544f779bb79cee7479c4f4 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:30.487922 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:30.488864 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:30.493367 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:30.496987 27318 catalog_manager.cc:5495] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:30.506467 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 89) took 4308 ms. Trace:
I20260810 11:30:30.506873 27248 rpcz_store.cc:276] 0810 11:30:26.180775 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.182846 (+ 2071us) service_pool.cc:227] Handling call
0810 11:30:30.125926 (+3943080us) ts_tablet_manager.cc:1145] Deleting tablet 43e42cc642544f779bb79cee7479c4f4
0810 11:30:30.125947 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:30.181468 (+ 55521us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:30.346879 (+165411us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:30.488801 (+141922us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3935990}
I20260810 11:30:30.507880 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]). Expected version 1 got 0
I20260810 11:30:30.509302 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 43e42cc642544f779bb79cee7479c4f4 (table default.Table_38ce4003d8e84bec8c910d35efb2a64e [id=9a87e462e8834e0ab7d9a8ae87f06e09]) successfully deleted
I20260810 11:30:30.509436 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 1 got 0
I20260810 11:30:30.510089 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_e9f0bd7bcd1441cbbb1e927313ee6335 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 2 got 0
I20260810 11:30:30.515832 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:30.521974 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:30.524832 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]). Expected version 1 got 0
I20260810 11:30:30.529748 27318 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:30.558224 27718 raft_consensus.cc:482] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:30.558678 27718 raft_consensus.cc:504] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:30.561802 27718 leader_election.cc:288] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:30.564158 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 90) took 4345 ms. Trace:
I20260810 11:30:30.564484 27248 rpcz_store.cc:276] 0810 11:30:26.189129 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.189377 (+ 248us) service_pool.cc:227] Handling call
0810 11:30:30.507551 (+4318174us) ts_tablet_manager.cc:1145] Deleting tablet 0713f4f14a284050a7774a70ab974f30
0810 11:30:30.533241 (+ 25690us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:30.534647 (+ 1406us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4316763}
W20260810 11:30:30.565791 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 0713f4f14a284050a7774a70ab974f30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0713f4f14a284050a7774a70ab974f30 already in progress: creating tablet
I20260810 11:30:30.566781 27248 tablet_replica.cc:330] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:30.567605 27248 raft_consensus.cc:2229] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:30.569267 27248 raft_consensus.cc:2258] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:30.570720 27248 ts_tablet_manager.cc:1905] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:30.577760 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9394f9ca2c44de93354e23973cf902" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:30.579156 27334 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet 02ff6a9bc02441ddb7f307d6b3df31bd
W20260810 11:30:30.579525 26993 leader_election.cc:341] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:30.580446 27334 catalog_manager.cc:6565] ReplaceTablet: tablet 02ff6a9bc02441ddb7f307d6b3df31bd deleted and replaced by tablet aaef5a4d651e4bc2b0b76cf6f51b0751
I20260810 11:30:30.580762 27334 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:49152 (request call id 130) took 2944 ms. Trace:
I20260810 11:30:30.580958 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet 02ff6a9bc02441ddb7f307d6b3df31bd with delete_type TABLET_DATA_DELETED (replaced by tablet aaef5a4d651e4bc2b0b76cf6f51b0751) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:30.580940 27334 rpcz_store.cc:276] 0810 11:30:27.636465 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.317832 (+2681367us) service_pool.cc:227] Handling call
0810 11:30:30.580663 (+262831us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:30.561607 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:30.561897 (+ 290us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:30.561903 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:30.561915 (+ 12us) tablet.cc:660] Decoding operations
0810 11:30:30.562137 (+ 222us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:30.562154 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:30.562158 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:30.562270 (+ 112us) tablet.cc:699] Row locks acquired
0810 11:30:30.562275 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:30.562679 (+ 404us) write_op.cc:270] Start()
0810 11:30:30.562769 (+ 90us) write_op.cc:276] Timestamp: P: 1786361430562468 usec, L: 0
0810 11:30:30.562779 (+ 10us) op_driver.cc:331] REPLICATION: starting
0810 11:30:30.563156 (+ 377us) log.cc:842] Serialized 665 byte log entry
0810 11:30:30.570853 (+ 7697us) op_driver.cc:444] REPLICATION: finished
0810 11:30:30.571060 (+ 207us) write_op.cc:301] APPLY: starting
0810 11:30:30.571082 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:30.571142 (+ 60us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:30.571193 (+ 51us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:30.571341 (+ 148us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:30.571514 (+ 173us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:30.571521 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:30.571689 (+ 168us) log.cc:842] Serialized 29 byte log entry
0810 11:30:30.571800 (+ 111us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.571834 (+ 34us) write_op.cc:454] Released schema lock
0810 11:30:30.571842 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:30.571960 (+ 118us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.571964 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":104,"apply.run_cpu_time_us":1001,"apply.run_wall_time_us":1005,"num_ops":2,"prepare.queue_time_us":116,"prepare.run_cpu_time_us":1657,"prepare.run_wall_time_us":1657,"replication_time_us":8042}]]}
I20260810 11:30:30.584611 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 02ff6a9bc02441ddb7f307d6b3df31bd with delete_type TABLET_DATA_DELETED (replaced by tablet aaef5a4d651e4bc2b0b76cf6f51b0751) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:30.590430 27334 master_service.cc:946] ReplaceTablet: received request to replace tablet ee803ddf27594d2b9e19fe440fc269c7 from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:30.597038 27231 raft_consensus.cc:374] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:30.597595 27231 raft_consensus.cc:729] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:30.598340 27231 consensus_queue.cc:260] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:30.601892 27708 raft_consensus.cc:504] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:30.603544 27708 leader_election.cc:288] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:30.604849 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87f6835f0dc4ad4b3a23b297726100d" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:30.605459 26762 raft_consensus.cc:3037] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:30.614636 28260 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: acquiring CA information for follower catalog manager: success
I20260810 11:30:30.621542 27866 raft_consensus.cc:482] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:30.622347 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87f6835f0dc4ad4b3a23b297726100d" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:30.625749 26914 raft_consensus.cc:2454] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:30.627935 27866 raft_consensus.cc:504] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:30.629427 27866 leader_election.cc:288] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:30.634315 26762 raft_consensus.cc:2454] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:30.636128 26993 leader_election.cc:302] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:30.637728 27718 raft_consensus.cc:2781] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:30.638914 27718 raft_consensus.cc:686] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:30.643229 27718 consensus_queue.cc:237] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:30.658430 27999 rpcz_store.cc:276] 0810 11:30:25.500301 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.500774 (+ 473us) service_pool.cc:227] Handling call
0810 11:30:29.804469 (+4303695us) ts_tablet_manager.cc:1145] Deleting tablet 725d2e70e1d441b497d56a278e1de0ad
0810 11:30:29.804499 (+ 30us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:30.086077 (+281578us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:30.238895 (+152818us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:30.389385 (+150490us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4278581}
I20260810 11:30:30.679327 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 99) took 4361 ms. Trace:
I20260810 11:30:30.679629 27974 rpcz_store.cc:276] 0810 11:30:26.318051 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.318113 (+ 62us) service_pool.cc:227] Handling call
0810 11:30:30.387495 (+4069382us) ts_tablet_manager.cc:1145] Deleting tablet 6e829d4bffeb4289a54b4d3d7a53c44e
0810 11:30:30.387516 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:30.414900 (+ 27384us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:30.422525 (+ 7625us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:30.679222 (+256697us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10726,"tablet-delete.queue_time_us":4060078}
I20260810 11:30:30.680258 27974 tablet_replica.cc:330] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:30.684958 27974 raft_consensus.cc:2229] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:30.685551 27974 raft_consensus.cc:2258] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:30.687512 27974 ts_tablet_manager.cc:1905] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:30.681252 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 6e829d4bffeb4289a54b4d3d7a53c44e (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]) successfully deleted
I20260810 11:30:30.705904 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 44) took 5185 ms. Trace:
W20260810 11:30:30.663264 26848 leader_election.cc:341] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: fdbe21b4f124411988dd35a0b864f868
I20260810 11:30:30.699482 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet 02ff6a9bc02441ddb7f307d6b3df31bd with delete_type TABLET_DATA_DELETED (replaced by tablet aaef5a4d651e4bc2b0b76cf6f51b0751) from {username='slave'} at 127.0.0.1:50850
W20260810 11:30:30.707456 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 71579.2us
W20260810 11:30:30.708483 26991 leader_election.cc:341] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:30.724748 27334 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet ee803ddf27594d2b9e19fe440fc269c7
I20260810 11:30:30.726153 27334 catalog_manager.cc:6565] ReplaceTablet: tablet ee803ddf27594d2b9e19fe440fc269c7 deleted and replaced by tablet 82de53efa73447fe84e70dbb11a16a5f
I20260810 11:30:30.726420 27334 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:49152 (request call id 131) took 2838 ms. Trace:
I20260810 11:30:30.726640 27334 rpcz_store.cc:276] 0810 11:30:27.887815 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.582244 (+2694429us) service_pool.cc:227] Handling call
0810 11:30:30.726359 (+144115us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:30.710640 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:30.711319 (+ 679us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:30.711332 (+ 13us) write_op.cc:435] Acquired schema lock
0810 11:30:30.711337 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:30.711645 (+ 308us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:30.711668 (+ 23us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:30.711676 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:30.711792 (+ 116us) tablet.cc:699] Row locks acquired
0810 11:30:30.711795 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:30.711852 (+ 57us) write_op.cc:270] Start()
0810 11:30:30.711894 (+ 42us) write_op.cc:276] Timestamp: P: 1786361430711816 usec, L: 0
0810 11:30:30.711897 (+ 3us) op_driver.cc:331] REPLICATION: starting
0810 11:30:30.712149 (+ 252us) log.cc:842] Serialized 631 byte log entry
0810 11:30:30.721693 (+ 9544us) op_driver.cc:444] REPLICATION: finished
0810 11:30:30.721865 (+ 172us) write_op.cc:301] APPLY: starting
0810 11:30:30.721900 (+ 35us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:30.721953 (+ 53us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:30.721985 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:30.722107 (+ 122us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:30.722186 (+ 79us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:30.722192 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:30.722308 (+ 116us) log.cc:842] Serialized 29 byte log entry
0810 11:30:30.722384 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.722408 (+ 24us) write_op.cc:454] Released schema lock
0810 11:30:30.722415 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:30.722486 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.722491 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":105,"apply.run_cpu_time_us":699,"apply.run_wall_time_us":698,"num_ops":2,"prepare.queue_time_us":227,"prepare.run_cpu_time_us":1702,"prepare.run_wall_time_us":1705,"raft.queue_time_us":2584,"raft.run_cpu_time_us":1053,"raft.run_wall_time_us":1061,"replication_time_us":9760}]]}
I20260810 11:30:30.728039 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet ee803ddf27594d2b9e19fe440fc269c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 82de53efa73447fe84e70dbb11a16a5f) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:30.728123 27334 master_service.cc:946] ReplaceTablet: received request to replace tablet e276b0fa124d42dfb3fe750d245e44d8 from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:30.730566 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet ee803ddf27594d2b9e19fe440fc269c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 82de53efa73447fe84e70dbb11a16a5f) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:30.732306 28260 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 11:30:30.739008 26730 tablet_service.cc:1467] Processing CreateTablet for tablet ad85aa3d1ec54f0ea3a299e33292738a (DEFAULT_TABLE table=default.Table_e0aa1ad6dfda4ef2b7c441f45f74c0f7 [id=b27cf2b15cb64704b6f447284daadd55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.740840 26730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad85aa3d1ec54f0ea3a299e33292738a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.751096 27031 tablet_service.cc:1467] Processing CreateTablet for tablet ad85aa3d1ec54f0ea3a299e33292738a (DEFAULT_TABLE table=default.Table_e0aa1ad6dfda4ef2b7c441f45f74c0f7 [id=b27cf2b15cb64704b6f447284daadd55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.752034 27031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad85aa3d1ec54f0ea3a299e33292738a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.755363 27334 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet e276b0fa124d42dfb3fe750d245e44d8
I20260810 11:30:30.758282 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7acf847a1fd74ccc89b5bffe1bbb76f3) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:30.759788 27334 catalog_manager.cc:6565] ReplaceTablet: tablet e276b0fa124d42dfb3fe750d245e44d8 deleted and replaced by tablet 7acf847a1fd74ccc89b5bffe1bbb76f3
I20260810 11:30:30.760607 27334 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:49152 (request call id 132) took 2345 ms. Trace:
I20260810 11:30:30.760953 27334 rpcz_store.cc:276] 0810 11:30:28.415452 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.727965 (+2312513us) service_pool.cc:227] Handling call
0810 11:30:30.760395 (+ 32430us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:30.732117 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:30.732359 (+ 242us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:30.732379 (+ 20us) write_op.cc:435] Acquired schema lock
0810 11:30:30.732384 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:30.732638 (+ 254us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:30.732669 (+ 31us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:30.732689 (+ 20us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:30.732889 (+ 200us) tablet.cc:699] Row locks acquired
0810 11:30:30.732895 (+ 6us) write_op.cc:260] PREPARE: finished
0810 11:30:30.733001 (+ 106us) write_op.cc:270] Start()
0810 11:30:30.733086 (+ 85us) write_op.cc:276] Timestamp: P: 1786361430732952 usec, L: 0
0810 11:30:30.733094 (+ 8us) op_driver.cc:331] REPLICATION: starting
0810 11:30:30.733525 (+ 431us) log.cc:842] Serialized 631 byte log entry
0810 11:30:30.749301 (+ 15776us) op_driver.cc:444] REPLICATION: finished
0810 11:30:30.749709 (+ 408us) write_op.cc:301] APPLY: starting
0810 11:30:30.749732 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:30.749783 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:30.749845 (+ 62us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:30.749988 (+ 143us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:30.750071 (+ 83us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:30.750080 (+ 9us) write_op.cc:312] APPLY: finished
0810 11:30:30.750197 (+ 117us) log.cc:842] Serialized 29 byte log entry
0810 11:30:30.750292 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.750340 (+ 48us) write_op.cc:454] Released schema lock
0810 11:30:30.750353 (+ 13us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:30.750467 (+ 114us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.750472 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":185,"apply.run_cpu_time_us":860,"apply.run_wall_time_us":860,"num_ops":2,"prepare.queue_time_us":85,"prepare.run_cpu_time_us":1571,"prepare.run_wall_time_us":1580,"raft.queue_time_us":900,"raft.run_cpu_time_us":560,"raft.run_wall_time_us":561,"replication_time_us":16165}]]}
I20260810 11:30:30.764480 27334 master_service.cc:946] ReplaceTablet: received request to replace tablet 10e6c41db71a4146840f06c5b7412d9c from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:30.770351 27025 tablet_service.cc:1467] Processing CreateTablet for tablet dd04642dea1f47318871b4e078fd234c (DEFAULT_TABLE table=default.Table_dd41dff7d9584a46821b6a187e5c52a4 [id=1f1a6853eb434bc1988eeda6224a2ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.771272 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd04642dea1f47318871b4e078fd234c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.785264 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7acf847a1fd74ccc89b5bffe1bbb76f3) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:30.789211 26732 tablet_service.cc:1467] Processing CreateTablet for tablet 12d5aaa533ad4d719c480098da979fc7 (DEFAULT_TABLE table=default.Table_f8b086b05e6b4174a3494b211543a5c8 [id=0332305d764840cd9789d29ac4527fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.791822 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 0edef936026743a896d5a73c134a8bca (DEFAULT_TABLE table=default.Table_bcf64628ba2c463ba5acce6617ec4324 [id=d823bbbb98b14646a119632dc037ad03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.792898 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0edef936026743a896d5a73c134a8bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.796296 27033 tablet_service.cc:1467] Processing CreateTablet for tablet 960104be1fa345d0a495b5686503b96a (DEFAULT_TABLE table=default.Table_9c70c3590985497fbaae37e05c4db1e4 [id=03fe9b9970bd450e890e1cddf9b5a43b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.797272 27033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 960104be1fa345d0a495b5686503b96a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.797809 27031 tablet_service.cc:1467] Processing CreateTablet for tablet 12d5aaa533ad4d719c480098da979fc7 (DEFAULT_TABLE table=default.Table_f8b086b05e6b4174a3494b211543a5c8 [id=0332305d764840cd9789d29ac4527fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.802372 27031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12d5aaa533ad4d719c480098da979fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.819585 27039 tablet_service.cc:1467] Processing CreateTablet for tablet b121c13e9241468aa224e17093eb38f4 (DEFAULT_TABLE table=default.Table_2c7697ec19204b3d823f5684c30978e2 [id=9d480f65788b486db55bbbe48a0ad5eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.820382 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12d5aaa533ad4d719c480098da979fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.829260 27039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b121c13e9241468aa224e17093eb38f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.835112 27034 tablet_service.cc:1467] Processing CreateTablet for tablet 78633fbe048b4534ae3277ce6b7c4313 (DEFAULT_TABLE table=default.Table_6e9cd3888b17405bad2475ba3da34507 [id=ae57f634bfef4952bb4e0a170d67fbdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.836123 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78633fbe048b4534ae3277ce6b7c4313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.857860 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_e9f0bd7bcd1441cbbb1e927313ee6335 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 2 got 0
I20260810 11:30:30.858691 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 0edef936026743a896d5a73c134a8bca (DEFAULT_TABLE table=default.Table_bcf64628ba2c463ba5acce6617ec4324 [id=d823bbbb98b14646a119632dc037ad03]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:30.862102 26849 leader_election.cc:341] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: fdbe21b4f124411988dd35a0b864f868
I20260810 11:30:30.862381 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0edef936026743a896d5a73c134a8bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.862622 26849 leader_election.cc:302] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:30.863263 28256 raft_consensus.cc:2726] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:30.858968 26743 tablet_service.cc:1467] Processing CreateTablet for tablet dd04642dea1f47318871b4e078fd234c (DEFAULT_TABLE table=default.Table_dd41dff7d9584a46821b6a187e5c52a4 [id=1f1a6853eb434bc1988eeda6224a2ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.871133 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd04642dea1f47318871b4e078fd234c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.706262 27999 rpcz_store.cc:276] 0810 11:30:25.520501 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.521087 (+ 586us) service_pool.cc:227] Handling call
0810 11:30:30.705463 (+5184376us) ts_tablet_manager.cc:1145] Deleting tablet 8a1e2e624fff4692a22e29b293cd82d6
0810 11:30:30.705493 (+ 30us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:30.705821 (+ 328us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5082054}
I20260810 11:30:30.883337 26741 tablet_service.cc:1467] Processing CreateTablet for tablet 960104be1fa345d0a495b5686503b96a (DEFAULT_TABLE table=default.Table_9c70c3590985497fbaae37e05c4db1e4 [id=03fe9b9970bd450e890e1cddf9b5a43b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.888866 26741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 960104be1fa345d0a495b5686503b96a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.899808 27974 ts_tablet_manager.cc:1918] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:30.889387 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b6a3b1e37ac943e391d54640987136f8 (table default.Table_acbcb3a347b647a19e81cfcf5636677f [id=56dee621acfa4f73b3bd69fefa7cb7e1]). Expected version 1 got 0
I20260810 11:30:30.903441 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:30.904152 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
W20260810 11:30:30.904826 26765 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.553s user 0.034s sys 0.045s
I20260810 11:30:30.904974 27974 log.cc:1196] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/60d56e162b4b41e2867ac845e524aca4
W20260810 11:30:30.906724 26765 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.560s user 0.034s sys 0.045s
I20260810 11:30:30.911935 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:30.913108 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:30.913867 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:30.914991 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 78633fbe048b4534ae3277ce6b7c4313 (DEFAULT_TABLE table=default.Table_6e9cd3888b17405bad2475ba3da34507 [id=ae57f634bfef4952bb4e0a170d67fbdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.915774 26748 tablet_service.cc:1467] Processing CreateTablet for tablet b121c13e9241468aa224e17093eb38f4 (DEFAULT_TABLE table=default.Table_2c7697ec19204b3d823f5684c30978e2 [id=9d480f65788b486db55bbbe48a0ad5eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:30.916462 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78633fbe048b4534ae3277ce6b7c4313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.919677 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9394f9ca2c44de93354e23973cf902" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:30.922531 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:30.923062 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
I20260810 11:30:30.924517 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]). Expected version 1 got 0
I20260810 11:30:30.929456 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b121c13e9241468aa224e17093eb38f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:30.934981 27974 ts_tablet_manager.cc:1939] T 60d56e162b4b41e2867ac845e524aca4 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:30.937390 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]). Expected version 1 got 0
I20260810 11:30:30.939607 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:30.940378 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:30.941608 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:30.944536 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 101) took 4624 ms. Trace:
I20260810 11:30:30.944952 28290 raft_consensus.cc:482] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:30.945456 28290 raft_consensus.cc:504] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:30.946277 28206 raft_consensus.cc:482] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:30.947193 28290 leader_election.cc:288] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:30.944267 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:30.944974 27974 rpcz_store.cc:276] 0810 11:30:26.319788 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.319860 (+ 72us) service_pool.cc:227] Handling call
0810 11:30:30.680149 (+4360289us) ts_tablet_manager.cc:1145] Deleting tablet 60d56e162b4b41e2867ac845e524aca4
0810 11:30:30.680174 (+ 25us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:30.706336 (+ 26162us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:30.868378 (+162042us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:30.944379 (+ 76001us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4349482}
I20260810 11:30:30.950947 28206 raft_consensus.cc:504] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:30.952260 28206 leader_election.cc:288] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:30.954540 27231 ts_tablet_manager.cc:1428] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.704s user 0.002s sys 0.006s
I20260810 11:30:30.952898 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 60d56e162b4b41e2867ac845e524aca4 (table default.Table_4d9bc84fc41e4b87ac2f6432852e5d61 [id=9b708c86ff534253961e7c29909eb1bd]) successfully deleted
I20260810 11:30:30.958673 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:30.959885 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:30.960367 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:30.960729 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]). Expected version 2 got 0
W20260810 11:30:30.960749 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 164047us
I20260810 11:30:30.961207 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:30.961921 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]). Expected version 2 got 0
I20260810 11:30:30.961988 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 725d2e70e1d441b497d56a278e1de0ad (table default.Table_59ed990b31964d6080614081ee46a6de [id=6d8fc88a491140548a45c7fbb403bb36]) successfully deleted
I20260810 11:30:30.962550 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 2 got 0
I20260810 11:30:30.963294 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:30.964602 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:30.967525 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 1 got 0
W20260810 11:30:30.963615 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 8a1e2e624fff4692a22e29b293cd82d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a1e2e624fff4692a22e29b293cd82d6 already in progress: creating tablet
I20260810 11:30:30.969915 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:30.971140 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:30.971920 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]). Expected version 1 got 0
I20260810 11:30:30.973973 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a1e2e624fff4692a22e29b293cd82d6" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:30.979374 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:30.981556 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 1 got 0
I20260810 11:30:30.982713 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:30.984326 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]). Expected version 1 got 0
I20260810 11:30:30.985025 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:30.985437 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:30.986173 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:30.987154 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:30.987912 26763 raft_consensus.cc:2454] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:30.988903 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]). Expected version 1 got 0
I20260810 11:30:30.990638 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:30.991705 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:30.991750 26700 leader_election.cc:302] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:30.992422 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]). Expected version 2 got 0
I20260810 11:30:30.992635 26993 leader_election.cc:302] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:30.993566 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:30.994035 27708 raft_consensus.cc:2781] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:30.994277 27708 raft_consensus.cc:482] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:30.994617 27708 raft_consensus.cc:3037] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:30.994807 27326 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:30.999318 27334 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:49152 (request call id 133) took 2414 ms. Trace:
I20260810 11:30:30.999874 27334 rpcz_store.cc:276] 0810 11:30:28.585253 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.764188 (+2178935us) service_pool.cc:227] Handling call
0810 11:30:30.999087 (+234899us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:31.000833 27334 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49152:
table { table_name: "default.Table_e9f0bd7bcd1441cbbb1e927313ee6335" } new_table_name: "default.Table_f7a27d5218ae44a18c1de689474ef3c8" modify_external_catalogs: true
I20260810 11:30:31.000765 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3406dc345e3429fb4bce5a59643b686" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:30.996651 27231 ts_tablet_manager.cc:1460] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215: Tablet startup took 730ms
W20260810 11:30:31.002791 27231 ts_tablet_manager.cc:1462] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215: Trace:
0810 11:30:15.013461 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:15.013960 (+ 499us) service_pool.cc:227] Handling call
0810 11:30:15.014403 (+ 443us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:15.014422 (+ 19us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:15.091303 (+ 76881us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:15.500217 (+408914us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:15.500371 (+ 154us) inbound_call.cc:173] Queueing success response
0810 11:30:30.119115 (+14618744us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0810 11:30:30.224441 (+105326us) ts_tablet_manager.cc:1429] Starting tablet replica
0810 11:30:30.225039 (+ 598us) tablet_replica.cc:259] Starting instrumentation
0810 11:30:30.225798 (+ 759us) tablet_replica.cc:278] Starting consensus
Metrics: {"raft.queue_time_us":200,"raft.run_cpu_time_us":44,"raft.run_wall_time_us":44,"tablet-open.queue_time_us":14618735}
I20260810 11:30:31.009399 27231 tablet_bootstrap.cc:492] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:31.046416 27231 tablet_bootstrap.cc:654] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:31.051398 27222 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.538s user 0.083s sys 0.080s
W20260810 11:30:31.051783 27222 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.640s user 0.083s sys 0.081s
I20260810 11:30:30.985468 28290 consensus_queue.cc:1035] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.095s
W20260810 11:30:31.061218 26702 leader_election.cc:341] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:31.061616 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 56850.9us
I20260810 11:30:31.063232 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 100) took 4736 ms. Trace:
I20260810 11:30:31.063607 27974 rpcz_store.cc:276] 0810 11:30:26.319401 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.319497 (+ 96us) service_pool.cc:227] Handling call
0810 11:30:30.949332 (+4629835us) ts_tablet_manager.cc:1145] Deleting tablet 1aa4562a2247405187d9dbd1baa48f39
0810 11:30:30.961853 (+ 12521us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x618000004d18. stack: 00007f81b1fa466e 00007f81b1fa4430 00007f81b102b5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f81b1f9a0fd 00007f81b1f9b16e 00007f81c4eefcfd 00007f81c4e6d883 00007f81c110d6e6 00007f81c110ea37 00007f81c1141404 00007f81c1122870 00007f81c11225fd 00000000009edb7c
0810 11:30:31.053285 (+ 91432us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:31.055591 (+ 2306us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12076416,"tablet-delete.queue_time_us":4615672}
I20260810 11:30:31.065133 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 102) took 4736 ms. Trace:
I20260810 11:30:31.065335 27974 rpcz_store.cc:276] 0810 11:30:26.328282 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.328349 (+ 67us) service_pool.cc:227] Handling call
0810 11:30:31.064477 (+4736128us) ts_tablet_manager.cc:1145] Deleting tablet 0118ff9d21924aefa8c6c32977c10453
0810 11:30:31.064519 (+ 42us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:31.064853 (+ 334us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4729707}
I20260810 11:30:31.066175 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 103) took 4732 ms. Trace:
I20260810 11:30:31.066665 27974 rpcz_store.cc:276] 0810 11:30:26.340792 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.340849 (+ 57us) service_pool.cc:227] Handling call
0810 11:30:31.065871 (+4725022us) ts_tablet_manager.cc:1145] Deleting tablet 43e42cc642544f779bb79cee7479c4f4
0810 11:30:31.065886 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:31.066065 (+ 179us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4724328}
W20260810 11:30:31.068184 26889 consensus_meta.cc:287] T 713663be70014b17b17056a865e7db63 P b6079090b1124d84aa4477974bb53700: Time spent flushing consensus metadata: real 0.695s user 0.006s sys 0.001s
W20260810 11:30:31.069065 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 1aa4562a2247405187d9dbd1baa48f39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1aa4562a2247405187d9dbd1baa48f39 already in progress: creating tablet
W20260810 11:30:31.069470 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 0118ff9d21924aefa8c6c32977c10453 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0118ff9d21924aefa8c6c32977c10453 already in progress: creating tablet
W20260810 11:30:31.069694 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 43e42cc642544f779bb79cee7479c4f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43e42cc642544f779bb79cee7479c4f4 already in progress: creating tablet
I20260810 11:30:31.074069 28267 raft_consensus.cc:2781] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:31.074360 28267 raft_consensus.cc:686] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:31.076505 28267 consensus_queue.cc:237] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:31.088768 28256 raft_consensus.cc:482] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:31.089238 28256 raft_consensus.cc:504] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:31.091353 28256 leader_election.cc:288] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:31.096550 27222 tablet_bootstrap.cc:492] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:31.097180 27222 ts_tablet_manager.cc:1397] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.703s user 0.087s sys 0.081s
W20260810 11:30:31.108551 27021 consensus_meta.cc:287] T 214be3356fda4c8484596196c0985721 P 482e605580be48cbbacce05a3e61c215: Time spent flushing consensus metadata: real 0.593s user 0.008s sys 0.000s
I20260810 11:30:31.080853 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87f6835f0dc4ad4b3a23b297726100d" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:31.163132 27228 tablet_bootstrap.cc:654] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:31.166994 28290 raft_consensus.cc:482] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6079090b1124d84aa4477974bb53700)
I20260810 11:30:31.167824 28290 raft_consensus.cc:504] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:31.173378 26889 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50850 (request call id 156) took 1047 ms. Trace:
I20260810 11:30:31.176632 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 45) took 5548 ms. Trace:
I20260810 11:30:31.179045 26889 rpcz_store.cc:276] 0810 11:30:30.096279 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.096481 (+ 202us) service_pool.cc:227] Handling call
0810 11:30:30.097672 (+ 1191us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:30.097702 (+ 30us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:30.174695 (+ 76993us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:31.068534 (+893839us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:31.143278 (+ 74744us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:31.179814 27999 rpcz_store.cc:276] 0810 11:30:25.601398 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.601539 (+ 141us) service_pool.cc:227] Handling call
0810 11:30:30.876642 (+5275103us) ts_tablet_manager.cc:1145] Deleting tablet 10210204d5ff4e5e97c98fd255f674a5
0810 11:30:31.142686 (+266044us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:31.149621 (+ 6935us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5245574}
I20260810 11:30:31.180689 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 46) took 5549 ms. Trace:
I20260810 11:30:31.180855 27999 rpcz_store.cc:276] 0810 11:30:25.631722 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.631850 (+ 128us) service_pool.cc:227] Handling call
0810 11:30:31.180355 (+5548505us) ts_tablet_manager.cc:1145] Deleting tablet 43fee1a9a6f9482fbbe6ab6599c27fb9
0810 11:30:31.180375 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:31.180650 (+ 275us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5525878}
I20260810 11:30:31.181464 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 47) took 5528 ms. Trace:
I20260810 11:30:31.181649 27999 rpcz_store.cc:276] 0810 11:30:25.653208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.653380 (+ 172us) service_pool.cc:227] Handling call
0810 11:30:31.181249 (+5527869us) ts_tablet_manager.cc:1145] Deleting tablet d000f0ebaf0049a7bdaad93e307e16e2
0810 11:30:31.181270 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:31.181422 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5511659}
I20260810 11:30:31.182265 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 48) took 5526 ms. Trace:
I20260810 11:30:31.182546 27999 rpcz_store.cc:276] 0810 11:30:25.656160 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.656219 (+ 59us) service_pool.cc:227] Handling call
0810 11:30:31.182060 (+5525841us) ts_tablet_manager.cc:1145] Deleting tablet 256ad2e2d8e54a4caa1b5091bab60dd5
0810 11:30:31.182071 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:31.182220 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5511324}
I20260810 11:30:31.183820 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 51) took 5340 ms. Trace:
I20260810 11:30:31.184294 27999 rpcz_store.cc:276] 0810 11:30:25.843046 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.843124 (+ 78us) service_pool.cc:227] Handling call
0810 11:30:31.183642 (+5340518us) ts_tablet_manager.cc:1145] Deleting tablet 2801709d53614916abac370f7ae5e913
0810 11:30:31.183657 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:31.183780 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5339973}
I20260810 11:30:31.185343 27222 raft_consensus.cc:348] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:31.185827 27222 raft_consensus.cc:374] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:31.186203 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 53) took 5211 ms. Trace:
I20260810 11:30:31.187165 27974 tablet_replica.cc:330] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:31.187911 27999 rpcz_store.cc:276] 0810 11:30:25.974302 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.974378 (+ 76us) service_pool.cc:227] Handling call
0810 11:30:31.185748 (+5211370us) ts_tablet_manager.cc:1145] Deleting tablet 3851d39aeb3142938a5ac558ab438c21
0810 11:30:31.185765 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:31.186155 (+ 390us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5210978}
I20260810 11:30:31.189051 27999 tablet_replica.cc:330] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:31.189715 27999 raft_consensus.cc:2229] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:31.190434 27222 raft_consensus.cc:729] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:31.190797 27999 raft_consensus.cc:2258] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:31.191339 27222 consensus_queue.cc:260] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:31.204871 27974 raft_consensus.cc:2229] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:31.208674 27222 ts_tablet_manager.cc:1428] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.095s user 0.004s sys 0.000s
I20260810 11:30:31.216759 28290 leader_election.cc:288] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:31.221400 27974 raft_consensus.cc:2258] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:31.222568 27974 ts_tablet_manager.cc:1905] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:31.232758 27222 tablet_bootstrap.cc:492] T 2126d95992e549b7b2b3e662b0d39a36 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:31.257481 26883 consensus_meta.cc:287] T 499be709844f4a2cbc88e55dd628f985 P b6079090b1124d84aa4477974bb53700: Time spent flushing consensus metadata: real 0.510s user 0.006s sys 0.003s
I20260810 11:30:31.265537 28311 raft_consensus.cc:482] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:31.248219 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a1e2e624fff4692a22e29b293cd82d6" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:31.279690 27999 ts_tablet_manager.cc:1905] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:31.295746 27222 tablet_bootstrap.cc:654] T 2126d95992e549b7b2b3e662b0d39a36 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:31.312742 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet ee803ddf27594d2b9e19fe440fc269c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 82de53efa73447fe84e70dbb11a16a5f) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:31.276274 28311 raft_consensus.cc:504] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:31.328087 27288 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 00d52e5c77d94854b8ba0b38c63ad015 consensus state has no leader
I20260810 11:30:31.332731 28316 raft_consensus.cc:482] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:31.334411 27222 tablet_bootstrap.cc:492] T 2126d95992e549b7b2b3e662b0d39a36 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:31.334962 27222 ts_tablet_manager.cc:1397] T 2126d95992e549b7b2b3e662b0d39a36 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.124s user 0.005s sys 0.005s
I20260810 11:30:31.333228 28316 raft_consensus.cc:504] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:31.338025 27222 raft_consensus.cc:348] T 2126d95992e549b7b2b3e662b0d39a36 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:31.338776 27222 raft_consensus.cc:374] T 2126d95992e549b7b2b3e662b0d39a36 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:31.338985 27222 raft_consensus.cc:729] T 2126d95992e549b7b2b3e662b0d39a36 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:31.340714 27222 consensus_queue.cc:260] T 2126d95992e549b7b2b3e662b0d39a36 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:31.341434 26883 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50850 (request call id 157) took 1065 ms. Trace:
I20260810 11:30:31.343796 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3406dc345e3429fb4bce5a59643b686" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:31.345054 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7acf847a1fd74ccc89b5bffe1bbb76f3) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:31.345777 26893 tablet_service.cc:1467] Processing CreateTablet for tablet dd04642dea1f47318871b4e078fd234c (DEFAULT_TABLE table=default.Table_dd41dff7d9584a46821b6a187e5c52a4 [id=1f1a6853eb434bc1988eeda6224a2ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:31.346083 26822 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:31.346757 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd04642dea1f47318871b4e078fd234c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:31.348727 26894 tablet_service.cc:1467] Processing CreateTablet for tablet ad85aa3d1ec54f0ea3a299e33292738a (DEFAULT_TABLE table=default.Table_e0aa1ad6dfda4ef2b7c441f45f74c0f7 [id=b27cf2b15cb64704b6f447284daadd55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:31.349675 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad85aa3d1ec54f0ea3a299e33292738a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:31.351493 27222 ts_tablet_manager.cc:1428] T 2126d95992e549b7b2b3e662b0d39a36 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.016s user 0.000s sys 0.006s
I20260810 11:30:31.364787 26964 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:31.366124 28290 raft_consensus.cc:482] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:31.366241 27222 tablet_bootstrap.cc:492] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:31.366930 28290 raft_consensus.cc:504] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:31.368284 28290 leader_election.cc:288] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:31.368686 28311 leader_election.cc:288] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:31.369041 28316 leader_election.cc:288] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:31.369240 26883 rpcz_store.cc:276] 0810 11:30:30.259658 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.260093 (+ 435us) service_pool.cc:227] Handling call
0810 11:30:30.327100 (+ 67007us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:30.327129 (+ 29us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:30.699922 (+372793us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:31.267798 (+567876us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:31.324551 (+ 56753us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:31.377384 27222 tablet_bootstrap.cc:654] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:31.377396 27228 tablet_bootstrap.cc:492] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:31.378259 28316 raft_consensus.cc:482] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:31.378507 27228 ts_tablet_manager.cc:1397] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 1.059s user 0.010s sys 0.007s
I20260810 11:30:31.383860 27974 ts_tablet_manager.cc:1918] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:31.397091 27974 log.cc:1196] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/1e0a8513171f4c39b74c08760a139d9e
I20260810 11:30:31.398623 28267 raft_consensus.cc:482] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6079090b1124d84aa4477974bb53700)
I20260810 11:30:31.398705 27974 ts_tablet_manager.cc:1939] T 1e0a8513171f4c39b74c08760a139d9e P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:31.399657 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 104) took 5047 ms. Trace:
I20260810 11:30:31.400020 27974 rpcz_store.cc:276] 0810 11:30:26.351940 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.352013 (+ 73us) service_pool.cc:227] Handling call
0810 11:30:31.085812 (+4733799us) ts_tablet_manager.cc:1145] Deleting tablet 1e0a8513171f4c39b74c08760a139d9e
0810 11:30:31.085847 (+ 35us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:31.311633 (+225786us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:31.366061 (+ 54428us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:31.399600 (+ 33539us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4733382}
I20260810 11:30:31.400907 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 1e0a8513171f4c39b74c08760a139d9e (table default.Table_aa6798d7140e47fd8b1709e531dbbd10 [id=c62015a698ae48959d405f34503f5fb9]) successfully deleted
I20260810 11:30:31.402091 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 105) took 5049 ms. Trace:
I20260810 11:30:31.402710 27974 rpcz_store.cc:276] 0810 11:30:26.352936 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.353166 (+ 230us) service_pool.cc:227] Handling call
0810 11:30:31.401305 (+5048139us) ts_tablet_manager.cc:1145] Deleting tablet 603fe104b7ab485eab6b225a58bddc1c
0810 11:30:31.401318 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:31.401932 (+ 614us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5047840}
W20260810 11:30:31.404001 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 603fe104b7ab485eab6b225a58bddc1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 603fe104b7ab485eab6b225a58bddc1c already in progress: creating tablet
I20260810 11:30:31.404891 27974 tablet_replica.cc:330] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:31.405579 27974 raft_consensus.cc:2229] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:31.406226 27974 pending_rounds.cc:62] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d: Trying to abort 1 pending ops.
I20260810 11:30:31.406625 27974 pending_rounds.cc:68] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936421696704512 op_type: NO_OP noop_request { }
I20260810 11:30:31.407049 27974 raft_consensus.cc:2866] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:31.379333 28316 raft_consensus.cc:504] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:31.415697 28316 leader_election.cc:288] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:31.408502 27974 raft_consensus.cc:2258] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:31.423782 26993 consensus_peers.cc:487] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:31.267722 27708 raft_consensus.cc:504] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:31.436911 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 247498us
I20260810 11:30:31.470413 27708 leader_election.cc:288] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:31.542737 28327 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 83cc8e39a3b9455f8242a6da6a54c38a)
I20260810 11:30:31.544353 28327 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:31.547864 27379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac259bcf213a4aa297d1d8e73b262361" candidate_term: 4 candidate_status { last_received { term: 3 index: 603 } } ignore_live_leader: false dest_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" is_pre_election: true
I20260810 11:30:31.548629 28327 leader_election.cc:288] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547)
I20260810 11:30:31.550099 28034 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac259bcf213a4aa297d1d8e73b262361" candidate_term: 4 candidate_status { last_received { term: 3 index: 603 } } ignore_live_leader: false dest_uuid: "c40c76e125b44de181b88b7f63a566f7" is_pre_election: true
I20260810 11:30:31.550722 28034 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac259bcf213a4aa297d1d8e73b262361 in term 3.
I20260810 11:30:31.551962 26564 leader_election.cc:302] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac259bcf213a4aa297d1d8e73b262361, c40c76e125b44de181b88b7f63a566f7; no voters: 83cc8e39a3b9455f8242a6da6a54c38a
I20260810 11:30:31.552963 28327 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260810 11:30:31.553153 28327 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 83cc8e39a3b9455f8242a6da6a54c38a)
I20260810 11:30:31.553287 28327 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 3 FOLLOWER]: Advancing to term 4
I20260810 11:30:31.563261 27708 consensus_queue.cc:1035] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260810 11:30:31.577379 26885 tablet_service.cc:1467] Processing CreateTablet for tablet 12d5aaa533ad4d719c480098da979fc7 (DEFAULT_TABLE table=default.Table_f8b086b05e6b4174a3494b211543a5c8 [id=0332305d764840cd9789d29ac4527fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:31.446182 27222 tablet_bootstrap.cc:492] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:31.589164 27222 ts_tablet_manager.cc:1397] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.237s user 0.006s sys 0.028s
I20260810 11:30:31.591351 27222 raft_consensus.cc:348] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:31.591982 27222 raft_consensus.cc:374] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:31.592183 27222 raft_consensus.cc:729] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:31.476939 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a1e2e624fff4692a22e29b293cd82d6" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:31.592839 26763 raft_consensus.cc:3037] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:31.490321 26702 leader_election.cc:341] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 9311943eebaa4824bde96b4cb09f1e2c
W20260810 11:30:31.596779 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 106606us
W20260810 11:30:31.597875 26702 leader_election.cc:341] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 70f6017d4d01463398cb347779dacf90
I20260810 11:30:31.604179 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12d5aaa533ad4d719c480098da979fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:31.604821 27222 consensus_queue.cc:260] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:31.612898 27222 ts_tablet_manager.cc:1428] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260810 11:30:31.617110 27222 tablet_bootstrap.cc:492] T bd6b328baa2346afbbe9f513ae4db3df P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:31.623083 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 960104be1fa345d0a495b5686503b96a (DEFAULT_TABLE table=default.Table_9c70c3590985497fbaae37e05c4db1e4 [id=03fe9b9970bd450e890e1cddf9b5a43b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:31.624368 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 960104be1fa345d0a495b5686503b96a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:31.615909 26763 raft_consensus.cc:2454] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:31.629586 26993 leader_election.cc:302] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:31.629554 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 0edef936026743a896d5a73c134a8bca (DEFAULT_TABLE table=default.Table_bcf64628ba2c463ba5acce6617ec4324 [id=d823bbbb98b14646a119632dc037ad03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:31.630648 28206 raft_consensus.cc:2781] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:31.631108 28206 raft_consensus.cc:686] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:31.631480 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0edef936026743a896d5a73c134a8bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:31.632351 28206 consensus_queue.cc:237] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:31.407593 28267 raft_consensus.cc:504] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:31.648033 27231 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.544s user 0.037s sys 0.128s
W20260810 11:30:31.648366 27231 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.548s user 0.037s sys 0.128s
I20260810 11:30:31.651624 27974 ts_tablet_manager.cc:1905] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:31.654789 26895 tablet_service.cc:1467] Processing CreateTablet for tablet b121c13e9241468aa224e17093eb38f4 (DEFAULT_TABLE table=default.Table_2c7697ec19204b3d823f5684c30978e2 [id=9d480f65788b486db55bbbe48a0ad5eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:31.656424 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 78633fbe048b4534ae3277ce6b7c4313 (DEFAULT_TABLE table=default.Table_6e9cd3888b17405bad2475ba3da34507 [id=ae57f634bfef4952bb4e0a170d67fbdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:31.657621 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2126d95992e549b7b2b3e662b0d39a36" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:31.657907 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 10210204d5ff4e5e97c98fd255f674a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10210204d5ff4e5e97c98fd255f674a5 already in progress: creating tablet
W20260810 11:30:31.659121 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 already in progress: creating tablet
W20260810 11:30:31.659826 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet d000f0ebaf0049a7bdaad93e307e16e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d000f0ebaf0049a7bdaad93e307e16e2 already in progress: creating tablet
W20260810 11:30:31.660777 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 256ad2e2d8e54a4caa1b5091bab60dd5 already in progress: creating tablet
W20260810 11:30:31.661835 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 2801709d53614916abac370f7ae5e913 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2801709d53614916abac370f7ae5e913 already in progress: creating tablet
I20260810 11:30:31.663913 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b121c13e9241468aa224e17093eb38f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:31.668390 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78633fbe048b4534ae3277ce6b7c4313. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:31.671903 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 3851d39aeb3142938a5ac558ab438c21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3851d39aeb3142938a5ac558ab438c21 already in progress: creating tablet
I20260810 11:30:31.560338 28327 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:31.678983 26591 raft_consensus.cc:1226] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 4 FOLLOWER]: Rejecting Update request from peer 83cc8e39a3b9455f8242a6da6a54c38a for earlier term 3. Current term is 4. Ops: []
I20260810 11:30:31.682925 28330 consensus_queue.cc:1046] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 }, Status: INVALID_TERM, Last received: 3.603, Next index: 604, Last known committed idx: 603, Time since last communication: 0.001s
I20260810 11:30:31.684679 28330 raft_consensus.cc:3032] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 3 LEADER]: Stepping down as leader of term 3
I20260810 11:30:31.685180 28330 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 83cc8e39a3b9455f8242a6da6a54c38a, State: Running, Role: LEADER
I20260810 11:30:31.686203 28330 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 603, Committed index: 603, Last appended: 3.603, Last appended by leader: 603, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:31.689316 27379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac259bcf213a4aa297d1d8e73b262361" candidate_term: 4 candidate_status { last_received { term: 3 index: 603 } } ignore_live_leader: false dest_uuid: "83cc8e39a3b9455f8242a6da6a54c38a"
I20260810 11:30:31.695824 28330 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 3 FOLLOWER]: Advancing to term 4
I20260810 11:30:31.696933 28327 leader_election.cc:288] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 4 election: Requested vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547)
I20260810 11:30:31.701213 28034 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac259bcf213a4aa297d1d8e73b262361" candidate_term: 4 candidate_status { last_received { term: 3 index: 603 } } ignore_live_leader: false dest_uuid: "c40c76e125b44de181b88b7f63a566f7"
I20260810 11:30:31.702275 28034 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 3 FOLLOWER]: Advancing to term 4
I20260810 11:30:31.733453 28034 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac259bcf213a4aa297d1d8e73b262361 in term 4.
I20260810 11:30:31.734956 27231 tablet_bootstrap.cc:492] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:31.735510 27231 ts_tablet_manager.cc:1397] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.731s user 0.043s sys 0.135s
I20260810 11:30:31.750658 27379 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac259bcf213a4aa297d1d8e73b262361 in term 4.
I20260810 11:30:31.753908 26566 leader_election.cc:302] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83cc8e39a3b9455f8242a6da6a54c38a, ac259bcf213a4aa297d1d8e73b262361; no voters:
I20260810 11:30:31.755115 28327 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 4 FOLLOWER]: Leader election won for term 4
I20260810 11:30:31.764475 27708 raft_consensus.cc:482] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:31.767549 27231 raft_consensus.cc:348] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:31.768800 27231 raft_consensus.cc:374] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:31.770183 27231 raft_consensus.cc:729] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:31.770943 27231 consensus_queue.cc:260] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:31.772524 28033 raft_consensus.cc:1226] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 4 FOLLOWER]: Rejecting Update request from peer 83cc8e39a3b9455f8242a6da6a54c38a for earlier term 3. Current term is 4. Ops: []
I20260810 11:30:31.774573 26767 raft_consensus.cc:2454] T 2126d95992e549b7b2b3e662b0d39a36 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:31.778811 28326 raft_consensus.cc:482] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:31.779413 28326 raft_consensus.cc:504] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:31.782347 28326 leader_election.cc:288] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
I20260810 11:30:31.782213 26591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c40c76e125b44de181b88b7f63a566f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 603 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361" is_pre_election: true
I20260810 11:30:31.783552 27708 raft_consensus.cc:504] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:31.787184 27222 tablet_bootstrap.cc:654] T bd6b328baa2346afbbe9f513ae4db3df P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:31.791513 27377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c40c76e125b44de181b88b7f63a566f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 603 } } ignore_live_leader: false dest_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" is_pre_election: true
I20260810 11:30:31.792186 27377 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c40c76e125b44de181b88b7f63a566f7 in term 4.
I20260810 11:30:31.793898 27995 leader_election.cc:302] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83cc8e39a3b9455f8242a6da6a54c38a, c40c76e125b44de181b88b7f63a566f7; no voters:
I20260810 11:30:31.795825 28326 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260810 11:30:31.796392 28326 raft_consensus.cc:482] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:31.796775 28326 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 4 FOLLOWER]: Advancing to term 5
W20260810 11:30:31.799451 26849 leader_election.cc:341] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 7bd67ebf23694ae7b0ede6c5d1a06f88
I20260810 11:30:31.801124 27708 leader_election.cc:288] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:31.805563 26702 leader_election.cc:341] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 7dc4000f1dde46a3b881a9fa8e9a6e3e
I20260810 11:30:31.787254 28331 consensus_queue.cc:1035] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.073s
I20260810 11:30:31.806118 28267 leader_election.cc:288] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:31.809725 27231 ts_tablet_manager.cc:1428] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.068s user 0.006s sys 0.001s
I20260810 11:30:31.810314 27231 tablet_bootstrap.cc:492] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:31.815735 27231 tablet_bootstrap.cc:654] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:31.822337 27248 ts_tablet_manager.cc:1918] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:31.822573 27248 log.cc:1196] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/0118ff9d21924aefa8c6c32977c10453
I20260810 11:30:31.824676 26871 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:52546 (request call id 217) took 1984 ms. Trace:
I20260810 11:30:31.829547 27228 raft_consensus.cc:348] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:31.843320 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70f6017d4d01463398cb347779dacf90" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:31.843497 28326 raft_consensus.cc:504] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:31.844076 26762 raft_consensus.cc:2454] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:31.845268 27248 ts_tablet_manager.cc:1939] T 0118ff9d21924aefa8c6c32977c10453 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:31.859146 27228 raft_consensus.cc:374] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:31.860038 28327 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 4 LEADER]: Becoming Leader. State: Replica: ac259bcf213a4aa297d1d8e73b262361, State: Running, Role: LEADER
I20260810 11:30:31.861622 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 88) took 5681 ms. Trace:
I20260810 11:30:31.861740 28327 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 603, Committed index: 603, Last appended: 3.603, Last appended by leader: 603, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
W20260810 11:30:31.864876 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 63035.1us
I20260810 11:30:31.867944 27228 raft_consensus.cc:729] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:31.867914 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a1e2e624fff4692a22e29b293cd82d6" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:31.868468 27228 consensus_queue.cc:260] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
E20260810 11:30:31.875869 27574 catalog_manager.cc:816] Error processing pending assignments: Illegal state: error persisting updated tablet metadata: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.106s ago.
I20260810 11:30:31.876652 28341 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac259bcf213a4aa297d1d8e73b262361. Latest consensus state: current_term: 4 leader_uuid: "ac259bcf213a4aa297d1d8e73b262361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:31.879570 27228 ts_tablet_manager.cc:1428] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.453s user 0.004s sys 0.000s
I20260810 11:30:31.880410 26849 leader_election.cc:302] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:31.883426 26871 rpcz_store.cc:276] 0810 11:30:29.777650 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.777835 (+ 185us) service_pool.cc:227] Handling call
0810 11:30:31.762425 (+1984590us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:31.884979 27248 rpcz_store.cc:276] 0810 11:30:26.180119 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.183813 (+ 3694us) service_pool.cc:227] Handling call
0810 11:30:30.566360 (+4382547us) ts_tablet_manager.cc:1145] Deleting tablet 0118ff9d21924aefa8c6c32977c10453
0810 11:30:30.566387 (+ 27us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:31.519588 (+953201us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:31.822096 (+302508us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:31.861478 (+ 39382us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4365845}
I20260810 11:30:31.886694 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 0118ff9d21924aefa8c6c32977c10453 (table default.Table_9f14d3d9ba454257a07c6eb8b0ead5e6 [id=737e0806636e4c8ca0307a46408cbdec]) successfully deleted
W20260810 11:30:31.887331 26849 leader_election.cc:341] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 66908164ff2a4ee5b55da6158699e0c6
W20260810 11:30:31.887657 26849 leader_election.cc:341] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 2917f1ffb5214a80b19810540602df35
I20260810 11:30:31.888200 26849 leader_election.cc:302] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:31.888705 27379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c40c76e125b44de181b88b7f63a566f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 603 } } ignore_live_leader: false dest_uuid: "83cc8e39a3b9455f8242a6da6a54c38a"
I20260810 11:30:31.889571 27379 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 4 FOLLOWER]: Advancing to term 5
I20260810 11:30:31.889662 28316 raft_consensus.cc:2781] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:31.889864 28316 raft_consensus.cc:482] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:31.890035 28316 raft_consensus.cc:3037] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:31.893998 26991 leader_election.cc:341] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:31.894382 27999 ts_tablet_manager.cc:1918] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:31.894459 26991 leader_election.cc:302] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:31.895476 27911 raft_consensus.cc:2726] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:31.895996 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2126d95992e549b7b2b3e662b0d39a36" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:31.898151 28326 leader_election.cc:288] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 5 election: Requested vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
W20260810 11:30:31.900548 26991 leader_election.cc:341] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:31.914759 27228 tablet_bootstrap.cc:492] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:31.899423 27248 tablet_replica.cc:330] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:31.919682 27248 raft_consensus.cc:2229] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:31.923836 27379 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c40c76e125b44de181b88b7f63a566f7 in term 5.
I20260810 11:30:31.929064 27248 raft_consensus.cc:2258] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:31.930377 27248 ts_tablet_manager.cc:1905] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:31.898252 26591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c40c76e125b44de181b88b7f63a566f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 603 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361"
I20260810 11:30:31.932111 27911 consensus_queue.cc:1035] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:31.933588 28341 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: This master's current role is: LEADER
I20260810 11:30:31.940199 27995 leader_election.cc:302] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83cc8e39a3b9455f8242a6da6a54c38a, c40c76e125b44de181b88b7f63a566f7; no voters: ac259bcf213a4aa297d1d8e73b262361
I20260810 11:30:31.941591 28326 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 5 FOLLOWER]: Leader election won for term 5
W20260810 11:30:31.941833 26993 leader_election.cc:341] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 7e3707ae32624f6483866208321eefde
I20260810 11:30:31.949074 27999 log.cc:1196] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/0938a2f3688246a2b46978eeb7d5d521
I20260810 11:30:31.956105 28346 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260810 11:30:31.957636 26894 consensus_meta.cc:287] T ad85aa3d1ec54f0ea3a299e33292738a P b6079090b1124d84aa4477974bb53700: Time spent flushing consensus metadata: real 0.564s user 0.010s sys 0.000s
I20260810 11:30:31.966657 27222 tablet_bootstrap.cc:492] T bd6b328baa2346afbbe9f513ae4db3df P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:31.967645 27222 ts_tablet_manager.cc:1397] T bd6b328baa2346afbbe9f513ae4db3df P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.351s user 0.010s sys 0.009s
I20260810 11:30:31.968976 27222 raft_consensus.cc:348] T bd6b328baa2346afbbe9f513ae4db3df P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:31.988082 27222 raft_consensus.cc:374] T bd6b328baa2346afbbe9f513ae4db3df P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:31.988698 27222 raft_consensus.cc:729] T bd6b328baa2346afbbe9f513ae4db3df P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
W20260810 11:30:31.989243 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 216137us
I20260810 11:30:31.989692 27222 consensus_queue.cc:260] T bd6b328baa2346afbbe9f513ae4db3df P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:31.990912 27222 ts_tablet_manager.cc:1428] T bd6b328baa2346afbbe9f513ae4db3df P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.023s user 0.004s sys 0.000s
I20260810 11:30:31.996089 27974 ts_tablet_manager.cc:1918] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260810 11:30:32.005740 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 117659us
I20260810 11:30:32.013705 28345 raft_consensus.cc:2781] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:32.014070 28345 raft_consensus.cc:482] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:32.016932 28345 raft_consensus.cc:3037] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:32.013166 28316 raft_consensus.cc:504] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.031968 27999 ts_tablet_manager.cc:1939] T 0938a2f3688246a2b46978eeb7d5d521 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:32.033751 27228 tablet_bootstrap.cc:654] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:32.041706 27248 ts_tablet_manager.cc:1918] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:32.042098 27248 log.cc:1196] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/5ca5c88585394dba87e201696afa6934
I20260810 11:30:32.031617 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70f6017d4d01463398cb347779dacf90" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:32.043149 27248 ts_tablet_manager.cc:1939] T 5ca5c88585394dba87e201696afa6934 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:32.049721 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_061b7dfbcc074ad6a0d99d49113a354f [id=0186ddbf3c144b4e86ae21cbdac555d2]
W20260810 11:30:32.060151 26991 leader_election.cc:341] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:32.061301 26383 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu pid 27747
I20260810 11:30:32.064407 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 84) took 5884 ms. Trace:
I20260810 11:30:32.064813 26870 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:52546 (request call id 218) took 1267 ms. Trace:
I20260810 11:30:32.064724 27248 rpcz_store.cc:276] 0810 11:30:26.179485 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.184048 (+ 4563us) service_pool.cc:227] Handling call
0810 11:30:31.899100 (+5715052us) ts_tablet_manager.cc:1145] Deleting tablet 5ca5c88585394dba87e201696afa6934
0810 11:30:31.899130 (+ 30us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:31.955843 (+ 56713us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:32.041421 (+ 85578us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:32.064233 (+ 22812us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5697001}
I20260810 11:30:32.065909 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 5ca5c88585394dba87e201696afa6934 (table default.Table_5895dc74894a4711bf78dd8b259cfc40 [id=696fdd9a822c4e40930fc333e3f3d725]) successfully deleted
I20260810 11:30:32.066835 28326 raft_consensus.cc:686] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 5 LEADER]: Becoming Leader. State: Replica: c40c76e125b44de181b88b7f63a566f7, State: Running, Role: LEADER
I20260810 11:30:32.068878 28326 consensus_queue.cc:237] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 603, Committed index: 603, Last appended: 3.603, Last appended by leader: 603, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:32.072918 27248 tablet_replica.cc:330] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:32.076655 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 56) took 6070 ms. Trace:
I20260810 11:30:32.076877 27999 rpcz_store.cc:276] 0810 11:30:25.974567 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.975004 (+ 437us) service_pool.cc:227] Handling call
0810 11:30:31.188861 (+5213857us) ts_tablet_manager.cc:1145] Deleting tablet 0938a2f3688246a2b46978eeb7d5d521
0810 11:30:31.188897 (+ 36us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:31.795610 (+606713us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:31.894223 (+ 98613us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:32.044923 (+150700us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5213628}
I20260810 11:30:32.077775 27999 tablet_replica.cc:330] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:32.078517 27248 raft_consensus.cc:2229] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:32.078490 27999 raft_consensus.cc:2229] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:32.079967 26870 rpcz_store.cc:276] 0810 11:30:30.797756 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.797884 (+ 128us) service_pool.cc:227] Handling call
0810 11:30:31.649216 (+851332us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x615000104124. stack: 00007f7f891ce66e 00007f7f891ce430 00007f7f882555ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f7f946d6630 00007f7f982aec7f 00007f7f92e1a016 00007f7f92e19d45 00007f7f8fd0a9be 00007f7f8fd0979e 00007f7f8fd0fb25 00007f7f8fd1054f 00007f7f8fd10378 00000000009edb7c
0810 11:30:32.064755 (+415539us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":376574848}
I20260810 11:30:32.081240 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f8b086b05e6b4174a3494b211543a5c8 [id=0332305d764840cd9789d29ac4527fee]
I20260810 11:30:32.084285 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_9c70c3590985497fbaae37e05c4db1e4 [id=03fe9b9970bd450e890e1cddf9b5a43b]
I20260810 11:30:32.086552 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]
I20260810 11:30:32.089298 27248 raft_consensus.cc:2258] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:32.091099 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 0938a2f3688246a2b46978eeb7d5d521 (table default.Table_e15e0bcf194a490495cfd17ad551958b [id=45a883ca6cbe441bb7fffa52c88f423d]) successfully deleted
I20260810 11:30:32.092258 28345 raft_consensus.cc:504] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.092969 26912 raft_consensus.cc:2379] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate b6079090b1124d84aa4477974bb53700 in this term.
I20260810 11:30:32.095031 28345 leader_election.cc:288] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:32.046391 27231 tablet_bootstrap.cc:492] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:32.097286 27248 ts_tablet_manager.cc:1905] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:32.098742 27231 ts_tablet_manager.cc:1397] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.289s user 0.019s sys 0.038s
I20260810 11:30:32.047231 28339 raft_consensus.cc:482] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:32.064224 27222 tablet_bootstrap.cc:492] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:32.101275 28339 raft_consensus.cc:504] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.102833 27999 raft_consensus.cc:2258] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:32.103768 28339 leader_election.cc:288] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:32.091673 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2126d95992e549b7b2b3e662b0d39a36" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:32.104543 26767 raft_consensus.cc:3037] T 2126d95992e549b7b2b3e662b0d39a36 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:32.107435 27222 tablet_bootstrap.cc:654] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:32.108433 27974 log.cc:1196] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/8798892eb4604ee8ac9c95e64dbb14e9
I20260810 11:30:32.114750 27999 ts_tablet_manager.cc:1905] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:32.108762 28316 leader_election.cc:288] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:32.117961 27974 ts_tablet_manager.cc:1939] T 8798892eb4604ee8ac9c95e64dbb14e9 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:32.121127 27231 raft_consensus.cc:348] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:32.112087 26702 leader_election.cc:341] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 43e42cc642544f779bb79cee7479c4f4
I20260810 11:30:32.118417 27222 tablet_bootstrap.cc:492] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
W20260810 11:30:32.109402 26700 leader_election.cc:341] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 9311943eebaa4824bde96b4cb09f1e2c
I20260810 11:30:32.123211 27222 ts_tablet_manager.cc:1397] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.059s user 0.009s sys 0.001s
I20260810 11:30:32.123478 26700 leader_election.cc:302] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:32.127431 28339 raft_consensus.cc:2726] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:32.119269 28347 sys_catalog.cc:455] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c40c76e125b44de181b88b7f63a566f7. Latest consensus state: current_term: 5 leader_uuid: "c40c76e125b44de181b88b7f63a566f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:32.129161 28347 sys_catalog.cc:458] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: This master's current role is: LEADER
W20260810 11:30:32.132863 26848 leader_election.cc:341] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 7bd67ebf23694ae7b0ede6c5d1a06f88
I20260810 11:30:32.133387 27231 raft_consensus.cc:374] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:32.126866 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 106) took 5773 ms. Trace:
I20260810 11:30:32.133744 27228 tablet_bootstrap.cc:492] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:32.134114 27228 ts_tablet_manager.cc:1397] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.219s user 0.005s sys 0.012s
I20260810 11:30:32.134960 28348 raft_consensus.cc:482] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:32.134075 27231 raft_consensus.cc:729] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:32.135399 28348 raft_consensus.cc:504] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:32.137928 28348 leader_election.cc:288] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:32.133744 26848 leader_election.cc:302] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:32.139569 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_6471724ce77d490abaf4ad26ff7ae126 [id=068f712315544485a6fae8452986a3fa]
I20260810 11:30:32.139676 28348 raft_consensus.cc:2726] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:32.141585 27228 raft_consensus.cc:348] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:32.142170 27228 raft_consensus.cc:374] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:32.142428 27228 raft_consensus.cc:729] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:32.143293 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_2d6c3a53213a458aaee6bd445240041c [id=097ff3abe81b415799933e50feab6c39]
I20260810 11:30:32.145097 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]
W20260810 11:30:32.146056 26848 leader_election.cc:341] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:32.147004 26848 leader_election.cc:341] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 70f6017d4d01463398cb347779dacf90
W20260810 11:30:32.147985 26848 leader_election.cc:341] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 2917f1ffb5214a80b19810540602df35
I20260810 11:30:32.151053 27228 consensus_queue.cc:260] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:32.153563 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_14f7e10124574ccdb41f7b14117603c6 [id=0cf740b2e59643899dac59acdf576fe2]
I20260810 11:30:32.154887 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_8589a61b5c4e42c0a92a80a3576db8ac [id=0d2a77edfa664f679468b8b3cac2d9ee]
I20260810 11:30:32.156142 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]
I20260810 11:30:32.157270 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_7c178d343d8246599a00f6d1c602a818 [id=0e39402016b54f588ea123ee4ea9788a]
I20260810 11:30:32.158317 28359 raft_consensus.cc:482] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:32.158775 28359 raft_consensus.cc:504] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:32.160411 26700 leader_election.cc:341] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:32.160820 26700 leader_election.cc:302] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:32.161702 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_7d84624ac4e94437acb400decf3bb21b [id=0f6c3eaa5abb4fc5a07a723ed77c2e35]
W20260810 11:30:32.161960 26991 leader_election.cc:341] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:32.125583 27222 raft_consensus.cc:348] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.169382 28339 raft_consensus.cc:2726] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:32.170614 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_ad3534a46309483687ef9dd9471f1008 [id=0f9e142b43214fa8b2e362c54fabcb42]
I20260810 11:30:32.170706 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43e42cc642544f779bb79cee7479c4f4" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:32.173218 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_99cbe48a0bd54425b588a46ae1132cad [id=0faf073b01654e38b8f6083f5012abd7]
I20260810 11:30:32.173396 28360 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 11:30:32.174940 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_c40dd8e327db40b59167de093a5c616d [id=10ebb746a2b343b08b5b13d1107a7cd8]
I20260810 11:30:32.175833 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_91c2ed7bba91469685ccb4e15fb5c174 [id=163ec39724a44b518f07abf5938fbcb7]
I20260810 11:30:32.176433 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_168dc06875d64f40830cac1440688bd0 [id=167c03593b73416ab0f9607c87937a60]
I20260810 11:30:32.177105 27228 ts_tablet_manager.cc:1428] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.043s user 0.000s sys 0.006s
I20260810 11:30:32.177371 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_341bf544f7b94ef2ba94afc342f8bc1f [id=193e8263e8a54ee798e1d4406074a52f]
I20260810 11:30:32.177675 27228 tablet_bootstrap.cc:492] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:32.178184 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_dc83172ee2e44eccab63bccfa35523fe [id=19ea42a81c4f471592628b27a3404c4b]
I20260810 11:30:32.179867 26848 leader_election.cc:302] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
W20260810 11:30:32.181437 26991 leader_election.cc:341] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 7e3707ae32624f6483866208321eefde
I20260810 11:30:32.181746 26991 leader_election.cc:302] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:32.182479 27222 raft_consensus.cc:374] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:32.189703 27974 rpcz_store.cc:276] 0810 11:30:26.353750 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.353997 (+ 247us) service_pool.cc:227] Handling call
0810 11:30:31.404747 (+5050750us) ts_tablet_manager.cc:1145] Deleting tablet 8798892eb4604ee8ac9c95e64dbb14e9
0810 11:30:31.404776 (+ 29us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:31.855996 (+451220us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:31.995266 (+139270us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:32.126785 (+131519us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5050387}
I20260810 11:30:32.190781 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 107) took 5836 ms. Trace:
I20260810 11:30:32.190860 28345 raft_consensus.cc:2726] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:32.191331 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 8798892eb4604ee8ac9c95e64dbb14e9 (table default.Table_0d77c6da3c8349c9ad3caa2147b81827 [id=24870bec311f44e4a3a3afa3599437be]) successfully deleted
I20260810 11:30:32.192843 27222 raft_consensus.cc:729] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:32.193290 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]
I20260810 11:30:32.193338 27222 consensus_queue.cc:260] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.193807 26759 raft_consensus.cc:3037] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:32.194458 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_dd41dff7d9584a46821b6a187e5c52a4 [id=1f1a6853eb434bc1988eeda6224a2ff7]
I20260810 11:30:32.195845 27974 rpcz_store.cc:276] 0810 11:30:26.353942 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.354423 (+ 481us) service_pool.cc:227] Handling call
0810 11:30:32.190460 (+5836037us) ts_tablet_manager.cc:1145] Deleting tablet d91a02b22044429fb3e25840c7947a02
0810 11:30:32.190491 (+ 31us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:32.190725 (+ 234us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5835646}
W20260810 11:30:32.196990 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet d91a02b22044429fb3e25840c7947a02 because the tablet was not found. No further retry: Not found: Tablet not found: d91a02b22044429fb3e25840c7947a02
I20260810 11:30:32.197575 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70f6017d4d01463398cb347779dacf90" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:32.198571 26762 raft_consensus.cc:3037] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:32.198787 27222 ts_tablet_manager.cc:1428] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.075s user 0.005s sys 0.001s
W20260810 11:30:32.200484 26700 leader_election.cc:341] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 7dc4000f1dde46a3b881a9fa8e9a6e3e
I20260810 11:30:32.200915 26700 leader_election.cc:302] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:32.201527 28331 raft_consensus.cc:2726] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:32.202620 26700 leader_election.cc:302] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:32.203853 26700 leader_election.cc:302] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:32.205022 26874 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:52546 (request call id 219) took 1135 ms. Trace:
I20260810 11:30:32.205350 26874 rpcz_store.cc:276] 0810 11:30:31.069439 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:31.077660 (+ 8221us) service_pool.cc:227] Handling call
0810 11:30:32.181357 (+1103697us) spinlock_profiling.cc:243] Waited 65.1 ms on lock 0x6150001859a4. stack: 00007f7f891ce66e 00007f7f891ce430 00007f7f882555ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f7f946d6630 00007f7f982aec7f 00007f7f92e1a016 00007f7f92e19d45 00007f7f8fd0a9be 00007f7f8fd0979e 00007f7f8fd0fb25 00007f7f8fd1054f 00007f7f8fd10378 00000000009edb7c
0810 11:30:32.204909 (+ 23552us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":149676544}
I20260810 11:30:32.210654 27222 tablet_bootstrap.cc:492] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:32.212713 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_fee5e058d63849c189e798c232542ad2 [id=2c6a659407bc4d8dad087cb73c16e229]
W20260810 11:30:32.213656 26849 leader_election.cc:341] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: b28f3dcbd6d74559b372d3452e13ce9f
I20260810 11:30:32.217012 27974 tablet_replica.cc:330] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:32.217572 27974 raft_consensus.cc:2229] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:32.217569 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_66b8d163284b4347b99dea499ed256fc [id=304e1529f45d4d3c8799a22009066ce5]
I20260810 11:30:32.218154 27974 raft_consensus.cc:2258] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:32.219276 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_e9f0bd7bcd1441cbbb1e927313ee6335 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 2 got 0
I20260810 11:30:32.218750 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_5d3880885d6342738dd22e168d08e660 [id=31e5d2935c2f44e4b272255fbd4c948a]
I20260810 11:30:32.220319 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:32.220741 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_5a4c04e087c3490fae87a17247850531 [id=323f239c11f84a69beaf74e68c0cf50a]
I20260810 11:30:32.221230 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:32.222203 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:32.223201 27231 consensus_queue.cc:260] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.223671 26762 raft_consensus.cc:2454] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:32.221905 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_e7f8305a313f47b0a219cb6a9cb15049 [id=329af78463204d2da90569d268b49eb3]
I20260810 11:30:32.225008 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_6f7ae1749f224614a4fdaa33b125864d [id=339298a1ea1747d59a035a6a3cadfb30]
I20260810 11:30:32.225363 28331 raft_consensus.cc:2726] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:32.225553 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:32.226325 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
W20260810 11:30:32.227771 26991 consensus_peers.cc:487] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:32.228658 27974 ts_tablet_manager.cc:1905] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:32.232082 27911 raft_consensus.cc:2726] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:32.233713 27231 ts_tablet_manager.cc:1428] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.129s user 0.005s sys 0.001s
I20260810 11:30:32.234556 27231 tablet_bootstrap.cc:492] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:32.239243 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
I20260810 11:30:32.238170 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_a406a8172095498abc9c54697f00f4a0 [id=34056ce268f8490c94a38351b43357a6]
I20260810 11:30:32.246519 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]
I20260810 11:30:32.252059 27231 tablet_bootstrap.cc:654] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:32.253479 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:32.255607 27222 tablet_bootstrap.cc:654] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:32.256449 26849 leader_election.cc:302] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:32.257263 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_3fd59f07e4ee4f54bce7829aec4cf4c4 [id=3719720e5ca241b1a500a1aaf7f310c4]
I20260810 11:30:32.257503 28345 raft_consensus.cc:2781] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:32.258028 28345 raft_consensus.cc:686] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:32.258692 28345 consensus_queue.cc:237] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.261797 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]). Expected version 2 got 0
I20260810 11:30:32.264477 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]
W20260810 11:30:32.271328 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 123309us
I20260810 11:30:32.271708 26767 raft_consensus.cc:2454] T 2126d95992e549b7b2b3e662b0d39a36 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
W20260810 11:30:32.272179 26848 leader_election.cc:341] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 66908164ff2a4ee5b55da6158699e0c6
I20260810 11:30:32.272760 26848 leader_election.cc:302] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:32.272887 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:32.273339 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:32.273964 28348 raft_consensus.cc:2726] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:32.274993 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_44f89aa654e84f22a77580060f057750 [id=3cadcafa2d524a5892f6c315c30881ae]
I20260810 11:30:32.275497 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]). Expected version 1 got 0
I20260810 11:30:32.276702 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:32.276510 28359 leader_election.cc:288] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:32.278262 26849 leader_election.cc:302] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:32.280447 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]). Expected version 1 got 0
I20260810 11:30:32.282923 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2126d95992e549b7b2b3e662b0d39a36" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:32.283645 27222 tablet_bootstrap.cc:492] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:32.285645 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:32.289283 28359 raft_consensus.cc:2781] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:32.289582 28359 raft_consensus.cc:686] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:32.289292 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_afde78ad5bfa4a23828df391f669e7fa [id=3d8c46d7a15e457a93fd615ad99a4f36]
I20260810 11:30:32.289985 28359 consensus_queue.cc:237] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.291580 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:32.294546 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:32.296137 27222 ts_tablet_manager.cc:1397] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.073s user 0.002s sys 0.007s
I20260810 11:30:32.297071 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9394f9ca2c44de93354e23973cf902" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:32.298810 26849 leader_election.cc:341] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:32.303056 27222 raft_consensus.cc:348] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.302911 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:32.312498 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_eecd0244ecc849339f452f38db67c973 [id=41d3dec833b54d1e855194862cb1726b]
I20260810 11:30:32.313253 28339 raft_consensus.cc:2726] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:32.307639 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:32.314289 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:32.315644 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_9eee8b010360415faceef1c43fea61d9 [id=41dfd71fd24040a392812bca04e2baf6]
I20260810 11:30:32.317837 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9394f9ca2c44de93354e23973cf902" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:32.318421 27059 raft_consensus.cc:2454] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:32.318490 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:32.319329 27911 raft_consensus.cc:482] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:32.319690 27911 raft_consensus.cc:504] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.320815 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]
I20260810 11:30:32.323391 27911 leader_election.cc:288] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:32.329277 27228 tablet_bootstrap.cc:654] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:32.330613 27231 tablet_bootstrap.cc:492] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:32.330847 27231 ts_tablet_manager.cc:1397] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.096s user 0.004s sys 0.004s
I20260810 11:30:32.332300 27231 raft_consensus.cc:348] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.333083 27231 raft_consensus.cc:374] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:32.333210 27231 raft_consensus.cc:729] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:32.333482 27231 consensus_queue.cc:260] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.341360 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]
I20260810 11:30:32.343808 27248 ts_tablet_manager.cc:1918] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:32.350095 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_21a675494284471eaf3ea50b31b833d7 [id=46a8ee2948c04311b0d3c1a5174d08dc]
I20260810 11:30:32.351256 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 2 got 0
I20260810 11:30:32.352962 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:32.353477 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]). Expected version 2 got 0
I20260810 11:30:32.354161 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:32.355299 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:32.356537 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_a48c8668e73f4919a9c32c9c3e95f485 [id=46bda36574e1430dbada751ccf16703c]
I20260810 11:30:32.358480 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:32.358816 27974 ts_tablet_manager.cc:1918] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:32.360693 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]
I20260810 11:30:32.339190 27231 ts_tablet_manager.cc:1428] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260810 11:30:32.361814 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 1 got 0
I20260810 11:30:32.362498 27231 tablet_bootstrap.cc:492] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:32.364952 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet b6a3b1e37ac943e391d54640987136f8 (table default.Table_acbcb3a347b647a19e81cfcf5636677f [id=56dee621acfa4f73b3bd69fefa7cb7e1]). Expected version 1 got 0
I20260810 11:30:32.370929 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:32.372071 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:32.372644 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]). Expected version 2 got 0
I20260810 11:30:32.373057 28360 catalog_manager.cc:669] Loaded metadata for table default.Table_061b7dfbcc074ad6a0d99d49113a354f [id=0186ddbf3c144b4e86ae21cbdac555d2]
I20260810 11:30:32.374162 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]
I20260810 11:30:32.374882 26873 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:52546 (request call id 221) took 1084 ms. Trace:
I20260810 11:30:32.376200 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:32.376693 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]
I20260810 11:30:32.381295 27248 log.cc:1196] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/478c0c39658349c39e3afa1aa1653e82
I20260810 11:30:32.388073 28360 catalog_manager.cc:669] Loaded metadata for table default.Table_f8b086b05e6b4174a3494b211543a5c8 [id=0332305d764840cd9789d29ac4527fee]
I20260810 11:30:32.388549 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f3f00d1fa4db4cd4bbaaeefeef68897d [id=4cda0e139cc34db8ae99e56a074f5557]
I20260810 11:30:32.389498 27248 ts_tablet_manager.cc:1939] T 478c0c39658349c39e3afa1aa1653e82 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:32.390213 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:32.390470 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_03a616a243fc4350b4a01d7f5bb86949 [id=4e2dc56dde3346a0917e58c6c7e921eb]
I20260810 11:30:32.391017 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 91) took 6191 ms. Trace:
I20260810 11:30:32.391283 27248 rpcz_store.cc:276] 0810 11:30:26.199204 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.199369 (+ 165us) service_pool.cc:227] Handling call
0810 11:30:32.072696 (+5873327us) ts_tablet_manager.cc:1145] Deleting tablet 478c0c39658349c39e3afa1aa1653e82
0810 11:30:32.072760 (+ 64us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:32.263921 (+191161us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:32.343327 (+ 79406us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:32.390951 (+ 47624us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5870398}
I20260810 11:30:32.391373 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a18cb43b4dc04a1290a6bade7ac1f3cf" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:32.391844 27248 tablet_replica.cc:330] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:32.391995 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 478c0c39658349c39e3afa1aa1653e82 (table default.Table_38150fc48b7148a8bc17eb85f039d7b3 [id=b54ba03677734f2da90a534a0f5ff58e]) successfully deleted
I20260810 11:30:32.392251 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 1 got 0
I20260810 11:30:32.392433 27248 raft_consensus.cc:2229] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:32.393213 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f55e75edcec14683a44d60250c42dbc7 [id=4f456ea1fbfe40dc8ed31415b77d4743]
I20260810 11:30:32.394057 27974 log.cc:1196] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/9311943eebaa4824bde96b4cb09f1e2c
I20260810 11:30:32.393967 27222 raft_consensus.cc:374] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:32.394294 27222 raft_consensus.cc:729] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:32.394367 26762 raft_consensus.cc:2454] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:32.396056 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_645b3efca425434da139268167fec99f [id=51dc04b8252b4142a7ac67c5fc0dd1ad]
I20260810 11:30:32.396325 27974 ts_tablet_manager.cc:1939] T 9311943eebaa4824bde96b4cb09f1e2c P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:32.397274 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:32.399438 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 108) took 6043 ms. Trace:
I20260810 11:30:32.399693 27974 rpcz_store.cc:276] 0810 11:30:26.355120 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.355273 (+ 153us) service_pool.cc:227] Handling call
0810 11:30:32.196405 (+5841132us) ts_tablet_manager.cc:1145] Deleting tablet 9311943eebaa4824bde96b4cb09f1e2c
0810 11:30:32.206683 (+ 10278us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:32.260229 (+ 53546us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:32.358512 (+ 98283us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:32.399033 (+ 40521us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5675,"tablet-delete.queue_time_us":5840796}
I20260810 11:30:32.400031 27231 tablet_bootstrap.cc:654] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:32.401413 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 9311943eebaa4824bde96b4cb09f1e2c (table default.Table_547fe3fa37ab46aab94789c556ec37d7 [id=7413e4ae5b8b4ccd904917ec2adbf8f3]) successfully deleted
I20260810 11:30:32.401823 26993 leader_election.cc:302] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:32.403612 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]). Expected version 1 got 0
I20260810 11:30:32.404946 28213 raft_consensus.cc:2781] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:32.405380 28213 raft_consensus.cc:482] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:32.405974 28213 raft_consensus.cc:3037] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:32.407991 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]
I20260810 11:30:32.409273 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]). Expected version 1 got 0
I20260810 11:30:32.410281 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:32.411604 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]
I20260810 11:30:32.412545 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
W20260810 11:30:32.414088 28362 log.cc:924] Time spent T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d: Append to log took a long time: real 0.087s user 0.000s sys 0.000s
I20260810 11:30:32.414449 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:32.414535 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 109) took 6058 ms. Trace:
I20260810 11:30:32.414606 28213 raft_consensus.cc:504] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.415009 27974 rpcz_store.cc:276] 0810 11:30:26.355887 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.355948 (+ 61us) service_pool.cc:227] Handling call
0810 11:30:32.400142 (+6044194us) ts_tablet_manager.cc:1145] Deleting tablet 809b5b6b65d244cd9186517e39494839
0810 11:30:32.400159 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:32.414348 (+ 14189us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6043924}
I20260810 11:30:32.416301 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_b7e6c83a5d5340b5b960f65b82d4939a [id=553f87ed39f148aba3be0a6fcd13e25d]
I20260810 11:30:32.417021 27222 consensus_queue.cc:260] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.419840 28072 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 11:30:32.419844 28213 leader_election.cc:288] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:32.419809 27222 ts_tablet_manager.cc:1428] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.123s user 0.000s sys 0.005s
W20260810 11:30:32.417228 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 809b5b6b65d244cd9186517e39494839 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 809b5b6b65d244cd9186517e39494839 already in progress: creating tablet
I20260810 11:30:32.427395 27379 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 5 FOLLOWER]: Rejecting Update request from peer ac259bcf213a4aa297d1d8e73b262361 for earlier term 4. Current term is 5. Ops: []
I20260810 11:30:32.427692 27321 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]). Expected version 1 got 0
I20260810 11:30:32.431367 28341 consensus_queue.cc:1046] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 604, Last known committed idx: 603, Time since last communication: 0.001s
I20260810 11:30:32.434360 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a18cb43b4dc04a1290a6bade7ac1f3cf" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:32.448498 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_acbcb3a347b647a19e81cfcf5636677f [id=56dee621acfa4f73b3bd69fefa7cb7e1]
I20260810 11:30:32.398869 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a18cb43b4dc04a1290a6bade7ac1f3cf" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:32.460958 26873 rpcz_store.cc:276] 0810 11:30:31.290619 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:31.290764 (+ 145us) service_pool.cc:227] Handling call
0810 11:30:31.317981 (+ 27217us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x618000004d18. stack: 00007f7f891ce66e 00007f7f891ce430 00007f7f882555ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f7f891c40fd 00007f7f891c4977 00007f7f9d572a7d 00007f7f9d572a0e 00007f7f9833e0cc 00007f7f9833e7bb 00007f7f982ae7f6 00007f7f92e1a016 00007f7f92e19d45 00007f7f8fd0a9be
0810 11:30:31.922139 (+604158us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x6150001e58a4. stack: 00007f7f891ce66e 00007f7f891ce430 00007f7f882555ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f7f946d6630 00007f7f982aec7f 00007f7f92e1a016 00007f7f92e19d45 00007f7f8fd0a9be 00007f7f8fd0979e 00007f7f8fd0fb25 00007f7f8fd1054f 00007f7f8fd10378 00000000009edb7c
0810 11:30:31.957363 (+ 35224us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x6150000a4224. stack: 00007f7f891ce66e 00007f7f891ce430 00007f7f882555ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f7f946d6630 00007f7f982aec7f 00007f7f92e1a016 00007f7f92e19d45 00007f7f8fd0a9be 00007f7f8fd0979e 00007f7f8fd0fb25 00007f7f8fd1054f 00007f7f8fd10378 00000000009edb7c
0810 11:30:32.252463 (+295100us) spinlock_profiling.cc:243] Waited 95 ms on lock 0x6150001859a4. stack: 00007f7f891ce66e 00007f7f891ce430 00007f7f882555ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f7f946d6630 00007f7f982aec7f 00007f7f92e1a016 00007f7f92e19d45 00007f7f8fd0a9be 00007f7f8fd0979e 00007f7f8fd0fb25 00007f7f8fd1054f 00007f7f8fd10378 00000000009edb7c
0810 11:30:32.374558 (+122095us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":235462400}
I20260810 11:30:32.465270 27248 raft_consensus.cc:2258] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:32.469928 27248 ts_tablet_manager.cc:1905] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:32.472391 27999 ts_tablet_manager.cc:1918] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:32.475643 27999 log.cc:1196] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/b7a3b877457c4a2489d397f3f864d6b2
W20260810 11:30:32.472981 26848 leader_election.cc:341] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:32.482443 27999 ts_tablet_manager.cc:1939] T b7a3b877457c4a2489d397f3f864d6b2 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
W20260810 11:30:32.483014 26848 leader_election.cc:341] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 70f6017d4d01463398cb347779dacf90
W20260810 11:30:32.484792 26848 leader_election.cc:341] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: b28f3dcbd6d74559b372d3452e13ce9f
I20260810 11:30:32.485492 26848 leader_election.cc:302] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:32.485723 28371 raft_consensus.cc:3032] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 4 LEADER]: Stepping down as leader of term 4
I20260810 11:30:32.486042 28371 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac259bcf213a4aa297d1d8e73b262361, State: Running, Role: LEADER
I20260810 11:30:32.486699 28359 raft_consensus.cc:2726] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:32.486423 26848 leader_election.cc:302] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:32.487124 28359 raft_consensus.cc:2781] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:32.487447 27228 tablet_bootstrap.cc:492] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:32.487541 28359 raft_consensus.cc:482] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:32.487775 28359 raft_consensus.cc:3037] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:32.487895 27228 ts_tablet_manager.cc:1397] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.310s user 0.002s sys 0.011s
I20260810 11:30:32.487581 28371 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 603, Committed index: 603, Last appended: 4.604, Last appended by leader: 604, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:32.490139 28371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 4 FOLLOWER]: Advancing to term 5
I20260810 11:30:32.491345 27228 raft_consensus.cc:348] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.491940 27228 raft_consensus.cc:374] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:32.492328 27228 raft_consensus.cc:729] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:32.492980 27228 consensus_queue.cc:260] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.498030 27228 ts_tablet_manager.cc:1428] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.010s user 0.003s sys 0.003s
I20260810 11:30:32.499279 27228 tablet_bootstrap.cc:492] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:32.503917 26762 raft_consensus.cc:3037] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:32.504833 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]
I20260810 11:30:32.507059 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_67580ad3fe7a47d6a051e7da7005c171 [id=5ae9efa77fb54cf58ff2a1662eee03f7]
I20260810 11:30:32.508085 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]
I20260810 11:30:32.510159 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_711dc900ac3b45b8897cd1fbc2964dec [id=5e0aa4c382c24a7d9380bec9f8a50ad7]
I20260810 11:30:32.511927 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_d4313ebe5ce04c1aa10d064712cbf3ab [id=5f6080c52e46443e9b4ba99dd4352b12]
I20260810 11:30:32.512612 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 110) took 6142 ms. Trace:
I20260810 11:30:32.512882 27974 rpcz_store.cc:276] 0810 11:30:26.356525 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.356603 (+ 78us) service_pool.cc:227] Handling call
0810 11:30:32.479027 (+6122424us) ts_tablet_manager.cc:1145] Deleting tablet f6e264e8507446809f3c386fdb3c34ae
0810 11:30:32.479050 (+ 23us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:32.498986 (+ 19936us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6121993}
I20260810 11:30:32.513660 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 111) took 6156 ms. Trace:
I20260810 11:30:32.513829 27974 rpcz_store.cc:276] 0810 11:30:26.357304 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.357365 (+ 61us) service_pool.cc:227] Handling call
0810 11:30:32.513398 (+6156033us) ts_tablet_manager.cc:1145] Deleting tablet 5adcec593b8c4d40997c8911e9f77c85
0810 11:30:32.513421 (+ 23us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:32.513583 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6155778}
I20260810 11:30:32.514379 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 112) took 6156 ms. Trace:
I20260810 11:30:32.514475 26762 raft_consensus.cc:2454] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:32.515133 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_e91c3002bfab499aad3c1d686b4f4437 [id=5f8a0b38bb0d428c8bf6253bfbf40650]
I20260810 11:30:32.514560 27974 rpcz_store.cc:276] 0810 11:30:26.357873 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.357931 (+ 58us) service_pool.cc:227] Handling call
0810 11:30:32.514117 (+6156186us) ts_tablet_manager.cc:1145] Deleting tablet 49db12565dbc4187b78a98ed35c40fed
0810 11:30:32.514129 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:32.514293 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6155892}
W20260810 11:30:32.515554 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet f6e264e8507446809f3c386fdb3c34ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6e264e8507446809f3c386fdb3c34ae already in progress: creating tablet
I20260810 11:30:32.515638 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f33a13096a144e538af2795c149abdcd [id=60ce1267de814f218c27ac084a08a26a]
I20260810 11:30:32.515846 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 113) took 6157 ms. Trace:
I20260810 11:30:32.515987 27974 rpcz_store.cc:276] 0810 11:30:26.358591 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.358642 (+ 51us) service_pool.cc:227] Handling call
0810 11:30:32.515519 (+6156877us) ts_tablet_manager.cc:1145] Deleting tablet 5ca5c88585394dba87e201696afa6934
0810 11:30:32.515538 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:32.515730 (+ 192us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6156585}
W20260810 11:30:32.516002 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 5adcec593b8c4d40997c8911e9f77c85 because the tablet was not found. No further retry: Not found: Tablet not found: 5adcec593b8c4d40997c8911e9f77c85
I20260810 11:30:32.516208 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]
I20260810 11:30:32.516510 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 114) took 6157 ms. Trace:
I20260810 11:30:32.516747 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]
I20260810 11:30:32.516657 27974 rpcz_store.cc:276] 0810 11:30:26.359184 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.359237 (+ 53us) service_pool.cc:227] Handling call
0810 11:30:32.516316 (+6157079us) ts_tablet_manager.cc:1145] Deleting tablet ac4b1821ac30452cbe7a8f844d9b37e5
0810 11:30:32.516328 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:32.516446 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6156806}
I20260810 11:30:32.517227 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 115) took 6157 ms. Trace:
I20260810 11:30:32.517418 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_57b6151125a144fcb6230ee986bff7ee [id=62f404c62e4040fc801f70cafddf9d95]
I20260810 11:30:32.517405 27974 rpcz_store.cc:276] 0810 11:30:26.359760 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.359816 (+ 56us) service_pool.cc:227] Handling call
0810 11:30:32.516929 (+6157113us) ts_tablet_manager.cc:1145] Deleting tablet 110b5acc36bd4d6bba13735e5daec75f
0810 11:30:32.516944 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:32.517130 (+ 186us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6156839}
I20260810 11:30:32.519311 27228 tablet_bootstrap.cc:654] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:32.519869 27974 tablet_replica.cc:330] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:32.520380 27974 raft_consensus.cc:2229] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:32.521025 27974 raft_consensus.cc:2258] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:32.522367 27974 ts_tablet_manager.cc:1905] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:32.522514 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]
W20260810 11:30:32.522629 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 49db12565dbc4187b78a98ed35c40fed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49db12565dbc4187b78a98ed35c40fed already in progress: creating tablet
W20260810 11:30:32.523109 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 5ca5c88585394dba87e201696afa6934 because the tablet was not found. No further retry: Not found: Tablet not found: 5ca5c88585394dba87e201696afa6934
W20260810 11:30:32.523636 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ac4b1821ac30452cbe7a8f844d9b37e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac4b1821ac30452cbe7a8f844d9b37e5 already in progress: creating tablet
W20260810 11:30:32.524266 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 110b5acc36bd4d6bba13735e5daec75f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 110b5acc36bd4d6bba13735e5daec75f already in progress: creating tablet
I20260810 11:30:32.525938 26993 leader_election.cc:302] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:32.526835 28213 raft_consensus.cc:2781] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:32.528383 28213 raft_consensus.cc:686] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:32.529524 28213 consensus_queue.cc:237] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.530921 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_e9f0bd7bcd1441cbbb1e927313ee6335 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 2 got 0
I20260810 11:30:32.532013 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:32.532684 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:32.533300 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:32.534341 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:32.535279 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:32.536084 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:32.537436 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
I20260810 11:30:32.538844 27222 tablet_bootstrap.cc:492] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:32.539520 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]). Expected version 1 got 0
I20260810 11:30:32.541575 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]). Expected version 1 got 0
I20260810 11:30:32.543105 28359 raft_consensus.cc:504] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:32.543609 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:32.544495 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:32.546064 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:32.546473 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_10b2af8299224f5db4a63bd1fae61155 [id=6a421de2b28a46088fd0bad429a52bad]
I20260810 11:30:32.547322 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:32.548722 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:32.549892 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
W20260810 11:30:32.549896 26991 leader_election.cc:341] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:32.550781 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:32.551390 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]). Expected version 2 got 0
I20260810 11:30:32.552093 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:32.552407 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]). Expected version 2 got 0
I20260810 11:30:32.552862 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 2 got 0
I20260810 11:30:32.553457 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:32.553779 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:32.554314 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 1 got 0
I20260810 11:30:32.546478 28345 raft_consensus.cc:482] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:32.549005 26915 raft_consensus.cc:3037] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:32.555284 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:32.555174 28345 raft_consensus.cc:504] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.555541 28359 leader_election.cc:288] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:32.555785 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:32.556473 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]). Expected version 1 got 0
I20260810 11:30:32.556614 28345 leader_election.cc:288] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:32.557214 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:32.557601 27231 tablet_bootstrap.cc:492] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:32.558312 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 1 got 0
I20260810 11:30:32.559242 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:32.559945 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]). Expected version 1 got 0
I20260810 11:30:32.560372 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:32.560747 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:32.550081 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a18cb43b4dc04a1290a6bade7ac1f3cf" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:32.561360 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:32.562284 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9394f9ca2c44de93354e23973cf902" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
W20260810 11:30:32.562599 26849 leader_election.cc:341] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: eb51618d37ac488fa7e3d23e5f85ec36
W20260810 11:30:32.563242 26849 leader_election.cc:341] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:32.563536 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:32.569147 27708 raft_consensus.cc:482] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 11:30:32.569907 26991 consensus_peers.cc:487] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:32.570045 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]). Expected version 1 got 0
I20260810 11:30:32.570900 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:32.571360 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:32.554813 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 57) took 6580 ms. Trace:
I20260810 11:30:32.573282 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]). Expected version 2 got 0
I20260810 11:30:32.574061 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:32.573658 27999 rpcz_store.cc:276] 0810 11:30:25.974660 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.975230 (+ 570us) service_pool.cc:227] Handling call
0810 11:30:32.077583 (+6102353us) ts_tablet_manager.cc:1145] Deleting tablet b7a3b877457c4a2489d397f3f864d6b2
0810 11:30:32.077613 (+ 30us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:32.288433 (+210820us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:32.472017 (+183584us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:32.554678 (+ 82661us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22302,"tablet-delete.queue_time_us":6102139}
I20260810 11:30:32.575407 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet b7a3b877457c4a2489d397f3f864d6b2 (table default.Table_3449a59ebd4f47d58e6a93dee9ef6f73 [id=6a400e6303ea4b42a4fa36252c95a62b]) successfully deleted
I20260810 11:30:32.578141 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 58) took 6603 ms. Trace:
I20260810 11:30:32.578694 27336 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:32.580842 27362 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet c60baf810a544a4a90dccd2337a39043
I20260810 11:30:32.582010 27362 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49152 (request call id 120) took 5320 ms. Trace:
I20260810 11:30:32.583016 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet c60baf810a544a4a90dccd2337a39043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:32.583788 27222 tablet_bootstrap.cc:654] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:32.582230 27362 rpcz_store.cc:276] 0810 11:30:27.260920 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.354403 (+2093483us) service_pool.cc:227] Handling call
0810 11:30:29.355837 (+ 1434us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:29.356173 (+ 336us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:29.356293 (+ 120us) catalog_manager.cc:2761] Locking tablets
0810 11:30:29.614985 (+258692us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:29.901871 (+286886us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:29.902110 (+ 239us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:32.580374 (+2678264us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:32.581753 (+ 1379us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:29.658402 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:29.658518 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:29.658523 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:29.658525 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:29.658671 (+ 146us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:29.658679 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:29.658695 (+ 16us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:29.659005 (+ 310us) tablet.cc:699] Row locks acquired
0810 11:30:29.659020 (+ 15us) write_op.cc:260] PREPARE: finished
0810 11:30:29.659078 (+ 58us) write_op.cc:270] Start()
0810 11:30:29.659106 (+ 28us) write_op.cc:276] Timestamp: P: 1786361429659027 usec, L: 0
0810 11:30:29.659109 (+ 3us) op_driver.cc:331] REPLICATION: starting
0810 11:30:29.659283 (+ 174us) log.cc:842] Serialized 734 byte log entry
0810 11:30:29.894117 (+234834us) op_driver.cc:444] REPLICATION: finished
0810 11:30:29.895871 (+ 1754us) write_op.cc:301] APPLY: starting
0810 11:30:29.895901 (+ 30us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:29.895969 (+ 68us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:29.896045 (+ 76us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:29.896156 (+ 111us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:29.896247 (+ 91us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:29.896269 (+ 22us) write_op.cc:312] APPLY: finished
0810 11:30:29.896404 (+ 135us) log.cc:842] Serialized 29 byte log entry
0810 11:30:29.901361 (+ 4957us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.901459 (+ 98us) write_op.cc:454] Released schema lock
0810 11:30:29.901479 (+ 20us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:29.901616 (+ 137us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.901632 (+ 16us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":3456,"child_traces":[["op",{"apply.queue_time_us":1610,"apply.run_cpu_time_us":1105,"apply.run_wall_time_us":5882,"mutex_wait_us":38504,"num_ops":2,"prepare.queue_time_us":41709,"prepare.run_cpu_time_us":962,"prepare.run_wall_time_us":961,"replication_time_us":234912}]]}
I20260810 11:30:32.584779 27999 rpcz_store.cc:276] 0810 11:30:25.974743 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.975455 (+ 712us) service_pool.cc:227] Handling call
0810 11:30:32.577575 (+6602120us) ts_tablet_manager.cc:1145] Deleting tablet 49db12565dbc4187b78a98ed35c40fed
0810 11:30:32.577622 (+ 47us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:32.577977 (+ 355us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6601852}
W20260810 11:30:32.585258 27334 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8083fa130cd04dae9d61aeed977c1c63 consensus state has no leader
I20260810 11:30:32.585657 27334 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:49152 (request call id 134) took 3139 ms. Trace:
I20260810 11:30:32.586498 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]
I20260810 11:30:32.585935 27334 rpcz_store.cc:276] 0810 11:30:29.446733 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:31.000465 (+1553732us) service_pool.cc:227] Handling call
0810 11:30:31.001259 (+ 794us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:31.001710 (+ 451us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:31.002046 (+ 336us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:31.002147 (+ 101us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:31.033308 (+ 31161us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:31.033330 (+ 22us) write_op.cc:454] Released schema lock
0810 11:30:31.033461 (+ 131us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:32.585549 (+1552088us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:31.006803 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:31.007085 (+ 282us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:31.007095 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:31.007097 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:31.007531 (+ 434us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:31.007567 (+ 36us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:31.007575 (+ 8us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:31.008418 (+ 843us) tablet.cc:699] Row locks acquired
0810 11:30:31.008424 (+ 6us) write_op.cc:260] PREPARE: finished
0810 11:30:31.009237 (+ 813us) write_op.cc:270] Start()
0810 11:30:31.009401 (+ 164us) write_op.cc:276] Timestamp: P: 1786361431009171 usec, L: 0
0810 11:30:31.009408 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:31.010140 (+ 732us) log.cc:842] Serialized 405 byte log entry
0810 11:30:31.027545 (+ 17405us) op_driver.cc:444] REPLICATION: finished
0810 11:30:31.029363 (+ 1818us) write_op.cc:301] APPLY: starting
0810 11:30:31.029395 (+ 32us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:31.029479 (+ 84us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:31.029552 (+ 73us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:31.029646 (+ 94us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:31.029718 (+ 72us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:31.029736 (+ 18us) write_op.cc:312] APPLY: finished
0810 11:30:31.029899 (+ 163us) log.cc:842] Serialized 23 byte log entry
0810 11:30:31.030024 (+ 125us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:31.030070 (+ 46us) write_op.cc:454] Released schema lock
0810 11:30:31.030083 (+ 13us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1703,"apply.run_cpu_time_us":861,"apply.run_wall_time_us":861,"num_ops":1,"prepare.queue_time_us":3579,"prepare.run_cpu_time_us":3874,"prepare.run_wall_time_us":12542,"raft.queue_time_us":249,"raft.run_cpu_time_us":1957,"raft.run_wall_time_us":1957,"replication_time_us":18095}]]}
I20260810 11:30:32.587893 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_4eef50b9dbea413f91b6b6a35c997283 [id=6eb74fbbf5db4f2f8434c3c9a83188b7]
I20260810 11:30:32.588212 27322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: Sending DeleteTablet for 3 replicas of tablet b6395bce17ee40c2822669246ce7eb42
I20260810 11:30:32.596678 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet c60baf810a544a4a90dccd2337a39043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:50850
W20260810 11:30:32.594762 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 49db12565dbc4187b78a98ed35c40fed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49db12565dbc4187b78a98ed35c40fed already in progress: creating tablet
I20260810 11:30:32.601171 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet b6395bce17ee40c2822669246ce7eb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:32.601619 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet b6395bce17ee40c2822669246ce7eb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.602218 27322 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49152 (request call id 118) took 5436 ms. Trace:
I20260810 11:30:32.604259 27999 tablet_replica.cc:330] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:32.604822 27999 raft_consensus.cc:2229] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:32.605384 27999 raft_consensus.cc:2258] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:32.607125 27999 ts_tablet_manager.cc:1905] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:32.581620 28377 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:32.609355 28377 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:32.602638 27322 rpcz_store.cc:276] 0810 11:30:27.161793 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.299402 (+2137609us) service_pool.cc:227] Handling call
0810 11:30:29.313314 (+ 13912us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:29.313554 (+ 240us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:29.313689 (+ 135us) catalog_manager.cc:2761] Locking tablets
0810 11:30:29.614949 (+301260us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:29.904195 (+289246us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:29.904396 (+ 201us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:32.585364 (+2680968us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:32.598450 (+ 13086us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:29.662818 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:29.663027 (+ 209us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:29.663036 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:29.663042 (+ 6us) tablet.cc:660] Decoding operations
0810 11:30:29.663199 (+ 157us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:29.663217 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:29.663221 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:29.663440 (+ 219us) tablet.cc:699] Row locks acquired
0810 11:30:29.663442 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:29.663521 (+ 79us) write_op.cc:270] Start()
0810 11:30:29.663626 (+ 105us) write_op.cc:276] Timestamp: P: 1786361429663469 usec, L: 0
0810 11:30:29.663630 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:29.664019 (+ 389us) log.cc:842] Serialized 734 byte log entry
0810 11:30:29.902593 (+238574us) op_driver.cc:444] REPLICATION: finished
0810 11:30:29.902771 (+ 178us) write_op.cc:301] APPLY: starting
0810 11:30:29.902802 (+ 31us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:29.902874 (+ 72us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:29.902930 (+ 56us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:29.903074 (+ 144us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:29.903134 (+ 60us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:29.903143 (+ 9us) write_op.cc:312] APPLY: finished
0810 11:30:29.903324 (+ 181us) log.cc:842] Serialized 29 byte log entry
0810 11:30:29.903592 (+ 268us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.903633 (+ 41us) write_op.cc:454] Released schema lock
0810 11:30:29.903643 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:29.909267 (+ 5624us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.909277 (+ 10us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":305536,"child_traces":[["op",{"apply.queue_time_us":70,"apply.run_cpu_time_us":1183,"apply.run_wall_time_us":6651,"mutex_wait_us":42656,"num_ops":2,"prepare.queue_time_us":45968,"prepare.run_cpu_time_us":1339,"prepare.run_wall_time_us":4174,"replication_time_us":238911}]]}
W20260810 11:30:32.615695 27336 catalog_manager.cc:6033] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: An error occurred while updating sys-tables: Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER
W20260810 11:30:32.619336 27291 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet c62ae41d2dd74eedbe252c4de70fbe1e consensus state has no leader
W20260810 11:30:32.624581 27333 catalog_manager.cc:6033] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: An error occurred while updating sys-tables: Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER
I20260810 11:30:32.652318 27231 ts_tablet_manager.cc:1397] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.197s user 0.004s sys 0.013s
W20260810 11:30:32.661615 26991 leader_election.cc:341] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:32.670161 27333 catalog_manager.cc:6033] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: An error occurred while updating sys-tables: Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER
I20260810 11:30:32.670017 27708 raft_consensus.cc:504] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.673475 27708 leader_election.cc:288] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:32.673692 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet c60baf810a544a4a90dccd2337a39043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:33500
W20260810 11:30:32.674752 27319 catalog_manager.cc:6033] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: An error occurred while updating sys-tables: Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER
I20260810 11:30:32.674750 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9394f9ca2c44de93354e23973cf902" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:32.675099 27059 raft_consensus.cc:3037] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:32.676934 28339 raft_consensus.cc:482] T bd6b328baa2346afbbe9f513ae4db3df P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:32.677748 28339 raft_consensus.cc:504] T bd6b328baa2346afbbe9f513ae4db3df P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.682562 28339 leader_election.cc:288] T bd6b328baa2346afbbe9f513ae4db3df P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:32.682466 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd6b328baa2346afbbe9f513ae4db3df" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:32.683621 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet b6395bce17ee40c2822669246ce7eb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:32.687849 28339 raft_consensus.cc:482] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:32.688694 28339 raft_consensus.cc:504] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.689857 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3406dc345e3429fb4bce5a59643b686" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:32.690657 26762 raft_consensus.cc:2454] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
W20260810 11:30:32.672470 26991 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 81220.2us
I20260810 11:30:32.692704 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c595e0892634348b64418ae9dbbd4c2" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:32.693539 26915 raft_consensus.cc:2454] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:32.696432 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3406dc345e3429fb4bce5a59643b686" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:32.696609 26700 leader_election.cc:302] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:32.697489 28331 raft_consensus.cc:2781] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:32.697829 28331 raft_consensus.cc:482] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:32.698179 28331 raft_consensus.cc:3037] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:32.700927 26848 leader_election.cc:341] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: eb51618d37ac488fa7e3d23e5f85ec36
I20260810 11:30:32.701506 26848 leader_election.cc:302] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:32.700381 26993 leader_election.cc:302] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:32.702654 28345 raft_consensus.cc:2726] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 11:30:32.705170 27318 catalog_manager.cc:6033] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: An error occurred while updating sys-tables: Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER
I20260810 11:30:32.711237 28339 leader_election.cc:288] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:32.705227 27708 raft_consensus.cc:2781] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260810 11:30:32.710090 26991 leader_election.cc:341] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:32.718189 28342 raft_consensus.cc:482] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:32.718293 27228 tablet_bootstrap.cc:492] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:32.718827 28342 raft_consensus.cc:504] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.719198 27228 ts_tablet_manager.cc:1397] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.220s user 0.005s sys 0.005s
I20260810 11:30:32.723382 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 2801709d53614916abac370f7ae5e913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.725601 27231 raft_consensus.cc:348] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.726280 27708 raft_consensus.cc:482] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:32.729127 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.730297 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8798892eb4604ee8ac9c95e64dbb14e9" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:32.733476 27334 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:49152 (request call id 135) took 3267 ms. Trace:
I20260810 11:30:32.733704 27334 rpcz_store.cc:276] 0810 11:30:29.465890 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.731920 (+3266030us) service_pool.cc:227] Handling call
0810 11:30:32.733369 (+ 1449us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:32.734392 27334 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:49152 (request call id 136) took 3268 ms. Trace:
I20260810 11:30:32.734556 27334 rpcz_store.cc:276] 0810 11:30:29.466215 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.733960 (+3267745us) service_pool.cc:227] Handling call
0810 11:30:32.734311 (+ 351us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:32.735342 27334 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:49152 (request call id 137) took 3232 ms. Trace:
I20260810 11:30:32.735882 27334 rpcz_store.cc:276] 0810 11:30:29.503024 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.734789 (+3231765us) service_pool.cc:227] Handling call
0810 11:30:32.735273 (+ 484us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260810 11:30:32.736513 27122 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.25.195.254:41125)
I20260810 11:30:32.736769 28342 leader_election.cc:288] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:32.737673 27231 raft_consensus.cc:374] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:32.737876 27231 raft_consensus.cc:729] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:32.739166 27231 consensus_queue.cc:260] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.742379 27231 ts_tablet_manager.cc:1428] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.088s user 0.004s sys 0.001s
W20260810 11:30:32.743415 26993 leader_election.cc:341] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 8798892eb4604ee8ac9c95e64dbb14e9
I20260810 11:30:32.743781 26915 raft_consensus.cc:2379] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 482e605580be48cbbacce05a3e61c215 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:32.746078 27708 raft_consensus.cc:3037] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:32.734040 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet fc558690dce44e999e55e9bf1b6ca172 with delete_type TABLET_DATA_DELETED (replaced by tablet 0bb01711769f457aa0696bb59582166d) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.732612 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 3851d39aeb3142938a5ac558ab438c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.745743 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a1e2e624fff4692a22e29b293cd82d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.751194 27231 tablet_bootstrap.cc:492] T 4c595e0892634348b64418ae9dbbd4c2 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:32.751139 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 10210204d5ff4e5e97c98fd255f674a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.752101 26991 leader_election.cc:302] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:32.756613 27334 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 138) took 3233 ms. Trace:
I20260810 11:30:32.758071 27334 rpcz_store.cc:276] 0810 11:30:29.503266 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.736077 (+3232811us) service_pool.cc:227] Handling call
0810 11:30:32.736496 (+ 419us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:32.759871 27059 raft_consensus.cc:2454] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:32.764698 28331 raft_consensus.cc:504] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.759550 27248 ts_tablet_manager.cc:1918] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:32.767082 27248 log.cc:1196] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/31888ddeafe14738b818016a9c0a4ad3
W20260810 11:30:32.767373 27122 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.25.195.254:41125)
I20260810 11:30:32.765951 28213 raft_consensus.cc:3037] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:32.773149 26848 leader_election.cc:302] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:32.774350 28345 raft_consensus.cc:2781] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:32.774757 28331 leader_election.cc:288] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:32.775094 28345 raft_consensus.cc:686] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:32.775748 28345 consensus_queue.cc:237] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:32.776674 28342 raft_consensus.cc:482] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 443ec871f1ed4232b932ecfb0b18510d)
I20260810 11:30:32.777737 28342 raft_consensus.cc:504] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.779238 28342 leader_election.cc:288] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:32.779384 27322 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:49152 (request call id 140) took 3198 ms. Trace:
I20260810 11:30:32.778959 27334 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49152 (request call id 139) took 3239 ms. Trace:
I20260810 11:30:32.781808 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ada1df82eb44ecb9a6c615b5410e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:50850
W20260810 11:30:32.782457 26993 leader_election.cc:341] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 23d8ce485cb84495a6e964b6d5977f0d
I20260810 11:30:32.785773 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c595e0892634348b64418ae9dbbd4c2" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:32.786635 26915 raft_consensus.cc:3037] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:32.788224 26991 leader_election.cc:341] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 23d8ce485cb84495a6e964b6d5977f0d
I20260810 11:30:32.788483 27334 rpcz_store.cc:276] 0810 11:30:29.538469 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.768469 (+3230000us) service_pool.cc:227] Handling call
0810 11:30:32.778283 (+ 9814us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:32.790169 26991 leader_election.cc:302] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:32.789338 27322 rpcz_store.cc:276] 0810 11:30:29.576773 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.769770 (+3192997us) service_pool.cc:227] Handling call
0810 11:30:32.775113 (+ 5343us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1647360}
I20260810 11:30:32.791016 26762 raft_consensus.cc:3037] T bd6b328baa2346afbbe9f513ae4db3df P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:32.794623 27228 raft_consensus.cc:348] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:32.794971 27122 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.25.195.254:41125)
I20260810 11:30:32.797936 28342 raft_consensus.cc:2726] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 11:30:32.799705 27333 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet f756689d4c99489885a0cd59f84a6e8a consensus state has no leader
I20260810 11:30:32.810928 27228 raft_consensus.cc:374] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:32.811776 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 725d2e70e1d441b497d56a278e1de0ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.813118 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet b28f3dcbd6d74559b372d3452e13ce9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:32.815431 27248 ts_tablet_manager.cc:1939] T 31888ddeafe14738b818016a9c0a4ad3 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:32.817013 27708 raft_consensus.cc:504] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.821074 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 318d5b8453fe4c438d0fa32cb91c409e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.823184 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 9311943eebaa4824bde96b4cb09f1e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.824254 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 49db12565dbc4187b78a98ed35c40fed with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1e46f80f7f4e3a84638421892e6236) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.589390 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]
I20260810 11:30:32.809226 27334 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49152 (request call id 141) took 3221 ms. Trace:
I20260810 11:30:32.833678 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_56b4699099fd417496e71ccbed272638 [id=72829be151bc48dba287b32c7028caf7]
I20260810 11:30:32.835695 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aa16654b7f34f9baf856bf724cece8f with delete_type TABLET_DATA_DELETED (replaced by tablet 760aeada57464892ae3b9013a761c509) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.835841 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_9a25589f61c844cab9a7d2db84a7eba2 [id=744c7bf0857b476cabce9efa16d7d885]
I20260810 11:30:32.838972 27708 leader_election.cc:288] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:32.840953 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3406dc345e3429fb4bce5a59643b686" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:32.808862 27231 tablet_bootstrap.cc:654] T 4c595e0892634348b64418ae9dbbd4c2 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:32.843103 27228 raft_consensus.cc:729] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
W20260810 11:30:32.828255 27362 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.195:58893 (request call id 82) took 952 ms (client timeout 1000 ms). Trace:
I20260810 11:30:32.848869 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet a18cb43b4dc04a1290a6bade7ac1f3cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:33500
W20260810 11:30:32.833671 27321 catalog_manager.cc:6033] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: An error occurred while updating sys-tables: Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER
I20260810 11:30:32.834345 27334 rpcz_store.cc:276] 0810 11:30:29.588006 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.796836 (+3208830us) service_pool.cc:227] Handling call
0810 11:30:32.809068 (+ 12232us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:32.853211 27334 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49152 (request call id 142) took 3244 ms. Trace:
I20260810 11:30:32.841348 28377 leader_election.cc:288] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
W20260810 11:30:32.833964 27333 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet bd34a4de1b93402c8a4bce1215660e77 consensus state has no leader
I20260810 11:30:32.854377 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet 10210204d5ff4e5e97c98fd255f674a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:32.854653 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:33500
W20260810 11:30:32.854740 27333 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 consensus state has no leader
I20260810 11:30:32.854817 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a1e2e624fff4692a22e29b293cd82d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:33500
W20260810 11:30:32.854854 26991 leader_election.cc:341] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:32.853582 27334 rpcz_store.cc:276] 0810 11:30:29.608818 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.852587 (+3243769us) service_pool.cc:227] Handling call
0810 11:30:32.853124 (+ 537us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:32.857023 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c595e0892634348b64418ae9dbbd4c2" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:32.859375 27334 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 143) took 3196 ms. Trace:
I20260810 11:30:32.859727 27334 rpcz_store.cc:276] 0810 11:30:29.662644 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.856444 (+3193800us) service_pool.cc:227] Handling call
0810 11:30:32.858987 (+ 2543us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:32.863859 27111 heartbeater.cc:503] Master 127.25.195.254:41125 was elected leader, sending a full tablet report...
I20260810 11:30:32.863932 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c595e0892634348b64418ae9dbbd4c2" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:32.866011 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd6b328baa2346afbbe9f513ae4db3df" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:32.832484 27326 catalog_manager.cc:6033] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: An error occurred while updating sys-tables: Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER
I20260810 11:30:32.867420 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 92) took 6662 ms. Trace:
I20260810 11:30:32.867619 27248 rpcz_store.cc:276] 0810 11:30:26.201376 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.201515 (+ 139us) service_pool.cc:227] Handling call
0810 11:30:32.391718 (+6190203us) ts_tablet_manager.cc:1145] Deleting tablet 31888ddeafe14738b818016a9c0a4ad3
0810 11:30:32.391734 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:32.553628 (+161894us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:32.750444 (+196816us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:32.863515 (+113071us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6184837}
I20260810 11:30:32.867303 27334 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 144) took 2800 ms. Trace:
I20260810 11:30:32.868528 27248 tablet_replica.cc:330] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:32.868978 27248 raft_consensus.cc:2229] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:32.869630 27248 raft_consensus.cc:2258] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:32.870764 27334 rpcz_store.cc:276] 0810 11:30:30.065225 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.862125 (+2796900us) service_pool.cc:227] Handling call
0810 11:30:32.865260 (+ 3135us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:32.872068 27248 ts_tablet_manager.cc:1905] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:32.875749 26702 leader_election.cc:341] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:32.885689 27334 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 146) took 2776 ms. Trace:
I20260810 11:30:32.886622 28213 raft_consensus.cc:2726] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:32.888072 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 9311943eebaa4824bde96b4cb09f1e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:32.890375 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_1e1ca07e9c824349af23675b66b77321 [id=755202f095f04307a11ce87087df835c]
W20260810 11:30:32.889391 27336 catalog_manager.cc:6033] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: An error occurred while updating sys-tables: Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER
I20260810 11:30:32.887097 27322 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 145) took 2809 ms. Trace:
I20260810 11:30:32.891733 27322 rpcz_store.cc:276] 0810 11:30:30.065971 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.867664 (+2801693us) service_pool.cc:227] Handling call
0810 11:30:32.874877 (+ 7213us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260810 11:30:32.845067 27362 rpcz_store.cc:269] 0810 11:30:31.875791 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.584291 (+708500us) service_pool.cc:227] Handling call
0810 11:30:32.827926 (+243635us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:32.892688 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:32.893298 27228 consensus_queue.cc:260] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.894091 28287 raft_consensus.cc:482] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:32.894809 27228 ts_tablet_manager.cc:1428] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.175s user 0.008s sys 0.000s
I20260810 11:30:32.894373 28287 raft_consensus.cc:504] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.897328 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b15cc8669b549a2b4461dccd66a0c5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:32.899340 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e0a8513171f4c39b74c08760a139d9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:32.899416 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_84fd493f2b9e4a46aa2035a43a9069a1 [id=773fafc7914a45dabad64680fc3a4a27]
I20260810 11:30:32.900683 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_96d4976d4de649c4a98910a1b7fd1b59 [id=777f92ce815f4314898abce665fec1eb]
I20260810 11:30:32.901867 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]
I20260810 11:30:32.903482 28287 leader_election.cc:288] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:32.903523 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.904610 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 478c0c39658349c39e3afa1aa1653e82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:32.905246 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e829d4bffeb4289a54b4d3d7a53c44e with delete_type TABLET_DATA_DELETED (replaced by tablet 00d52e5c77d94854b8ba0b38c63ad015) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:32.905630 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 70f6017d4d01463398cb347779dacf90 with delete_type TABLET_DATA_DELETED (replaced by tablet 110b5acc36bd4d6bba13735e5daec75f) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:32.906281 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet a18cb43b4dc04a1290a6bade7ac1f3cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:32.844132 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.913144 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3406dc345e3429fb4bce5a59643b686" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:32.913714 26767 raft_consensus.cc:3037] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:32.915096 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0118ff9d21924aefa8c6c32977c10453" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:32.916790 27321 catalog_manager.cc:6033] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a: An error occurred while updating sys-tables: Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER
I20260810 11:30:32.918074 27334 rpcz_store.cc:276] 0810 11:30:30.109815 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.877411 (+2767596us) service_pool.cc:227] Handling call
0810 11:30:32.885590 (+ 8179us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:32.918804 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 5adcec593b8c4d40997c8911e9f77c85 with delete_type TABLET_DATA_DELETED (replaced by tablet 10e6c41db71a4146840f06c5b7412d9c) from {username='slave'} at 127.0.0.1:50850
W20260810 11:30:32.919608 26700 leader_election.cc:341] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:32.921886 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet b7a3b877457c4a2489d397f3f864d6b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:11 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.922268 27362 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 147) took 2643 ms. Trace:
I20260810 11:30:32.922511 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.922600 27362 rpcz_store.cc:276] 0810 11:30:30.265849 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.908738 (+2642889us) service_pool.cc:227] Handling call
0810 11:30:32.909318 (+ 580us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:32.922796 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ff4e19071fc435fbae4490799325e37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.923612 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d8ce485cb84495a6e964b6d5977f0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.924449 26915 raft_consensus.cc:2454] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:32.926002 28371 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:32.926132 26700 leader_election.cc:302] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:32.926705 27228 tablet_bootstrap.cc:492] T a18cb43b4dc04a1290a6bade7ac1f3cf P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:32.926474 28371 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:32.926085 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_0b6cd084cecf499e9091685515cb1a3b [id=7b4e4650915f4c16bef68adf43618b89]
I20260810 11:30:32.927915 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_fd64c13d7a514c7285b42e1c91a63cdf [id=7c8348b49b664bee8d8243efb2cdbb79]
I20260810 11:30:32.930445 28287 raft_consensus.cc:2781] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:32.930895 28287 raft_consensus.cc:686] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:32.930985 27231 tablet_bootstrap.cc:492] T 4c595e0892634348b64418ae9dbbd4c2 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:32.931669 27231 ts_tablet_manager.cc:1397] T 4c595e0892634348b64418ae9dbbd4c2 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.188s user 0.007s sys 0.007s
I20260810 11:30:32.931341 28287 consensus_queue.cc:237] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.931960 27228 tablet_bootstrap.cc:654] T a18cb43b4dc04a1290a6bade7ac1f3cf P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:32.933548 27379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac259bcf213a4aa297d1d8e73b262361" candidate_term: 6 candidate_status { last_received { term: 4 index: 604 } } ignore_live_leader: false dest_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" is_pre_election: true
I20260810 11:30:32.928431 28371 leader_election.cc:288] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547)
I20260810 11:30:32.935550 27231 raft_consensus.cc:348] T 4c595e0892634348b64418ae9dbbd4c2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.937242 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 60d56e162b4b41e2867ac845e524aca4 with delete_type TABLET_DATA_DELETED (replaced by tablet 10210204d5ff4e5e97c98fd255f674a5) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.938347 27379 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac259bcf213a4aa297d1d8e73b262361 in term 5.
I20260810 11:30:32.936400 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 0938a2f3688246a2b46978eeb7d5d521 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.939363 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 110b5acc36bd4d6bba13735e5daec75f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.939743 26566 leader_election.cc:302] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83cc8e39a3b9455f8242a6da6a54c38a, ac259bcf213a4aa297d1d8e73b262361; no voters:
I20260810 11:30:32.940855 28371 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260810 11:30:32.941291 28371 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:32.941514 28371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 5 FOLLOWER]: Advancing to term 6
I20260810 11:30:32.941010 27231 raft_consensus.cc:374] T 4c595e0892634348b64418ae9dbbd4c2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:32.946570 27231 raft_consensus.cc:729] T 4c595e0892634348b64418ae9dbbd4c2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:32.947269 27231 consensus_queue.cc:260] T 4c595e0892634348b64418ae9dbbd4c2 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.928642 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_09ff2cfcae6d4c1b96479fd190b3c084 [id=7d0dd215c30648438a460f730b0b7ba4]
I20260810 11:30:32.951066 28371 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:32.961341 27248 ts_tablet_manager.cc:1918] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:32.961896 27231 ts_tablet_manager.cc:1428] T 4c595e0892634348b64418ae9dbbd4c2 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.016s user 0.001s sys 0.005s
I20260810 11:30:32.962248 27248 log.cc:1196] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/4b15cc8669b549a2b4461dccd66a0c5a
I20260810 11:30:32.964967 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_ce10a5f4bedc411da7e7089a730e9cc8 [id=807b3a26a49f446797962bb532b4c58e]
I20260810 11:30:32.966014 27248 ts_tablet_manager.cc:1939] T 4b15cc8669b549a2b4461dccd66a0c5a P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:32.966432 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_23ac53b1a7794ddda0a697254fff0ede [id=80a1649fe2d74dd4bf5aa5e07a762de3]
I20260810 11:30:32.964025 27231 tablet_bootstrap.cc:492] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:32.975175 27231 tablet_bootstrap.cc:654] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:32.983659 28345 raft_consensus.cc:482] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:32.984444 28345 raft_consensus.cc:504] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:32.984355 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]
I20260810 11:30:32.989176 27322 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 149) took 2461 ms. Trace:
I20260810 11:30:32.989244 27379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ac259bcf213a4aa297d1d8e73b262361" candidate_term: 6 candidate_status { last_received { term: 4 index: 604 } } ignore_live_leader: false dest_uuid: "83cc8e39a3b9455f8242a6da6a54c38a"
I20260810 11:30:32.989737 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb0357271cfd46478867a3cc0660bcdc" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:32.989459 27322 rpcz_store.cc:276] 0810 11:30:30.515085 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.975655 (+2460570us) service_pool.cc:227] Handling call
0810 11:30:32.976215 (+ 560us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:32.990574 27379 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 5 FOLLOWER]: Advancing to term 6
W20260810 11:30:32.991699 26849 leader_election.cc:341] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:32.992587 27222 tablet_bootstrap.cc:492] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:32.993031 27222 ts_tablet_manager.cc:1397] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.518s user 0.003s sys 0.011s
I20260810 11:30:32.976537 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 93) took 6772 ms. Trace:
I20260810 11:30:32.996795 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:50850
I20260810 11:30:32.996850 27248 rpcz_store.cc:276] 0810 11:30:26.204362 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.204479 (+ 117us) service_pool.cc:227] Handling call
0810 11:30:32.868217 (+6663738us) ts_tablet_manager.cc:1145] Deleting tablet 4b15cc8669b549a2b4461dccd66a0c5a
0810 11:30:32.868232 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:32.921711 (+ 53479us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:32.954895 (+ 33184us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:32.976487 (+ 21592us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6650792}
W20260810 11:30:32.997910 27333 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 0bb01711769f457aa0696bb59582166d consensus state has no leader
I20260810 11:30:32.998042 27248 tablet_replica.cc:330] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:32.998584 27248 raft_consensus.cc:2229] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:32.999511 27248 raft_consensus.cc:2258] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:32.987039 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb0357271cfd46478867a3cc0660bcdc" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:33.001497 28345 leader_election.cc:288] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:33.002097 27059 raft_consensus.cc:2454] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
W20260810 11:30:33.002421 27333 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.194:38225 (request call id 88) took 5356 ms (client timeout 1000 ms). Trace:
I20260810 11:30:33.004530 26848 leader_election.cc:302] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:33.006310 28359 raft_consensus.cc:2781] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:33.006812 28359 raft_consensus.cc:482] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:33.007118 28359 raft_consensus.cc:3037] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:33.004678 27333 rpcz_store.cc:269] 0810 11:30:27.644734 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.647606 (+ 2872us) service_pool.cc:227] Handling call
0810 11:30:32.623498 (+4975892us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.623507 (+ 9us) write_op.cc:454] Released schema lock
0810 11:30:32.670000 (+ 46493us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.670006 (+ 6us) write_op.cc:454] Released schema lock
0810 11:30:33.001007 (+331001us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:32.623344 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER)
0810 11:30:32.623366 (+ 22us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.623387 (+ 21us) write_op.cc:454] Released schema lock
0810 11:30:32.623391 (+ 4us) write_op.cc:335] FINISH: Op aborted
Related trace 'op':
0810 11:30:32.669869 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER)
0810 11:30:32.669882 (+ 13us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.669889 (+ 7us) write_op.cc:454] Released schema lock
0810 11:30:32.669893 (+ 4us) write_op.cc:335] FINISH: Op aborted
Metrics: {"mutex_wait_us":60344,"reported_tablets":215,"child_traces":[["op",{}],["op",{}]]}
I20260810 11:30:33.014810 27248 ts_tablet_manager.cc:1905] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:33.018951 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_bbae9d833ed04fc89a867eb497163403 [id=822d8386d19c4a2bb83cc63fbc186792]
I20260810 11:30:33.021258 28359 raft_consensus.cc:504] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:33.027711 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb0357271cfd46478867a3cc0660bcdc" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:33.028162 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_49be430f1e8f475482b54850772c0430 [id=82e113439bc04ce9955f59612ba480dc]
I20260810 11:30:33.029277 27059 raft_consensus.cc:3037] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:33.030746 26767 raft_consensus.cc:2454] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:33.036755 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_aa56bd03f9eb42468dce12fd81958879 [id=851eb82758954da2b3ec9bf0007880fa]
I20260810 11:30:33.039368 28359 leader_election.cc:288] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:33.040881 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]
I20260810 11:30:33.044327 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_6f7fdd85630648659dcfe3b52e5ab365 [id=862df0152eda418da6110067b4ab588b]
I20260810 11:30:33.044787 27379 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac259bcf213a4aa297d1d8e73b262361 in term 6.
I20260810 11:30:33.045469 26566 leader_election.cc:302] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83cc8e39a3b9455f8242a6da6a54c38a, ac259bcf213a4aa297d1d8e73b262361; no voters:
I20260810 11:30:33.046625 27333 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 151) took 2383 ms. Trace:
I20260810 11:30:33.047137 27333 rpcz_store.cc:276] 0810 11:30:30.662232 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.015767 (+2353535us) service_pool.cc:227] Handling call
0810 11:30:33.045256 (+ 29489us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dc313 00007f55f09ce466 00007f55f09ce195 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:33.045768 (+ 512us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":65454848}
I20260810 11:30:33.048153 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:33.048818 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet eb51618d37ac488fa7e3d23e5f85ec36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:33.053544 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_9efdfb09fd194dc2a9cbdc9a87749126 [id=8afbc0cc8e704a03a064974937b5a36b]
I20260810 11:30:33.059629 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]
W20260810 11:30:33.063825 26383 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu pid 27747: Timed out: CheckLeaks RPC to 127.25.195.253:34547 timed out after 1.000s (SENT)
I20260810 11:30:33.064525 28371 leader_election.cc:288] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 6 election: Requested vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547)
I20260810 11:30:33.064980 26383 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu with pid 27747
I20260810 11:30:33.069880 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]
I20260810 11:30:33.070801 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_04e075d361354421aa7085057964f310 [id=94c8e7388b644043b77cb6b5087e87e8]
I20260810 11:30:33.072836 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]
I20260810 11:30:33.074782 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 0118ff9d21924aefa8c6c32977c10453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:33.075052 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_5f7d17a1cdaa4396b5faf52b01518860 [id=973454ab92f84e73be26260d66ee9763]
I20260810 11:30:33.076314 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 31888ddeafe14738b818016a9c0a4ad3 (table default.Table_5763dcd0b2ae40b4945a6966bfd23099 [id=9ec5a85bb4b34875b465a5ee221ab4f9]) successfully deleted
I20260810 11:30:33.072999 28371 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 6 FOLLOWER]: Leader election won for term 6
I20260810 11:30:33.080600 28371 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [term 6 LEADER]: Becoming Leader. State: Replica: ac259bcf213a4aa297d1d8e73b262361, State: Running, Role: LEADER
W20260810 11:30:33.085687 26702 leader_election.cc:341] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:33.086395 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 60886.9us
I20260810 11:30:33.088953 27228 tablet_bootstrap.cc:492] T a18cb43b4dc04a1290a6bade7ac1f3cf P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:33.089038 27059 raft_consensus.cc:2454] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:33.086481 28371 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 603, Committed index: 603, Last appended: 4.604, Last appended by leader: 604, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:33.090500 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 49db12565dbc4187b78a98ed35c40fed with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1e46f80f7f4e3a84638421892e6236) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:33.090638 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet f6e264e8507446809f3c386fdb3c34ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:33.090798 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 0033d61d07d84262a98b0ebc54bd7960 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:33.094499 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]
I20260810 11:30:33.090972 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb0357271cfd46478867a3cc0660bcdc" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:33.092206 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet eb9394f9ca2c44de93354e23973cf902 with delete_type TABLET_DATA_DELETED (replaced by tablet db59523b71224370bf5fce6b56592f71) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:33.092881 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:33.093478 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet bb0357271cfd46478867a3cc0660bcdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:33.091792 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 43e42cc642544f779bb79cee7479c4f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:33.090365 26702 leader_election.cc:302] T bd6b328baa2346afbbe9f513ae4db3df P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:33.090337 27222 raft_consensus.cc:348] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:33.110553 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 60d56e162b4b41e2867ac845e524aca4 with delete_type TABLET_DATA_DELETED (replaced by tablet 10210204d5ff4e5e97c98fd255f674a5) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:33.112938 28287 raft_consensus.cc:2726] T bd6b328baa2346afbbe9f513ae4db3df P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:33.106392 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 8798892eb4604ee8ac9c95e64dbb14e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:33.113440 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:32816
W20260810 11:30:33.096359 26849 leader_election.cc:341] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:33.113766 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet ac4b1821ac30452cbe7a8f844d9b37e5 with delete_type TABLET_DATA_DELETED (replaced by tablet a45422addab84e9083df8665a0cf9322) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:33.110716 27999 ts_tablet_manager.cc:1918] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:33.114080 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 110b5acc36bd4d6bba13735e5daec75f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:33.114329 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 0938a2f3688246a2b46978eeb7d5d521 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:33.112742 27222 raft_consensus.cc:374] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:33.114737 27999 log.cc:1196] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/b28f3dcbd6d74559b372d3452e13ce9f
I20260810 11:30:33.115422 27322 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 150) took 2558 ms. Trace:
I20260810 11:30:33.115626 27322 rpcz_store.cc:276] 0810 11:30:30.518224 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.990677 (+2472453us) service_pool.cc:227] Handling call
0810 11:30:33.076416 (+ 85739us) spinlock_profiling.cc:243] Waited 55.4 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dc313 00007f55f09ce466 00007f55f09ce195 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:33.076808 (+ 392us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":127380864}
I20260810 11:30:33.109647 27334 master_service.cc:946] ReplaceTablet: received request to replace tablet fbe0a0ab82a147a3b6164904b135d1ab from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:33.118651 27999 ts_tablet_manager.cc:1939] T b28f3dcbd6d74559b372d3452e13ce9f P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:33.115162 27222 raft_consensus.cc:729] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:33.116847 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d8ce485cb84495a6e964b6d5977f0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:33.121634 27222 consensus_queue.cc:260] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:33.115806 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 603fe104b7ab485eab6b225a58bddc1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:32816
W20260810 11:30:33.122586 26566 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.254:41125, user_credentials={real_user=slave}} blocked reactor thread for 77181us
I20260810 11:30:33.124998 27974 ts_tablet_manager.cc:1918] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:33.125015 27334 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:49152 (request call id 152) took 1087 ms. Trace:
I20260810 11:30:33.125349 27974 log.cc:1196] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/7dc4000f1dde46a3b881a9fa8e9a6e3e
I20260810 11:30:33.125277 27334 rpcz_store.cc:276] 0810 11:30:32.030346 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.049480 (+1019134us) service_pool.cc:227] Handling call
0810 11:30:33.117237 (+ 67757us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260810 11:30:33.127612 27122 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.25.195.254:41125)
I20260810 11:30:33.128338 27222 ts_tablet_manager.cc:1428] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.134s user 0.004s sys 0.004s
I20260810 11:30:33.130162 27228 ts_tablet_manager.cc:1397] T a18cb43b4dc04a1290a6bade7ac1f3cf P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.202s user 0.004s sys 0.008s
I20260810 11:30:33.132369 27362 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49152 (request call id 148) took 2607 ms. Trace:
I20260810 11:30:33.132694 27362 rpcz_store.cc:276] 0810 11:30:30.481025 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.937323 (+2456298us) service_pool.cc:227] Handling call
0810 11:30:33.087429 (+150106us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96dc313 00007f55f09ce466 00007f55f09ce195 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:33.087963 (+ 534us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":76771200}
I20260810 11:30:33.133323 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 4b15cc8669b549a2b4461dccd66a0c5a (table default.Table_16866d33f78041fd9fdfdd14a4daf75e [id=3ed241516c2f474c818b0b4e77ae4bbc]) successfully deleted
I20260810 11:30:33.134250 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet ac4b1821ac30452cbe7a8f844d9b37e5 with delete_type TABLET_DATA_DELETED (replaced by tablet a45422addab84e9083df8665a0cf9322) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.136126 27362 master_service.cc:946] ReplaceTablet: received request to replace tablet a835d30ef9fc474ab927bb119a95d83c from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:33.137923 26993 leader_election.cc:302] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
W20260810 11:30:33.139253 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 70380.6us
I20260810 11:30:33.135541 28342 consensus_queue.cc:1035] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.073s
I20260810 11:30:33.141031 26848 leader_election.cc:302] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:33.142073 27334 master_service.cc:946] ReplaceTablet: received request to replace tablet d14091e1c111438bac8bcf3d36123d80 from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:33.142185 28359 raft_consensus.cc:2781] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:33.142764 28359 raft_consensus.cc:686] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:33.143695 28359 consensus_queue.cc:237] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:33.147324 27231 tablet_bootstrap.cc:492] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:33.152730 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.154651 28388 raft_consensus.cc:2781] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:33.155452 28388 raft_consensus.cc:686] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:33.156030 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e0a8513171f4c39b74c08760a139d9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.159158 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aa16654b7f34f9baf856bf724cece8f with delete_type TABLET_DATA_DELETED (replaced by tablet 760aeada57464892ae3b9013a761c509) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.161580 27231 ts_tablet_manager.cc:1397] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.190s user 0.006s sys 0.009s
W20260810 11:30:33.165210 26564 connection.cc:535] client connection to 127.25.195.253:34547 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 11:30:33.165647 26564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 1 similar messages]
W20260810 11:30:33.164297 26848 consensus_peers.cc:487] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:33.167857 26700 connection.cc:535] client connection to 127.25.195.253:34547 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 11:30:33.168912 26991 connection.cc:535] client connection to 127.25.195.253:34547 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 11:30:33.173102 28385 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 11:30:32.738647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.195.253:34547 (local address 127.0.0.1:40440)
0810 11:30:32.828946 (+ 90299us) negotiation.cc:107] Waiting for socket to connect
0810 11:30:32.829001 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 11:30:32.833105 (+ 4104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 11:30:33.166834 (+333729us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":87607,"thread_start_us":88709,"threads_started":1}
I20260810 11:30:33.163683 28388 consensus_queue.cc:237] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:33.143285 27362 master_service.cc:946] ReplaceTablet: received request to replace tablet 2801709d53614916abac370f7ae5e913 from {username='slave'} at 127.0.0.1:49152
W20260810 11:30:33.143886 27288 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 56692.9us
I20260810 11:30:33.176440 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 0713f4f14a284050a7774a70ab974f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.176729 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet 0713f4f14a284050a7774a70ab974f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.177825 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 70f6017d4d01463398cb347779dacf90 with delete_type TABLET_DATA_DELETED (replaced by tablet 110b5acc36bd4d6bba13735e5daec75f) from {username='slave'} at 127.0.0.1:33500
W20260810 11:30:33.167234 27286 connection.cc:535] client connection to 127.25.195.253:34547 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 11:30:33.184722 27231 raft_consensus.cc:348] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:33.187182 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 49db12565dbc4187b78a98ed35c40fed with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1e46f80f7f4e3a84638421892e6236) from {username='slave'} at 127.0.0.1:33500
W20260810 11:30:33.186959 27286 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 3 similar messages]
I20260810 11:30:33.187542 27231 raft_consensus.cc:374] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:33.187650 27231 raft_consensus.cc:729] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:33.202625 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 9311943eebaa4824bde96b4cb09f1e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.200074 27362 master_service.cc:946] ReplaceTablet: received request to replace tablet a63227e69df14a4ea935087fd31ece63 from {username='slave'} at 127.0.0.1:49152
I20260810 11:30:33.205679 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 0118ff9d21924aefa8c6c32977c10453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.206151 27228 raft_consensus.cc:348] T a18cb43b4dc04a1290a6bade7ac1f3cf P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:33.206663 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet a3406dc345e3429fb4bce5a59643b686 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.207010 27228 raft_consensus.cc:374] T a18cb43b4dc04a1290a6bade7ac1f3cf P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:33.207252 27228 raft_consensus.cc:729] T a18cb43b4dc04a1290a6bade7ac1f3cf P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
W20260810 11:30:33.207409 27319 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.195:58893 (request call id 79) took 6379 ms (client timeout 1000 ms). Trace:
I20260810 11:30:33.207631 27228 consensus_queue.cc:260] T a18cb43b4dc04a1290a6bade7ac1f3cf P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:33.207945 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.208829 27228 ts_tablet_manager.cc:1428] T a18cb43b4dc04a1290a6bade7ac1f3cf P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.078s user 0.002s sys 0.002s
I20260810 11:30:33.209038 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f24c84cdd945b78f39f24015eb1e43 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b95f3ec8ff34c89a68cd1edf8391f9b) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.209334 27228 tablet_bootstrap.cc:492] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:33.208716 27231 consensus_queue.cc:260] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:33.210407 27231 ts_tablet_manager.cc:1428] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.048s user 0.005s sys 0.000s
I20260810 11:30:33.210917 27231 tablet_bootstrap.cc:492] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:33.210844 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 52) took 7236 ms. Trace:
I20260810 11:30:33.211227 27999 rpcz_store.cc:276] 0810 11:30:25.974066 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.974108 (+ 42us) service_pool.cc:227] Handling call
0810 11:30:32.604026 (+6629918us) ts_tablet_manager.cc:1145] Deleting tablet b28f3dcbd6d74559b372d3452e13ce9f
0810 11:30:32.604077 (+ 51us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:32.955084 (+351007us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.110575 (+155491us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.210771 (+100196us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6615803}
I20260810 11:30:33.212095 27999 tablet_replica.cc:330] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:33.212632 27999 raft_consensus.cc:2229] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:33.213147 27999 raft_consensus.cc:2258] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:33.216487 27999 ts_tablet_manager.cc:1905] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:33.210683 27319 rpcz_store.cc:269] 0810 11:30:26.807297 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.954920 (+147623us) service_pool.cc:227] Handling call
0810 11:30:32.674524 (+5719604us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.674547 (+ 23us) write_op.cc:454] Released schema lock
0810 11:30:33.186633 (+512086us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:29.652237 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:29.652471 (+ 234us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:29.652499 (+ 28us) write_op.cc:435] Acquired schema lock
0810 11:30:29.652504 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:29.652930 (+ 426us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:29.652948 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:29.652954 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:29.653087 (+ 133us) tablet.cc:699] Row locks acquired
0810 11:30:29.653090 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:29.653175 (+ 85us) write_op.cc:270] Start()
0810 11:30:29.653265 (+ 90us) write_op.cc:276] Timestamp: P: 1786361429653123 usec, L: 0
0810 11:30:29.653271 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:29.653919 (+ 648us) log.cc:842] Serialized 356 byte log entry
0810 11:30:29.670655 (+ 16736us) op_driver.cc:444] REPLICATION: finished
0810 11:30:29.670845 (+ 190us) write_op.cc:301] APPLY: starting
0810 11:30:29.670867 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:29.670920 (+ 53us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:29.670967 (+ 47us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:29.671088 (+ 121us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:29.671176 (+ 88us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:29.671198 (+ 22us) write_op.cc:312] APPLY: finished
0810 11:30:29.671366 (+ 168us) log.cc:842] Serialized 23 byte log entry
0810 11:30:29.671490 (+ 124us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.671524 (+ 34us) write_op.cc:454] Released schema lock
0810 11:30:29.671534 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:29.671664 (+ 130us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:29.671668 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:32.674338 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER)
0810 11:30:32.674370 (+ 32us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.674388 (+ 18us) write_op.cc:454] Released schema lock
0810 11:30:32.674397 (+ 9us) write_op.cc:335] FINISH: Op aborted
Metrics: {"mutex_wait_us":77495,"reported_tablets":202,"child_traces":[["op",{"apply.queue_time_us":121,"apply.run_cpu_time_us":921,"apply.run_wall_time_us":920,"num_ops":1,"prepare.queue_time_us":252493,"prepare.run_cpu_time_us":1924,"prepare.run_wall_time_us":1916,"raft.queue_time_us":76,"raft.run_cpu_time_us":676,"raft.run_wall_time_us":677,"replication_time_us":17345}],["op",{}]]}
W20260810 11:30:33.220333 27321 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.194:38225 (request call id 89) took 3638 ms (client timeout 1000 ms). Trace:
W20260810 11:30:33.220814 27321 rpcz_store.cc:269] 0810 11:30:29.569138 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.860709 (+291571us) service_pool.cc:227] Handling call
0810 11:30:32.808449 (+2947740us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.808454 (+ 5us) write_op.cc:454] Released schema lock
0810 11:30:32.916369 (+107915us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.916373 (+ 4us) write_op.cc:454] Released schema lock
0810 11:30:33.206964 (+290591us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:32.808308 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER)
0810 11:30:32.808344 (+ 36us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.808368 (+ 24us) write_op.cc:454] Released schema lock
0810 11:30:32.808374 (+ 6us) write_op.cc:335] FINISH: Op aborted
Related trace 'op':
0810 11:30:32.916164 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER)
0810 11:30:32.916177 (+ 13us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.916185 (+ 8us) write_op.cc:454] Released schema lock
0810 11:30:32.916230 (+ 45us) write_op.cc:335] FINISH: Op aborted
Metrics: {"mutex_wait_us":124666,"reported_tablets":223,"child_traces":[["op",{}],["op",{}]]}
W20260810 11:30:33.224099 27336 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.193:39107 (request call id 84) took 2843 ms (client timeout 1000 ms). Trace:
W20260810 11:30:33.225992 27336 rpcz_store.cc:269] 0810 11:30:30.365222 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.452077 (+ 86855us) service_pool.cc:227] Handling call
0810 11:30:32.615279 (+2163202us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.615283 (+ 4us) write_op.cc:454] Released schema lock
0810 11:30:32.889146 (+273863us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.889149 (+ 3us) write_op.cc:454] Released schema lock
0810 11:30:33.208368 (+319219us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:32.615130 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER)
0810 11:30:32.615159 (+ 29us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.615168 (+ 9us) write_op.cc:454] Released schema lock
0810 11:30:32.615188 (+ 20us) write_op.cc:335] FINISH: Op aborted
Related trace 'op':
0810 11:30:32.889053 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER)
0810 11:30:32.889066 (+ 13us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.889075 (+ 9us) write_op.cc:454] Released schema lock
0810 11:30:32.889080 (+ 5us) write_op.cc:335] FINISH: Op aborted
Metrics: {"mutex_wait_us":15083,"reported_tablets":203,"child_traces":[["op",{}],["op",{}]]}
W20260810 11:30:33.227630 26702 leader_election.cc:341] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 0118ff9d21924aefa8c6c32977c10453
I20260810 11:30:33.233609 27222 tablet_bootstrap.cc:492] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:33.233639 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_2c7697ec19204b3d823f5684c30978e2 [id=9d480f65788b486db55bbbe48a0ad5eb]
I20260810 11:30:33.235420 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_d863b14a3a96454e8ee5a85fb2ab30c8 [id=a40ab01e5be24248b3af7ef1dc456da6]
I20260810 11:30:33.236347 28394 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac259bcf213a4aa297d1d8e73b262361. Latest consensus state: current_term: 6 leader_uuid: "ac259bcf213a4aa297d1d8e73b262361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:33.238374 28394 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: This master's current role is: LEADER
I20260810 11:30:33.239629 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]
I20260810 11:30:33.240995 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 478c0c39658349c39e3afa1aa1653e82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.242014 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet eb51618d37ac488fa7e3d23e5f85ec36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.242373 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_883ee52a6394446eb2ca688ec956d44b [id=a47869d3574543b19e821bbfcb5d3785]
I20260810 11:30:33.242725 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.243255 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_835cdd4f3794466d808449e2e17bb15a [id=a483de6ef1fc453b93e3f183e9c15dd1]
I20260810 11:30:33.244218 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet f6e264e8507446809f3c386fdb3c34ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.245177 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_307bbf62894b4edc922e0fd4afa1a91f [id=a700655211944205a74b75b8449abc29]
I20260810 11:30:33.249341 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 43e42cc642544f779bb79cee7479c4f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.250746 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_c447a9537b844dffa1767531896bf6fe [id=a74215a4f78c47348bc5a41e4b1232f8]
I20260810 11:30:33.250718 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.251683 27248 ts_tablet_manager.cc:1918] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:33.259289 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]
I20260810 11:30:33.262909 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]
I20260810 11:30:33.252542 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.253265 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca5c88585394dba87e201696afa6934 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.256138 27231 tablet_bootstrap.cc:654] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:33.260187 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet e25ae21cc8cc4749a507fcab5ee225a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.260970 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 0033d61d07d84262a98b0ebc54bd7960 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.261919 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 110b5acc36bd4d6bba13735e5daec75f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.266629 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_b15d6127087043a186b912230d2fe666 [id=ac5dd73c5e8e40108a8b663241887081]
I20260810 11:30:33.269691 27248 log.cc:1196] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/cb01e54d817c4b0dbcc80f90f82923c0
I20260810 11:30:33.270457 27248 ts_tablet_manager.cc:1939] T cb01e54d817c4b0dbcc80f90f82923c0 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:33.272182 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_6e9cd3888b17405bad2475ba3da34507 [id=ae57f634bfef4952bb4e0a170d67fbdb]
I20260810 11:30:33.274048 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_b2c244ee13d14619b9f1eac6ab1aba2a [id=afa11e2df47a4a739727c8d834e24b84]
I20260810 11:30:33.275668 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]
I20260810 11:30:33.279573 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]
I20260810 11:30:33.283739 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_e0aa1ad6dfda4ef2b7c441f45f74c0f7 [id=b27cf2b15cb64704b6f447284daadd55]
I20260810 11:30:33.289426 27322 rpcz_store.cc:275] Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:49132 (request call id 5) took 6375 ms. Trace:
I20260810 11:30:33.288410 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_a827339eadbd440bb3c0bfa6c52512ca [id=b457cccecbf24d6dab4e74bf16bb68eb]
I20260810 11:30:33.292672 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet b28f3dcbd6d74559b372d3452e13ce9f (table default.Table_95523d7d33a4423099b179a2d91867f9 [id=01eb86f74b7e4434a2d6aae5dd94b3b5]) successfully deleted
W20260810 11:30:33.293085 27286 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 76814.4us
I20260810 11:30:33.294597 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet cb01e54d817c4b0dbcc80f90f82923c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5deec04c1be64473accf8b9df14bd22e) from {username='slave'} at 127.0.0.1:32816
W20260810 11:30:33.298326 27331 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.193:39107 (request call id 82) took 6006 ms (client timeout 1000 ms). Trace:
I20260810 11:30:33.300879 26702 leader_election.cc:302] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:33.301760 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]
W20260810 11:30:33.302048 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 74470.6us
I20260810 11:30:33.304319 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_abbbb80ecbe4491d98912dcdcaab5dd3 [id=ba999b4084c84b2f8e0313b96849b169]
I20260810 11:30:33.304462 28339 raft_consensus.cc:2726] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:33.307068 27318 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.195:58893 (request call id 81) took 3951 ms (client timeout 1000 ms). Trace:
I20260810 11:30:33.308033 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85]
I20260810 11:30:33.311292 27322 rpcz_store.cc:276] 0810 11:30:26.835280 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.199314 (+6364034us) service_pool.cc:227] Handling call
0810 11:30:33.210841 (+ 11527us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:33.312404 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]
W20260810 11:30:33.301299 27331 rpcz_store.cc:269] 0810 11:30:27.280786 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.289762 (+ 8976us) service_pool.cc:227] Handling call
0810 11:30:33.287518 (+5997756us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:28.727669 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:28.728088 (+ 419us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:28.728111 (+ 23us) write_op.cc:435] Acquired schema lock
0810 11:30:28.728115 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:28.729022 (+ 907us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:28.729058 (+ 36us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:28.729066 (+ 8us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:28.729257 (+ 191us) tablet.cc:699] Row locks acquired
0810 11:30:28.729260 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:28.729374 (+ 114us) write_op.cc:270] Start()
0810 11:30:28.729465 (+ 91us) write_op.cc:276] Timestamp: P: 1786361428729308 usec, L: 0
0810 11:30:28.729482 (+ 17us) op_driver.cc:331] REPLICATION: starting
0810 11:30:28.741417 (+ 11935us) log.cc:842] Serialized 536 byte log entry
0810 11:30:28.855347 (+113930us) op_driver.cc:444] REPLICATION: finished
0810 11:30:28.860142 (+ 4795us) write_op.cc:301] APPLY: starting
0810 11:30:28.860189 (+ 47us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:28.860338 (+ 149us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:28.860685 (+ 347us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:28.861310 (+ 625us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:28.861412 (+ 102us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:28.861421 (+ 9us) write_op.cc:312] APPLY: finished
0810 11:30:28.862919 (+ 1498us) log.cc:842] Serialized 23 byte log entry
0810 11:30:28.865224 (+ 2305us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.866046 (+ 822us) write_op.cc:454] Released schema lock
0810 11:30:28.866059 (+ 13us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:28.866159 (+ 100us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:28.866166 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":58288,"reported_tablets":198,"child_traces":[["op",{"apply.queue_time_us":4511,"apply.run_cpu_time_us":2592,"apply.run_wall_time_us":6299,"num_ops":1,"prepare.queue_time_us":103607,"prepare.run_cpu_time_us":3409,"prepare.run_wall_time_us":71627,"raft.queue_time_us":3787,"raft.run_cpu_time_us":767,"raft.run_wall_time_us":768,"replication_time_us":125811,"thread_start_us":132480,"threads_started":3,"wal-append.queue_time_us":18824,"wal-append.run_cpu_time_us":31852,"wal-append.run_wall_time_us":3270513}]]}
I20260810 11:30:33.314751 27334 rpcz_store.cc:275] Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:43976 (request call id 1) took 3821 ms. Trace:
I20260810 11:30:33.315045 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 31cafb7c691d40a48a40f7d4190c4f8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:32816
I20260810 11:30:33.322156 27334 rpcz_store.cc:276] 0810 11:30:29.478891 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.208272 (+3729381us) service_pool.cc:227] Handling call
0810 11:30:33.300721 (+ 92449us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:33.242503 28400 tablet.cc:1722] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260810 11:30:33.279862 26849 consensus_peers.cc:487] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 949f31fa0c124eefbee695cfc7f50cbe. This is attempt 6: this message will repeat every 5th retry.
W20260810 11:30:33.324138 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 43610.8us
I20260810 11:30:33.327951 28287 raft_consensus.cc:482] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:33.328320 28287 raft_consensus.cc:504] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:33.318627 28359 raft_consensus.cc:482] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:33.329552 28359 raft_consensus.cc:504] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:33.322743 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_3efc57bdbafc46dfab4d324acb0d5f73 [id=bcba186b6e93492fb06f70e033be3296]
I20260810 11:30:33.338498 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]
I20260810 11:30:33.332386 27974 ts_tablet_manager.cc:1939] T 7dc4000f1dde46a3b881a9fa8e9a6e3e P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
W20260810 11:30:33.343497 27326 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.193:39107 (request call id 83) took 4615 ms (client timeout 1000 ms). Trace:
W20260810 11:30:33.343904 27326 rpcz_store.cc:269] 0810 11:30:28.719406 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.246278 (+526872us) service_pool.cc:227] Handling call
0810 11:30:29.920294 (+674016us) spinlock_profiling.cc:243] Waited 97 ms on lock 0x615000060a24. stack: 00007f55e66a666e 00007f55e66a6430 00007f55e572d5ed 00000000008ea064 00000000008ea02d 00007f55f4dbf27d 00007f55f4dbf373 00007f55f1be1361 00007f55f955466a 00007f55f96d6d8f 00007f55f09cb946 00007f55f09cb675 00007f55ed1e29be 00007f55ed1e179e 00007f55ed1e7b25 00007f55ed1e854f
0810 11:30:32.832171 (+2911877us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.832178 (+ 7us) write_op.cc:454] Released schema lock
0810 11:30:33.335092 (+502914us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:32.831997 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER)
0810 11:30:32.832012 (+ 15us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.832032 (+ 20us) write_op.cc:454] Released schema lock
0810 11:30:32.832037 (+ 5us) write_op.cc:335] FINISH: Op aborted
Metrics: {"mutex_wait_us":37298,"reported_tablets":206,"spinlock_wait_cycles":223124864,"child_traces":[["op",{}]]}
I20260810 11:30:33.345606 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_5f6a37537c33412a80f2642fb0162da6 [id=bfc3f2f94773444181545d43ecd88190]
W20260810 11:30:33.334312 27318 rpcz_store.cc:269] 0810 11:30:29.274025 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.293806 (+ 19781us) service_pool.cc:227] Handling call
0810 11:30:32.697027 (+3403221us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.697078 (+ 51us) write_op.cc:454] Released schema lock
0810 11:30:33.225184 (+528106us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:30.545138 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:30.545489 (+ 351us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:30.545497 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:30.545500 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:30.545865 (+ 365us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:30.545892 (+ 27us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:30.545899 (+ 7us) tablet.cc:683] Acquiring locks for 3 operations
0810 11:30:30.546042 (+ 143us) tablet.cc:699] Row locks acquired
0810 11:30:30.546044 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:30.546118 (+ 74us) write_op.cc:270] Start()
0810 11:30:30.546181 (+ 63us) write_op.cc:276] Timestamp: P: 1786361430545999 usec, L: 0
0810 11:30:30.546186 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:30.546638 (+ 452us) log.cc:842] Serialized 1302 byte log entry
0810 11:30:30.555760 (+ 9122us) op_driver.cc:444] REPLICATION: finished
0810 11:30:30.555898 (+ 138us) write_op.cc:301] APPLY: starting
0810 11:30:30.555917 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:30.555970 (+ 53us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:30.556012 (+ 42us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:30.556138 (+ 126us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:30.556180 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0810 11:30:30.556187 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:30.556286 (+ 99us) log.cc:842] Serialized 35 byte log entry
0810 11:30:30.556352 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.556377 (+ 25us) write_op.cc:454] Released schema lock
0810 11:30:30.556384 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:30.556441 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:30.556444 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:32.692434 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 83cc8e39a3b9455f8242a6da6a54c38a is not leader of this config: current role FOLLOWER)
0810 11:30:32.692464 (+ 30us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:32.692473 (+ 9us) write_op.cc:454] Released schema lock
0810 11:30:32.692491 (+ 18us) write_op.cc:335] FINISH: Op aborted
Metrics: {"mutex_wait_us":91190,"reported_tablets":208,"child_traces":[["op",{"apply.queue_time_us":79,"apply.run_cpu_time_us":604,"apply.run_wall_time_us":604,"num_ops":3,"prepare.queue_time_us":4575,"prepare.run_cpu_time_us":1770,"prepare.run_wall_time_us":1771,"raft.queue_time_us":649,"raft.run_cpu_time_us":437,"raft.run_wall_time_us":438,"replication_time_us":9541}],["op",{}]]}
I20260810 11:30:33.348620 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_2d65cf26d2254f29a785321b186cb2c8 [id=c16570aaa0c7449191f68085a12017da]
I20260810 11:30:33.349957 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.351039 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.351506 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_094455b6d4f745fa83445cfc650e43b7 [id=c2f01a1417424ff6b61d8c4cb35a638a]
I20260810 11:30:33.352517 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 31888ddeafe14738b818016a9c0a4ad3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.353586 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ff4e19071fc435fbae4490799325e37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:13 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.354393 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_52c39be8057948a49dfd7394b4152265 [id=c48cb5a0af7b4f0483e799a49fd5d307]
I20260810 11:30:33.356164 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f3567f07068942e9a5d42f9877f39bb7 [id=c557d3488f464c5bbff89fd13e52b02a]
W20260810 11:30:33.358129 26849 leader_election.cc:341] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: f3884736eec74c8992b8d51b37465875
I20260810 11:30:33.360119 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_fabd7780b9224b7993ad4321be6f92e2 [id=c9c81bc9d6dc48c89ba4cc51ca4f8bd9]
I20260810 11:30:33.361524 28287 leader_election.cc:288] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:33.363106 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]
I20260810 11:30:33.366245 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_971ac96924ee4a09bc7bc1befdb296d1 [id=cbb462ed5c1f4adf9363f7ac03b78c8c]
I20260810 11:30:33.368184 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_b2381e8587204bffa96b34e428682d5d [id=d4074ee00ab24054b4121d5c9c74d9a4]
I20260810 11:30:33.369590 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_174d1e3073a34beabbd10fd4f6d61bd4 [id=d538eb7fe6224d6895190c79c041b76f]
I20260810 11:30:33.371165 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_53285a0af75e4705982c23850f7b27e2 [id=d58840daecc84b789f04a35ca6cd8393]
I20260810 11:30:33.371949 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]
I20260810 11:30:33.373095 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_7458a59fbdce4e9485d51df6fccf66a5 [id=d63533f5d837481889b34a78d860e018]
W20260810 11:30:33.374673 26564 leader_election.cc:334] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547): Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111)
I20260810 11:30:33.374807 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_da82b7e264034027b41209e3a8be8903 [id=d7ee651e98084bd798d76ecf28546e83]
W20260810 11:30:33.375001 26564 leader_election.cc:334] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547): Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111)
I20260810 11:30:33.375667 26541 master_runner.cc:186] Error getting master registration for 127.25.195.253:34547: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111),
I20260810 11:30:33.376122 26541 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 11:30:33.377067 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_bcf64628ba2c463ba5acce6617ec4324 [id=d823bbbb98b14646a119632dc037ad03]
I20260810 11:30:33.378741 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0033d61d07d84262a98b0ebc54bd7960" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:33.380127 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_6efb1e8e65fa4f88ae25c9d2ebc6b4f4 [id=d83083bfedd542398d132e4bac9a7f12]
I20260810 11:30:33.382869 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_e18fcf91bf3b4fa0a993bc1aa1471e62 [id=de3117675bb34e7c91a3eb51e015b7c9]
I20260810 11:30:33.385646 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]
I20260810 11:30:33.388311 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_5f8ecc7877924d0f9871dd16aaeafdde [id=e1ca02b3f3f94632843632a15fc19245]
I20260810 11:30:33.390949 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_ba61129cdf35481dbf06effd223949f6 [id=e20f1c45c6d743cba2c3cc60c78186a4]
I20260810 11:30:33.393513 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_fb8c5684b00a41eebe3f5b088bcbee33 [id=e22f19a993564e53b1cc76633f25f505]
I20260810 11:30:33.397408 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_db5e3f1e3cf74bc0b15660e83ea59ad6 [id=e7142023363b432b803533be5da13aec]
I20260810 11:30:33.397804 27228 tablet_bootstrap.cc:654] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:33.399910 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_1f48a9af47ad4e0c93ed4dd43ecd12a3 [id=e985b1ae60d94bfa998e1986bdf3fcd9]
W20260810 11:30:33.400708 27286 connection.cc:441] server connection from 127.0.0.1:43976 torn down before Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:43976 (request call id 1) could send its response
W20260810 11:30:33.401072 27286 leader_election.cc:334] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547): Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111)
I20260810 11:30:33.401818 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]
I20260810 11:30:33.404636 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_4857a0fc183c421382b9b70094d76ac3 [id=eb184bc24462433e89048f962a639600]
I20260810 11:30:33.409641 28359 leader_election.cc:288] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:33.410261 27222 tablet_bootstrap.cc:654] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:33.414927 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_12d15f4d2bd3426788aadc76beeff465 [id=ec7fc14fabfd4c83adcb3ea82f0087e8]
I20260810 11:30:33.419046 28399 tablet.cc:1722] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:33.421157 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_ddaa0e35d54b49c894cbf994bb7fbbab [id=ed36f07f53e04f308770145b0d7435ac]
I20260810 11:30:33.428187 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]
I20260810 11:30:33.435629 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_6d8b58857bb84e579c8c308dcb0800f0 [id=f0f8365d722447a090e236fd1fcb0e98]
I20260810 11:30:33.441905 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e]
I20260810 11:30:33.445475 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 94) took 7230 ms. Trace:
I20260810 11:30:33.414978 27228 tablet_bootstrap.cc:492] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:33.446259 27228 ts_tablet_manager.cc:1397] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.237s user 0.008s sys 0.000s
I20260810 11:30:33.445585 27999 ts_tablet_manager.cc:1918] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:33.447479 27228 raft_consensus.cc:348] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:33.447600 27999 log.cc:1196] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/fdbe21b4f124411988dd35a0b864f868
W20260810 11:30:33.440785 26848 consensus_peers.cc:487] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 70f6017d4d01463398cb347779dacf90. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:33.447836 27228 raft_consensus.cc:374] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:33.425408 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0033d61d07d84262a98b0ebc54bd7960" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:33.449997 27228 raft_consensus.cc:729] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:33.450711 27228 consensus_queue.cc:260] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:33.451596 26700 leader_election.cc:302] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:33.452543 27228 ts_tablet_manager.cc:1428] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 11:30:33.452945 28339 raft_consensus.cc:2726] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:33.454515 27228 tablet_bootstrap.cc:492] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:33.461830 28348 consensus_queue.cc:1035] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 11:30:33.462136 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_9744be92699b40d1bae23bbb564db585 [id=f27ef087b00e469197a44c70d4bc979b]
W20260810 11:30:33.463796 26849 consensus_peers.cc:487] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d729baae40a64e6e8c23e6870f230afb. This is attempt 6: this message will repeat every 5th retry.
I20260810 11:30:33.464468 28348 consensus_queue.cc:1035] T 2126d95992e549b7b2b3e662b0d39a36 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:33.470304 27999 ts_tablet_manager.cc:1939] T fdbe21b4f124411988dd35a0b864f868 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:33.471527 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]
I20260810 11:30:33.475412 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_2d72d964c7c54d639c11a02fc168152a [id=f49e68eaa81e49bb92ed473e754de42f]
I20260810 11:30:33.477371 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_c32d1cb0b9e744fbacbd00c8736fad21 [id=f54b49f28880453aa7bc67b9c36a219b]
I20260810 11:30:33.477974 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 116) took 7117 ms. Trace:
I20260810 11:30:33.483228 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]
I20260810 11:30:33.484169 27228 tablet_bootstrap.cc:654] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:33.484845 26848 leader_election.cc:341] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: f3884736eec74c8992b8d51b37465875
I20260810 11:30:33.485273 28348 raft_consensus.cc:482] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 443ec871f1ed4232b932ecfb0b18510d)
I20260810 11:30:33.485939 26848 leader_election.cc:302] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:33.487706 28345 raft_consensus.cc:2726] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:33.460367 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 5adcec593b8c4d40997c8911e9f77c85 with delete_type TABLET_DATA_DELETED (replaced by tablet 10e6c41db71a4146840f06c5b7412d9c) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.474458 27231 tablet_bootstrap.cc:492] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:33.490264 27231 ts_tablet_manager.cc:1397] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.279s user 0.008s sys 0.000s
I20260810 11:30:33.489442 27248 rpcz_store.cc:276] 0810 11:30:26.214942 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.215012 (+ 70us) service_pool.cc:227] Handling call
0810 11:30:32.997923 (+6782911us) ts_tablet_manager.cc:1145] Deleting tablet cb01e54d817c4b0dbcc80f90f82923c0
0810 11:30:32.997942 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:33.151102 (+153160us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.251351 (+100249us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.445275 (+193924us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6755229}
I20260810 11:30:33.491079 28348 raft_consensus.cc:504] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:33.493417 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 55) took 7510 ms. Trace:
I20260810 11:30:33.493728 27999 rpcz_store.cc:276] 0810 11:30:25.974479 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.974922 (+ 443us) service_pool.cc:227] Handling call
0810 11:30:33.211930 (+7237008us) ts_tablet_manager.cc:1145] Deleting tablet fdbe21b4f124411988dd35a0b864f868
0810 11:30:33.211945 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:33.371596 (+159651us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.443066 (+ 71470us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.485257 (+ 42191us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7211541}
I20260810 11:30:33.494904 28348 leader_election.cc:288] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:33.495711 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet fdbe21b4f124411988dd35a0b864f868 (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]) successfully deleted
I20260810 11:30:33.498833 27248 tablet_replica.cc:330] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:33.501566 26848 leader_election.cc:341] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: e25ae21cc8cc4749a507fcab5ee225a3
I20260810 11:30:33.504400 27228 tablet_bootstrap.cc:492] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:33.506901 27248 raft_consensus.cc:2229] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:33.508074 27248 raft_consensus.cc:2258] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:33.508656 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 54) took 7534 ms. Trace:
I20260810 11:30:33.507999 27228 ts_tablet_manager.cc:1397] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.054s user 0.017s sys 0.000s
I20260810 11:30:33.508900 27999 rpcz_store.cc:276] 0810 11:30:25.974385 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:25.974810 (+ 425us) service_pool.cc:227] Handling call
0810 11:30:33.494500 (+7519690us) ts_tablet_manager.cc:1145] Deleting tablet ac4b1821ac30452cbe7a8f844d9b37e5
0810 11:30:33.507825 (+ 13325us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x618000004d18. stack: 00007f7f891ce66e 00007f7f891ce430 00007f7f882555ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f7f891c40fd 00007f7f891c516e 00007f7f9c119cfd 00007f7f9c097883 00007f7f983376e6 00007f7f98338a37 00007f7f9836b404 00007f7f9834c870 00007f7f9834c5fd 00000000009edb7c
0810 11:30:33.508110 (+ 285us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:33.508395 (+ 285us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":29935488,"tablet-delete.queue_time_us":7491206}
I20260810 11:30:33.510030 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 60) took 7507 ms. Trace:
I20260810 11:30:33.510263 27999 rpcz_store.cc:276] 0810 11:30:26.002312 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.003105 (+ 793us) service_pool.cc:227] Handling call
0810 11:30:33.509679 (+7506574us) ts_tablet_manager.cc:1145] Deleting tablet 809b5b6b65d244cd9186517e39494839
0810 11:30:33.509713 (+ 34us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:33.509939 (+ 226us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7505521}
I20260810 11:30:33.505584 27231 raft_consensus.cc:348] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:33.511029 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 59) took 7509 ms. Trace:
W20260810 11:30:33.511960 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ac4b1821ac30452cbe7a8f844d9b37e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac4b1821ac30452cbe7a8f844d9b37e5 already in progress: creating tablet
I20260810 11:30:33.511989 27999 rpcz_store.cc:276] 0810 11:30:26.001489 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.001560 (+ 71us) service_pool.cc:227] Handling call
0810 11:30:33.510698 (+7509138us) ts_tablet_manager.cc:1145] Deleting tablet f6e264e8507446809f3c386fdb3c34ae
0810 11:30:33.510722 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:33.510950 (+ 228us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7505830}
I20260810 11:30:33.511816 27231 raft_consensus.cc:374] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 11:30:33.512506 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 809b5b6b65d244cd9186517e39494839 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 809b5b6b65d244cd9186517e39494839 already in progress: creating tablet
I20260810 11:30:33.512645 27999 tablet_replica.cc:330] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
W20260810 11:30:33.512941 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet f6e264e8507446809f3c386fdb3c34ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6e264e8507446809f3c386fdb3c34ae already in progress: creating tablet
I20260810 11:30:33.513095 27999 raft_consensus.cc:2229] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:33.512621 27231 raft_consensus.cc:729] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:33.513339 27999 raft_consensus.cc:2258] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:33.514412 27999 ts_tablet_manager.cc:1905] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:33.514742 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet d729baae40a64e6e8c23e6870f230afb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:14 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.514339 27248 ts_tablet_manager.cc:1905] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:33.516206 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 60d56e162b4b41e2867ac845e524aca4 with delete_type TABLET_DATA_DELETED (replaced by tablet 10210204d5ff4e5e97c98fd255f674a5) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.515647 27231 consensus_queue.cc:260] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:33.516888 27228 raft_consensus.cc:348] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:33.519913 27228 raft_consensus.cc:374] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:33.520733 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet db5adccd80a04e328e13793b461c38b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:12 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.521340 27228 raft_consensus.cc:729] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:33.523423 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 0938a2f3688246a2b46978eeb7d5d521 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.527401 28348 raft_consensus.cc:482] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:33.527606 28348 raft_consensus.cc:504] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:33.525380 27228 consensus_queue.cc:260] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:33.529366 28348 leader_election.cc:288] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:33.531651 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8798892eb4604ee8ac9c95e64dbb14e9" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:33.531993 27060 raft_consensus.cc:2454] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:33.532757 26848 leader_election.cc:302] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:33.533581 28348 raft_consensus.cc:2781] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 11:30:33.534368 28348 raft_consensus.cc:482] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:33.534875 28348 raft_consensus.cc:3037] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:33.536100 27231 ts_tablet_manager.cc:1428] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.045s user 0.006s sys 0.001s
I20260810 11:30:33.537180 27379 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 6 FOLLOWER]: Refusing update from remote peer ac259bcf213a4aa297d1d8e73b262361: Log matching property violated. Preceding OpId in replica: term: 3 index: 603. Preceding OpId from leader: term: 6 index: 605. (index mismatch)
I20260810 11:30:33.538724 28394 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 605, Last known committed idx: 603, Time since last communication: 0.000s
I20260810 11:30:33.533584 27228 ts_tablet_manager.cc:1428] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.024s user 0.001s sys 0.005s
I20260810 11:30:33.546298 27231 tablet_bootstrap.cc:492] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:33.547181 27228 tablet_bootstrap.cc:492] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
W20260810 11:30:33.548060 26849 leader_election.cc:341] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: e25ae21cc8cc4749a507fcab5ee225a3
I20260810 11:30:33.548283 26849 leader_election.cc:302] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
W20260810 11:30:33.549295 26849 leader_election.cc:341] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 8798892eb4604ee8ac9c95e64dbb14e9
I20260810 11:30:33.549665 28359 raft_consensus.cc:2726] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:33.550006 28348 raft_consensus.cc:504] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:33.551447 27231 tablet_bootstrap.cc:654] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:33.553249 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet fdbe21b4f124411988dd35a0b864f868 with delete_type TABLET_DATA_DELETED (replaced by tablet f756689d4c99489885a0cd59f84a6e8a) from {username='slave'} at 127.0.0.1:33500
W20260810 11:30:33.554235 26564 consensus_peers.cc:487] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 -> Peer c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547): Couldn't send request to peer c40c76e125b44de181b88b7f63a566f7. Status: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:33.557576 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8798892eb4604ee8ac9c95e64dbb14e9" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:33.557886 27055 raft_consensus.cc:3037] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:33.558292 28348 leader_election.cc:288] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:33.563133 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet a28849649c704f2fbdec1aced9ce01b1 with delete_type TABLET_DATA_DELETED (replaced by tablet eb9394f9ca2c44de93354e23973cf902) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.566376 27055 raft_consensus.cc:2454] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 2.
I20260810 11:30:33.566970 26848 leader_election.cc:302] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:33.567116 27228 tablet_bootstrap.cc:654] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:33.567452 28348 raft_consensus.cc:2781] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 11:30:33.567706 28348 raft_consensus.cc:686] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 2 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:33.568764 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 725d2e70e1d441b497d56a278e1de0ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:33500
I20260810 11:30:33.568385 28348 consensus_queue.cc:237] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:33.572988 26704 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.25.195.252:34489, user_credentials={real_user=slave}} blocked reactor thread for 63247.8us
I20260810 11:30:33.575671 26763 raft_consensus.cc:3037] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:33.582008 26915 raft_consensus.cc:3037] T a18cb43b4dc04a1290a6bade7ac1f3cf P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:33.587210 26849 leader_election.cc:341] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 8798892eb4604ee8ac9c95e64dbb14e9
I20260810 11:30:33.587679 27999 ts_tablet_manager.cc:1918] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:33.587901 27999 log.cc:1196] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/db5adccd80a04e328e13793b461c38b1
I20260810 11:30:33.590674 27911 consensus_queue.cc:1035] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:33.592103 27248 ts_tablet_manager.cc:1918] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:33.595721 27248 log.cc:1196] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/23d8ce485cb84495a6e964b6d5977f0d
I20260810 11:30:33.596910 27248 ts_tablet_manager.cc:1939] T 23d8ce485cb84495a6e964b6d5977f0d P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:33.599253 27974 rpcz_store.cc:276] 0810 11:30:26.360368 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.360426 (+ 58us) service_pool.cc:227] Handling call
0810 11:30:32.517949 (+6157523us) ts_tablet_manager.cc:1145] Deleting tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e
0810 11:30:32.517974 (+ 25us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:32.867494 (+349520us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.093368 (+225874us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.477819 (+384451us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6156963}
I20260810 11:30:33.601584 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 95) took 7339 ms. Trace:
I20260810 11:30:33.602144 27248 rpcz_store.cc:276] 0810 11:30:26.261987 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.262166 (+ 179us) service_pool.cc:227] Handling call
0810 11:30:33.493075 (+7230909us) ts_tablet_manager.cc:1145] Deleting tablet 23d8ce485cb84495a6e964b6d5977f0d
0810 11:30:33.493309 (+ 234us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:33.567393 (+ 74084us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.591904 (+ 24511us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.601516 (+ 9612us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7208599}
I20260810 11:30:33.604167 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 96) took 7311 ms. Trace:
I20260810 11:30:33.604888 27248 rpcz_store.cc:276] 0810 11:30:26.292265 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.292430 (+ 165us) service_pool.cc:227] Handling call
0810 11:30:33.603608 (+7311178us) ts_tablet_manager.cc:1145] Deleting tablet e31b380f99854eb8b63e1f9eede1fc7c
0810 11:30:33.603634 (+ 26us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:33.603987 (+ 353us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7306274}
I20260810 11:30:33.605511 27248 tablet_replica.cc:330] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:33.606290 27248 raft_consensus.cc:2229] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:33.607046 27248 raft_consensus.cc:2258] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:33.594749 28423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac259bcf213a4aa297d1d8e73b262361. Latest consensus state: current_term: 6 leader_uuid: "ac259bcf213a4aa297d1d8e73b262361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:33.609820 27248 ts_tablet_manager.cc:1905] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:33.610822 28423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:33.626575 27228 tablet_bootstrap.cc:492] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:33.629572 27999 ts_tablet_manager.cc:1939] T db5adccd80a04e328e13793b461c38b1 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:33.631546 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 65) took 7613 ms. Trace:
I20260810 11:30:33.631692 27999 rpcz_store.cc:276] 0810 11:30:26.017841 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.017889 (+ 48us) service_pool.cc:227] Handling call
0810 11:30:33.512541 (+7494652us) ts_tablet_manager.cc:1145] Deleting tablet db5adccd80a04e328e13793b461c38b1
0810 11:30:33.512551 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:33.521659 (+ 9108us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.587443 (+ 65784us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.631465 (+ 44022us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7493195}
I20260810 11:30:33.632229 27999 tablet_replica.cc:330] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:33.632717 27999 raft_consensus.cc:2229] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:33.633003 27999 raft_consensus.cc:2258] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:33.633574 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet db5adccd80a04e328e13793b461c38b1 (table default.Table_baaf705869df4c36a233bb967b25455a [id=f325caa441054ab180909b9af9de3ba6]) successfully deleted
I20260810 11:30:33.634078 27999 ts_tablet_manager.cc:1905] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:33.637327 27228 ts_tablet_manager.cc:1397] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.092s user 0.009s sys 0.004s
I20260810 11:30:33.639163 27911 consensus_queue.cc:1035] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:33.640923 27228 raft_consensus.cc:348] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:33.642112 27228 raft_consensus.cc:374] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:33.642695 27228 raft_consensus.cc:729] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:33.644330 27228 consensus_queue.cc:260] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:33.655292 27286 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 52a9367b7a8345739b5b9acf9ea1e6d8 consensus state has no leader
I20260810 11:30:33.631860 27222 tablet_bootstrap.cc:492] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:33.660036 27222 ts_tablet_manager.cc:1397] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.513s user 0.006s sys 0.002s
I20260810 11:30:33.663486 27228 ts_tablet_manager.cc:1428] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.025s user 0.005s sys 0.001s
I20260810 11:30:33.665768 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e (table default.Table_9b714db8cc714c0999f926e8182ca6e4 [id=b1d90eb4a63941fd83313166eed533dc]) successfully deleted
I20260810 11:30:33.666846 27228 tablet_bootstrap.cc:492] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:33.673663 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet cb01e54d817c4b0dbcc80f90f82923c0 (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]) successfully deleted
I20260810 11:30:33.675179 28423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "ac259bcf213a4aa297d1d8e73b262361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:33.676241 28423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:33.678316 28440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "ac259bcf213a4aa297d1d8e73b262361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:33.679174 27231 tablet_bootstrap.cc:492] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:33.679644 27231 ts_tablet_manager.cc:1397] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.138s user 0.007s sys 0.003s
I20260810 11:30:33.680778 27228 tablet_bootstrap.cc:654] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:33.682384 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 121) took 7203 ms. Trace:
I20260810 11:30:33.681331 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 23d8ce485cb84495a6e964b6d5977f0d (table default.Table_1ff9ed629e8b465e9ac5588ad616105a [id=75fe62ca5f6448c38b7f9f683cb932b5]) successfully deleted
W20260810 11:30:33.683920 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet e31b380f99854eb8b63e1f9eede1fc7c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e31b380f99854eb8b63e1f9eede1fc7c already in progress: creating tablet
I20260810 11:30:33.684521 28440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:33.688262 26914 raft_consensus.cc:3037] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:33.698040 28424 tablet.cc:1722] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:33.703939 27248 ts_tablet_manager.cc:1918] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:33.706328 27248 log.cc:1196] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/ffeb0373c6124af291336ca9da50c318
I20260810 11:30:33.711195 27231 raft_consensus.cc:348] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:33.712671 27231 raft_consensus.cc:374] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:33.717080 27222 raft_consensus.cc:348] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:33.717941 27222 raft_consensus.cc:374] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:33.718307 27222 raft_consensus.cc:729] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:33.726109 28394 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "ac259bcf213a4aa297d1d8e73b262361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:33.726975 28394 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: This master's current role is: LEADER
I20260810 11:30:33.737510 27222 consensus_queue.cc:260] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:33.682688 27974 rpcz_store.cc:276] 0810 11:30:26.448802 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.448853 (+ 51us) service_pool.cc:227] Handling call
0810 11:30:33.652118 (+7203265us) ts_tablet_manager.cc:1145] Deleting tablet 7d3406f12d9c492cbd0d86fa7a57de82
0810 11:30:33.652148 (+ 30us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:33.652512 (+ 364us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7202902}
I20260810 11:30:33.744441 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 122) took 7295 ms. Trace:
I20260810 11:30:33.745261 27974 rpcz_store.cc:276] 0810 11:30:26.448966 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.459358 (+ 10392us) service_pool.cc:227] Handling call
0810 11:30:33.744127 (+7284769us) ts_tablet_manager.cc:1145] Deleting tablet db59523b71224370bf5fce6b56592f71
0810 11:30:33.744154 (+ 27us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:33.744371 (+ 217us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7284460}
I20260810 11:30:33.745855 27974 tablet_replica.cc:330] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:33.746153 27974 raft_consensus.cc:2229] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:33.746547 27974 raft_consensus.cc:2258] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:33.747301 27974 ts_tablet_manager.cc:1905] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:33.757576 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7d3406f12d9c492cbd0d86fa7a57de82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d3406f12d9c492cbd0d86fa7a57de82 already in progress: creating tablet
I20260810 11:30:33.758195 27222 ts_tablet_manager.cc:1428] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.098s user 0.005s sys 0.001s
I20260810 11:30:33.759245 27222 tablet_bootstrap.cc:492] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:33.761412 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet db59523b71224370bf5fce6b56592f71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db59523b71224370bf5fce6b56592f71 already in progress: creating tablet
I20260810 11:30:33.780277 28346 tablet_loader.cc:96] loaded metadata for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14])
I20260810 11:30:33.788782 28346 tablet_loader.cc:96] loaded metadata for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7])
I20260810 11:30:33.713490 27248 ts_tablet_manager.cc:1939] T ffeb0373c6124af291336ca9da50c318 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:33.792078 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 97) took 7497 ms. Trace:
I20260810 11:30:33.749001 28342 raft_consensus.cc:482] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:33.793290 28342 raft_consensus.cc:504] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:33.794752 28342 leader_election.cc:288] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:33.792359 27248 rpcz_store.cc:276] 0810 11:30:26.294211 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.294326 (+ 115us) service_pool.cc:227] Handling call
0810 11:30:33.605404 (+7311078us) ts_tablet_manager.cc:1145] Deleting tablet ffeb0373c6124af291336ca9da50c318
0810 11:30:33.605424 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:33.686090 (+ 80666us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.703779 (+ 17689us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.791913 (+ 88134us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7303001}
I20260810 11:30:33.797807 27248 tablet_replica.cc:330] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:33.798060 27248 raft_consensus.cc:2229] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:33.798529 27248 raft_consensus.cc:2258] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:33.798934 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet ffeb0373c6124af291336ca9da50c318 (table default.Table_cc55e38123c6426fb73e83da0b48d081 [id=c1ed54f150864132aa31551870ffde82]) successfully deleted
I20260810 11:30:33.799856 27248 ts_tablet_manager.cc:1905] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:33.800800 28346 tablet_loader.cc:96] loaded metadata for tablet 00e63f994ff84941852b0cfee763c303 (table default.Table_b2381e8587204bffa96b34e428682d5d [id=d4074ee00ab24054b4121d5c9c74d9a4])
I20260810 11:30:33.809980 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f85c0767ad164075b87ba672cafafb47" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:33.812274 26993 leader_election.cc:341] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:33.815346 27222 tablet_bootstrap.cc:654] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:33.815791 27231 raft_consensus.cc:729] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:33.816512 27231 consensus_queue.cc:260] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:33.818203 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f85c0767ad164075b87ba672cafafb47" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:33.820358 28346 tablet_loader.cc:96] loaded metadata for tablet 046fede13acf44e294fde386f78446a5 (table default.Table_b15d6127087043a186b912230d2fe666 [id=ac5dd73c5e8e40108a8b663241887081])
I20260810 11:30:33.827265 27060 raft_consensus.cc:3037] T 4c595e0892634348b64418ae9dbbd4c2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:33.840981 27231 ts_tablet_manager.cc:1428] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.161s user 0.002s sys 0.002s
I20260810 11:30:33.844213 27231 tablet_bootstrap.cc:492] T 2126d95992e549b7b2b3e662b0d39a36 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:33.844533 28339 consensus_queue.cc:1035] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:33.853649 26991 leader_election.cc:341] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:33.854298 26991 leader_election.cc:302] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:33.855101 28342 raft_consensus.cc:2726] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:33.860186 28346 tablet_loader.cc:96] loaded metadata for tablet 0ad96bbd29ad4ce9a766ac84db1a9c60 (table default.Table_bc8bc2c9015443fb865751881638284b [id=3d0ee62af94a45ebb75470e84997368f])
I20260810 11:30:33.823762 27999 ts_tablet_manager.cc:1918] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:33.861666 27999 log.cc:1196] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/f3884736eec74c8992b8d51b37465875
I20260810 11:30:33.864202 27999 ts_tablet_manager.cc:1939] T f3884736eec74c8992b8d51b37465875 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:33.868439 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 64) took 7850 ms. Trace:
I20260810 11:30:33.869881 28346 tablet_loader.cc:96] loaded metadata for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6])
I20260810 11:30:33.871754 28346 tablet_loader.cc:96] loaded metadata for tablet 0cc17c55109b47eeb91920c3ed8178e0 (table default.Table_fee5e058d63849c189e798c232542ad2 [id=2c6a659407bc4d8dad087cb73c16e229])
I20260810 11:30:33.873380 28346 tablet_loader.cc:96] loaded metadata for tablet 0d7a07e844984b88ab81610cb95bf21e (table default.Table_b2c244ee13d14619b9f1eac6ab1aba2a [id=afa11e2df47a4a739727c8d834e24b84])
I20260810 11:30:33.874043 27999 rpcz_store.cc:276] 0810 11:30:26.017582 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.017629 (+ 47us) service_pool.cc:227] Handling call
0810 11:30:33.632105 (+7614476us) ts_tablet_manager.cc:1145] Deleting tablet f3884736eec74c8992b8d51b37465875
0810 11:30:33.632121 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:33.741295 (+109174us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.823401 (+ 82106us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.868364 (+ 44963us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7612253}
I20260810 11:30:33.883483 27222 tablet_bootstrap.cc:492] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:33.884146 27222 ts_tablet_manager.cc:1397] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.125s user 0.013s sys 0.000s
I20260810 11:30:33.885066 27248 ts_tablet_manager.cc:1918] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:33.885659 27248 log.cc:1196] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/7e3707ae32624f6483866208321eefde
I20260810 11:30:33.886245 27222 raft_consensus.cc:348] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:33.886831 27248 ts_tablet_manager.cc:1939] T 7e3707ae32624f6483866208321eefde P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:33.886793 27222 raft_consensus.cc:374] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:33.887356 27222 raft_consensus.cc:729] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:33.891674 27231 tablet_bootstrap.cc:654] T 2126d95992e549b7b2b3e662b0d39a36 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:33.893249 28342 raft_consensus.cc:482] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:33.893620 28342 raft_consensus.cc:504] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:33.894973 28342 leader_election.cc:288] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:33.896760 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2801709d53614916abac370f7ae5e913" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:33.897766 26993 leader_election.cc:341] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:33.891256 27222 consensus_queue.cc:260] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:33.906066 27222 ts_tablet_manager.cc:1428] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.021s user 0.004s sys 0.000s
I20260810 11:30:33.911340 28331 consensus_queue.cc:1035] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:33.913916 27222 tablet_bootstrap.cc:492] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:33.925007 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 99) took 7624 ms. Trace:
I20260810 11:30:33.925462 27248 rpcz_store.cc:276] 0810 11:30:26.300825 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.300889 (+ 64us) service_pool.cc:227] Handling call
0810 11:30:33.797699 (+7496810us) ts_tablet_manager.cc:1145] Deleting tablet 7e3707ae32624f6483866208321eefde
0810 11:30:33.797715 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:33.805317 (+ 7602us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.880330 (+ 75013us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.924893 (+ 44563us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7493585}
I20260810 11:30:33.926391 28346 tablet_loader.cc:96] loaded metadata for tablet 0edef936026743a896d5a73c134a8bca (table default.Table_bcf64628ba2c463ba5acce6617ec4324 [id=d823bbbb98b14646a119632dc037ad03])
I20260810 11:30:33.926697 27248 tablet_replica.cc:330] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:33.927078 27248 raft_consensus.cc:2229] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:33.875142 28316 consensus_queue.cc:1035] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:33.877683 27228 tablet_bootstrap.cc:492] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:33.927729 27228 ts_tablet_manager.cc:1397] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.262s user 0.037s sys 0.082s
I20260810 11:30:33.928998 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet f3884736eec74c8992b8d51b37465875 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]) successfully deleted
I20260810 11:30:33.929646 27228 raft_consensus.cc:348] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:33.930222 27228 raft_consensus.cc:374] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:33.930409 27228 raft_consensus.cc:729] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:33.927341 27248 raft_consensus.cc:2258] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:33.930922 27228 consensus_queue.cc:260] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:33.931983 27228 ts_tablet_manager.cc:1428] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 11:30:33.919806 28348 raft_consensus.cc:482] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:33.932188 27248 ts_tablet_manager.cc:1905] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:33.896238 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2801709d53614916abac370f7ae5e913" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:33.932298 28348 raft_consensus.cc:504] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:33.933503 28348 leader_election.cc:288] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:33.934540 27228 tablet_bootstrap.cc:492] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
W20260810 11:30:33.934587 26991 leader_election.cc:341] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:33.934883 26991 leader_election.cc:302] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:33.935760 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 7e3707ae32624f6483866208321eefde (table default.Table_dcc367d62a8f4e07a9e10fbb2faa27d1 [id=742f385d32c24e459b83a90971ad60ed]) successfully deleted
I20260810 11:30:33.937898 27228 tablet_bootstrap.cc:654] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:33.930915 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 66) took 7910 ms. Trace:
I20260810 11:30:33.946282 27911 raft_consensus.cc:2726] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:33.950645 27248 ts_tablet_manager.cc:1918] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 11:30:33.945111 26849 consensus_peers.cc:487] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:33.948268 26848 leader_election.cc:341] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 5ca5c88585394dba87e201696afa6934
W20260810 11:30:33.952911 26849 leader_election.cc:341] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 5ca5c88585394dba87e201696afa6934
I20260810 11:30:33.953270 26849 leader_election.cc:302] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:33.953860 28359 raft_consensus.cc:2726] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:33.954990 27999 rpcz_store.cc:276] 0810 11:30:26.019995 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.020035 (+ 40us) service_pool.cc:227] Handling call
0810 11:30:33.930594 (+7910559us) ts_tablet_manager.cc:1145] Deleting tablet 1aa4562a2247405187d9dbd1baa48f39
0810 11:30:33.930622 (+ 28us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:33.930828 (+ 206us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7909891}
W20260810 11:30:33.956198 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 1aa4562a2247405187d9dbd1baa48f39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1aa4562a2247405187d9dbd1baa48f39 already in progress: creating tablet
I20260810 11:30:33.959879 27999 tablet_replica.cc:330] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:33.961040 28346 tablet_loader.cc:96] loaded metadata for tablet 0f048b690d764c83a4a9ce4cbadc75b0 (table default.Table_dc83172ee2e44eccab63bccfa35523fe [id=19ea42a81c4f471592628b27a3404c4b])
I20260810 11:30:33.964373 28346 tablet_loader.cc:96] loaded metadata for tablet 12d5aaa533ad4d719c480098da979fc7 (table default.Table_f8b086b05e6b4174a3494b211543a5c8 [id=0332305d764840cd9789d29ac4527fee])
I20260810 11:30:33.964794 27248 log.cc:1196] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/1a83391804894d268d0e603f4feb1745
I20260810 11:30:33.965651 27248 ts_tablet_manager.cc:1939] T 1a83391804894d268d0e603f4feb1745 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:33.956538 27974 ts_tablet_manager.cc:1918] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:33.967918 27974 log.cc:1196] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/ffeb0373c6124af291336ca9da50c318
I20260810 11:30:33.968283 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 98) took 7670 ms. Trace:
I20260810 11:30:33.968717 27248 rpcz_store.cc:276] 0810 11:30:26.297892 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.297969 (+ 77us) service_pool.cc:227] Handling call
0810 11:30:33.926546 (+7628577us) ts_tablet_manager.cc:1145] Deleting tablet 1a83391804894d268d0e603f4feb1745
0810 11:30:33.926577 (+ 31us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:33.945290 (+ 18713us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.950452 (+ 5162us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.968180 (+ 17728us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7611451}
I20260810 11:30:33.970367 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 1a83391804894d268d0e603f4feb1745 (table default.Table_9329d33b857541719c3852e79fdc14b6 [id=d74c35e9ac524f3798c37c9b6a422a82]) successfully deleted
I20260810 11:30:33.970486 27974 ts_tablet_manager.cc:1939] T ffeb0373c6124af291336ca9da50c318 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:33.972432 27248 tablet_replica.cc:330] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:33.972992 27248 raft_consensus.cc:2229] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:33.973436 27248 pending_rounds.cc:62] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215: Trying to abort 1 pending ops.
I20260810 11:30:33.973619 27248 pending_rounds.cc:68] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936428657565696 op_type: NO_OP noop_request { }
I20260810 11:30:33.975518 27248 raft_consensus.cc:2866] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:33.975854 27248 raft_consensus.cc:2258] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:33.960503 27999 raft_consensus.cc:2229] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:33.976631 27999 raft_consensus.cc:2258] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:33.980041 27999 ts_tablet_manager.cc:1905] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:33.981746 27222 tablet_bootstrap.cc:654] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:33.982507 26848 consensus_peers.cc:487] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:33.986956 28346 tablet_loader.cc:96] loaded metadata for tablet 1549a26ba0f6427fae87b204c5d49eff (table default.Table_f55e75edcec14683a44d60250c42dbc7 [id=4f456ea1fbfe40dc8ed31415b77d4743])
I20260810 11:30:33.993631 27228 tablet_bootstrap.cc:492] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:33.994020 27248 ts_tablet_manager.cc:1905] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:33.996465 27228 ts_tablet_manager.cc:1397] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.061s user 0.008s sys 0.004s
I20260810 11:30:33.989979 28346 tablet_loader.cc:96] loaded metadata for tablet 16101a5784394d3aa570f4ecd8f2ac56 (table default.Table_645b3efca425434da139268167fec99f [id=51dc04b8252b4142a7ac67c5fc0dd1ad])
I20260810 11:30:33.999881 28346 tablet_loader.cc:96] loaded metadata for tablet 17ff4152fc6a449db3a172c5d948168f (table default.Table_91c2ed7bba91469685ccb4e15fb5c174 [id=163ec39724a44b518f07abf5938fbcb7])
I20260810 11:30:34.001870 28346 tablet_loader.cc:96] loaded metadata for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b])
I20260810 11:30:34.004941 28346 tablet_loader.cc:96] loaded metadata for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0])
I20260810 11:30:34.005175 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 120) took 7556 ms. Trace:
I20260810 11:30:34.009295 27228 raft_consensus.cc:348] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:34.011164 27291 leader_election.cc:334] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489): Timed out: RequestConsensusVote RPC to 127.25.195.252:34489 timed out after 0.682s (SENT)
I20260810 11:30:34.011579 27291 leader_election.cc:302] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83cc8e39a3b9455f8242a6da6a54c38a; no voters: ac259bcf213a4aa297d1d8e73b262361, c40c76e125b44de181b88b7f63a566f7
I20260810 11:30:34.012621 28440 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260810 11:30:34.016508 27248 ts_tablet_manager.cc:1918] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:34.016669 28346 tablet_loader.cc:96] loaded metadata for tablet 2126d95992e549b7b2b3e662b0d39a36 (table default.Table_21a675494284471eaf3ea50b31b833d7 [id=46a8ee2948c04311b0d3c1a5174d08dc])
I20260810 11:30:34.016829 27248 log.cc:1196] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/eb9394f9ca2c44de93354e23973cf902
I20260810 11:30:34.005484 27974 rpcz_store.cc:276] 0810 11:30:26.448640 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.463469 (+ 14829us) service_pool.cc:227] Handling call
0810 11:30:33.745763 (+7282294us) ts_tablet_manager.cc:1145] Deleting tablet ffeb0373c6124af291336ca9da50c318
0810 11:30:33.745775 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:33.868414 (+122639us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:33.956350 (+ 87936us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.005033 (+ 48683us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7282001}
I20260810 11:30:34.020159 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet ffeb0373c6124af291336ca9da50c318 (table default.Table_cc55e38123c6426fb73e83da0b48d081 [id=c1ed54f150864132aa31551870ffde82]) successfully deleted
I20260810 11:30:34.020932 27222 tablet_bootstrap.cc:492] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:34.021577 27222 ts_tablet_manager.cc:1397] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.109s user 0.009s sys 0.000s
I20260810 11:30:34.025256 28346 tablet_loader.cc:96] loaded metadata for tablet 214be3356fda4c8484596196c0985721 (table default.Table_5a4c04e087c3490fae87a17247850531 [id=323f239c11f84a69beaf74e68c0cf50a])
I20260810 11:30:34.026170 28346 tablet_loader.cc:96] loaded metadata for tablet 23637a02b6464e17aa2a69ea5cc4ddfe (table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85])
I20260810 11:30:34.028926 27248 ts_tablet_manager.cc:1939] T eb9394f9ca2c44de93354e23973cf902 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:34.030663 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 100) took 7707 ms. Trace:
I20260810 11:30:34.030918 27248 rpcz_store.cc:276] 0810 11:30:26.322836 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.322952 (+ 116us) service_pool.cc:227] Handling call
0810 11:30:33.972149 (+7649197us) ts_tablet_manager.cc:1145] Deleting tablet eb9394f9ca2c44de93354e23973cf902
0810 11:30:33.972331 (+ 182us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:34.002401 (+ 30070us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.016308 (+ 13907us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.030619 (+ 14311us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1408,"tablet-delete.queue_time_us":7646604}
I20260810 11:30:34.031232 27222 raft_consensus.cc:348] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.032187 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet eb9394f9ca2c44de93354e23973cf902 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]) successfully deleted
I20260810 11:30:34.029950 28345 raft_consensus.cc:482] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:34.032953 27248 tablet_replica.cc:330] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:34.032883 27222 raft_consensus.cc:374] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:34.033207 27222 raft_consensus.cc:729] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:34.033083 28345 raft_consensus.cc:504] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:34.033511 27248 raft_consensus.cc:2229] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:34.033860 27248 raft_consensus.cc:2258] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:34.034768 28345 leader_election.cc:288] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:34.034950 27248 ts_tablet_manager.cc:1905] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:34.025348 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 119) took 7575 ms. Trace:
I20260810 11:30:34.035262 27974 rpcz_store.cc:276] 0810 11:30:26.448482 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.448534 (+ 52us) service_pool.cc:227] Handling call
0810 11:30:34.020962 (+7572428us) ts_tablet_manager.cc:1145] Deleting tablet 81f24c84cdd945b78f39f24015eb1e43
0810 11:30:34.020981 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:34.024014 (+ 3033us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7550501}
I20260810 11:30:34.036006 27974 tablet_replica.cc:330] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:34.035936 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87f6835f0dc4ad4b3a23b297726100d" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:34.035881 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87f6835f0dc4ad4b3a23b297726100d" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:34.036428 27974 raft_consensus.cc:2229] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:34.036880 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 81f24c84cdd945b78f39f24015eb1e43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81f24c84cdd945b78f39f24015eb1e43 already in progress: creating tablet
I20260810 11:30:34.025509 27228 raft_consensus.cc:374] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:34.038350 27228 raft_consensus.cc:729] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:34.038309 26848 leader_election.cc:302] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:34.040719 28345 raft_consensus.cc:2726] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:34.038959 27228 consensus_queue.cc:260] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:34.048252 27974 raft_consensus.cc:2258] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:34.047591 27222 consensus_queue.cc:260] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.053663 27228 ts_tablet_manager.cc:1428] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.056s user 0.005s sys 0.001s
I20260810 11:30:34.057420 28346 tablet_loader.cc:96] loaded metadata for tablet 262656cbd3944702ac0ce04222cda500 (table default.Table_174d1e3073a34beabbd10fd4f6d61bd4 [id=d538eb7fe6224d6895190c79c041b76f])
I20260810 11:30:34.065574 27228 tablet_bootstrap.cc:492] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:34.065018 27974 ts_tablet_manager.cc:1905] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:34.066160 28346 tablet_loader.cc:96] loaded metadata for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e])
I20260810 11:30:34.068328 28345 raft_consensus.cc:482] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:34.068816 28345 raft_consensus.cc:504] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:34.070192 27999 ts_tablet_manager.cc:1918] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:34.066205 27222 ts_tablet_manager.cc:1428] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.044s user 0.006s sys 0.000s
I20260810 11:30:34.071033 28346 tablet_loader.cc:96] loaded metadata for tablet 2b95f3ec8ff34c89a68cd1edf8391f9b (table default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e])
I20260810 11:30:34.045548 28342 consensus_queue.cc:1035] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260810 11:30:34.041733 27231 tablet_bootstrap.cc:492] T 2126d95992e549b7b2b3e662b0d39a36 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
W20260810 11:30:34.062098 26993 consensus_peers.cc:487] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:34.082000 27231 ts_tablet_manager.cc:1397] T 2126d95992e549b7b2b3e662b0d39a36 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.238s user 0.013s sys 0.009s
I20260810 11:30:34.083034 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3406dc345e3429fb4bce5a59643b686" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:34.076602 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3406dc345e3429fb4bce5a59643b686" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:34.096156 27222 tablet_bootstrap.cc:492] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:34.070823 28345 leader_election.cc:288] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:34.094094 27228 tablet_bootstrap.cc:654] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:34.108546 27999 log.cc:1196] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/2917f1ffb5214a80b19810540602df35
I20260810 11:30:34.094002 26849 leader_election.cc:302] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:34.110396 28345 raft_consensus.cc:2726] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:34.111606 26915 raft_consensus.cc:3037] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:34.111974 27999 ts_tablet_manager.cc:1939] T 2917f1ffb5214a80b19810540602df35 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:34.118503 26383 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
/tmp/dist-test-taskNjNKA2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.195.253:34547
--webserver_interface=127.25.195.253
--webserver_port=42129
--builtin_ntp_servers=127.25.195.212:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260810 11:30:34.123564 28346 tablet_loader.cc:96] loaded metadata for tablet 34ed8c9efa634fc7b091b1bb6bc6d452 (table default.Table_fd64c13d7a514c7285b42e1c91a63cdf [id=7c8348b49b664bee8d8243efb2cdbb79])
I20260810 11:30:34.130362 28346 tablet_loader.cc:96] loaded metadata for tablet 3604b43dcdfc469db476f3d0e2f900bb (table default.Table_7d84624ac4e94437acb400decf3bb21b [id=0f6c3eaa5abb4fc5a07a723ed77c2e35])
I20260810 11:30:34.130757 27231 raft_consensus.cc:348] T 2126d95992e549b7b2b3e662b0d39a36 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:34.131403 27231 raft_consensus.cc:374] T 2126d95992e549b7b2b3e662b0d39a36 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:34.126215 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 63) took 8108 ms. Trace:
I20260810 11:30:34.129335 27228 tablet_bootstrap.cc:492] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:34.132186 27228 ts_tablet_manager.cc:1397] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.068s user 0.004s sys 0.004s
I20260810 11:30:34.134459 27228 raft_consensus.cc:348] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:34.135242 27228 raft_consensus.cc:374] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:34.135545 27228 raft_consensus.cc:729] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:34.136114 27228 consensus_queue.cc:260] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:34.137902 27228 ts_tablet_manager.cc:1428] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260810 11:30:34.138515 27228 tablet_bootstrap.cc:492] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:34.140929 28346 tablet_loader.cc:96] loaded metadata for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7])
I20260810 11:30:34.145350 28346 tablet_loader.cc:96] loaded metadata for tablet 37cecd4266eb47669e7fd5cfeb847adc (table default.Table_7c178d343d8246599a00f6d1c602a818 [id=0e39402016b54f588ea123ee4ea9788a])
I20260810 11:30:34.153853 28346 tablet_loader.cc:96] loaded metadata for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_56b4699099fd417496e71ccbed272638 [id=72829be151bc48dba287b32c7028caf7])
I20260810 11:30:34.131971 27999 rpcz_store.cc:276] 0810 11:30:26.017493 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.018491 (+ 998us) service_pool.cc:227] Handling call
0810 11:30:33.959736 (+7941245us) ts_tablet_manager.cc:1145] Deleting tablet 2917f1ffb5214a80b19810540602df35
0810 11:30:33.959770 (+ 34us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:34.028985 (+ 69215us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.069791 (+ 40806us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.126106 (+ 56315us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7938796}
I20260810 11:30:34.157502 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 2917f1ffb5214a80b19810540602df35 (table default.Table_fa1a8ca288074aa495b826ea794186bb [id=e34ecb3dff68425b9c53395ce189841b]) successfully deleted
I20260810 11:30:34.157737 28342 consensus_queue.cc:1035] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:34.158452 27231 raft_consensus.cc:729] T 2126d95992e549b7b2b3e662b0d39a36 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:34.159416 27231 consensus_queue.cc:260] T 2126d95992e549b7b2b3e662b0d39a36 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:34.161404 27231 ts_tablet_manager.cc:1428] T 2126d95992e549b7b2b3e662b0d39a36 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.079s user 0.007s sys 0.000s
I20260810 11:30:34.168510 28346 tablet_loader.cc:96] loaded metadata for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea])
I20260810 11:30:34.173588 27999 tablet_replica.cc:330] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:34.174665 27999 raft_consensus.cc:2229] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:34.175932 27999 raft_consensus.cc:2258] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:34.177805 28346 tablet_loader.cc:96] loaded metadata for tablet 3a0284718f694a0591888e81357721b0 (table default.Table_ddaa0e35d54b49c894cbf994bb7fbbab [id=ed36f07f53e04f308770145b0d7435ac])
I20260810 11:30:34.176540 27228 tablet_bootstrap.cc:654] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:34.193082 27222 tablet_bootstrap.cc:654] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:34.185269 26849 consensus_peers.cc:487] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:34.182231 27999 ts_tablet_manager.cc:1905] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:34.195847 27248 ts_tablet_manager.cc:1918] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:34.196135 27248 log.cc:1196] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/31cafb7c691d40a48a40f7d4190c4f8d
I20260810 11:30:34.196144 28346 tablet_loader.cc:96] loaded metadata for tablet 3a1e46f80f7f4e3a84638421892e6236 (table default.Table_49be430f1e8f475482b54850772c0430 [id=82e113439bc04ce9955f59612ba480dc])
I20260810 11:30:34.196796 27248 ts_tablet_manager.cc:1939] T 31cafb7c691d40a48a40f7d4190c4f8d P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:34.198271 28346 tablet_loader.cc:96] loaded metadata for tablet 3ccef06fa06c4c519d8760fa948d6c8b (table default.Table_abbbb80ecbe4491d98912dcdcaab5dd3 [id=ba999b4084c84b2f8e0313b96849b169])
I20260810 11:30:34.199723 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 101) took 7876 ms. Trace:
I20260810 11:30:34.199875 27248 rpcz_store.cc:276] 0810 11:30:26.323446 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.323497 (+ 51us) service_pool.cc:227] Handling call
0810 11:30:34.032851 (+7709354us) ts_tablet_manager.cc:1145] Deleting tablet 31cafb7c691d40a48a40f7d4190c4f8d
0810 11:30:34.032878 (+ 27us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:34.082077 (+ 49199us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.175256 (+ 93179us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.199691 (+ 24435us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7706130}
I20260810 11:30:34.200911 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 31cafb7c691d40a48a40f7d4190c4f8d (table default.Table_891d3f4e3019401fbb1b13496065cb5c [id=7213c582179a43c1b80901a2266e5477]) successfully deleted
I20260810 11:30:34.202267 27231 tablet_bootstrap.cc:492] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:34.213845 28346 tablet_loader.cc:96] loaded metadata for tablet 3ddb6e67c316416681074e454ab9b01e (table default.Table_1e1ca07e9c824349af23675b66b77321 [id=755202f095f04307a11ce87087df835c])
I20260810 11:30:34.213932 28359 raft_consensus.cc:482] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:34.214274 28359 raft_consensus.cc:504] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:34.215723 28359 leader_election.cc:288] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:34.216895 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a83391804894d268d0e603f4feb1745" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:34.217796 26848 leader_election.cc:341] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 1a83391804894d268d0e603f4feb1745
W20260810 11:30:34.218580 26849 leader_election.cc:341] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:34.218906 26849 leader_election.cc:302] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:34.218871 27974 ts_tablet_manager.cc:1918] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:34.219430 28359 raft_consensus.cc:2726] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:34.219755 27974 log.cc:1196] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/a7a2cb1d2e8e40f58144908e34438d53
I20260810 11:30:34.234510 27228 tablet_bootstrap.cc:492] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:34.235096 27228 ts_tablet_manager.cc:1397] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.097s user 0.004s sys 0.004s
I20260810 11:30:34.237253 27228 raft_consensus.cc:348] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.240244 28346 tablet_loader.cc:96] loaded metadata for tablet 40f5eecfc66a4711aef60c1a2bff6b97 (table default.Table_3efc57bdbafc46dfab4d324acb0d5f73 [id=bcba186b6e93492fb06f70e033be3296])
I20260810 11:30:34.241125 27055 raft_consensus.cc:3037] T 2126d95992e549b7b2b3e662b0d39a36 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:34.242306 27231 tablet_bootstrap.cc:654] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:34.244731 27228 raft_consensus.cc:374] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:34.244930 27228 raft_consensus.cc:729] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:34.245491 27228 consensus_queue.cc:260] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.254140 27228 ts_tablet_manager.cc:1428] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.019s user 0.004s sys 0.000s
I20260810 11:30:34.255021 27228 tablet_bootstrap.cc:492] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:34.244462 28346 tablet_loader.cc:96] loaded metadata for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599])
W20260810 11:30:34.263357 26849 consensus_peers.cc:487] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3c6bd6803c245b7bb3d78423de482b6. This is attempt 6: this message will repeat every 5th retry.
I20260810 11:30:34.265952 28346 tablet_loader.cc:96] loaded metadata for tablet 490ada0a918d48c3a07e12eed58bda19 (table default.Table_ba61129cdf35481dbf06effd223949f6 [id=e20f1c45c6d743cba2c3cc60c78186a4])
I20260810 11:30:34.271986 27999 ts_tablet_manager.cc:1918] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:34.274714 28342 raft_consensus.cc:482] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:34.275044 28342 raft_consensus.cc:504] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.275439 28346 tablet_loader.cc:96] loaded metadata for tablet 499be709844f4a2cbc88e55dd628f985 (table default.Table_711dc900ac3b45b8897cd1fbc2964dec [id=5e0aa4c382c24a7d9380bec9f8a50ad7])
I20260810 11:30:34.276285 28342 leader_election.cc:288] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:34.278501 28346 tablet_loader.cc:96] loaded metadata for tablet 4efa31ad2ce8436b9638e6759d9b5421 (table default.Table_f3567f07068942e9a5d42f9877f39bb7 [id=c557d3488f464c5bbff89fd13e52b02a])
I20260810 11:30:34.280292 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd4f555b5d840c182a31b3c94da9619" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:34.282292 26993 leader_election.cc:341] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:34.288254 26564 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.253:34547, user_credentials={real_user=slave}} blocked reactor thread for 105100us
I20260810 11:30:34.274330 27228 tablet_bootstrap.cc:654] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:34.279561 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd4f555b5d840c182a31b3c94da9619" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:34.280867 28461 log.cc:924] Time spent T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700: Append to log took a long time: real 0.085s user 0.001s sys 0.000s
W20260810 11:30:34.298998 26991 leader_election.cc:341] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:34.299356 26991 leader_election.cc:302] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:34.299603 27999 log.cc:1196] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/7eae49e1c6554ba2ae831831ff4bb45c
I20260810 11:30:34.300622 27999 ts_tablet_manager.cc:1939] T 7eae49e1c6554ba2ae831831ff4bb45c P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:34.300961 28346 tablet_loader.cc:96] loaded metadata for tablet 501defb075d142ec8b22e5e8236a009c (table default.Table_a48c8668e73f4919a9c32c9c3e95f485 [id=46bda36574e1430dbada751ccf16703c])
I20260810 11:30:34.301075 27248 tablet_replica.cc:330] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:34.301692 27248 raft_consensus.cc:2229] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:34.303531 28346 tablet_loader.cc:96] loaded metadata for tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae])
I20260810 11:30:34.305465 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 61) took 8300 ms. Trace:
I20260810 11:30:34.306355 27231 tablet_bootstrap.cc:492] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:34.306702 27231 ts_tablet_manager.cc:1397] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.105s user 0.010s sys 0.000s
I20260810 11:30:34.307523 27999 rpcz_store.cc:276] 0810 11:30:26.004667 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.004745 (+ 78us) service_pool.cc:227] Handling call
0810 11:30:34.173362 (+8168617us) ts_tablet_manager.cc:1145] Deleting tablet 7eae49e1c6554ba2ae831831ff4bb45c
0810 11:30:34.173398 (+ 36us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:34.232053 (+ 58655us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.271740 (+ 39687us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.305385 (+ 33645us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8136603}
I20260810 11:30:34.307626 27231 raft_consensus.cc:348] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.307878 27231 raft_consensus.cc:374] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:34.307940 27231 raft_consensus.cc:729] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:34.308156 27231 consensus_queue.cc:260] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.308532 28213 raft_consensus.cc:2726] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:34.312440 28316 raft_consensus.cc:482] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 443ec871f1ed4232b932ecfb0b18510d)
I20260810 11:30:34.312875 28316 raft_consensus.cc:504] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.313441 28346 tablet_loader.cc:96] loaded metadata for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070])
I20260810 11:30:34.314270 28316 leader_election.cc:288] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:34.309165 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 7eae49e1c6554ba2ae831831ff4bb45c (table default.Table_29f8cf6d48514b87bae05b1c797607cd [id=aee0dce4bed94ceebb0ad9fbba02f4b3]) successfully deleted
I20260810 11:30:34.315996 27248 raft_consensus.cc:2258] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:34.316777 28346 tablet_loader.cc:96] loaded metadata for tablet 5409c96c1949416e85cfcaa8f2f61227 (table default.Table_da82b7e264034027b41209e3a8be8903 [id=d7ee651e98084bd798d76ecf28546e83])
I20260810 11:30:34.317045 27248 ts_tablet_manager.cc:1905] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:34.317153 26849 leader_election.cc:341] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 1e0a8513171f4c39b74c08760a139d9e
I20260810 11:30:34.318864 28346 tablet_loader.cc:96] loaded metadata for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a])
I20260810 11:30:34.319584 28346 tablet_loader.cc:96] loaded metadata for tablet 5a2e1b54043444989ac64c87f30ffc07 (table default.Table_341bf544f7b94ef2ba94afc342f8bc1f [id=193e8263e8a54ee798e1d4406074a52f])
I20260810 11:30:34.323612 27228 tablet_bootstrap.cc:492] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:34.323608 28346 tablet_loader.cc:96] loaded metadata for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14])
I20260810 11:30:34.324115 27228 ts_tablet_manager.cc:1397] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.069s user 0.009s sys 0.001s
I20260810 11:30:34.324155 28346 tablet_loader.cc:96] loaded metadata for tablet 5ea85f89d7a64080a66f1251cd038039 (table default.Table_84fd493f2b9e4a46aa2035a43a9069a1 [id=773fafc7914a45dabad64680fc3a4a27])
I20260810 11:30:34.324821 28346 tablet_loader.cc:96] loaded metadata for tablet 5eb3dd7bd54c485d9ea0c2186f799d0f (table default.Table_4eef50b9dbea413f91b6b6a35c997283 [id=6eb74fbbf5db4f2f8434c3c9a83188b7])
I20260810 11:30:34.325466 28346 tablet_loader.cc:96] loaded metadata for tablet 5eff8ccaa3ad4187aa00c33abd7131ae (table default.Table_8589a61b5c4e42c0a92a80a3576db8ac [id=0d2a77edfa664f679468b8b3cac2d9ee])
I20260810 11:30:34.325707 27999 tablet_replica.cc:330] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:34.327028 27999 raft_consensus.cc:2229] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:34.328306 27999 raft_consensus.cc:2258] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:34.327692 27228 raft_consensus.cc:348] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.328761 27228 raft_consensus.cc:374] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:34.329790 27999 ts_tablet_manager.cc:1905] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:34.329998 27228 raft_consensus.cc:729] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
W20260810 11:30:34.332178 26848 leader_election.cc:341] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 1e0a8513171f4c39b74c08760a139d9e
I20260810 11:30:34.334715 28346 tablet_loader.cc:96] loaded metadata for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219])
I20260810 11:30:34.335186 26848 leader_election.cc:302] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:34.335819 27228 consensus_queue.cc:260] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.337554 27974 ts_tablet_manager.cc:1939] T a7a2cb1d2e8e40f58144908e34438d53 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:34.341202 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 118) took 7892 ms. Trace:
I20260810 11:30:34.341509 27974 rpcz_store.cc:276] 0810 11:30:26.448334 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.474223 (+ 25889us) service_pool.cc:227] Handling call
0810 11:30:34.035807 (+7561584us) ts_tablet_manager.cc:1145] Deleting tablet a7a2cb1d2e8e40f58144908e34438d53
0810 11:30:34.035862 (+ 55us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:34.099460 (+ 63598us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.218033 (+118573us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.341116 (+123083us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7556570}
I20260810 11:30:34.342480 28348 raft_consensus.cc:2726] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:34.342447 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 117) took 7894 ms. Trace:
I20260810 11:30:34.342806 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet a7a2cb1d2e8e40f58144908e34438d53 (table default.Table_05a7698994184d6bbed238252235f5f8 [id=7d1bf48b16db41a0a41a092bb07b8753]) successfully deleted
I20260810 11:30:34.342907 27974 rpcz_store.cc:276] 0810 11:30:26.448110 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.478865 (+ 30755us) service_pool.cc:227] Handling call
0810 11:30:34.342227 (+7863362us) ts_tablet_manager.cc:1145] Deleting tablet e31b380f99854eb8b63e1f9eede1fc7c
0810 11:30:34.342250 (+ 23us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:34.342405 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7862700}
W20260810 11:30:34.343665 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet e31b380f99854eb8b63e1f9eede1fc7c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e31b380f99854eb8b63e1f9eede1fc7c already in progress: creating tablet
I20260810 11:30:34.344352 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 133) took 7029 ms. Trace:
I20260810 11:30:34.344632 27974 rpcz_store.cc:276] 0810 11:30:27.314791 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.314850 (+ 59us) service_pool.cc:227] Handling call
0810 11:30:34.344097 (+7029247us) ts_tablet_manager.cc:1145] Deleting tablet 7e78fb1bf0534deca5cc5a603fd77592
0810 11:30:34.344114 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:34.344292 (+ 178us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7028896}
W20260810 11:30:34.345510 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7e78fb1bf0534deca5cc5a603fd77592 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e78fb1bf0534deca5cc5a603fd77592 already in progress: creating tablet
I20260810 11:30:34.347071 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 134) took 7031 ms. Trace:
I20260810 11:30:34.347750 27974 rpcz_store.cc:276] 0810 11:30:27.315337 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.315384 (+ 47us) service_pool.cc:227] Handling call
0810 11:30:34.346580 (+7031196us) ts_tablet_manager.cc:1145] Deleting tablet 2da86554bc51486e91f1ea5995a245b5
0810 11:30:34.346625 (+ 45us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:34.346968 (+ 343us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7030762}
I20260810 11:30:34.348157 28346 tablet_loader.cc:96] loaded metadata for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_f3f00d1fa4db4cd4bbaaeefeef68897d [id=4cda0e139cc34db8ae99e56a074f5557])
I20260810 11:30:34.349476 28346 tablet_loader.cc:96] loaded metadata for tablet 6926d0dc68fa48ae8ffabf5b5272b3d0 (table default.Table_96d4976d4de649c4a98910a1b7fd1b59 [id=777f92ce815f4314898abce665fec1eb])
W20260810 11:30:34.349689 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2da86554bc51486e91f1ea5995a245b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2da86554bc51486e91f1ea5995a245b5 already in progress: creating tablet
I20260810 11:30:34.350553 27974 tablet_replica.cc:330] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:34.351181 27974 raft_consensus.cc:2229] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:34.353468 27222 tablet_bootstrap.cc:492] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:34.353785 27222 ts_tablet_manager.cc:1397] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.263s user 0.011s sys 0.010s
W20260810 11:30:34.356220 26849 consensus_peers.cc:487] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96cae4eb16c84410926a317af70e44f7. This is attempt 6: this message will repeat every 5th retry.
I20260810 11:30:34.364326 27231 ts_tablet_manager.cc:1428] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.057s user 0.003s sys 0.002s
I20260810 11:30:34.365201 27228 ts_tablet_manager.cc:1428] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.041s user 0.002s sys 0.002s
I20260810 11:30:34.355533 27222 raft_consensus.cc:348] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:34.365706 27222 raft_consensus.cc:374] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:34.365933 27222 raft_consensus.cc:729] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:34.366334 27222 consensus_queue.cc:260] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:34.367647 27222 ts_tablet_manager.cc:1428] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260810 11:30:34.368287 27222 tablet_bootstrap.cc:492] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:34.368757 27974 raft_consensus.cc:2258] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:34.381212 27228 tablet_bootstrap.cc:492] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:34.383750 28346 tablet_loader.cc:96] loaded metadata for tablet 6c5b650bc02f4fa393bada5b54c77f1f (table default.Table_afde78ad5bfa4a23828df391f669e7fa [id=3d8c46d7a15e457a93fd615ad99a4f36])
I20260810 11:30:34.381114 28359 consensus_queue.cc:1035] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:34.383710 27974 ts_tablet_manager.cc:1905] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:34.385147 27231 tablet_bootstrap.cc:492] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:34.389947 28346 tablet_loader.cc:96] loaded metadata for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05])
W20260810 11:30:34.390290 26849 consensus_peers.cc:487] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8798892eb4604ee8ac9c95e64dbb14e9. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:34.393762 28346 tablet_loader.cc:96] loaded metadata for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4])
I20260810 11:30:34.395856 28359 raft_consensus.cc:482] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:34.396922 28359 raft_consensus.cc:504] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.400538 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb6805a5dd264939850ea2cd9a850a1f" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:34.402192 26849 leader_election.cc:341] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:34.403954 27228 tablet_bootstrap.cc:654] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:34.407879 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb6805a5dd264939850ea2cd9a850a1f" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:34.405059 28345 raft_consensus.cc:482] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:34.408372 28345 raft_consensus.cc:504] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
W20260810 11:30:34.409108 26848 leader_election.cc:341] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:34.409400 26848 leader_election.cc:302] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:34.409695 28345 leader_election.cc:288] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:34.410053 28345 raft_consensus.cc:2726] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:34.410907 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0118ff9d21924aefa8c6c32977c10453" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:34.411414 26767 raft_consensus.cc:2454] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:34.413084 26849 leader_election.cc:302] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:34.414167 28345 raft_consensus.cc:2781] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:34.414502 28345 raft_consensus.cc:482] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:34.414830 28345 raft_consensus.cc:3037] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:34.415019 26848 leader_election.cc:341] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 0118ff9d21924aefa8c6c32977c10453
I20260810 11:30:34.422056 28359 leader_election.cc:288] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:34.422200 27222 tablet_bootstrap.cc:654] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:34.423758 28345 raft_consensus.cc:504] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:34.432906 28346 tablet_loader.cc:96] loaded metadata for tablet 713663be70014b17b17056a865e7db63 (table default.Table_12d15f4d2bd3426788aadc76beeff465 [id=ec7fc14fabfd4c83adcb3ea82f0087e8])
I20260810 11:30:34.434362 28346 tablet_loader.cc:96] loaded metadata for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e])
I20260810 11:30:34.435397 28346 tablet_loader.cc:96] loaded metadata for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8])
I20260810 11:30:34.436157 28346 tablet_loader.cc:96] loaded metadata for tablet 728f273a89cd48f8bf0d8616645f5eed (table default.Table_9a25589f61c844cab9a7d2db84a7eba2 [id=744c7bf0857b476cabce9efa16d7d885])
I20260810 11:30:34.437245 28346 tablet_loader.cc:96] loaded metadata for tablet 72e0b69e7c7e4343b309d16c030d4306 (table default.Table_c32d1cb0b9e744fbacbd00c8736fad21 [id=f54b49f28880453aa7bc67b9c36a219b])
W20260810 11:30:34.454779 26848 leader_election.cc:341] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 0118ff9d21924aefa8c6c32977c10453
I20260810 11:30:34.455922 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0118ff9d21924aefa8c6c32977c10453" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:34.456543 26767 raft_consensus.cc:3037] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:34.471354 26767 raft_consensus.cc:2454] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:34.473649 28345 leader_election.cc:288] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:34.475026 26848 consensus_peers.cc:487] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:34.477938 27231 tablet_bootstrap.cc:654] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:34.484102 26914 raft_consensus.cc:3037] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:34.484616 27222 tablet_bootstrap.cc:492] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:34.485105 27222 ts_tablet_manager.cc:1397] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.117s user 0.003s sys 0.005s
I20260810 11:30:34.485316 26849 leader_election.cc:302] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:34.487181 28359 raft_consensus.cc:2781] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:34.487751 28359 raft_consensus.cc:686] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:34.489171 28359 consensus_queue.cc:237] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:34.489814 27222 raft_consensus.cc:348] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.493695 27228 tablet_bootstrap.cc:492] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:34.494148 27228 ts_tablet_manager.cc:1397] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.113s user 0.005s sys 0.004s
I20260810 11:30:34.495721 27228 raft_consensus.cc:348] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.496423 27228 raft_consensus.cc:374] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:34.496691 27228 raft_consensus.cc:729] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:34.499221 27999 ts_tablet_manager.cc:1918] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:34.500037 27999 log.cc:1196] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/7bd67ebf23694ae7b0ede6c5d1a06f88
I20260810 11:30:34.500921 27999 ts_tablet_manager.cc:1939] T 7bd67ebf23694ae7b0ede6c5d1a06f88 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:34.481571 28346 tablet_loader.cc:96] loaded metadata for tablet 750950c424184d08bf6777774db3a0b2 (table default.Table_9eee8b010360415faceef1c43fea61d9 [id=41dfd71fd24040a392812bca04e2baf6])
I20260810 11:30:34.502019 28346 tablet_loader.cc:96] loaded metadata for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e])
I20260810 11:30:34.512867 28346 tablet_loader.cc:96] loaded metadata for tablet 77f0c916ccf24e86b0ec29de1ba54b84 (table default.Table_bbae9d833ed04fc89a867eb497163403 [id=822d8386d19c4a2bb83cc63fbc186792])
I20260810 11:30:34.514081 28346 tablet_loader.cc:96] loaded metadata for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_10b2af8299224f5db4a63bd1fae61155 [id=6a421de2b28a46088fd0bad429a52bad])
I20260810 11:30:34.500680 27228 consensus_queue.cc:260] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.513399 27222 raft_consensus.cc:374] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:34.515969 28346 tablet_loader.cc:96] loaded metadata for tablet 78633fbe048b4534ae3277ce6b7c4313 (table default.Table_6e9cd3888b17405bad2475ba3da34507 [id=ae57f634bfef4952bb4e0a170d67fbdb])
I20260810 11:30:34.515604 27222 raft_consensus.cc:729] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
W20260810 11:30:34.518031 26848 consensus_peers.cc:487] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 31cafb7c691d40a48a40f7d4190c4f8d. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:34.519379 28346 tablet_loader.cc:96] loaded metadata for tablet 7acf847a1fd74ccc89b5bffe1bbb76f3 (table default.Table_2d6c3a53213a458aaee6bd445240041c [id=097ff3abe81b415799933e50feab6c39])
I20260810 11:30:34.519711 27228 ts_tablet_manager.cc:1428] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.025s user 0.003s sys 0.001s
I20260810 11:30:34.520601 27228 tablet_bootstrap.cc:492] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:34.518148 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 62) took 8500 ms. Trace:
W20260810 11:30:34.518352 26849 consensus_peers.cc:487] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e2c9112462f442e8de5b4a944cfdc6b. This is attempt 6: this message will repeat every 5th retry.
I20260810 11:30:34.521625 27999 rpcz_store.cc:276] 0810 11:30:26.017371 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.018536 (+ 1165us) service_pool.cc:227] Handling call
0810 11:30:34.310170 (+8291634us) ts_tablet_manager.cc:1145] Deleting tablet 7bd67ebf23694ae7b0ede6c5d1a06f88
0810 11:30:34.310305 (+ 135us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:34.395423 (+ 85118us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.498999 (+103576us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.518032 (+ 19033us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2081,"tablet-delete.queue_time_us":8283101}
I20260810 11:30:34.522513 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 67) took 8499 ms. Trace:
I20260810 11:30:34.522768 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 7bd67ebf23694ae7b0ede6c5d1a06f88 (table default.Table_ace165519d4f4967aba430a52d996643 [id=a1f146c12202425da0d345c5bca3b82c]) successfully deleted
I20260810 11:30:34.522755 27999 rpcz_store.cc:276] 0810 11:30:26.023052 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.023109 (+ 57us) service_pool.cc:227] Handling call
0810 11:30:34.522151 (+8499042us) ts_tablet_manager.cc:1145] Deleting tablet 34bd3c0edf6b49d1891c0ee9af344872
0810 11:30:34.522179 (+ 28us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:34.522417 (+ 238us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8494027}
I20260810 11:30:34.523392 27999 tablet_replica.cc:330] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:34.523535 28346 tablet_loader.cc:96] loaded metadata for tablet 7c9e437989e54e459f74b49617dabf52 (table default.Table_e91c3002bfab499aad3c1d686b4f4437 [id=5f8a0b38bb0d428c8bf6253bfbf40650])
I20260810 11:30:34.524183 27999 raft_consensus.cc:2229] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:34.524291 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 34bd3c0edf6b49d1891c0ee9af344872 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34bd3c0edf6b49d1891c0ee9af344872 already in progress: creating tablet
I20260810 11:30:34.527860 28331 raft_consensus.cc:482] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:34.531589 28331 raft_consensus.cc:504] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.533216 28331 leader_election.cc:288] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:34.533509 27231 tablet_bootstrap.cc:492] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:34.533779 27231 ts_tablet_manager.cc:1397] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.152s user 0.007s sys 0.007s
W20260810 11:30:34.535171 26702 leader_election.cc:341] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: eb9394f9ca2c44de93354e23973cf902
I20260810 11:30:34.535197 27231 raft_consensus.cc:348] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.527772 27228 tablet_bootstrap.cc:654] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:34.535619 27231 raft_consensus.cc:374] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:34.535786 27231 raft_consensus.cc:729] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:34.535965 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9394f9ca2c44de93354e23973cf902" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:34.524406 28346 tablet_loader.cc:96] loaded metadata for tablet 7cd4f555b5d840c182a31b3c94da9619 (table default.Table_061b7dfbcc074ad6a0d99d49113a354f [id=0186ddbf3c144b4e86ae21cbdac555d2])
I20260810 11:30:34.536157 27231 consensus_queue.cc:260] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.537184 26700 leader_election.cc:302] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:34.537721 28331 raft_consensus.cc:2726] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:34.539104 28346 tablet_loader.cc:96] loaded metadata for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5])
I20260810 11:30:34.543254 28346 tablet_loader.cc:96] loaded metadata for tablet 7de2d60cf87c48459e6663a68ac96714 (table default.Table_53285a0af75e4705982c23850f7b27e2 [id=d58840daecc84b789f04a35ca6cd8393])
I20260810 11:30:34.537921 27222 consensus_queue.cc:260] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.558862 28213 raft_consensus.cc:482] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:34.559146 28213 raft_consensus.cc:504] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.560171 27231 ts_tablet_manager.cc:1428] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.026s user 0.004s sys 0.000s
I20260810 11:30:34.560213 28213 leader_election.cc:288] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:34.561484 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb6805a5dd264939850ea2cd9a850a1f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:34.561679 27231 tablet_bootstrap.cc:492] T 592be61b7e524941931264125b33d92c P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
W20260810 11:30:34.562747 26993 leader_election.cc:341] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:34.565443 28346 tablet_loader.cc:96] loaded metadata for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d])
I20260810 11:30:34.569747 28346 tablet_loader.cc:96] loaded metadata for tablet 82de53efa73447fe84e70dbb11a16a5f (table default.Table_67580ad3fe7a47d6a051e7da7005c171 [id=5ae9efa77fb54cf58ff2a1662eee03f7])
I20260810 11:30:34.573797 28346 tablet_loader.cc:96] loaded metadata for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655])
I20260810 11:30:34.576709 28346 tablet_loader.cc:96] loaded metadata for tablet 8400c601e9894ea9b68679f6d7927456 (table default.Table_ce10a5f4bedc411da7e7089a730e9cc8 [id=807b3a26a49f446797962bb532b4c58e])
I20260810 11:30:34.579169 28346 tablet_loader.cc:96] loaded metadata for tablet 859477ecf37240a4888542d2559f99cd (table default.Table_c447a9537b844dffa1767531896bf6fe [id=a74215a4f78c47348bc5a41e4b1232f8])
I20260810 11:30:34.558084 27222 ts_tablet_manager.cc:1428] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.073s user 0.001s sys 0.010s
I20260810 11:30:34.583675 27222 tablet_bootstrap.cc:492] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:34.586006 28346 tablet_loader.cc:96] loaded metadata for tablet 88268e3571884ac88c1a617ce74499f3 (table default.Table_ad3534a46309483687ef9dd9471f1008 [id=0f9e142b43214fa8b2e362c54fabcb42])
I20260810 11:30:34.587790 27974 ts_tablet_manager.cc:1918] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:34.588150 27974 log.cc:1196] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/587c6ce242c0411b886404a0df03b1bb
I20260810 11:30:34.592465 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb6805a5dd264939850ea2cd9a850a1f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:34.593053 26912 raft_consensus.cc:2454] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:34.593930 28346 tablet_loader.cc:96] loaded metadata for tablet 9079c8fec89043be9d0040a3728e93f4 (table default.Table_fabd7780b9224b7993ad4321be6f92e2 [id=c9c81bc9d6dc48c89ba4cc51ca4f8bd9])
I20260810 11:30:34.598320 28346 tablet_loader.cc:96] loaded metadata for tablet 932ac2ae54324e6e830291ed449a31a8 (table default.Table_168dc06875d64f40830cac1440688bd0 [id=167c03593b73416ab0f9607c87937a60])
I20260810 11:30:34.600870 28346 tablet_loader.cc:96] loaded metadata for tablet 94bcb1739e5144559201479b82c07941 (table default.Table_e7f8305a313f47b0a219cb6a9cb15049 [id=329af78463204d2da90569d268b49eb3])
I20260810 11:30:34.604089 27228 tablet_bootstrap.cc:492] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:34.604466 27228 ts_tablet_manager.cc:1397] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.084s user 0.009s sys 0.013s
I20260810 11:30:34.605723 27228 raft_consensus.cc:348] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.606150 27228 raft_consensus.cc:374] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:34.606395 27228 raft_consensus.cc:729] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:34.606845 27228 consensus_queue.cc:260] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.607893 27222 tablet_bootstrap.cc:654] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:34.617292 27228 ts_tablet_manager.cc:1428] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.013s user 0.002s sys 0.001s
I20260810 11:30:34.620011 28346 tablet_loader.cc:96] loaded metadata for tablet 960104be1fa345d0a495b5686503b96a (table default.Table_9c70c3590985497fbaae37e05c4db1e4 [id=03fe9b9970bd450e890e1cddf9b5a43b])
I20260810 11:30:34.617964 27231 tablet_bootstrap.cc:654] T 592be61b7e524941931264125b33d92c P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:34.628831 27228 tablet_bootstrap.cc:492] T 83992214ba314d3fa674e00d8eaddec6 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:34.632227 28346 tablet_loader.cc:96] loaded metadata for tablet 9744f59d7e49430e91080f56f3342038 (table default.Table_835cdd4f3794466d808449e2e17bb15a [id=a483de6ef1fc453b93e3f183e9c15dd1])
I20260810 11:30:34.633627 27974 ts_tablet_manager.cc:1939] T 587c6ce242c0411b886404a0df03b1bb P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:34.637622 27228 tablet_bootstrap.cc:654] T 83992214ba314d3fa674e00d8eaddec6 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:34.639355 28346 tablet_loader.cc:96] loaded metadata for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a])
I20260810 11:30:34.640543 28346 tablet_loader.cc:96] loaded metadata for tablet 98de7ce411bb4b54ada2df3b78b72190 (table default.Table_6471724ce77d490abaf4ad26ff7ae126 [id=068f712315544485a6fae8452986a3fa])
I20260810 11:30:34.645789 28346 tablet_loader.cc:96] loaded metadata for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9])
I20260810 11:30:34.649936 28346 tablet_loader.cc:96] loaded metadata for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_a827339eadbd440bb3c0bfa6c52512ca [id=b457cccecbf24d6dab4e74bf16bb68eb])
I20260810 11:30:34.658684 28346 tablet_loader.cc:96] loaded metadata for tablet 9de57b6d03e34ee783b822b30090c077 (table default.Table_09ff2cfcae6d4c1b96479fd190b3c084 [id=7d0dd215c30648438a460f730b0b7ba4])
I20260810 11:30:34.659811 28346 tablet_loader.cc:96] loaded metadata for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53])
I20260810 11:30:34.665287 27228 tablet_bootstrap.cc:492] T 83992214ba314d3fa674e00d8eaddec6 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:34.669129 27228 ts_tablet_manager.cc:1397] T 83992214ba314d3fa674e00d8eaddec6 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.048s user 0.012s sys 0.000s
I20260810 11:30:34.671658 28482 raft_consensus.cc:482] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:34.671761 27228 raft_consensus.cc:348] T 83992214ba314d3fa674e00d8eaddec6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.679112 28346 tablet_loader.cc:96] loaded metadata for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82])
I20260810 11:30:34.679834 27228 raft_consensus.cc:374] T 83992214ba314d3fa674e00d8eaddec6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:34.680656 27228 raft_consensus.cc:729] T 83992214ba314d3fa674e00d8eaddec6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
W20260810 11:30:34.683023 26847 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.Ping -> {remote=127.25.195.253:34547, user_credentials={real_user=slave}} blocked reactor thread for 92576.3us
I20260810 11:30:34.687443 27999 raft_consensus.cc:2258] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:34.682185 27228 consensus_queue.cc:260] T 83992214ba314d3fa674e00d8eaddec6 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.687568 28482 raft_consensus.cc:504] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:34.697855 27228 ts_tablet_manager.cc:1428] T 83992214ba314d3fa674e00d8eaddec6 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.028s user 0.008s sys 0.000s
I20260810 11:30:34.701277 28346 tablet_loader.cc:96] loaded metadata for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd])
I20260810 11:30:34.702560 28346 tablet_loader.cc:96] loaded metadata for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079])
I20260810 11:30:34.703121 28346 tablet_loader.cc:96] loaded metadata for tablet a4dde1d1eef74911b20498149e8c1785 (table default.Table_aa56bd03f9eb42468dce12fd81958879 [id=851eb82758954da2b3ec9bf0007880fa])
I20260810 11:30:34.703883 28346 tablet_loader.cc:96] loaded metadata for tablet a63227e69df14a4ea935087fd31ece63 (table default.Table_d863b14a3a96454e8ee5a85fb2ab30c8 [id=a40ab01e5be24248b3af7ef1dc456da6])
I20260810 11:30:34.709172 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 135) took 7356 ms. Trace:
I20260810 11:30:34.711552 27228 tablet_bootstrap.cc:492] T e8dc3dece9d84d47a638707d10de6fd4 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:34.712401 27974 rpcz_store.cc:276] 0810 11:30:27.315961 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.316012 (+ 51us) service_pool.cc:227] Handling call
0810 11:30:34.350383 (+7034371us) ts_tablet_manager.cc:1145] Deleting tablet 587c6ce242c0411b886404a0df03b1bb
0810 11:30:34.350412 (+ 29us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:34.493118 (+142706us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.587531 (+ 94413us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.672867 (+ 85336us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7034028}
I20260810 11:30:34.713533 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb0357271cfd46478867a3cc0660bcdc" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:34.720610 27231 tablet_bootstrap.cc:492] T 592be61b7e524941931264125b33d92c P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:34.720956 27231 ts_tablet_manager.cc:1397] T 592be61b7e524941931264125b33d92c P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.160s user 0.016s sys 0.004s
W20260810 11:30:34.721717 26991 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.Ping -> {remote=127.25.195.253:34547, user_credentials={real_user=slave}} blocked reactor thread for 46001.5us
I20260810 11:30:34.722167 28346 tablet_loader.cc:96] loaded metadata for tablet a74acd5078ec4a45987d68a1e4d138b9 (table default.Table_2d65cf26d2254f29a785321b186cb2c8 [id=c16570aaa0c7449191f68085a12017da])
I20260810 11:30:34.723165 27231 raft_consensus.cc:348] T 592be61b7e524941931264125b33d92c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.723963 27231 raft_consensus.cc:374] T 592be61b7e524941931264125b33d92c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:34.724140 27231 raft_consensus.cc:729] T 592be61b7e524941931264125b33d92c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:34.734557 28346 tablet_loader.cc:96] loaded metadata for tablet a835d30ef9fc474ab927bb119a95d83c (table default.Table_eecd0244ecc849339f452f38db67c973 [id=41d3dec833b54d1e855194862cb1726b])
I20260810 11:30:34.734743 28359 raft_consensus.cc:482] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:34.735061 28359 raft_consensus.cc:504] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.735417 27228 tablet_bootstrap.cc:654] T e8dc3dece9d84d47a638707d10de6fd4 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:34.736389 28359 leader_election.cc:288] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:34.737773 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 587c6ce242c0411b886404a0df03b1bb (table default.Table_8326a5b5a7544e828699f8b41fdee4d1 [id=1ae6d36bfe0e427a9a996dff3cdccc91]) successfully deleted
I20260810 11:30:34.740943 27974 tablet_replica.cc:330] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:34.741160 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd4f555b5d840c182a31b3c94da9619" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:34.741405 27974 raft_consensus.cc:2229] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:34.741583 27059 raft_consensus.cc:2454] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:34.743480 28346 tablet_loader.cc:96] loaded metadata for tablet aaef5a4d651e4bc2b0b76cf6f51b0751 (table default.Table_5f8ecc7877924d0f9871dd16aaeafdde [id=e1ca02b3f3f94632843632a15fc19245])
I20260810 11:30:34.744346 28346 tablet_loader.cc:96] loaded metadata for tablet ab2471d06e0841e7bebae4ca1865618c (table default.Table_db5e3f1e3cf74bc0b15660e83ea59ad6 [id=e7142023363b432b803533be5da13aec])
I20260810 11:30:34.744724 28485 raft_consensus.cc:482] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:34.712541 28487 tablet.cc:1722] T cd3575197c464c7fb51f9592831959bb P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:34.747169 28346 tablet_loader.cc:96] loaded metadata for tablet ad85aa3d1ec54f0ea3a299e33292738a (table default.Table_e0aa1ad6dfda4ef2b7c441f45f74c0f7 [id=b27cf2b15cb64704b6f447284daadd55])
I20260810 11:30:34.748994 28346 tablet_loader.cc:96] loaded metadata for tablet add1743851c34d58afb7e4886325d659 (table default.Table_2d72d964c7c54d639c11a02fc168152a [id=f49e68eaa81e49bb92ed473e754de42f])
I20260810 11:30:34.752974 28482 leader_election.cc:288] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:34.753130 27222 tablet_bootstrap.cc:492] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:34.753393 28346 tablet_loader.cc:96] loaded metadata for tablet adecd2f0952b4f4c83919c78d563e429 (table default.Table_6f7fdd85630648659dcfe3b52e5ab365 [id=862df0152eda418da6110067b4ab588b])
I20260810 11:30:34.753726 27974 raft_consensus.cc:2258] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:34.755244 28480 raft_consensus.cc:482] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:34.756255 28346 tablet_loader.cc:96] loaded metadata for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa])
I20260810 11:30:34.756515 27974 ts_tablet_manager.cc:1905] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:34.758397 28346 tablet_loader.cc:96] loaded metadata for tablet b121c13e9241468aa224e17093eb38f4 (table default.Table_2c7697ec19204b3d823f5684c30978e2 [id=9d480f65788b486db55bbbe48a0ad5eb])
I20260810 11:30:34.760635 28346 tablet_loader.cc:96] loaded metadata for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3])
I20260810 11:30:34.760694 27222 ts_tablet_manager.cc:1397] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.170s user 0.009s sys 0.010s
I20260810 11:30:34.760494 26991 leader_election.cc:302] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:34.761756 28342 raft_consensus.cc:2781] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:34.761926 28342 raft_consensus.cc:482] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:34.762087 28342 raft_consensus.cc:3037] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:34.736522 27231 consensus_queue.cc:260] T 592be61b7e524941931264125b33d92c P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.764111 28346 tablet_loader.cc:96] loaded metadata for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96])
I20260810 11:30:34.771190 26848 leader_election.cc:302] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:34.771931 28359 raft_consensus.cc:2781] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:34.773073 28359 raft_consensus.cc:482] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:34.773391 28359 raft_consensus.cc:3037] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:34.774752 27228 tablet_bootstrap.cc:492] T e8dc3dece9d84d47a638707d10de6fd4 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:34.775300 27231 ts_tablet_manager.cc:1428] T 592be61b7e524941931264125b33d92c P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.054s user 0.006s sys 0.004s
I20260810 11:30:34.780220 27228 ts_tablet_manager.cc:1397] T e8dc3dece9d84d47a638707d10de6fd4 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.071s user 0.014s sys 0.003s
I20260810 11:30:34.781121 27231 tablet_bootstrap.cc:492] T dc2506b72a624cb388059efc326abbc1 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:34.779587 28359 raft_consensus.cc:504] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.783185 27228 raft_consensus.cc:348] T e8dc3dece9d84d47a638707d10de6fd4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.784507 27228 raft_consensus.cc:374] T e8dc3dece9d84d47a638707d10de6fd4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:34.786445 27228 raft_consensus.cc:729] T e8dc3dece9d84d47a638707d10de6fd4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:34.785542 28359 leader_election.cc:288] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:34.787559 27228 consensus_queue.cc:260] T e8dc3dece9d84d47a638707d10de6fd4 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.692027 27999 ts_tablet_manager.cc:1905] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:34.789572 27228 ts_tablet_manager.cc:1428] T e8dc3dece9d84d47a638707d10de6fd4 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.009s user 0.000s sys 0.004s
I20260810 11:30:34.790370 27228 tablet_bootstrap.cc:492] T 592be61b7e524941931264125b33d92c P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:34.793794 27228 tablet_bootstrap.cc:654] T 592be61b7e524941931264125b33d92c P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:34.755707 28480 raft_consensus.cc:504] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.749876 28485 raft_consensus.cc:504] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.790804 28342 raft_consensus.cc:504] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.799975 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd4f555b5d840c182a31b3c94da9619" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:34.800631 26762 raft_consensus.cc:2454] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:34.802830 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "592be61b7e524941931264125b33d92c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:34.804967 27291 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8083fa130cd04dae9d61aeed977c1c63 consensus state has no leader
W20260810 11:30:34.806085 26993 consensus_peers.cc:487] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:34.807665 28346 tablet_loader.cc:96] loaded metadata for tablet b6a3b1e37ac943e391d54640987136f8 (table default.Table_acbcb3a347b647a19e81cfcf5636677f [id=56dee621acfa4f73b3bd69fefa7cb7e1])
I20260810 11:30:34.808842 27059 raft_consensus.cc:2454] T 592be61b7e524941931264125b33d92c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
W20260810 11:30:34.809230 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 143112us
I20260810 11:30:34.809921 28346 tablet_loader.cc:96] loaded metadata for tablet b6eb6dc4b6f34e598933853717b86866 (table default.Table_e18fcf91bf3b4fa0a993bc1aa1471e62 [id=de3117675bb34e7c91a3eb51e015b7c9])
I20260810 11:30:34.805853 28480 leader_election.cc:288] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:34.810214 28485 leader_election.cc:288] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:34.810792 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd4f555b5d840c182a31b3c94da9619" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:34.810698 27222 raft_consensus.cc:348] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:34.811866 26763 raft_consensus.cc:3037] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:34.817670 27222 raft_consensus.cc:374] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:34.818917 27222 raft_consensus.cc:729] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:34.819641 27222 consensus_queue.cc:260] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:34.822208 28346 tablet_loader.cc:96] loaded metadata for tablet b755744059b04967857c1b00e951b8ee (table default.Table_04e075d361354421aa7085057964f310 [id=94c8e7388b644043b77cb6b5087e87e8])
I20260810 11:30:34.824196 28346 tablet_loader.cc:96] loaded metadata for tablet b9195690e00b4f3cb3d5076dcca3519c (table default.Table_6f7ae1749f224614a4fdaa33b125864d [id=339298a1ea1747d59a035a6a3cadfb30])
I20260810 11:30:34.831056 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb0357271cfd46478867a3cc0660bcdc" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:34.833580 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "592be61b7e524941931264125b33d92c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:34.834765 28346 tablet_loader.cc:96] loaded metadata for tablet b945038c03e343489af6ae7e50131d97 (table default.Table_9744be92699b40d1bae23bbb564db585 [id=f27ef087b00e469197a44c70d4bc979b])
I20260810 11:30:34.837321 28346 tablet_loader.cc:96] loaded metadata for tablet b945cb22353f4d99a3836e3c0b8e26e3 (table default.Table_307bbf62894b4edc922e0fd4afa1a91f [id=a700655211944205a74b75b8449abc29])
I20260810 11:30:34.840432 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83992214ba314d3fa674e00d8eaddec6" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:34.841481 27222 ts_tablet_manager.cc:1428] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.061s user 0.004s sys 0.006s
I20260810 11:30:34.842350 27222 tablet_bootstrap.cc:492] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:34.840262 28346 tablet_loader.cc:96] loaded metadata for tablet ba9d15002e6a40f58a7be07f46e7c328 (table default.Table_d4313ebe5ce04c1aa10d064712cbf3ab [id=5f6080c52e46443e9b4ba99dd4352b12])
I20260810 11:30:34.843798 26700 leader_election.cc:302] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:34.848662 27999 ts_tablet_manager.cc:1918] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:34.849856 27999 log.cc:1196] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/1e0a8513171f4c39b74c08760a139d9e
I20260810 11:30:34.851557 27999 ts_tablet_manager.cc:1939] T 1e0a8513171f4c39b74c08760a139d9e P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:34.852900 26763 raft_consensus.cc:2454] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:34.856052 28485 raft_consensus.cc:2726] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:34.857466 26700 leader_election.cc:341] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:34.854998 26915 raft_consensus.cc:2454] T 83992214ba314d3fa674e00d8eaddec6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:34.860054 26849 leader_election.cc:302] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:34.860852 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 68) took 8776 ms. Trace:
I20260810 11:30:34.861212 28348 raft_consensus.cc:2781] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:34.861886 28348 raft_consensus.cc:686] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:34.862461 28348 consensus_queue.cc:237] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.861606 27999 rpcz_store.cc:276] 0810 11:30:26.084074 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.084158 (+ 84us) service_pool.cc:227] Handling call
0810 11:30:34.523238 (+8439080us) ts_tablet_manager.cc:1145] Deleting tablet 1e0a8513171f4c39b74c08760a139d9e
0810 11:30:34.523252 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:34.834091 (+310839us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.848277 (+ 14186us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.860731 (+ 12454us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8427357}
I20260810 11:30:34.863765 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 1e0a8513171f4c39b74c08760a139d9e (table default.Table_aa6798d7140e47fd8b1709e531dbbd10 [id=c62015a698ae48959d405f34503f5fb9]) successfully deleted
I20260810 11:30:34.868156 27999 tablet_replica.cc:330] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:34.868795 27999 raft_consensus.cc:2229] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:34.870771 27999 raft_consensus.cc:2258] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:34.870823 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd4f555b5d840c182a31b3c94da9619" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:34.871201 27060 raft_consensus.cc:3037] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:34.872370 27999 ts_tablet_manager.cc:1905] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:34.872354 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83992214ba314d3fa674e00d8eaddec6" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:34.874531 26700 leader_election.cc:302] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:34.868510 28346 tablet_loader.cc:96] loaded metadata for tablet bbe34108a7604fa6aa667758be11f569 (table default.Table_5f6a37537c33412a80f2642fb0162da6 [id=bfc3f2f94773444181545d43ecd88190])
I20260810 11:30:34.875231 28346 tablet_loader.cc:96] loaded metadata for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6])
I20260810 11:30:34.875296 28485 raft_consensus.cc:2781] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:34.875439 28485 raft_consensus.cc:482] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:34.875594 28485 raft_consensus.cc:3037] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:34.884687 28346 tablet_loader.cc:96] loaded metadata for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6])
I20260810 11:30:34.905570 28346 tablet_loader.cc:96] loaded metadata for tablet c317ccebde05457d9e81c5c871638092 (table default.Table_0b6cd084cecf499e9091685515cb1a3b [id=7b4e4650915f4c16bef68adf43618b89])
I20260810 11:30:34.907279 28346 tablet_loader.cc:96] loaded metadata for tablet c3a5d7b8b0a14134ac55fa17a7dac21e (table default.Table_14f7e10124574ccdb41f7b14117603c6 [id=0cf740b2e59643899dac59acdf576fe2])
W20260810 11:30:34.922097 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 47568.6us
I20260810 11:30:34.884282 28485 raft_consensus.cc:504] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.925082 28485 leader_election.cc:288] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:34.928303 26702 leader_election.cc:302] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:34.928431 28346 tablet_loader.cc:96] loaded metadata for tablet c4124999339e4133b2bd47b3739da373 (table default.Table_9efdfb09fd194dc2a9cbdc9a87749126 [id=8afbc0cc8e704a03a064974937b5a36b])
I20260810 11:30:34.928627 27222 tablet_bootstrap.cc:654] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:34.929281 26702 leader_election.cc:341] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:34.930186 28346 tablet_loader.cc:96] loaded metadata for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704])
I20260810 11:30:34.930406 28483 raft_consensus.cc:2781] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:34.930593 28483 raft_consensus.cc:482] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:34.930857 28483 raft_consensus.cc:3037] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:34.931196 28348 raft_consensus.cc:482] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:34.931492 28348 raft_consensus.cc:504] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:34.933971 28348 leader_election.cc:288] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:34.936487 28346 tablet_loader.cc:96] loaded metadata for tablet cc032509e78c4a04bbe504f54e9d6c6b (table default.Table_44f89aa654e84f22a77580060f057750 [id=3cadcafa2d524a5892f6c315c30881ae])
I20260810 11:30:34.938265 28342 leader_election.cc:288] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:34.939640 28483 raft_consensus.cc:504] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:34.941181 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c715bdcff8c4cdabfddf871f6fdc388" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:34.941563 28483 leader_election.cc:288] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:34.942488 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "592be61b7e524941931264125b33d92c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:34.944000 28346 tablet_loader.cc:96] loaded metadata for tablet cc76d30f37094391b75076c92ccc277f (table default.Table_03a616a243fc4350b4a01d7f5bb86949 [id=4e2dc56dde3346a0917e58c6c7e921eb])
I20260810 11:30:34.944813 28346 tablet_loader.cc:96] loaded metadata for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156])
I20260810 11:30:34.945796 28346 tablet_loader.cc:96] loaded metadata for tablet d14091e1c111438bac8bcf3d36123d80 (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda])
I20260810 11:30:34.946867 28346 tablet_loader.cc:96] loaded metadata for tablet d1d0d55b526749059470504a27887b22 (table default.Table_57b6151125a144fcb6230ee986bff7ee [id=62f404c62e4040fc801f70cafddf9d95])
I20260810 11:30:34.947917 28346 tablet_loader.cc:96] loaded metadata for tablet d24726d0214947beab0bb31b1597c1c3 (table default.Table_3fd59f07e4ee4f54bce7829aec4cf4c4 [id=3719720e5ca241b1a500a1aaf7f310c4])
I20260810 11:30:34.948166 27059 raft_consensus.cc:3037] T 592be61b7e524941931264125b33d92c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:34.948933 28346 tablet_loader.cc:96] loaded metadata for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_a406a8172095498abc9c54697f00f4a0 [id=34056ce268f8490c94a38351b43357a6])
I20260810 11:30:34.949683 28346 tablet_loader.cc:96] loaded metadata for tablet d4873fe8318040a2b7e021708a875f43 (table default.Table_f33a13096a144e538af2795c149abdcd [id=60ce1267de814f218c27ac084a08a26a])
I20260810 11:30:34.950675 28346 tablet_loader.cc:96] loaded metadata for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9])
I20260810 11:30:34.951589 28346 tablet_loader.cc:96] loaded metadata for tablet d560157da0624333b91a18481b058f91 (table default.Table_5f7d17a1cdaa4396b5faf52b01518860 [id=973454ab92f84e73be26260d66ee9763])
I20260810 11:30:34.955659 28346 tablet_loader.cc:96] loaded metadata for tablet d722b93fe27f4c08a592bc393046b6bd (table default.Table_99cbe48a0bd54425b588a46ae1132cad [id=0faf073b01654e38b8f6083f5012abd7])
I20260810 11:30:34.957926 28346 tablet_loader.cc:96] loaded metadata for tablet d91cb30457a74d51885ad81c4ab89d71 (table default.Table_1f48a9af47ad4e0c93ed4dd43ecd12a3 [id=e985b1ae60d94bfa998e1986bdf3fcd9])
I20260810 11:30:34.958609 27974 ts_tablet_manager.cc:1918] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:34.962957 28346 tablet_loader.cc:96] loaded metadata for tablet dc10f61181794e2bba099ca46881e94d (table default.Table_971ac96924ee4a09bc7bc1befdb296d1 [id=cbb462ed5c1f4adf9363f7ac03b78c8c])
I20260810 11:30:34.963934 28346 tablet_loader.cc:96] loaded metadata for tablet dc2506b72a624cb388059efc326abbc1 (table default.Table_b7e6c83a5d5340b5b960f65b82d4939a [id=553f87ed39f148aba3be0a6fcd13e25d])
I20260810 11:30:34.964973 28346 tablet_loader.cc:96] loaded metadata for tablet dd04642dea1f47318871b4e078fd234c (table default.Table_dd41dff7d9584a46821b6a187e5c52a4 [id=1f1a6853eb434bc1988eeda6224a2ff7])
I20260810 11:30:34.963975 27974 log.cc:1196] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/a87f6835f0dc4ad4b3a23b297726100d
I20260810 11:30:34.966020 28495 tablet.cc:1722] T cd3575197c464c7fb51f9592831959bb P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:34.966813 28346 tablet_loader.cc:96] loaded metadata for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_883ee52a6394446eb2ca688ec956d44b [id=a47869d3574543b19e821bbfcb5d3785])
I20260810 11:30:34.967473 28346 tablet_loader.cc:96] loaded metadata for tablet e25557126afd4f51a31fba73cd7da219 (table default.Table_4857a0fc183c421382b9b70094d76ac3 [id=eb184bc24462433e89048f962a639600])
I20260810 11:30:34.970656 28346 tablet_loader.cc:96] loaded metadata for tablet e69916a35fba4714bbc565921738888f (table default.Table_c40dd8e327db40b59167de093a5c616d [id=10ebb746a2b343b08b5b13d1107a7cd8])
I20260810 11:30:34.970947 27999 ts_tablet_manager.cc:1918] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:34.971479 28346 tablet_loader.cc:96] loaded metadata for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a])
I20260810 11:30:34.972149 28346 tablet_loader.cc:96] loaded metadata for tablet e9732b90bc054f8a83fc17c0df9dfafe (table default.Table_094455b6d4f745fa83445cfc650e43b7 [id=c2f01a1417424ff6b61d8c4cb35a638a])
I20260810 11:30:34.972929 28346 tablet_loader.cc:96] loaded metadata for tablet ea66da5bc20e4718901ffc473677421c (table default.Table_23ac53b1a7794ddda0a697254fff0ede [id=80a1649fe2d74dd4bf5aa5e07a762de3])
I20260810 11:30:34.974030 27999 log.cc:1196] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/66908164ff2a4ee5b55da6158699e0c6
I20260810 11:30:34.974201 28346 tablet_loader.cc:96] loaded metadata for tablet ebaf046e524b485c8b3ebf419c8035bb (table default.Table_52c39be8057948a49dfd7394b4152265 [id=c48cb5a0af7b4f0483e799a49fd5d307])
I20260810 11:30:34.976044 28346 tablet_loader.cc:96] loaded metadata for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743])
I20260810 11:30:34.979454 28346 tablet_loader.cc:96] loaded metadata for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57])
I20260810 11:30:34.979586 27999 ts_tablet_manager.cc:1939] T 66908164ff2a4ee5b55da6158699e0c6 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:34.980899 28346 tablet_loader.cc:96] loaded metadata for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe])
I20260810 11:30:34.984321 28346 tablet_loader.cc:96] loaded metadata for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f (table default.Table_7458a59fbdce4e9485d51df6fccf66a5 [id=d63533f5d837481889b34a78d860e018])
I20260810 11:30:34.984088 27974 ts_tablet_manager.cc:1939] T a87f6835f0dc4ad4b3a23b297726100d P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:34.987941 28346 tablet_loader.cc:96] loaded metadata for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b])
I20260810 11:30:34.989022 28346 tablet_loader.cc:96] loaded metadata for tablet fa14fea852c24cd7bb3d57094af2e178 (table default.Table_6d8b58857bb84e579c8c308dcb0800f0 [id=f0f8365d722447a090e236fd1fcb0e98])
I20260810 11:30:34.989835 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "592be61b7e524941931264125b33d92c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:34.990622 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83992214ba314d3fa674e00d8eaddec6" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:34.990981 26912 raft_consensus.cc:3037] T 83992214ba314d3fa674e00d8eaddec6 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:34.996192 26700 leader_election.cc:341] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:34.998571 27248 ts_tablet_manager.cc:1918] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:35.000128 28346 tablet_loader.cc:96] loaded metadata for tablet faff8489499e4e318b127d9c1b19d2e4 (table default.Table_6efb1e8e65fa4f88ae25c9d2ebc6b4f4 [id=d83083bfedd542398d132e4bac9a7f12])
I20260810 11:30:35.000416 27248 log.cc:1196] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/8798892eb4604ee8ac9c95e64dbb14e9
I20260810 11:30:35.000988 28346 tablet_loader.cc:96] loaded metadata for tablet fc023d51790042ce978eb53a2979e29c (table default.Table_66b8d163284b4347b99dea499ed256fc [id=304e1529f45d4d3c8799a22009066ce5])
I20260810 11:30:35.001287 27231 tablet_bootstrap.cc:654] T dc2506b72a624cb388059efc326abbc1 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.002413 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83992214ba314d3fa674e00d8eaddec6" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
W20260810 11:30:35.003912 26702 leader_election.cc:341] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:35.003921 27222 tablet_bootstrap.cc:492] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:35.009845 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 69) took 8908 ms. Trace:
I20260810 11:30:35.011042 27999 rpcz_store.cc:276] 0810 11:30:26.093837 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.093928 (+ 91us) service_pool.cc:227] Handling call
0810 11:30:34.867945 (+8774017us) ts_tablet_manager.cc:1145] Deleting tablet 66908164ff2a4ee5b55da6158699e0c6
0810 11:30:34.867981 (+ 36us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:34.934331 (+ 66350us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.970683 (+ 36352us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.002341 (+ 31658us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8771928}
I20260810 11:30:35.011035 27222 ts_tablet_manager.cc:1397] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.168s user 0.020s sys 0.003s
I20260810 11:30:35.011998 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 71) took 8916 ms. Trace:
I20260810 11:30:35.012128 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 66908164ff2a4ee5b55da6158699e0c6 (table default.Table_5920ba1cda06446c8f95e65aec6a42bf [id=10cadcb426e64a27a94df23fc8956de1]) successfully deleted
I20260810 11:30:35.012420 28346 tablet_loader.cc:96] loaded metadata for tablet fccc21cfc1ce4eb586f03276ec6e987f (table default.Table_fb8c5684b00a41eebe3f5b088bcbee33 [id=e22f19a993564e53b1cc76633f25f505])
I20260810 11:30:35.013991 28346 tablet_loader.cc:96] loaded metadata for tablet fdeba015c2364ec385e8b06c18a2a9d2 (table default.Table_5d3880885d6342738dd22e168d08e660 [id=31e5d2935c2f44e4b272255fbd4c948a])
I20260810 11:30:35.014307 27999 rpcz_store.cc:276] 0810 11:30:26.095438 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.095517 (+ 79us) service_pool.cc:227] Handling call
0810 11:30:35.011711 (+8916194us) ts_tablet_manager.cc:1145] Deleting tablet 08f6636df13548c49f35e1808a87c1f5
0810 11:30:35.011738 (+ 27us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.011895 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8914540}
W20260810 11:30:35.015233 27286 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 08f6636df13548c49f35e1808a87c1f5 because the tablet was not found. No further retry: Not found: Tablet not found: 08f6636df13548c49f35e1808a87c1f5
I20260810 11:30:35.015889 27999 tablet_replica.cc:330] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:35.017081 27999 raft_consensus.cc:2229] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:35.018262 27999 raft_consensus.cc:2258] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.019979 26912 raft_consensus.cc:2454] T 83992214ba314d3fa674e00d8eaddec6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
W20260810 11:30:35.020453 28346 catalog_manager.cc:1476] Time spent T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Loading table and tablet metadata into memory: real 3.044s user 0.393s sys 0.168s
I20260810 11:30:35.021422 27999 ts_tablet_manager.cc:1905] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.020517 26589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" candidate_term: 6 candidate_status { last_received { term: 3 index: 603 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361" is_pre_election: true
I20260810 11:30:35.019361 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 136) took 7702 ms. Trace:
I20260810 11:30:35.021521 26580 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:51252 (request call id 72) took 2282 ms. Trace:
I20260810 11:30:35.021814 26591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" candidate_term: 6 candidate_status { last_received { term: 3 index: 603 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361" is_pre_election: true
W20260810 11:30:35.022861 26591 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57848 (request call id 139) took 2405 ms (client timeout 682 ms). Trace:
I20260810 11:30:35.022445 26580 rpcz_store.cc:276] 0810 11:30:32.738863 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.739065 (+ 202us) service_pool.cc:227] Handling call
0810 11:30:35.021310 (+2282245us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260810 11:30:35.023211 26591 rpcz_store.cc:269] 0810 11:30:32.617744 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.618007 (+ 263us) service_pool.cc:227] Handling call
0810 11:30:35.022676 (+2404669us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260810 11:30:35.024089 26589 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57848 (request call id 140) took 1694 ms (client timeout 682 ms). Trace:
W20260810 11:30:35.024294 26589 rpcz_store.cc:269] 0810 11:30:33.330250 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.330435 (+ 185us) service_pool.cc:227] Handling call
0810 11:30:35.024014 (+1693579us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:35.026995 28346 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 11:30:35.034309 27222 raft_consensus.cc:348] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.045423 27248 ts_tablet_manager.cc:1939] T 8798892eb4604ee8ac9c95e64dbb14e9 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:35.049422 27222 raft_consensus.cc:374] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.049817 27222 raft_consensus.cc:729] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.053335 28500 tablet.cc:1722] T cd3575197c464c7fb51f9592831959bb P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:35.054600 28346 catalog_manager.cc:1259] Loaded cluster ID: 5081849c8420415b9be91728667896d5
I20260810 11:30:35.054848 28346 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 11:30:35.054965 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 102) took 8730 ms. Trace:
I20260810 11:30:35.056594 27974 rpcz_store.cc:276] 0810 11:30:27.316515 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.316636 (+ 121us) service_pool.cc:227] Handling call
0810 11:30:34.713234 (+7396598us) ts_tablet_manager.cc:1145] Deleting tablet a87f6835f0dc4ad4b3a23b297726100d
0810 11:30:34.713266 (+ 32us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:34.833816 (+120550us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.949408 (+115592us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.019106 (+ 69698us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7396334}
I20260810 11:30:35.058390 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 137) took 7741 ms. Trace:
I20260810 11:30:35.058535 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet a87f6835f0dc4ad4b3a23b297726100d (table default.Table_cbf7fb0f0585465a9be24fa7e70d68d2 [id=82041e96f8de4fae85baf690bbbfc7a3]) successfully deleted
I20260810 11:30:35.063170 28495 tablet.cc:1722] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:35.064198 27999 ts_tablet_manager.cc:1918] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.064503 27999 log.cc:1196] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/eb51618d37ac488fa7e3d23e5f85ec36
I20260810 11:30:35.065605 27999 ts_tablet_manager.cc:1939] T eb51618d37ac488fa7e3d23e5f85ec36 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:35.071192 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 70) took 8976 ms. Trace:
I20260810 11:30:35.071473 27999 rpcz_store.cc:276] 0810 11:30:26.094701 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.094808 (+ 107us) service_pool.cc:227] Handling call
0810 11:30:35.015742 (+8920934us) ts_tablet_manager.cc:1145] Deleting tablet eb51618d37ac488fa7e3d23e5f85ec36
0810 11:30:35.015760 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.045738 (+ 29978us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.062763 (+ 17025us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.071105 (+ 8342us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8918077}
I20260810 11:30:35.072150 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet eb51618d37ac488fa7e3d23e5f85ec36 (table default.Table_7466a225b5ae492ab3ac3cf5d74a360f [id=696bbe0dbb864163b77ab537e2700f7d]) successfully deleted
I20260810 11:30:35.072332 27999 tablet_replica.cc:330] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:35.072830 27999 raft_consensus.cc:2229] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:35.074020 27999 raft_consensus.cc:2258] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.077713 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb6805a5dd264939850ea2cd9a850a1f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:35.078382 26912 raft_consensus.cc:3037] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.078675 27228 tablet_bootstrap.cc:492] T 592be61b7e524941931264125b33d92c P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:35.078806 27999 ts_tablet_manager.cc:1905] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.079200 27228 ts_tablet_manager.cc:1397] T 592be61b7e524941931264125b33d92c P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.289s user 0.004s sys 0.011s
I20260810 11:30:35.080794 27974 rpcz_store.cc:276] 0810 11:30:27.317232 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.317303 (+ 71us) service_pool.cc:227] Handling call
0810 11:30:35.057991 (+7740688us) ts_tablet_manager.cc:1145] Deleting tablet 2801709d53614916abac370f7ae5e913
0810 11:30:35.058037 (+ 46us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.058307 (+ 270us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7740354}
I20260810 11:30:35.081996 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 138) took 7763 ms. Trace:
W20260810 11:30:35.082134 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2801709d53614916abac370f7ae5e913 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2801709d53614916abac370f7ae5e913 already in progress: creating tablet
I20260810 11:30:35.082261 27974 rpcz_store.cc:276] 0810 11:30:27.318202 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.318353 (+ 151us) service_pool.cc:227] Handling call
0810 11:30:35.081599 (+7763246us) ts_tablet_manager.cc:1145] Deleting tablet 256ad2e2d8e54a4caa1b5091bab60dd5
0810 11:30:35.081630 (+ 31us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.081918 (+ 288us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7762798}
W20260810 11:30:35.083096 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 256ad2e2d8e54a4caa1b5091bab60dd5 already in progress: creating tablet
I20260810 11:30:35.056488 27222 consensus_queue.cc:260] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.083869 26767 raft_consensus.cc:3037] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.084115 27248 rpcz_store.cc:276] 0810 11:30:26.324842 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.324944 (+ 102us) service_pool.cc:227] Handling call
0810 11:30:34.253566 (+7928622us) ts_tablet_manager.cc:1145] Deleting tablet 8798892eb4604ee8ac9c95e64dbb14e9
0810 11:30:34.300961 (+ 47395us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:34.702345 (+401384us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:34.998192 (+295847us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.054923 (+ 56731us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15485,"tablet-delete.queue_time_us":7922931}
I20260810 11:30:35.084962 27248 tablet_replica.cc:330] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:35.085374 27248 raft_consensus.cc:2229] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:35.085661 27248 raft_consensus.cc:2258] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.087723 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 139) took 7768 ms. Trace:
I20260810 11:30:35.087944 27974 rpcz_store.cc:276] 0810 11:30:27.319362 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.319459 (+ 97us) service_pool.cc:227] Handling call
0810 11:30:35.082724 (+7763265us) ts_tablet_manager.cc:1145] Deleting tablet 3851d39aeb3142938a5ac558ab438c21
0810 11:30:35.082738 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.087627 (+ 4889us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7762880}
I20260810 11:30:35.088666 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 140) took 7768 ms. Trace:
I20260810 11:30:35.088912 27974 rpcz_store.cc:276] 0810 11:30:27.320192 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.320266 (+ 74us) service_pool.cc:227] Handling call
0810 11:30:35.088403 (+7768137us) ts_tablet_manager.cc:1145] Deleting tablet f3884736eec74c8992b8d51b37465875
0810 11:30:35.088416 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.088526 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7767884}
W20260810 11:30:35.089097 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 3851d39aeb3142938a5ac558ab438c21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3851d39aeb3142938a5ac558ab438c21 already in progress: creating tablet
I20260810 11:30:35.089591 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 141) took 7768 ms. Trace:
I20260810 11:30:35.089712 27974 rpcz_store.cc:276] 0810 11:30:27.320797 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.320857 (+ 60us) service_pool.cc:227] Handling call
0810 11:30:35.089431 (+7768574us) ts_tablet_manager.cc:1145] Deleting tablet d000f0ebaf0049a7bdaad93e307e16e2
0810 11:30:35.089451 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.089545 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7768348}
W20260810 11:30:35.089784 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet f3884736eec74c8992b8d51b37465875 because the tablet was not found. No further retry: Not found: Tablet not found: f3884736eec74c8992b8d51b37465875
I20260810 11:30:35.090081 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 142) took 7768 ms. Trace:
W20260810 11:30:35.090214 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet d000f0ebaf0049a7bdaad93e307e16e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d000f0ebaf0049a7bdaad93e307e16e2 already in progress: creating tablet
I20260810 11:30:35.090219 27974 rpcz_store.cc:276] 0810 11:30:27.338113 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.338501 (+ 388us) service_pool.cc:227] Handling call
0810 11:30:35.089945 (+7751444us) ts_tablet_manager.cc:1145] Deleting tablet fdbe21b4f124411988dd35a0b864f868
0810 11:30:35.089955 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.090031 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7750952}
I20260810 11:30:35.090626 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 143) took 7749 ms. Trace:
W20260810 11:30:35.090683 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet fdbe21b4f124411988dd35a0b864f868 because the tablet was not found. No further retry: Not found: Tablet not found: fdbe21b4f124411988dd35a0b864f868
I20260810 11:30:35.090747 27974 rpcz_store.cc:276] 0810 11:30:27.342074 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.342552 (+ 478us) service_pool.cc:227] Handling call
0810 11:30:35.090469 (+7747917us) ts_tablet_manager.cc:1145] Deleting tablet 4b5a7f67ec5b48c2b5a510add0282a76
0810 11:30:35.090478 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.090592 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7747387}
I20260810 11:30:35.091094 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 144) took 7746 ms. Trace:
W20260810 11:30:35.091183 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 4b5a7f67ec5b48c2b5a510add0282a76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b5a7f67ec5b48c2b5a510add0282a76 already in progress: creating tablet
I20260810 11:30:35.091213 27974 rpcz_store.cc:276] 0810 11:30:27.345505 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.345908 (+ 403us) service_pool.cc:227] Handling call
0810 11:30:35.090972 (+7745064us) ts_tablet_manager.cc:1145] Deleting tablet 0713f4f14a284050a7774a70ab974f30
0810 11:30:35.090981 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.091058 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7744767}
I20260810 11:30:35.091569 27974 tablet_replica.cc:330] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
W20260810 11:30:35.091725 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 0713f4f14a284050a7774a70ab974f30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0713f4f14a284050a7774a70ab974f30 already in progress: creating tablet
I20260810 11:30:35.091800 27974 raft_consensus.cc:2229] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:35.055466 28493 tablet.cc:1722] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:35.064991 27059 raft_consensus.cc:2454] T 592be61b7e524941931264125b33d92c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:35.093570 27231 tablet_bootstrap.cc:492] T dc2506b72a624cb388059efc326abbc1 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:35.093791 27231 ts_tablet_manager.cc:1397] T dc2506b72a624cb388059efc326abbc1 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.315s user 0.009s sys 0.009s
I20260810 11:30:35.095196 26702 leader_election.cc:302] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:35.095099 27231 raft_consensus.cc:348] T dc2506b72a624cb388059efc326abbc1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.095332 27231 raft_consensus.cc:374] T dc2506b72a624cb388059efc326abbc1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.095384 27231 raft_consensus.cc:729] T dc2506b72a624cb388059efc326abbc1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.067410 27060 raft_consensus.cc:2454] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:35.095587 27231 consensus_queue.cc:260] T dc2506b72a624cb388059efc326abbc1 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.096166 27231 ts_tablet_manager.cc:1428] T dc2506b72a624cb388059efc326abbc1 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 11:30:35.097280 27222 ts_tablet_manager.cc:1428] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.085s user 0.005s sys 0.000s
I20260810 11:30:35.098017 27222 tablet_bootstrap.cc:492] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:35.100455 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 8798892eb4604ee8ac9c95e64dbb14e9 (table default.Table_0d77c6da3c8349c9ad3caa2147b81827 [id=24870bec311f44e4a3a3afa3599437be]) successfully deleted
I20260810 11:30:35.102799 27228 raft_consensus.cc:348] T 592be61b7e524941931264125b33d92c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.103413 27228 raft_consensus.cc:374] T 592be61b7e524941931264125b33d92c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.103554 27228 raft_consensus.cc:729] T 592be61b7e524941931264125b33d92c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.108832 27231 tablet_bootstrap.cc:492] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:35.109297 27248 ts_tablet_manager.cc:1905] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.128396 27231 tablet_bootstrap.cc:654] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.100518 27222 tablet_bootstrap.cc:654] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.101409 28480 raft_consensus.cc:2781] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:35.137291 26767 raft_consensus.cc:3037] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.137447 28480 raft_consensus.cc:686] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:35.137996 28480 consensus_queue.cc:237] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.108278 27228 consensus_queue.cc:260] T 592be61b7e524941931264125b33d92c P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.142252 27999 ts_tablet_manager.cc:1918] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.147950 27974 raft_consensus.cc:2258] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.136816 26700 leader_election.cc:302] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
W20260810 11:30:35.150415 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 107606us
I20260810 11:30:35.152842 28485 raft_consensus.cc:2781] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:35.153187 28485 raft_consensus.cc:686] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:35.153760 28485 consensus_queue.cc:237] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.156632 27222 tablet_bootstrap.cc:492] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:35.156909 27222 ts_tablet_manager.cc:1397] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.003s
I20260810 11:30:35.158682 27222 raft_consensus.cc:348] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.159158 27222 raft_consensus.cc:374] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.159349 27222 raft_consensus.cc:729] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.159861 27222 consensus_queue.cc:260] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.161470 27974 ts_tablet_manager.cc:1905] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:35.174397 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 304440us
I20260810 11:30:35.176481 27911 raft_consensus.cc:482] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:35.176810 27911 raft_consensus.cc:504] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.177697 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c715bdcff8c4cdabfddf871f6fdc388" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:35.178033 27911 leader_election.cc:288] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:35.178988 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb6805a5dd264939850ea2cd9a850a1f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:35.179064 28487 tablet.cc:1722] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:35.180974 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac4b1821ac30452cbe7a8f844d9b37e5" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:35.181517 27999 log.cc:1196] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/70f6017d4d01463398cb347779dacf90
I20260810 11:30:35.182371 27999 ts_tablet_manager.cc:1939] T 70f6017d4d01463398cb347779dacf90 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:35.185318 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 72) took 9078 ms. Trace:
I20260810 11:30:35.185770 27999 rpcz_store.cc:276] 0810 11:30:26.106760 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.106901 (+ 141us) service_pool.cc:227] Handling call
0810 11:30:35.072205 (+8965304us) ts_tablet_manager.cc:1145] Deleting tablet 70f6017d4d01463398cb347779dacf90
0810 11:30:35.072221 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.095337 (+ 23116us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.141995 (+ 46658us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.185176 (+ 43181us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8964831}
I20260810 11:30:35.187213 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 73) took 9072 ms. Trace:
I20260810 11:30:35.187505 27999 rpcz_store.cc:276] 0810 11:30:26.114508 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.114611 (+ 103us) service_pool.cc:227] Handling call
0810 11:30:35.186486 (+9071875us) ts_tablet_manager.cc:1145] Deleting tablet 8228600e3f6b4f9993dd25e4ceb57e4d
0810 11:30:35.186510 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.187044 (+ 534us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9064659}
I20260810 11:30:35.189373 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 70f6017d4d01463398cb347779dacf90 (table default.Table_24bdc44050024c23aa90a182bdcecb50 [id=4ea7ee58aac74fba84dbbcc009017421]) successfully deleted
W20260810 11:30:35.189967 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 8228600e3f6b4f9993dd25e4ceb57e4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8228600e3f6b4f9993dd25e4ceb57e4d already in progress: creating tablet
I20260810 11:30:35.143714 27228 ts_tablet_manager.cc:1428] T 592be61b7e524941931264125b33d92c P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.064s user 0.005s sys 0.001s
I20260810 11:30:35.197170 27228 tablet_bootstrap.cc:492] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:35.201696 27228 tablet_bootstrap.cc:654] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.146533 26912 raft_consensus.cc:2454] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:35.165776 26915 raft_consensus.cc:3037] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.180902 26848 leader_election.cc:302] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:35.210011 28348 raft_consensus.cc:482] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:35.210351 28348 raft_consensus.cc:504] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.211424 28348 leader_election.cc:288] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:35.211791 26848 consensus_peers.cc:487] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3c6bd6803c245b7bb3d78423de482b6. This is attempt 6: this message will repeat every 5th retry.
I20260810 11:30:35.212476 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f85c0767ad164075b87ba672cafafb47" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:35.213358 26849 leader_election.cc:341] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:35.156548 28346 catalog_manager.cc:1504] Loading token signing keys...
I20260810 11:30:35.214700 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac4b1821ac30452cbe7a8f844d9b37e5" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:35.226451 26993 leader_election.cc:341] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:35.220135 26991 leader_election.cc:341] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:35.237494 26993 leader_election.cc:341] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:35.241405 27248 ts_tablet_manager.cc:1918] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.241936 27248 log.cc:1196] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/bb0357271cfd46478867a3cc0660bcdc
I20260810 11:30:35.188433 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 74) took 9065 ms. Trace:
I20260810 11:30:35.243847 27999 rpcz_store.cc:276] 0810 11:30:26.122579 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.122660 (+ 81us) service_pool.cc:227] Handling call
0810 11:30:35.188057 (+9065397us) ts_tablet_manager.cc:1145] Deleting tablet e31b380f99854eb8b63e1f9eede1fc7c
0810 11:30:35.188083 (+ 26us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.188324 (+ 241us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9063826}
I20260810 11:30:35.244666 27999 tablet_replica.cc:330] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:35.245090 27999 raft_consensus.cc:2229] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:35.245920 27999 raft_consensus.cc:2258] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:35.247447 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet e31b380f99854eb8b63e1f9eede1fc7c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e31b380f99854eb8b63e1f9eede1fc7c already in progress: creating tablet
I20260810 11:30:35.247826 27222 ts_tablet_manager.cc:1428] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.091s user 0.003s sys 0.001s
I20260810 11:30:35.248492 27222 tablet_bootstrap.cc:492] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:35.257802 27228 tablet_bootstrap.cc:492] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:35.258280 27228 ts_tablet_manager.cc:1397] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.005s
I20260810 11:30:35.237167 26991 leader_election.cc:302] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:35.241653 26993 leader_election.cc:302] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:35.259368 28497 raft_consensus.cc:2726] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:35.260007 27228 raft_consensus.cc:348] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.260375 27228 raft_consensus.cc:374] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.258325 27999 ts_tablet_manager.cc:1905] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.260547 27228 raft_consensus.cc:729] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.263254 27911 raft_consensus.cc:2781] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:35.263512 27911 raft_consensus.cc:686] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:35.264194 27911 consensus_queue.cc:237] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:35.280232 26993 consensus_peers.cc:487] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 587c6ce242c0411b886404a0df03b1bb. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:35.274837 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f85c0767ad164075b87ba672cafafb47" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:35.282338 27060 raft_consensus.cc:2454] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:35.286443 28346 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Loaded TSK: 0
I20260810 11:30:35.262593 27228 consensus_queue.cc:260] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.287803 27248 ts_tablet_manager.cc:1939] T bb0357271cfd46478867a3cc0660bcdc P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:35.288020 26848 leader_election.cc:302] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:35.289397 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 103) took 8963 ms. Trace:
I20260810 11:30:35.289575 27248 rpcz_store.cc:276] 0810 11:30:26.326257 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.328681 (+ 2424us) service_pool.cc:227] Handling call
0810 11:30:35.084857 (+8756176us) ts_tablet_manager.cc:1145] Deleting tablet bb0357271cfd46478867a3cc0660bcdc
0810 11:30:35.084887 (+ 30us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.136913 (+ 52026us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.241218 (+104305us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.289356 (+ 48138us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8746581}
I20260810 11:30:35.290045 28348 raft_consensus.cc:2781] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:35.290275 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 104) took 8950 ms. Trace:
I20260810 11:30:35.290277 28348 raft_consensus.cc:482] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:35.290416 27248 rpcz_store.cc:276] 0810 11:30:26.339888 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.339958 (+ 70us) service_pool.cc:227] Handling call
0810 11:30:35.290045 (+8950087us) ts_tablet_manager.cc:1145] Deleting tablet 603fe104b7ab485eab6b225a58bddc1c
0810 11:30:35.290069 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.290249 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8939404}
I20260810 11:30:35.290576 28348 raft_consensus.cc:3037] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.291518 27248 tablet_replica.cc:330] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:35.293507 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet bb0357271cfd46478867a3cc0660bcdc (table default.Table_23889fedecbf43c09cf2ab7717d5801b [id=ea4def2ac652452aaca61214b2d04cc6]) successfully deleted
W20260810 11:30:35.294180 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 603fe104b7ab485eab6b225a58bddc1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 603fe104b7ab485eab6b225a58bddc1c already in progress: creating tablet
I20260810 11:30:35.294829 28346 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 11:30:35.300941 28359 raft_consensus.cc:482] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 11:30:35.301651 26993 consensus_peers.cc:487] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d91a02b22044429fb3e25840c7947a02. This is attempt 6: this message will repeat every 5th retry.
W20260810 11:30:35.302029 26993 consensus_peers.cc:487] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:35.303911 27231 tablet_bootstrap.cc:492] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:35.312772 27231 ts_tablet_manager.cc:1397] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.216s user 0.007s sys 0.006s
I20260810 11:30:35.313803 28348 raft_consensus.cc:504] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.314458 27231 raft_consensus.cc:348] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.301491 28359 raft_consensus.cc:504] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.314896 27231 raft_consensus.cc:374] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.315042 27231 raft_consensus.cc:729] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.315407 27231 consensus_queue.cc:260] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.315779 28359 leader_election.cc:288] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:35.317150 27228 ts_tablet_manager.cc:1428] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.058s user 0.000s sys 0.004s
I20260810 11:30:35.317152 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83631b421a614796bdf76335f1437e00" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:35.317677 26762 raft_consensus.cc:2454] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:35.319377 26849 leader_election.cc:302] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:35.320021 28359 raft_consensus.cc:2781] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:35.320247 28359 raft_consensus.cc:482] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:35.320377 28359 raft_consensus.cc:3037] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.320744 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f85c0767ad164075b87ba672cafafb47" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
W20260810 11:30:35.322394 26849 leader_election.cc:341] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:35.324342 27222 tablet_bootstrap.cc:654] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.329650 28346 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 11:30:35.331516 27248 raft_consensus.cc:2229] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:35.332590 27248 pending_rounds.cc:62] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215: Trying to abort 1 pending ops.
I20260810 11:30:35.332707 27248 pending_rounds.cc:68] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936438911033344 op_type: NO_OP noop_request { }
I20260810 11:30:35.332885 27248 raft_consensus.cc:2866] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:35.333076 27248 raft_consensus.cc:2258] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.333539 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83631b421a614796bdf76335f1437e00" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:35.333985 27060 raft_consensus.cc:2454] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:35.340344 27974 ts_tablet_manager.cc:1918] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.340092 28515 consensus_queue.cc:1035] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 11:30:35.340718 27974 log.cc:1196] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/a3406dc345e3429fb4bce5a59643b686
I20260810 11:30:35.341697 27974 ts_tablet_manager.cc:1939] T a3406dc345e3429fb4bce5a59643b686 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:35.343612 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 145) took 7995 ms. Trace:
I20260810 11:30:35.343850 27974 rpcz_store.cc:276] 0810 11:30:27.349653 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.350035 (+ 382us) service_pool.cc:227] Handling call
0810 11:30:35.091497 (+7741462us) ts_tablet_manager.cc:1145] Deleting tablet a3406dc345e3429fb4bce5a59643b686
0810 11:30:35.091507 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.237713 (+146206us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.340137 (+102424us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.343499 (+ 3362us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":55697,"tablet-delete.queue_time_us":7741007}
I20260810 11:30:35.345115 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet a3406dc345e3429fb4bce5a59643b686 (table default.Table_b9bd48d71fac4e03b0d84dcafd4cb4a5 [id=0db7b6eb26f8438caf57a129ba2c81fe]) successfully deleted
I20260810 11:30:35.348652 27228 tablet_bootstrap.cc:492] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:35.349395 28345 raft_consensus.cc:2726] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:35.355432 27231 ts_tablet_manager.cc:1428] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.042s user 0.001s sys 0.003s
I20260810 11:30:35.356529 27231 tablet_bootstrap.cc:492] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:35.367285 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f85c0767ad164075b87ba672cafafb47" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:35.367570 27059 raft_consensus.cc:3037] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.369766 27222 tablet_bootstrap.cc:492] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:35.369987 27222 ts_tablet_manager.cc:1397] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.122s user 0.006s sys 0.006s
I20260810 11:30:35.371483 27059 raft_consensus.cc:2454] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:35.371434 27222 raft_consensus.cc:348] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.371707 27222 raft_consensus.cc:374] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.371803 27222 raft_consensus.cc:729] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.372167 27222 consensus_queue.cc:260] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:35.366046 28514 consensus_queue.cc:1159] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "482e605580be48cbbacce05a3e61c215" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260810 11:30:35.373713 27248 ts_tablet_manager.cc:1905] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.374262 27231 tablet_bootstrap.cc:654] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.375381 26848 leader_election.cc:302] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:35.375723 28345 raft_consensus.cc:2781] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:35.375835 28345 raft_consensus.cc:686] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:35.376078 28345 consensus_queue.cc:237] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.380079 27222 ts_tablet_manager.cc:1428] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260810 11:30:35.380653 27222 tablet_bootstrap.cc:492] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:35.382671 27248 ts_tablet_manager.cc:1918] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.383024 27248 log.cc:1196] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/cb6805a5dd264939850ea2cd9a850a1f
I20260810 11:30:35.383235 27222 tablet_bootstrap.cc:654] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.385792 27248 ts_tablet_manager.cc:1939] T cb6805a5dd264939850ea2cd9a850a1f P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:35.388273 27999 ts_tablet_manager.cc:1918] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.401589 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 107) took 9043 ms. Trace:
I20260810 11:30:35.402441 27248 rpcz_store.cc:276] 0810 11:30:26.357642 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.357744 (+ 102us) service_pool.cc:227] Handling call
0810 11:30:35.291324 (+8933580us) ts_tablet_manager.cc:1145] Deleting tablet cb6805a5dd264939850ea2cd9a850a1f
0810 11:30:35.291439 (+ 115us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.332162 (+ 40723us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x6150001db3a4. stack: 00007faac62fb66e 00007faac62fb430 00007faac53825ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007faad183304d 00007faad2ad75ec 00007faad54662e6 00007faad5498404 00007faad5479870 00007faad54795fd 00000000009edb7c 00007faac6341344 00007faac634491b 00007faac6344798
0810 11:30:35.377889 (+ 45727us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.382478 (+ 4589us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.401391 (+ 18913us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":90859392,"tablet-delete.queue_time_us":8932023}
I20260810 11:30:35.404824 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet cb6805a5dd264939850ea2cd9a850a1f (table default.Table_057f1bf3995143138dd2954a212a480b [id=2db59831074f4dd2b4603d6f8215b1d0]) successfully deleted
I20260810 11:30:35.405676 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 108) took 9046 ms. Trace:
I20260810 11:30:35.406201 27248 rpcz_store.cc:276] 0810 11:30:26.359030 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.359365 (+ 335us) service_pool.cc:227] Handling call
0810 11:30:35.404698 (+9045333us) ts_tablet_manager.cc:1145] Deleting tablet 91b6078efadf496fb252f725bdf56b02
0810 11:30:35.404717 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.405496 (+ 779us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9044958}
W20260810 11:30:35.407837 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 91b6078efadf496fb252f725bdf56b02 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91b6078efadf496fb252f725bdf56b02 already in progress: creating tablet
I20260810 11:30:35.408779 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 109) took 9049 ms. Trace:
I20260810 11:30:35.409420 27248 rpcz_store.cc:276] 0810 11:30:26.359705 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.359750 (+ 45us) service_pool.cc:227] Handling call
0810 11:30:35.407855 (+9048105us) ts_tablet_manager.cc:1145] Deleting tablet 3851d39aeb3142938a5ac558ab438c21
0810 11:30:35.408043 (+ 188us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.408758 (+ 715us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9047314}
I20260810 11:30:35.411480 27231 tablet_bootstrap.cc:492] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:35.411783 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 106) took 9054 ms. Trace:
W20260810 11:30:35.410938 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 3851d39aeb3142938a5ac558ab438c21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3851d39aeb3142938a5ac558ab438c21 already in progress: creating tablet
I20260810 11:30:35.413118 27231 ts_tablet_manager.cc:1397] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.057s user 0.000s sys 0.004s
I20260810 11:30:35.412177 27248 rpcz_store.cc:276] 0810 11:30:26.357496 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.357777 (+ 281us) service_pool.cc:227] Handling call
0810 11:30:35.411010 (+9053233us) ts_tablet_manager.cc:1145] Deleting tablet 10e6c41db71a4146840f06c5b7412d9c
0810 11:30:35.411189 (+ 179us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.411763 (+ 574us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9050174}
I20260810 11:30:35.414198 27231 raft_consensus.cc:348] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.391049 28515 raft_consensus.cc:482] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:35.365577 28359 raft_consensus.cc:504] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.414747 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 110) took 9053 ms. Trace:
I20260810 11:30:35.405949 28348 leader_election.cc:288] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:35.415341 27248 rpcz_store.cc:276] 0810 11:30:26.361442 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.361614 (+ 172us) service_pool.cc:227] Handling call
0810 11:30:35.413967 (+9052353us) ts_tablet_manager.cc:1145] Deleting tablet ff9b649e43a9456fa51cf3330290bb91
0810 11:30:35.414139 (+ 172us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.414723 (+ 584us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9051704}
I20260810 11:30:35.414885 28515 raft_consensus.cc:504] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.417451 28515 leader_election.cc:288] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:35.417411 27248 tablet_replica.cc:330] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:35.417722 28515 raft_consensus.cc:482] T 592be61b7e524941931264125b33d92c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:35.417893 28515 raft_consensus.cc:504] T 592be61b7e524941931264125b33d92c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.418519 28515 leader_election.cc:288] T 592be61b7e524941931264125b33d92c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:35.413870 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 10e6c41db71a4146840f06c5b7412d9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10e6c41db71a4146840f06c5b7412d9c already in progress: creating tablet
I20260810 11:30:35.406510 27228 tablet_bootstrap.cc:654] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.418817 27248 raft_consensus.cc:2229] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:35.419415 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet ff9b649e43a9456fa51cf3330290bb91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff9b649e43a9456fa51cf3330290bb91 already in progress: creating tablet
I20260810 11:30:35.419767 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 146) took 8068 ms. Trace:
I20260810 11:30:35.419967 27999 log.cc:1196] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/43e42cc642544f779bb79cee7479c4f4
I20260810 11:30:35.419844 27248 raft_consensus.cc:2258] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.422511 27231 raft_consensus.cc:374] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.422629 27231 raft_consensus.cc:729] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.415993 28359 leader_election.cc:288] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:35.422880 27231 consensus_queue.cc:260] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.423722 27231 ts_tablet_manager.cc:1428] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260810 11:30:35.424048 27231 tablet_bootstrap.cc:492] T b9195690e00b4f3cb3d5076dcca3519c P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:35.429452 27231 tablet_bootstrap.cc:654] T b9195690e00b4f3cb3d5076dcca3519c P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.430173 27999 ts_tablet_manager.cc:1939] T 43e42cc642544f779bb79cee7479c4f4 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:35.432691 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 83) took 9000 ms. Trace:
I20260810 11:30:35.435135 27248 ts_tablet_manager.cc:1905] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.437381 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83631b421a614796bdf76335f1437e00" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:35.437770 26759 raft_consensus.cc:3037] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.441377 26759 raft_consensus.cc:2454] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:35.443224 27974 rpcz_store.cc:276] 0810 11:30:27.352626 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.352802 (+ 176us) service_pool.cc:227] Handling call
0810 11:30:35.344456 (+7991654us) ts_tablet_manager.cc:1145] Deleting tablet cb6805a5dd264939850ea2cd9a850a1f
0810 11:30:35.344472 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.419688 (+ 75216us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7991280}
W20260810 11:30:35.444232 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet cb6805a5dd264939850ea2cd9a850a1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb6805a5dd264939850ea2cd9a850a1f already in progress: creating tablet
I20260810 11:30:35.444406 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "592be61b7e524941931264125b33d92c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:35.444692 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 147) took 8089 ms. Trace:
I20260810 11:30:35.445032 27974 rpcz_store.cc:276] 0810 11:30:27.355504 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.355782 (+ 278us) service_pool.cc:227] Handling call
0810 11:30:35.444039 (+8088257us) ts_tablet_manager.cc:1145] Deleting tablet 43fee1a9a6f9482fbbe6ab6599c27fb9
0810 11:30:35.444084 (+ 45us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.444529 (+ 445us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8087600}
I20260810 11:30:35.445538 27999 rpcz_store.cc:276] 0810 11:30:26.432360 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.432526 (+ 166us) service_pool.cc:227] Handling call
0810 11:30:35.244430 (+8811904us) ts_tablet_manager.cc:1145] Deleting tablet 43e42cc642544f779bb79cee7479c4f4
0810 11:30:35.244458 (+ 28us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.358670 (+114212us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.388060 (+ 29390us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.432627 (+ 44567us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8769357}
W20260810 11:30:35.445796 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 already in progress: creating tablet
I20260810 11:30:35.446043 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 148) took 8088 ms. Trace:
I20260810 11:30:35.446883 27974 rpcz_store.cc:276] 0810 11:30:27.382871 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.383084 (+ 213us) service_pool.cc:227] Handling call
0810 11:30:35.445621 (+8062537us) ts_tablet_manager.cc:1145] Deleting tablet 91b6078efadf496fb252f725bdf56b02
0810 11:30:35.445667 (+ 46us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.445953 (+ 286us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8062222}
I20260810 11:30:35.442765 26849 leader_election.cc:302] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
W20260810 11:30:35.447604 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 91b6078efadf496fb252f725bdf56b02 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91b6078efadf496fb252f725bdf56b02 already in progress: creating tablet
I20260810 11:30:35.447708 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 149) took 8062 ms. Trace:
I20260810 11:30:35.447926 27974 rpcz_store.cc:276] 0810 11:30:27.385776 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.386028 (+ 252us) service_pool.cc:227] Handling call
0810 11:30:35.447376 (+8061348us) ts_tablet_manager.cc:1145] Deleting tablet ff9b649e43a9456fa51cf3330290bb91
0810 11:30:35.447389 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.447590 (+ 201us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8060984}
W20260810 11:30:35.448534 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ff9b649e43a9456fa51cf3330290bb91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff9b649e43a9456fa51cf3330290bb91 already in progress: creating tablet
I20260810 11:30:35.448748 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 150) took 8058 ms. Trace:
I20260810 11:30:35.449433 28345 raft_consensus.cc:2781] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 11:30:35.449586 26849 leader_election.cc:341] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 478c0c39658349c39e3afa1aa1653e82
I20260810 11:30:35.449723 28345 raft_consensus.cc:686] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:35.450057 28345 consensus_queue.cc:237] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.451508 27999 tablet_replica.cc:330] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:35.452028 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 43e42cc642544f779bb79cee7479c4f4 (table default.Table_38ce4003d8e84bec8c910d35efb2a64e [id=9a87e462e8834e0ab7d9a8ae87f06e09]) successfully deleted
W20260810 11:30:35.453953 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 72661.4us
I20260810 11:30:35.457020 27999 raft_consensus.cc:2229] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:35.457378 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83631b421a614796bdf76335f1437e00" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:35.457577 27999 raft_consensus.cc:2258] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.457640 27059 raft_consensus.cc:3037] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.458482 27999 ts_tablet_manager.cc:1905] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.461357 27059 raft_consensus.cc:2454] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:35.449034 27974 rpcz_store.cc:276] 0810 11:30:27.390960 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.391189 (+ 229us) service_pool.cc:227] Handling call
0810 11:30:35.448382 (+8057193us) ts_tablet_manager.cc:1145] Deleting tablet 10e6c41db71a4146840f06c5b7412d9c
0810 11:30:35.448395 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.448625 (+ 230us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8056836}
W20260810 11:30:35.463440 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 10e6c41db71a4146840f06c5b7412d9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10e6c41db71a4146840f06c5b7412d9c already in progress: creating tablet
I20260810 11:30:35.463634 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "592be61b7e524941931264125b33d92c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:35.463958 27059 raft_consensus.cc:2379] T 592be61b7e524941931264125b33d92c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:35.464385 27222 tablet_bootstrap.cc:492] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:35.464633 27222 ts_tablet_manager.cc:1397] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.084s user 0.007s sys 0.000s
I20260810 11:30:35.468740 27974 tablet_replica.cc:330] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:35.469053 27974 raft_consensus.cc:2229] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:35.469448 27974 raft_consensus.cc:2258] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.470137 27974 ts_tablet_manager.cc:1905] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.455919 27228 tablet_bootstrap.cc:492] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:35.471676 27228 ts_tablet_manager.cc:1397] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.144s user 0.001s sys 0.006s
I20260810 11:30:35.471704 27222 raft_consensus.cc:348] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.472046 27222 raft_consensus.cc:374] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.472277 27222 raft_consensus.cc:729] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.472628 27222 consensus_queue.cc:260] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.473335 27222 ts_tablet_manager.cc:1428] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260810 11:30:35.476174 27228 raft_consensus.cc:348] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.476924 27228 raft_consensus.cc:374] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.477058 27228 raft_consensus.cc:729] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.477463 27228 consensus_queue.cc:260] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.477917 27222 tablet_bootstrap.cc:492] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:35.476761 26848 leader_election.cc:341] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 478c0c39658349c39e3afa1aa1653e82
I20260810 11:30:35.485661 26848 leader_election.cc:302] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:35.486343 26848 leader_election.cc:302] T 592be61b7e524941931264125b33d92c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
W20260810 11:30:35.488703 26848 consensus_peers.cc:487] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb0357271cfd46478867a3cc0660bcdc. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:35.488946 28519 raft_consensus.cc:3037] T 592be61b7e524941931264125b33d92c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.490648 27222 tablet_bootstrap.cc:654] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.486652 28345 raft_consensus.cc:2726] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:35.490863 27231 tablet_bootstrap.cc:492] T b9195690e00b4f3cb3d5076dcca3519c P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:35.491027 27231 ts_tablet_manager.cc:1397] T b9195690e00b4f3cb3d5076dcca3519c P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.067s user 0.004s sys 0.000s
I20260810 11:30:35.491986 27231 raft_consensus.cc:348] T b9195690e00b4f3cb3d5076dcca3519c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.492254 27231 raft_consensus.cc:374] T b9195690e00b4f3cb3d5076dcca3519c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.492328 27231 raft_consensus.cc:729] T b9195690e00b4f3cb3d5076dcca3519c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.492547 27231 consensus_queue.cc:260] T b9195690e00b4f3cb3d5076dcca3519c P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.493168 27231 ts_tablet_manager.cc:1428] T b9195690e00b4f3cb3d5076dcca3519c P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260810 11:30:35.493449 27231 tablet_bootstrap.cc:492] T 83992214ba314d3fa674e00d8eaddec6 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:35.495402 28519 raft_consensus.cc:2726] T 592be61b7e524941931264125b33d92c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:35.499495 27248 ts_tablet_manager.cc:1918] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:35.499969 27248 log.cc:1196] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/2801709d53614916abac370f7ae5e913
I20260810 11:30:35.489415 27228 ts_tablet_manager.cc:1428] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260810 11:30:35.502125 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_061b7dfbcc074ad6a0d99d49113a354f [id=0186ddbf3c144b4e86ae21cbdac555d2]
I20260810 11:30:35.502424 27231 tablet_bootstrap.cc:654] T 83992214ba314d3fa674e00d8eaddec6 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.503561 27228 tablet_bootstrap.cc:492] T b9195690e00b4f3cb3d5076dcca3519c P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:35.505105 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f8b086b05e6b4174a3494b211543a5c8 [id=0332305d764840cd9789d29ac4527fee]
W20260810 11:30:35.501844 26848 consensus_peers.cc:487] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0118ff9d21924aefa8c6c32977c10453. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:35.506830 27248 ts_tablet_manager.cc:1939] T 2801709d53614916abac370f7ae5e913 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:35.514043 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 105) took 9161 ms. Trace:
I20260810 11:30:35.518898 27248 rpcz_store.cc:276] 0810 11:30:26.353031 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.358833 (+ 5802us) service_pool.cc:227] Handling call
0810 11:30:35.417023 (+9058190us) ts_tablet_manager.cc:1145] Deleting tablet 2801709d53614916abac370f7ae5e913
0810 11:30:35.417209 (+ 186us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.474977 (+ 57768us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.499370 (+ 24393us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.514009 (+ 14639us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9053152}
I20260810 11:30:35.519675 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 117) took 9124 ms. Trace:
I20260810 11:30:35.519675 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 2801709d53614916abac370f7ae5e913 (table default.Table_be173a149b464952b17280eb1fe40667 [id=53a6520ad3b04ffe88477fd07c159add]) successfully deleted
I20260810 11:30:35.520581 27248 rpcz_store.cc:276] 0810 11:30:26.394921 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.394974 (+ 53us) service_pool.cc:227] Handling call
0810 11:30:35.519494 (+9124520us) ts_tablet_manager.cc:1145] Deleting tablet 64818ca5827e41d99428903ddb8688d9
0810 11:30:35.519513 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.519649 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9124224}
I20260810 11:30:35.521440 27228 tablet_bootstrap.cc:654] T b9195690e00b4f3cb3d5076dcca3519c P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.521715 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_9c70c3590985497fbaae37e05c4db1e4 [id=03fe9b9970bd450e890e1cddf9b5a43b]
I20260810 11:30:35.522583 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]
I20260810 11:30:35.523299 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 118) took 9127 ms. Trace:
W20260810 11:30:35.523283 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 64818ca5827e41d99428903ddb8688d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64818ca5827e41d99428903ddb8688d9 already in progress: creating tablet
I20260810 11:30:35.523420 27248 rpcz_store.cc:276] 0810 11:30:26.395544 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.395591 (+ 47us) service_pool.cc:227] Handling call
0810 11:30:35.523012 (+9127421us) ts_tablet_manager.cc:1145] Deleting tablet 318d5b8453fe4c438d0fa32cb91c409e
0810 11:30:35.523032 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.523160 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9122756}
I20260810 11:30:35.523777 27248 tablet_replica.cc:330] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:35.523934 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 318d5b8453fe4c438d0fa32cb91c409e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 318d5b8453fe4c438d0fa32cb91c409e already in progress: creating tablet
I20260810 11:30:35.524060 27248 raft_consensus.cc:2229] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:35.524477 27248 raft_consensus.cc:2258] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.525646 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_6471724ce77d490abaf4ad26ff7ae126 [id=068f712315544485a6fae8452986a3fa]
I20260810 11:30:35.526644 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_2d6c3a53213a458aaee6bd445240041c [id=097ff3abe81b415799933e50feab6c39]
I20260810 11:30:35.527125 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]
I20260810 11:30:35.528081 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_14f7e10124574ccdb41f7b14117603c6 [id=0cf740b2e59643899dac59acdf576fe2]
I20260810 11:30:35.529264 27974 ts_tablet_manager.cc:1918] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.529489 27974 log.cc:1196] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/4c595e0892634348b64418ae9dbbd4c2
I20260810 11:30:35.529863 28485 raft_consensus.cc:482] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:35.530054 28485 raft_consensus.cc:504] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.530791 28485 leader_election.cc:288] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:35.531658 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8dc3dece9d84d47a638707d10de6fd4" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:35.532320 26702 leader_election.cc:341] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:35.532903 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8dc3dece9d84d47a638707d10de6fd4" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:35.533154 26915 raft_consensus.cc:2454] T e8dc3dece9d84d47a638707d10de6fd4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:35.533516 27999 ts_tablet_manager.cc:1918] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.533598 27248 ts_tablet_manager.cc:1905] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.534219 26700 leader_election.cc:302] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:35.534734 28485 raft_consensus.cc:2781] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:35.534869 28485 raft_consensus.cc:482] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:35.534963 28485 raft_consensus.cc:3037] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.535768 27999 log.cc:1196] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/d729baae40a64e6e8c23e6870f230afb
I20260810 11:30:35.536368 27999 ts_tablet_manager.cc:1939] T d729baae40a64e6e8c23e6870f230afb P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:35.538115 28485 raft_consensus.cc:504] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.539155 28485 leader_election.cc:288] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:35.539645 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8dc3dece9d84d47a638707d10de6fd4" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:35.539736 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8dc3dece9d84d47a638707d10de6fd4" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:35.539952 26915 raft_consensus.cc:3037] T e8dc3dece9d84d47a638707d10de6fd4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:35.540278 26702 leader_election.cc:341] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:35.540815 27222 tablet_bootstrap.cc:492] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:35.540985 27222 ts_tablet_manager.cc:1397] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.003s
I20260810 11:30:35.541917 27222 raft_consensus.cc:348] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.542160 27222 raft_consensus.cc:374] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.542230 27222 raft_consensus.cc:729] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.542529 27222 consensus_queue.cc:260] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.543242 27974 ts_tablet_manager.cc:1939] T 4c595e0892634348b64418ae9dbbd4c2 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:35.543673 26915 raft_consensus.cc:2454] T e8dc3dece9d84d47a638707d10de6fd4 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:35.544288 26700 leader_election.cc:302] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:35.545019 28480 raft_consensus.cc:2781] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:35.545411 28480 raft_consensus.cc:686] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:35.545867 28480 consensus_queue.cc:237] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.547633 27222 ts_tablet_manager.cc:1428] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260810 11:30:35.547988 27222 tablet_bootstrap.cc:492] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:35.550441 28345 raft_consensus.cc:482] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:35.550684 28345 raft_consensus.cc:504] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:35.551440 28345 leader_election.cc:288] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:35.552816 26848 leader_election.cc:341] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: cb01e54d817c4b0dbcc80f90f82923c0
W20260810 11:30:35.553105 26849 leader_election.cc:341] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: cb01e54d817c4b0dbcc80f90f82923c0
I20260810 11:30:35.553269 26849 leader_election.cc:302] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:35.553709 28345 raft_consensus.cc:2726] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:35.554939 27231 tablet_bootstrap.cc:492] T 83992214ba314d3fa674e00d8eaddec6 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:35.555140 27231 ts_tablet_manager.cc:1397] T 83992214ba314d3fa674e00d8eaddec6 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.005s
I20260810 11:30:35.555949 27231 raft_consensus.cc:348] T 83992214ba314d3fa674e00d8eaddec6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.556252 27231 raft_consensus.cc:374] T 83992214ba314d3fa674e00d8eaddec6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.556344 27231 raft_consensus.cc:729] T 83992214ba314d3fa674e00d8eaddec6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.556607 27231 consensus_queue.cc:260] T 83992214ba314d3fa674e00d8eaddec6 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.557257 27231 ts_tablet_manager.cc:1428] T 83992214ba314d3fa674e00d8eaddec6 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 11:30:35.557335 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 151) took 8164 ms. Trace:
I20260810 11:30:35.557716 27231 tablet_bootstrap.cc:492] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:35.557510 27974 rpcz_store.cc:276] 0810 11:30:27.392925 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.392986 (+ 61us) service_pool.cc:227] Handling call
0810 11:30:35.463931 (+8070945us) ts_tablet_manager.cc:1145] Deleting tablet 4c595e0892634348b64418ae9dbbd4c2
0810 11:30:35.464180 (+ 249us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.506579 (+ 42399us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.512534 (+ 5955us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.557283 (+ 44749us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12422,"tablet-delete.queue_time_us":8070292}
I20260810 11:30:35.558790 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 4c595e0892634348b64418ae9dbbd4c2 (table default.Table_10b1b7ecd6ab43dfab0e6a29facddaf7 [id=ad429e3004674df1a8535523c4718f62]) successfully deleted
I20260810 11:30:35.560503 27222 tablet_bootstrap.cc:654] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.561076 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 84) took 9079 ms. Trace:
I20260810 11:30:35.561302 27231 tablet_bootstrap.cc:654] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.561996 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 152) took 8167 ms. Trace:
I20260810 11:30:35.562144 27974 rpcz_store.cc:276] 0810 11:30:27.394399 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.394589 (+ 190us) service_pool.cc:227] Handling call
0810 11:30:35.561800 (+8167211us) ts_tablet_manager.cc:1145] Deleting tablet a8a65a0e8b1f4e4b8d9a82059b766cda
0810 11:30:35.561815 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.561950 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8166924}
W20260810 11:30:35.563154 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet a8a65a0e8b1f4e4b8d9a82059b766cda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8a65a0e8b1f4e4b8d9a82059b766cda already in progress: creating tablet
I20260810 11:30:35.563583 27999 rpcz_store.cc:276] 0810 11:30:26.481185 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.481782 (+ 597us) service_pool.cc:227] Handling call
0810 11:30:35.451435 (+8969653us) ts_tablet_manager.cc:1145] Deleting tablet d729baae40a64e6e8c23e6870f230afb
0810 11:30:35.451448 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.488342 (+ 36894us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.533298 (+ 44956us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.560999 (+ 27701us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8949773}
I20260810 11:30:35.566300 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_8589a61b5c4e42c0a92a80a3576db8ac [id=0d2a77edfa664f679468b8b3cac2d9ee]
I20260810 11:30:35.565114 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet d729baae40a64e6e8c23e6870f230afb (table default.Table_d297e25211404611a6ba6a454c9dd5fd [id=093a9315d9f14cb28b5da3f910c28b0e]) successfully deleted
I20260810 11:30:35.568048 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]
I20260810 11:30:35.568145 27248 ts_tablet_manager.cc:1918] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.568352 27248 log.cc:1196] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/a7a2cb1d2e8e40f58144908e34438d53
I20260810 11:30:35.568908 27248 ts_tablet_manager.cc:1939] T a7a2cb1d2e8e40f58144908e34438d53 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:35.569504 27999 tablet_replica.cc:330] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:35.570009 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 112) took 9189 ms. Trace:
I20260810 11:30:35.570822 27974 tablet_replica.cc:330] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:35.571094 27974 raft_consensus.cc:2229] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:35.571302 27974 raft_consensus.cc:2258] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.570555 27228 tablet_bootstrap.cc:492] T b9195690e00b4f3cb3d5076dcca3519c P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:35.571648 28345 raft_consensus.cc:482] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:35.571898 28345 raft_consensus.cc:504] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.572618 28345 leader_election.cc:288] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:35.573153 27228 ts_tablet_manager.cc:1397] T b9195690e00b4f3cb3d5076dcca3519c P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.070s user 0.000s sys 0.004s
I20260810 11:30:35.573213 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "983916da755d4d14b7a3d43bb7cbc9c4" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:35.573668 26762 raft_consensus.cc:2454] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:35.575027 26849 leader_election.cc:302] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:35.575214 27228 raft_consensus.cc:348] T b9195690e00b4f3cb3d5076dcca3519c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.575814 27999 raft_consensus.cc:2229] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:35.576243 27999 raft_consensus.cc:2258] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.577204 27999 ts_tablet_manager.cc:1905] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.577557 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "983916da755d4d14b7a3d43bb7cbc9c4" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:35.584730 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_7c178d343d8246599a00f6d1c602a818 [id=0e39402016b54f588ea123ee4ea9788a]
I20260810 11:30:35.587944 27974 ts_tablet_manager.cc:1905] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.570133 27248 rpcz_store.cc:276] 0810 11:30:26.380847 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.384393 (+ 3546us) service_pool.cc:227] Handling call
0810 11:30:35.523719 (+9139326us) ts_tablet_manager.cc:1145] Deleting tablet a7a2cb1d2e8e40f58144908e34438d53
0810 11:30:35.523731 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.548258 (+ 24527us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.567975 (+ 19717us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.569980 (+ 2005us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9122072}
I20260810 11:30:35.593434 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_7d84624ac4e94437acb400decf3bb21b [id=0f6c3eaa5abb4fc5a07a723ed77c2e35]
I20260810 11:30:35.594065 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet a7a2cb1d2e8e40f58144908e34438d53 (table default.Table_05a7698994184d6bbed238252235f5f8 [id=7d1bf48b16db41a0a41a092bb07b8753]) successfully deleted
I20260810 11:30:35.594310 27248 tablet_replica.cc:330] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:35.595156 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_ad3534a46309483687ef9dd9471f1008 [id=0f9e142b43214fa8b2e362c54fabcb42]
I20260810 11:30:35.595213 27248 raft_consensus.cc:2229] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:35.595470 27228 raft_consensus.cc:374] T b9195690e00b4f3cb3d5076dcca3519c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.595736 27228 raft_consensus.cc:729] T b9195690e00b4f3cb3d5076dcca3519c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.595880 27248 raft_consensus.cc:2258] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.596061 27228 consensus_queue.cc:260] T b9195690e00b4f3cb3d5076dcca3519c P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.599175 27228 ts_tablet_manager.cc:1428] T b9195690e00b4f3cb3d5076dcca3519c P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.026s user 0.000s sys 0.003s
I20260810 11:30:35.599622 27228 tablet_bootstrap.cc:492] T dc2506b72a624cb388059efc326abbc1 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:35.601733 27228 tablet_bootstrap.cc:654] T dc2506b72a624cb388059efc326abbc1 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.605204 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_99cbe48a0bd54425b588a46ae1132cad [id=0faf073b01654e38b8f6083f5012abd7]
I20260810 11:30:35.605396 27248 ts_tablet_manager.cc:1905] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.610847 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_c40dd8e327db40b59167de093a5c616d [id=10ebb746a2b343b08b5b13d1107a7cd8]
I20260810 11:30:35.613049 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_91c2ed7bba91469685ccb4e15fb5c174 [id=163ec39724a44b518f07abf5938fbcb7]
I20260810 11:30:35.614979 27222 tablet_bootstrap.cc:492] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:35.615190 27222 ts_tablet_manager.cc:1397] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.067s user 0.003s sys 0.002s
I20260810 11:30:35.614985 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_168dc06875d64f40830cac1440688bd0 [id=167c03593b73416ab0f9607c87937a60]
I20260810 11:30:35.615952 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_341bf544f7b94ef2ba94afc342f8bc1f [id=193e8263e8a54ee798e1d4406074a52f]
I20260810 11:30:35.616140 27222 raft_consensus.cc:348] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.616403 27222 raft_consensus.cc:374] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.616518 27222 raft_consensus.cc:729] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.617086 27222 consensus_queue.cc:260] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.617761 27222 ts_tablet_manager.cc:1428] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:35.618257 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_dc83172ee2e44eccab63bccfa35523fe [id=19ea42a81c4f471592628b27a3404c4b]
I20260810 11:30:35.621296 27222 tablet_bootstrap.cc:492] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:35.623656 27222 tablet_bootstrap.cc:654] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.624795 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]
I20260810 11:30:35.626834 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_dd41dff7d9584a46821b6a187e5c52a4 [id=1f1a6853eb434bc1988eeda6224a2ff7]
I20260810 11:30:35.628156 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_fee5e058d63849c189e798c232542ad2 [id=2c6a659407bc4d8dad087cb73c16e229]
I20260810 11:30:35.628873 27999 ts_tablet_manager.cc:1918] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.630052 28480 raft_consensus.cc:482] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:35.630343 28480 raft_consensus.cc:504] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:35.631047 28480 leader_election.cc:288] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:35.632716 26702 leader_election.cc:341] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 1a83391804894d268d0e603f4feb1745
I20260810 11:30:35.633100 27999 log.cc:1196] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/478c0c39658349c39e3afa1aa1653e82
I20260810 11:30:35.633493 27974 ts_tablet_manager.cc:1918] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:35.634037 27999 ts_tablet_manager.cc:1939] T 478c0c39658349c39e3afa1aa1653e82 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:35.635020 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_66b8d163284b4347b99dea499ed256fc [id=304e1529f45d4d3c8799a22009066ce5]
I20260810 11:30:35.635449 27974 log.cc:1196] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/83631b421a614796bdf76335f1437e00
I20260810 11:30:35.630244 27228 tablet_bootstrap.cc:492] T dc2506b72a624cb388059efc326abbc1 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:35.635854 27228 ts_tablet_manager.cc:1397] T dc2506b72a624cb388059efc326abbc1 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.005s
I20260810 11:30:35.636989 27228 raft_consensus.cc:348] T dc2506b72a624cb388059efc326abbc1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.637336 27228 raft_consensus.cc:374] T dc2506b72a624cb388059efc326abbc1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.637460 27228 raft_consensus.cc:729] T dc2506b72a624cb388059efc326abbc1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.637840 27228 consensus_queue.cc:260] T dc2506b72a624cb388059efc326abbc1 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.638782 27228 ts_tablet_manager.cc:1428] T dc2506b72a624cb388059efc326abbc1 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 11:30:35.639146 27228 tablet_bootstrap.cc:492] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:35.642922 27228 tablet_bootstrap.cc:654] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.644467 27974 ts_tablet_manager.cc:1939] T 83631b421a614796bdf76335f1437e00 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:35.645201 27248 ts_tablet_manager.cc:1918] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:35.645362 27248 log.cc:1196] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/83631b421a614796bdf76335f1437e00
I20260810 11:30:35.645716 27248 ts_tablet_manager.cc:1939] T 83631b421a614796bdf76335f1437e00 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:35.654255 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_5d3880885d6342738dd22e168d08e660 [id=31e5d2935c2f44e4b272255fbd4c948a]
I20260810 11:30:35.643926 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 82) took 9214 ms. Trace:
I20260810 11:30:35.655973 27999 rpcz_store.cc:276] 0810 11:30:26.429303 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.452254 (+ 22951us) service_pool.cc:227] Handling call
0810 11:30:35.569378 (+9117124us) ts_tablet_manager.cc:1145] Deleting tablet 478c0c39658349c39e3afa1aa1653e82
0810 11:30:35.569397 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.613727 (+ 44330us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.628735 (+ 15008us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.643903 (+ 15168us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9059423}
I20260810 11:30:35.656378 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 113) took 9262 ms. Trace:
I20260810 11:30:35.656530 27248 rpcz_store.cc:276] 0810 11:30:26.394410 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.396029 (+ 1619us) service_pool.cc:227] Handling call
0810 11:30:35.594078 (+9198049us) ts_tablet_manager.cc:1145] Deleting tablet 83631b421a614796bdf76335f1437e00
0810 11:30:35.594179 (+ 101us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.637822 (+ 43643us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.645051 (+ 7229us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.656316 (+ 11265us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9191715}
I20260810 11:30:35.656978 27248 tablet_replica.cc:330] T 4c595e0892634348b64418ae9dbbd4c2 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:35.657315 27248 raft_consensus.cc:2229] T 4c595e0892634348b64418ae9dbbd4c2 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:35.657419 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 83631b421a614796bdf76335f1437e00 (table default.Table_7257f6125cd44735b0cfde14a574b1e6 [id=0bcc4778f70e44b8952915c4ba9d6ed8]) successfully deleted
I20260810 11:30:35.657541 27248 raft_consensus.cc:2258] T 4c595e0892634348b64418ae9dbbd4c2 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.657784 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 81) took 9237 ms. Trace:
I20260810 11:30:35.657939 27999 rpcz_store.cc:276] 0810 11:30:26.420517 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.473714 (+ 53197us) service_pool.cc:227] Handling call
0810 11:30:35.656489 (+9182775us) ts_tablet_manager.cc:1145] Deleting tablet 0713f4f14a284050a7774a70ab974f30
0810 11:30:35.656612 (+ 123us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.657755 (+ 1143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9132890}
I20260810 11:30:35.658178 27248 ts_tablet_manager.cc:1905] T 4c595e0892634348b64418ae9dbbd4c2 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.658812 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_5a4c04e087c3490fae87a17247850531 [id=323f239c11f84a69beaf74e68c0cf50a]
I20260810 11:30:35.662861 27231 tablet_bootstrap.cc:492] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:35.663311 27999 tablet_replica.cc:330] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:35.663571 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 153) took 8165 ms. Trace:
I20260810 11:30:35.663908 27999 raft_consensus.cc:2229] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:35.664744 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_e7f8305a313f47b0a219cb6a9cb15049 [id=329af78463204d2da90569d268b49eb3]
I20260810 11:30:35.664795 27231 ts_tablet_manager.cc:1397] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.105s user 0.017s sys 0.007s
I20260810 11:30:35.665303 27999 raft_consensus.cc:2258] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.664958 27974 rpcz_store.cc:276] 0810 11:30:27.497687 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.497829 (+ 142us) service_pool.cc:227] Handling call
0810 11:30:35.570718 (+8072889us) ts_tablet_manager.cc:1145] Deleting tablet 83631b421a614796bdf76335f1437e00
0810 11:30:35.570730 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.607985 (+ 37255us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.633338 (+ 25353us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.663465 (+ 30127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2944,"tablet-delete.queue_time_us":8070808}
I20260810 11:30:35.666507 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 154) took 8166 ms. Trace:
I20260810 11:30:35.666622 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 83631b421a614796bdf76335f1437e00 (table default.Table_7257f6125cd44735b0cfde14a574b1e6 [id=0bcc4778f70e44b8952915c4ba9d6ed8]) successfully deleted
I20260810 11:30:35.667331 27999 ts_tablet_manager.cc:1905] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.668336 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_6f7ae1749f224614a4fdaa33b125864d [id=339298a1ea1747d59a035a6a3cadfb30]
I20260810 11:30:35.668220 27231 raft_consensus.cc:348] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.668512 27231 raft_consensus.cc:374] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.668648 27231 raft_consensus.cc:729] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.668673 27974 rpcz_store.cc:276] 0810 11:30:27.500213 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.500398 (+ 185us) service_pool.cc:227] Handling call
0810 11:30:35.666235 (+8165837us) ts_tablet_manager.cc:1145] Deleting tablet 318d5b8453fe4c438d0fa32cb91c409e
0810 11:30:35.666257 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.666419 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8162591}
I20260810 11:30:35.668905 27231 consensus_queue.cc:260] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.673053 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 155) took 8172 ms. Trace:
I20260810 11:30:35.673797 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_a406a8172095498abc9c54697f00f4a0 [id=34056ce268f8490c94a38351b43357a6]
I20260810 11:30:35.674001 27974 rpcz_store.cc:276] 0810 11:30:27.500677 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.500769 (+ 92us) service_pool.cc:227] Handling call
0810 11:30:35.672820 (+8172051us) ts_tablet_manager.cc:1145] Deleting tablet 725d2e70e1d441b497d56a278e1de0ad
0810 11:30:35.672838 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.672989 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8168403}
W20260810 11:30:35.674180 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 318d5b8453fe4c438d0fa32cb91c409e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 318d5b8453fe4c438d0fa32cb91c409e already in progress: creating tablet
I20260810 11:30:35.675011 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 158) took 8169 ms. Trace:
W20260810 11:30:35.675065 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 725d2e70e1d441b497d56a278e1de0ad because the tablet was not found. No further retry: Not found: Tablet not found: 725d2e70e1d441b497d56a278e1de0ad
I20260810 11:30:35.675755 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]
I20260810 11:30:35.675935 27974 rpcz_store.cc:276] 0810 11:30:27.505540 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.505604 (+ 64us) service_pool.cc:227] Handling call
0810 11:30:35.674817 (+8169213us) ts_tablet_manager.cc:1145] Deleting tablet 7ff5b980ce4e41d7a6e1ca0e740b739c
0810 11:30:35.674831 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.674946 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8168286}
I20260810 11:30:35.676791 27974 tablet_replica.cc:330] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
W20260810 11:30:35.676903 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ff5b980ce4e41d7a6e1ca0e740b739c already in progress: creating tablet
I20260810 11:30:35.677424 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_3fd59f07e4ee4f54bce7829aec4cf4c4 [id=3719720e5ca241b1a500a1aaf7f310c4]
I20260810 11:30:35.677443 27222 tablet_bootstrap.cc:492] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:35.678069 27222 ts_tablet_manager.cc:1397] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.057s user 0.002s sys 0.005s
I20260810 11:30:35.679051 27228 tablet_bootstrap.cc:492] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:35.679080 27222 raft_consensus.cc:348] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.679270 27228 ts_tablet_manager.cc:1397] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.002s
I20260810 11:30:35.679360 27222 raft_consensus.cc:374] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.679435 27222 raft_consensus.cc:729] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.679934 27222 consensus_queue.cc:260] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.680861 27228 raft_consensus.cc:348] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.681192 27228 raft_consensus.cc:374] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.681313 27228 raft_consensus.cc:729] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.681596 27228 consensus_queue.cc:260] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.683353 27231 ts_tablet_manager.cc:1428] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20260810 11:30:35.685279 27228 ts_tablet_manager.cc:1428] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 11:30:35.686769 27974 raft_consensus.cc:2229] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:35.688048 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]
I20260810 11:30:35.688617 27228 tablet_bootstrap.cc:492] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:35.689079 27231 tablet_bootstrap.cc:492] T e8dc3dece9d84d47a638707d10de6fd4 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:35.689128 27974 raft_consensus.cc:2258] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.690603 28497 raft_consensus.cc:482] T 83992214ba314d3fa674e00d8eaddec6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:35.690773 28497 raft_consensus.cc:504] T 83992214ba314d3fa674e00d8eaddec6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.691223 27228 tablet_bootstrap.cc:654] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.691430 28497 leader_election.cc:288] T 83992214ba314d3fa674e00d8eaddec6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:35.692479 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83992214ba314d3fa674e00d8eaddec6" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:35.692953 27974 ts_tablet_manager.cc:1905] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.698005 27231 tablet_bootstrap.cc:654] T e8dc3dece9d84d47a638707d10de6fd4 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.699368 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_44f89aa654e84f22a77580060f057750 [id=3cadcafa2d524a5892f6c315c30881ae]
I20260810 11:30:35.701259 27222 ts_tablet_manager.cc:1428] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260810 11:30:35.701725 27222 tablet_bootstrap.cc:492] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:35.704386 27999 ts_tablet_manager.cc:1918] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.705076 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_afde78ad5bfa4a23828df391f669e7fa [id=3d8c46d7a15e457a93fd615ad99a4f36]
I20260810 11:30:35.706043 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_eecd0244ecc849339f452f38db67c973 [id=41d3dec833b54d1e855194862cb1726b]
I20260810 11:30:35.706102 27222 tablet_bootstrap.cc:654] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.709619 27248 ts_tablet_manager.cc:1918] T 4c595e0892634348b64418ae9dbbd4c2 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.709795 27248 log.cc:1196] T 4c595e0892634348b64418ae9dbbd4c2 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/4c595e0892634348b64418ae9dbbd4c2
I20260810 11:30:35.710266 27248 ts_tablet_manager.cc:1939] T 4c595e0892634348b64418ae9dbbd4c2 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:35.710868 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_9eee8b010360415faceef1c43fea61d9 [id=41dfd71fd24040a392812bca04e2baf6]
I20260810 11:30:35.711267 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 114) took 9316 ms. Trace:
I20260810 11:30:35.711398 27248 rpcz_store.cc:276] 0810 11:30:26.394577 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.396071 (+ 1494us) service_pool.cc:227] Handling call
0810 11:30:35.656899 (+9260828us) ts_tablet_manager.cc:1145] Deleting tablet 4c595e0892634348b64418ae9dbbd4c2
0810 11:30:35.656914 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.679050 (+ 22136us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.709467 (+ 30417us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.711225 (+ 1758us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9239785}
I20260810 11:30:35.711928 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 115) took 9317 ms. Trace:
I20260810 11:30:35.712052 27248 rpcz_store.cc:276] 0810 11:30:26.394685 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.396117 (+ 1432us) service_pool.cc:227] Handling call
0810 11:30:35.711727 (+9315610us) ts_tablet_manager.cc:1145] Deleting tablet a8a65a0e8b1f4e4b8d9a82059b766cda
0810 11:30:35.711742 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.711863 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9291961}
I20260810 11:30:35.712109 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 4c595e0892634348b64418ae9dbbd4c2 (table default.Table_10b1b7ecd6ab43dfab0e6a29facddaf7 [id=ad429e3004674df1a8535523c4718f62]) successfully deleted
I20260810 11:30:35.712373 27248 tablet_replica.cc:330] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:35.712637 27248 raft_consensus.cc:2229] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:35.713045 27248 raft_consensus.cc:2258] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:35.713426 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet a8a65a0e8b1f4e4b8d9a82059b766cda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8a65a0e8b1f4e4b8d9a82059b766cda already in progress: creating tablet
I20260810 11:30:35.716269 27248 ts_tablet_manager.cc:1905] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.716753 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]
W20260810 11:30:35.705384 26848 leader_election.cc:341] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:35.717247 27231 tablet_bootstrap.cc:492] T e8dc3dece9d84d47a638707d10de6fd4 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:35.717443 27231 ts_tablet_manager.cc:1397] T e8dc3dece9d84d47a638707d10de6fd4 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.003s
W20260810 11:30:35.717387 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 138967us
I20260810 11:30:35.705678 28345 raft_consensus.cc:2781] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:35.717918 28345 raft_consensus.cc:482] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:35.718011 28345 raft_consensus.cc:3037] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.718289 27231 raft_consensus.cc:348] T e8dc3dece9d84d47a638707d10de6fd4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.718556 27231 raft_consensus.cc:374] T e8dc3dece9d84d47a638707d10de6fd4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.718641 27231 raft_consensus.cc:729] T e8dc3dece9d84d47a638707d10de6fd4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.718974 27231 consensus_queue.cc:260] T e8dc3dece9d84d47a638707d10de6fd4 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.720817 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83992214ba314d3fa674e00d8eaddec6" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:35.721099 26915 raft_consensus.cc:2379] T 83992214ba314d3fa674e00d8eaddec6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 482e605580be48cbbacce05a3e61c215 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:35.721992 27222 tablet_bootstrap.cc:492] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:35.722177 27222 ts_tablet_manager.cc:1397] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.001s
I20260810 11:30:35.722183 28345 raft_consensus.cc:504] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.723080 28345 leader_election.cc:288] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:35.723137 26991 leader_election.cc:302] T 83992214ba314d3fa674e00d8eaddec6 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:35.723338 27222 raft_consensus.cc:348] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.723606 27222 raft_consensus.cc:374] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.723639 28497 raft_consensus.cc:3037] T 83992214ba314d3fa674e00d8eaddec6 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.723729 27222 raft_consensus.cc:729] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.724114 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "983916da755d4d14b7a3d43bb7cbc9c4" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:35.724357 27059 raft_consensus.cc:3037] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.726783 28497 raft_consensus.cc:2726] T 83992214ba314d3fa674e00d8eaddec6 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:35.727563 27059 raft_consensus.cc:2454] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:35.729255 26848 leader_election.cc:302] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:35.730443 28345 raft_consensus.cc:2781] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:35.730938 28345 raft_consensus.cc:686] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:35.731279 28345 consensus_queue.cc:237] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.724004 27222 consensus_queue.cc:260] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.732827 27231 ts_tablet_manager.cc:1428] T e8dc3dece9d84d47a638707d10de6fd4 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
W20260810 11:30:35.707172 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 132259us
I20260810 11:30:35.736822 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a83391804894d268d0e603f4feb1745" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:35.737058 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 478c0c39658349c39e3afa1aa1653e82 (table default.Table_38150fc48b7148a8bc17eb85f039d7b3 [id=b54ba03677734f2da90a534a0f5ff58e]) successfully deleted
I20260810 11:30:35.737130 26915 raft_consensus.cc:2454] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
W20260810 11:30:35.737403 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 0713f4f14a284050a7774a70ab974f30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0713f4f14a284050a7774a70ab974f30 already in progress: creating tablet
I20260810 11:30:35.738628 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "983916da755d4d14b7a3d43bb7cbc9c4" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:35.738873 26762 raft_consensus.cc:3037] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.739750 27999 log.cc:1196] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/a3406dc345e3429fb4bce5a59643b686
I20260810 11:30:35.739912 26700 leader_election.cc:302] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:35.740253 27999 ts_tablet_manager.cc:1939] T a3406dc345e3429fb4bce5a59643b686 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:35.740727 28480 raft_consensus.cc:2781] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:35.740854 28480 raft_consensus.cc:482] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:35.740973 28480 raft_consensus.cc:3037] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.741304 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 85) took 9247 ms. Trace:
I20260810 11:30:35.741410 27999 rpcz_store.cc:276] 0810 11:30:26.494072 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.494985 (+ 913us) service_pool.cc:227] Handling call
0810 11:30:35.663231 (+9168246us) ts_tablet_manager.cc:1145] Deleting tablet a3406dc345e3429fb4bce5a59643b686
0810 11:30:35.663255 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.696990 (+ 33735us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.704249 (+ 7259us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.741279 (+ 37030us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9130189}
I20260810 11:30:35.742141 26762 raft_consensus.cc:2454] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:35.742672 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]
I20260810 11:30:35.743477 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet a3406dc345e3429fb4bce5a59643b686 (table default.Table_b9bd48d71fac4e03b0d84dcafd4cb4a5 [id=0db7b6eb26f8438caf57a129ba2c81fe]) successfully deleted
I20260810 11:30:35.745184 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_21a675494284471eaf3ea50b31b833d7 [id=46a8ee2948c04311b0d3c1a5174d08dc]
I20260810 11:30:35.745993 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_a48c8668e73f4919a9c32c9c3e95f485 [id=46bda36574e1430dbada751ccf16703c]
I20260810 11:30:35.750140 27231 tablet_bootstrap.cc:492] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:35.750626 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 86) took 9256 ms. Trace:
I20260810 11:30:35.751314 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]
I20260810 11:30:35.751578 28497 raft_consensus.cc:482] T e8dc3dece9d84d47a638707d10de6fd4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:35.751760 27999 rpcz_store.cc:276] 0810 11:30:26.494224 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.494321 (+ 97us) service_pool.cc:227] Handling call
0810 11:30:35.750464 (+9256143us) ts_tablet_manager.cc:1145] Deleting tablet 81f24c84cdd945b78f39f24015eb1e43
0810 11:30:35.750478 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.750602 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9212962}
I20260810 11:30:35.751772 28497 raft_consensus.cc:504] T e8dc3dece9d84d47a638707d10de6fd4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.752909 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8dc3dece9d84d47a638707d10de6fd4" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:35.753937 28497 leader_election.cc:288] T e8dc3dece9d84d47a638707d10de6fd4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:35.753954 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8dc3dece9d84d47a638707d10de6fd4" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:35.744392 28480 raft_consensus.cc:504] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:35.754348 26915 raft_consensus.cc:2379] T e8dc3dece9d84d47a638707d10de6fd4 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 482e605580be48cbbacce05a3e61c215 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
W20260810 11:30:35.754789 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 81f24c84cdd945b78f39f24015eb1e43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81f24c84cdd945b78f39f24015eb1e43 already in progress: creating tablet
I20260810 11:30:35.755120 27999 tablet_replica.cc:330] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:35.755225 26991 leader_election.cc:302] T e8dc3dece9d84d47a638707d10de6fd4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:35.755431 27999 raft_consensus.cc:2229] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:35.755671 28497 raft_consensus.cc:3037] T e8dc3dece9d84d47a638707d10de6fd4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.756503 27999 raft_consensus.cc:2258] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:35.756676 26702 leader_election.cc:341] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 1a83391804894d268d0e603f4feb1745
I20260810 11:30:35.756122 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]
I20260810 11:30:35.756976 28480 leader_election.cc:288] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:35.759155 27228 tablet_bootstrap.cc:492] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:35.759298 27228 ts_tablet_manager.cc:1397] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.000s
I20260810 11:30:35.760417 27222 ts_tablet_manager.cc:1428] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.038s user 0.003s sys 0.000s
I20260810 11:30:35.760274 27228 raft_consensus.cc:348] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.760598 27228 raft_consensus.cc:374] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.760727 27228 raft_consensus.cc:729] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.760983 27228 consensus_queue.cc:260] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.761924 27228 ts_tablet_manager.cc:1428] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:35.762392 27228 tablet_bootstrap.cc:492] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:35.764163 27228 tablet_bootstrap.cc:654] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.765116 28497 raft_consensus.cc:2726] T e8dc3dece9d84d47a638707d10de6fd4 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:35.765625 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]
I20260810 11:30:35.766538 27974 ts_tablet_manager.cc:1918] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.766947 27999 ts_tablet_manager.cc:1905] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.767756 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f3f00d1fa4db4cd4bbaaeefeef68897d [id=4cda0e139cc34db8ae99e56a074f5557]
I20260810 11:30:35.769186 27974 log.cc:1196] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/f2b555f18c1e485d9af7b08f98543c80
I20260810 11:30:35.769716 27222 tablet_bootstrap.cc:492] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:35.770233 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_03a616a243fc4350b4a01d7f5bb86949 [id=4e2dc56dde3346a0917e58c6c7e921eb]
I20260810 11:30:35.773049 27974 ts_tablet_manager.cc:1939] T f2b555f18c1e485d9af7b08f98543c80 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:35.774197 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f55e75edcec14683a44d60250c42dbc7 [id=4f456ea1fbfe40dc8ed31415b77d4743]
I20260810 11:30:35.775298 27222 tablet_bootstrap.cc:654] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.776893 27231 tablet_bootstrap.cc:654] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.777714 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_645b3efca425434da139268167fec99f [id=51dc04b8252b4142a7ac67c5fc0dd1ad]
I20260810 11:30:35.778156 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 160) took 8272 ms. Trace:
I20260810 11:30:35.778707 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]
I20260810 11:30:35.778911 27974 rpcz_store.cc:276] 0810 11:30:27.506042 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.506103 (+ 61us) service_pool.cc:227] Handling call
0810 11:30:35.676678 (+8170575us) ts_tablet_manager.cc:1145] Deleting tablet f2b555f18c1e485d9af7b08f98543c80
0810 11:30:35.676691 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.714312 (+ 37621us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.766373 (+ 52061us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.778099 (+ 11726us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8169444}
I20260810 11:30:35.782019 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a83391804894d268d0e603f4feb1745" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:35.782308 26915 raft_consensus.cc:3037] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.783825 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]
I20260810 11:30:35.784798 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet f2b555f18c1e485d9af7b08f98543c80 (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]) successfully deleted
I20260810 11:30:35.782758 27974 tablet_replica.cc:330] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:35.786068 27974 raft_consensus.cc:2229] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:35.786429 26915 raft_consensus.cc:2454] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:35.786845 27974 raft_consensus.cc:2258] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.787495 26700 leader_election.cc:302] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:35.787914 28480 raft_consensus.cc:2781] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:35.788111 28483 raft_consensus.cc:482] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:35.788152 28480 raft_consensus.cc:686] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:35.788343 28483 raft_consensus.cc:504] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.788547 28480 consensus_queue.cc:237] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:35.789150 28483 leader_election.cc:288] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:35.790146 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9b649e43a9456fa51cf3330290bb91" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:35.790941 26702 leader_election.cc:341] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:35.796022 27999 ts_tablet_manager.cc:1918] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.785274 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_b7e6c83a5d5340b5b960f65b82d4939a [id=553f87ed39f148aba3be0a6fcd13e25d]
I20260810 11:30:35.798360 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_acbcb3a347b647a19e81cfcf5636677f [id=56dee621acfa4f73b3bd69fefa7cb7e1]
I20260810 11:30:35.799090 27974 ts_tablet_manager.cc:1905] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.799705 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9b649e43a9456fa51cf3330290bb91" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:35.800002 26915 raft_consensus.cc:2454] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:35.801316 26700 leader_election.cc:302] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:35.801927 28480 raft_consensus.cc:2781] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:35.802155 28480 raft_consensus.cc:482] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:35.802374 28480 raft_consensus.cc:3037] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.805860 28480 raft_consensus.cc:504] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.806193 27222 tablet_bootstrap.cc:492] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:35.806496 27222 ts_tablet_manager.cc:1397] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.004s
I20260810 11:30:35.804545 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]
I20260810 11:30:35.807742 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9b649e43a9456fa51cf3330290bb91" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:35.807687 27222 raft_consensus.cc:348] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.807979 27222 raft_consensus.cc:374] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.808090 27222 raft_consensus.cc:729] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
W20260810 11:30:35.808486 26702 leader_election.cc:341] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:35.808382 27222 consensus_queue.cc:260] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.808925 27999 log.cc:1196] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/5ca5c88585394dba87e201696afa6934
I20260810 11:30:35.809648 27999 ts_tablet_manager.cc:1939] T 5ca5c88585394dba87e201696afa6934 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:35.810083 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_67580ad3fe7a47d6a051e7da7005c171 [id=5ae9efa77fb54cf58ff2a1662eee03f7]
I20260810 11:30:35.813323 28480 leader_election.cc:288] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:35.814172 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]
I20260810 11:30:35.814821 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9b649e43a9456fa51cf3330290bb91" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:35.816665 27222 ts_tablet_manager.cc:1428] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.010s user 0.000s sys 0.003s
I20260810 11:30:35.816890 26915 raft_consensus.cc:3037] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.818877 27228 tablet_bootstrap.cc:492] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:35.819099 27228 ts_tablet_manager.cc:1397] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.057s user 0.008s sys 0.001s
I20260810 11:30:35.819926 27228 raft_consensus.cc:348] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.820182 27228 raft_consensus.cc:374] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.820371 27228 raft_consensus.cc:729] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.820660 27228 consensus_queue.cc:260] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.822960 26915 raft_consensus.cc:2454] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:35.824420 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 87) took 9300 ms. Trace:
I20260810 11:30:35.825364 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_711dc900ac3b45b8897cd1fbc2964dec [id=5e0aa4c382c24a7d9380bec9f8a50ad7]
I20260810 11:30:35.825533 27999 rpcz_store.cc:276] 0810 11:30:26.530997 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.536266 (+ 5269us) service_pool.cc:227] Handling call
0810 11:30:35.753858 (+9217592us) ts_tablet_manager.cc:1145] Deleting tablet 5ca5c88585394dba87e201696afa6934
0810 11:30:35.753884 (+ 26us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.779883 (+ 25999us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.795860 (+ 15977us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.824395 (+ 28535us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5504,"tablet-delete.queue_time_us":9213908}
I20260810 11:30:35.826092 27222 tablet_bootstrap.cc:492] T f85c0767ad164075b87ba672cafafb47 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:35.826381 27999 tablet_replica.cc:330] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:35.826900 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_d4313ebe5ce04c1aa10d064712cbf3ab [id=5f6080c52e46443e9b4ba99dd4352b12]
I20260810 11:30:35.827229 27999 raft_consensus.cc:2229] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:35.827489 27999 raft_consensus.cc:2258] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.828161 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_e91c3002bfab499aad3c1d686b4f4437 [id=5f8a0b38bb0d428c8bf6253bfbf40650]
I20260810 11:30:35.829005 27999 ts_tablet_manager.cc:1905] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:35.831372 26993 consensus_peers.cc:487] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:35.832073 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f33a13096a144e538af2795c149abdcd [id=60ce1267de814f218c27ac084a08a26a]
I20260810 11:30:35.832289 26700 leader_election.cc:302] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:35.832654 28485 raft_consensus.cc:482] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:35.832729 28480 raft_consensus.cc:2781] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:35.833081 28485 raft_consensus.cc:504] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.831959 27228 ts_tablet_manager.cc:1428] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260810 11:30:35.834371 28485 leader_election.cc:288] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:35.835187 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2506b72a624cb388059efc326abbc1" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:35.835459 27059 raft_consensus.cc:2454] T dc2506b72a624cb388059efc326abbc1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:35.836184 26702 leader_election.cc:302] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:35.836594 28485 raft_consensus.cc:2781] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:35.836725 28485 raft_consensus.cc:482] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:35.836815 28485 raft_consensus.cc:3037] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.837607 27228 tablet_bootstrap.cc:492] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:35.839927 28485 raft_consensus.cc:504] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.840510 27222 tablet_bootstrap.cc:654] T f85c0767ad164075b87ba672cafafb47 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.842403 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2506b72a624cb388059efc326abbc1" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:35.842659 27059 raft_consensus.cc:3037] T dc2506b72a624cb388059efc326abbc1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.840611 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]
I20260810 11:30:35.844738 28485 leader_election.cc:288] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:35.847652 28526 raft_consensus.cc:482] T dc2506b72a624cb388059efc326abbc1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:35.847924 28526 raft_consensus.cc:504] T dc2506b72a624cb388059efc326abbc1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.849092 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]
I20260810 11:30:35.849380 28526 leader_election.cc:288] T dc2506b72a624cb388059efc326abbc1 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:35.849503 27228 tablet_bootstrap.cc:654] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.849529 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2506b72a624cb388059efc326abbc1" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:35.849792 27059 raft_consensus.cc:2454] T dc2506b72a624cb388059efc326abbc1 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:35.850144 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_57b6151125a144fcb6230ee986bff7ee [id=62f404c62e4040fc801f70cafddf9d95]
I20260810 11:30:35.854604 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]
I20260810 11:30:35.859948 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_10b2af8299224f5db4a63bd1fae61155 [id=6a421de2b28a46088fd0bad429a52bad]
I20260810 11:30:35.865833 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 5ca5c88585394dba87e201696afa6934 (table default.Table_5895dc74894a4711bf78dd8b259cfc40 [id=696fdd9a822c4e40930fc333e3f3d725]) successfully deleted
I20260810 11:30:35.851045 27974 ts_tablet_manager.cc:1918] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.851301 26702 leader_election.cc:302] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:35.866825 27974 log.cc:1196] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/8a1e2e624fff4692a22e29b293cd82d6
I20260810 11:30:35.867405 27974 ts_tablet_manager.cc:1939] T 8a1e2e624fff4692a22e29b293cd82d6 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:35.868613 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 165) took 8360 ms. Trace:
I20260810 11:30:35.868709 28483 raft_consensus.cc:2781] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:35.869280 28483 raft_consensus.cc:686] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:35.868741 27974 rpcz_store.cc:276] 0810 11:30:27.507668 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.507858 (+ 190us) service_pool.cc:227] Handling call
0810 11:30:35.782654 (+8274796us) ts_tablet_manager.cc:1145] Deleting tablet 8a1e2e624fff4692a22e29b293cd82d6
0810 11:30:35.782673 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.816328 (+ 33655us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.850822 (+ 34494us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.868530 (+ 17708us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8273712}
I20260810 11:30:35.869644 28483 consensus_queue.cc:237] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.869827 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 166) took 8362 ms. Trace:
I20260810 11:30:35.869915 27974 rpcz_store.cc:276] 0810 11:30:27.507837 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.507900 (+ 63us) service_pool.cc:227] Handling call
0810 11:30:35.869664 (+8361764us) ts_tablet_manager.cc:1145] Deleting tablet fc558690dce44e999e55e9bf1b6ca172
0810 11:30:35.869681 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.869809 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8360470}
I20260810 11:30:35.870257 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 162) took 8363 ms. Trace:
I20260810 11:30:35.870337 27974 rpcz_store.cc:276] 0810 11:30:27.507125 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.509136 (+ 2011us) service_pool.cc:227] Handling call
0810 11:30:35.870144 (+8361008us) ts_tablet_manager.cc:1145] Deleting tablet 10210204d5ff4e5e97c98fd255f674a5
0810 11:30:35.870152 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.870241 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8360801}
I20260810 11:30:35.871486 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 8a1e2e624fff4692a22e29b293cd82d6 (table default.Table_f974a4ceae4649bb9f17115103f554cd [id=8c06eb3e2a9245af8c8e8eb250215e0c]) successfully deleted
W20260810 11:30:35.871907 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet fc558690dce44e999e55e9bf1b6ca172 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc558690dce44e999e55e9bf1b6ca172 already in progress: creating tablet
W20260810 11:30:35.872174 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 10210204d5ff4e5e97c98fd255f674a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10210204d5ff4e5e97c98fd255f674a5 already in progress: creating tablet
I20260810 11:30:35.874866 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2506b72a624cb388059efc326abbc1" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:35.875169 26915 raft_consensus.cc:2454] T dc2506b72a624cb388059efc326abbc1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:35.875475 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2506b72a624cb388059efc326abbc1" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:35.875658 26912 raft_consensus.cc:3037] T dc2506b72a624cb388059efc326abbc1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.876120 27231 tablet_bootstrap.cc:492] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:35.876288 27231 ts_tablet_manager.cc:1397] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.127s user 0.004s sys 0.000s
I20260810 11:30:35.877291 27231 raft_consensus.cc:348] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.877570 27231 raft_consensus.cc:374] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.877658 27231 raft_consensus.cc:729] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.877928 27231 consensus_queue.cc:260] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.878783 26912 raft_consensus.cc:2454] T dc2506b72a624cb388059efc326abbc1 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:35.870808 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 157) took 8365 ms. Trace:
I20260810 11:30:35.883292 27974 rpcz_store.cc:276] 0810 11:30:27.505388 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.505778 (+ 390us) service_pool.cc:227] Handling call
0810 11:30:35.870637 (+8364859us) ts_tablet_manager.cc:1145] Deleting tablet 64818ca5827e41d99428903ddb8688d9
0810 11:30:35.870651 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.870786 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8361252}
I20260810 11:30:35.881168 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2506b72a624cb388059efc326abbc1" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:35.887156 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 156) took 8383 ms. Trace:
I20260810 11:30:35.887287 27974 rpcz_store.cc:276] 0810 11:30:27.504025 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.504121 (+ 96us) service_pool.cc:227] Handling call
0810 11:30:35.886848 (+8382727us) ts_tablet_manager.cc:1145] Deleting tablet f7ada1df82eb44ecb9a6c615b5410e6f
0810 11:30:35.886865 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.887132 (+ 267us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8376892}
I20260810 11:30:35.888489 26849 leader_election.cc:302] T dc2506b72a624cb388059efc326abbc1 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:35.888900 28345 raft_consensus.cc:2726] T dc2506b72a624cb388059efc326abbc1 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:35.890636 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]
I20260810 11:30:35.891294 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 159) took 8385 ms. Trace:
I20260810 11:30:35.891893 27974 rpcz_store.cc:276] 0810 11:30:27.505679 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.505752 (+ 73us) service_pool.cc:227] Handling call
0810 11:30:35.891110 (+8385358us) ts_tablet_manager.cc:1145] Deleting tablet 2634beb347714fc7a2e05865adb34a22
0810 11:30:35.891125 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.891268 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8381103}
I20260810 11:30:35.895463 27231 ts_tablet_manager.cc:1428] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260810 11:30:35.900236 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_4eef50b9dbea413f91b6b6a35c997283 [id=6eb74fbbf5db4f2f8434c3c9a83188b7]
I20260810 11:30:35.900528 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 164) took 8393 ms. Trace:
I20260810 11:30:35.900748 27974 rpcz_store.cc:276] 0810 11:30:27.507507 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.507959 (+ 452us) service_pool.cc:227] Handling call
0810 11:30:35.895427 (+8387468us) ts_tablet_manager.cc:1145] Deleting tablet 44d5e146eeec4fe0be33c1c169d32e68
0810 11:30:35.895443 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.900500 (+ 5057us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8385152}
I20260810 11:30:35.901479 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 161) took 8395 ms. Trace:
I20260810 11:30:35.902621 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]
I20260810 11:30:35.904181 27231 tablet_bootstrap.cc:492] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:35.906131 27974 rpcz_store.cc:276] 0810 11:30:27.506227 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.506313 (+ 86us) service_pool.cc:227] Handling call
0810 11:30:35.901281 (+8394968us) ts_tablet_manager.cc:1145] Deleting tablet 420ba6e9f74c4ae5bf450f369e7fbdb3
0810 11:30:35.901295 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.901458 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8390444}
I20260810 11:30:35.906809 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 163) took 8399 ms. Trace:
I20260810 11:30:35.907323 27999 ts_tablet_manager.cc:1918] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.907971 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_56b4699099fd417496e71ccbed272638 [id=72829be151bc48dba287b32c7028caf7]
I20260810 11:30:35.908123 27974 rpcz_store.cc:276] 0810 11:30:27.507319 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.509953 (+ 2634us) service_pool.cc:227] Handling call
0810 11:30:35.906609 (+8396656us) ts_tablet_manager.cc:1145] Deleting tablet 834c9c99ec424bb39e8a003e9204b2bc
0810 11:30:35.906624 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.906783 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":116,"tablet-delete.queue_time_us":8395750}
I20260810 11:30:35.908478 27999 log.cc:1196] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/cb01e54d817c4b0dbcc80f90f82923c0
I20260810 11:30:35.908942 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 167) took 8400 ms. Trace:
I20260810 11:30:35.911147 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_9a25589f61c844cab9a7d2db84a7eba2 [id=744c7bf0857b476cabce9efa16d7d885]
I20260810 11:30:35.911324 27974 rpcz_store.cc:276] 0810 11:30:27.508341 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.508407 (+ 66us) service_pool.cc:227] Handling call
0810 11:30:35.908777 (+8400370us) ts_tablet_manager.cc:1145] Deleting tablet 34bd3c0edf6b49d1891c0ee9af344872
0810 11:30:35.908791 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.908919 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8396322}
I20260810 11:30:35.911793 27974 tablet_replica.cc:330] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:35.911993 27999 ts_tablet_manager.cc:1939] T cb01e54d817c4b0dbcc80f90f82923c0 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:35.913411 27974 raft_consensus.cc:2229] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:35.913700 27228 tablet_bootstrap.cc:492] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:35.913903 27228 ts_tablet_manager.cc:1397] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.076s user 0.004s sys 0.003s
I20260810 11:30:35.914053 27974 pending_rounds.cc:62] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d: Trying to abort 1 pending ops.
I20260810 11:30:35.914518 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 99) took 9353 ms. Trace:
I20260810 11:30:35.914121 27974 pending_rounds.cc:68] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936440994373632 op_type: NO_OP noop_request { }
I20260810 11:30:35.916133 27248 ts_tablet_manager.cc:1918] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.916343 27974 raft_consensus.cc:2866] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:35.917035 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_1e1ca07e9c824349af23675b66b77321 [id=755202f095f04307a11ce87087df835c]
I20260810 11:30:35.917074 28557 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac259bcf213a4aa297d1d8e73b262361)
I20260810 11:30:35.914780 27228 raft_consensus.cc:348] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.917280 28557 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:35.917631 27228 raft_consensus.cc:374] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.917829 27228 raft_consensus.cc:729] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.917897 27222 tablet_bootstrap.cc:492] T f85c0767ad164075b87ba672cafafb47 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:35.918041 27222 ts_tablet_manager.cc:1397] T f85c0767ad164075b87ba672cafafb47 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.092s user 0.013s sys 0.006s
I20260810 11:30:35.918251 27228 consensus_queue.cc:260] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.919157 27228 ts_tablet_manager.cc:1428] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 11:30:35.917268 27974 raft_consensus.cc:2258] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.919538 27999 rpcz_store.cc:276] 0810 11:30:26.560702 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.560763 (+ 61us) service_pool.cc:227] Handling call
0810 11:30:35.826328 (+9265565us) ts_tablet_manager.cc:1145] Deleting tablet cb01e54d817c4b0dbcc80f90f82923c0
0810 11:30:35.826342 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.855926 (+ 29584us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.907127 (+ 51201us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.914494 (+ 7367us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9262233}
I20260810 11:30:35.922338 27974 ts_tablet_manager.cc:1905] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.920619 27222 raft_consensus.cc:348] T f85c0767ad164075b87ba672cafafb47 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.923919 27222 raft_consensus.cc:374] T f85c0767ad164075b87ba672cafafb47 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.924026 27222 raft_consensus.cc:729] T f85c0767ad164075b87ba672cafafb47 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.924283 27222 consensus_queue.cc:260] T f85c0767ad164075b87ba672cafafb47 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.931277 27228 tablet_bootstrap.cc:492] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:35.932796 27999 tablet_replica.cc:330] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:35.933125 27999 raft_consensus.cc:2229] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:35.933514 27999 raft_consensus.cc:2258] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:35.935060 27222 ts_tablet_manager.cc:1428] T f85c0767ad164075b87ba672cafafb47 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260810 11:30:35.935453 27228 tablet_bootstrap.cc:654] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:35.939908 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 64818ca5827e41d99428903ddb8688d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64818ca5827e41d99428903ddb8688d9 already in progress: creating tablet
W20260810 11:30:35.940274 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet f7ada1df82eb44ecb9a6c615b5410e6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7ada1df82eb44ecb9a6c615b5410e6f already in progress: creating tablet
W20260810 11:30:35.940493 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2634beb347714fc7a2e05865adb34a22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2634beb347714fc7a2e05865adb34a22 already in progress: creating tablet
I20260810 11:30:35.941013 27999 ts_tablet_manager.cc:1905] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:35.943177 28485 raft_consensus.cc:482] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:35.943359 28485 raft_consensus.cc:504] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.944108 28485 leader_election.cc:288] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:35.945487 26702 leader_election.cc:341] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: cb6805a5dd264939850ea2cd9a850a1f
I20260810 11:30:35.945784 27222 tablet_bootstrap.cc:492] T fc023d51790042ce978eb53a2979e29c P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:35.947120 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb6805a5dd264939850ea2cd9a850a1f" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:35.947494 26912 raft_consensus.cc:2379] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
I20260810 11:30:35.947475 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_84fd493f2b9e4a46aa2035a43a9069a1 [id=773fafc7914a45dabad64680fc3a4a27]
I20260810 11:30:35.948001 26700 leader_election.cc:302] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:35.948670 28485 raft_consensus.cc:3037] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.949723 27222 tablet_bootstrap.cc:654] T fc023d51790042ce978eb53a2979e29c P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.952512 28485 raft_consensus.cc:2726] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:35.940768 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 44d5e146eeec4fe0be33c1c169d32e68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44d5e146eeec4fe0be33c1c169d32e68 already in progress: creating tablet
W20260810 11:30:35.953938 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 already in progress: creating tablet
W20260810 11:30:35.954618 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 834c9c99ec424bb39e8a003e9204b2bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 834c9c99ec424bb39e8a003e9204b2bc already in progress: creating tablet
W20260810 11:30:35.955195 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 34bd3c0edf6b49d1891c0ee9af344872 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34bd3c0edf6b49d1891c0ee9af344872 already in progress: creating tablet
I20260810 11:30:35.957434 27248 log.cc:1196] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/d91a02b22044429fb3e25840c7947a02
I20260810 11:30:35.958237 27248 ts_tablet_manager.cc:1939] T d91a02b22044429fb3e25840c7947a02 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:35.958817 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_96d4976d4de649c4a98910a1b7fd1b59 [id=777f92ce815f4314898abce665fec1eb]
I20260810 11:30:35.959240 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet cb01e54d817c4b0dbcc80f90f82923c0 (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]) successfully deleted
I20260810 11:30:35.961488 27231 tablet_bootstrap.cc:654] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.963268 27222 tablet_bootstrap.cc:492] T fc023d51790042ce978eb53a2979e29c P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:35.963455 27222 ts_tablet_manager.cc:1397] T fc023d51790042ce978eb53a2979e29c P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20260810 11:30:35.964268 28557 leader_election.cc:288] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
I20260810 11:30:35.964536 28480 raft_consensus.cc:686] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:35.966130 27222 raft_consensus.cc:348] T fc023d51790042ce978eb53a2979e29c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.966778 27222 raft_consensus.cc:374] T fc023d51790042ce978eb53a2979e29c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.966856 27222 raft_consensus.cc:729] T fc023d51790042ce978eb53a2979e29c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.967118 27222 consensus_queue.cc:260] T fc023d51790042ce978eb53a2979e29c P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.967248 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]
I20260810 11:30:35.966621 28480 consensus_queue.cc:237] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.967957 27222 ts_tablet_manager.cc:1428] T fc023d51790042ce978eb53a2979e29c P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260810 11:30:35.969803 27222 tablet_bootstrap.cc:492] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:35.972700 27228 tablet_bootstrap.cc:492] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:35.972946 27228 ts_tablet_manager.cc:1397] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.000s
I20260810 11:30:35.973901 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_0b6cd084cecf499e9091685515cb1a3b [id=7b4e4650915f4c16bef68adf43618b89]
I20260810 11:30:35.974728 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_fd64c13d7a514c7285b42e1c91a63cdf [id=7c8348b49b664bee8d8243efb2cdbb79]
W20260810 11:30:35.975867 26848 consensus_peers.cc:487] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e2c9112462f442e8de5b4a944cfdc6b. This is attempt 6: this message will repeat every 5th retry.
I20260810 11:30:35.974411 27228 raft_consensus.cc:348] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.978370 27222 tablet_bootstrap.cc:654] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.979437 27228 raft_consensus.cc:374] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:35.979573 27228 raft_consensus.cc:729] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:35.979844 27228 consensus_queue.cc:260] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.980665 27228 ts_tablet_manager.cc:1428] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260810 11:30:35.981024 27228 tablet_bootstrap.cc:492] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:35.983386 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_09ff2cfcae6d4c1b96479fd190b3c084 [id=7d0dd215c30648438a460f730b0b7ba4]
I20260810 11:30:35.985406 27228 tablet_bootstrap.cc:654] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:35.986523 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_ce10a5f4bedc411da7e7089a730e9cc8 [id=807b3a26a49f446797962bb532b4c58e]
I20260810 11:30:35.990924 27999 ts_tablet_manager.cc:1918] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:35.991608 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_23ac53b1a7794ddda0a697254fff0ede [id=80a1649fe2d74dd4bf5aa5e07a762de3]
I20260810 11:30:35.993593 28485 raft_consensus.cc:482] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:35.993818 28485 raft_consensus.cc:504] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:35.994750 28485 leader_election.cc:288] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:35.995966 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9195690e00b4f3cb3d5076dcca3519c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:35.996275 27059 raft_consensus.cc:2454] T b9195690e00b4f3cb3d5076dcca3519c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:35.997051 26702 leader_election.cc:302] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:35.997927 28485 raft_consensus.cc:2781] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:35.997437 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 119) took 9600 ms. Trace:
I20260810 11:30:35.998040 28485 raft_consensus.cc:482] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:35.998119 28485 raft_consensus.cc:3037] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.002724 28485 raft_consensus.cc:504] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.005061 28485 leader_election.cc:288] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.005722 27974 ts_tablet_manager.cc:1918] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:36.006958 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]
I20260810 11:30:36.007241 27974 log.cc:1196] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/1a83391804894d268d0e603f4feb1745
I20260810 11:30:36.004907 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9195690e00b4f3cb3d5076dcca3519c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:36.015461 27059 raft_consensus.cc:3037] T b9195690e00b4f3cb3d5076dcca3519c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:35.998921 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9195690e00b4f3cb3d5076dcca3519c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:36.016857 26912 raft_consensus.cc:2454] T b9195690e00b4f3cb3d5076dcca3519c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:36.004058 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9195690e00b4f3cb3d5076dcca3519c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:36.009408 27228 tablet_bootstrap.cc:492] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:36.017155 26915 raft_consensus.cc:3037] T b9195690e00b4f3cb3d5076dcca3519c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.017247 27228 ts_tablet_manager.cc:1397] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.036s user 0.007s sys 0.000s
I20260810 11:30:36.018513 27228 raft_consensus.cc:348] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.018738 27228 raft_consensus.cc:374] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.018806 27228 raft_consensus.cc:729] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.019070 27228 consensus_queue.cc:260] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.019237 27059 raft_consensus.cc:2454] T b9195690e00b4f3cb3d5076dcca3519c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:36.020033 26702 leader_election.cc:302] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:36.008405 28498 raft_consensus.cc:482] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.020537 28498 raft_consensus.cc:504] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.021406 28498 leader_election.cc:288] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:36.023007 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91b6078efadf496fb252f725bdf56b02" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:36.023310 26759 raft_consensus.cc:2454] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:36.024258 28485 raft_consensus.cc:2781] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:36.024399 26993 leader_election.cc:302] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:36.024596 28485 raft_consensus.cc:686] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:36.024879 28485 consensus_queue.cc:237] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.025234 27228 ts_tablet_manager.cc:1428] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 11:30:36.025466 27911 raft_consensus.cc:2781] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:36.025584 27911 raft_consensus.cc:482] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:36.025631 27228 tablet_bootstrap.cc:492] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:36.025679 27911 raft_consensus.cc:3037] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.027417 27228 tablet_bootstrap.cc:654] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.031188 28526 consensus_queue.cc:1035] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:36.032086 28480 consensus_queue.cc:1035] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:36.036748 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91b6078efadf496fb252f725bdf56b02" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:36.041471 26991 leader_election.cc:341] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:36.043020 26915 raft_consensus.cc:2454] T b9195690e00b4f3cb3d5076dcca3519c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:36.044322 27911 raft_consensus.cc:504] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.046239 27911 leader_election.cc:288] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:36.046335 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91b6078efadf496fb252f725bdf56b02" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:36.046592 26762 raft_consensus.cc:3037] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.047336 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91b6078efadf496fb252f725bdf56b02" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:36.048174 26991 leader_election.cc:341] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:36.050419 26762 raft_consensus.cc:2454] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:35.998288 27248 rpcz_store.cc:276] 0810 11:30:26.403888 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.404436 (+ 548us) service_pool.cc:227] Handling call
0810 11:30:35.712305 (+9307869us) ts_tablet_manager.cc:1145] Deleting tablet d91a02b22044429fb3e25840c7947a02
0810 11:30:35.712314 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.768667 (+ 56353us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.915967 (+147300us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.997199 (+ 81232us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9289399}
I20260810 11:30:36.052714 27248 tablet_replica.cc:330] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:36.052841 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet d91a02b22044429fb3e25840c7947a02 (table default.Table_ed278fa8f2db4fe8a3215e71eb2d3f9f [id=0b49f313222c437d921a10d967a953de]) successfully deleted
I20260810 11:30:36.053609 27248 raft_consensus.cc:2229] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:36.053921 26993 leader_election.cc:302] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:36.058328 27999 log.cc:1196] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/ffeb0373c6124af291336ca9da50c318
I20260810 11:30:36.008721 27974 ts_tablet_manager.cc:1939] T 1a83391804894d268d0e603f4feb1745 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:36.060462 27999 ts_tablet_manager.cc:1939] T ffeb0373c6124af291336ca9da50c318 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:36.063133 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 95) took 9510 ms. Trace:
I20260810 11:30:36.063357 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_bbae9d833ed04fc89a867eb497163403 [id=822d8386d19c4a2bb83cc63fbc186792]
I20260810 11:30:36.069113 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_49be430f1e8f475482b54850772c0430 [id=82e113439bc04ce9955f59612ba480dc]
I20260810 11:30:36.071918 28526 raft_consensus.cc:482] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.073446 28526 raft_consensus.cc:504] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.074158 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_aa56bd03f9eb42468dce12fd81958879 [id=851eb82758954da2b3ec9bf0007880fa]
I20260810 11:30:36.074199 28526 leader_election.cc:288] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.074621 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]
I20260810 11:30:36.074993 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_6f7fdd85630648659dcfe3b52e5ab365 [id=862df0152eda418da6110067b4ab588b]
I20260810 11:30:36.075109 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc023d51790042ce978eb53a2979e29c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:36.075376 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_9efdfb09fd194dc2a9cbdc9a87749126 [id=8afbc0cc8e704a03a064974937b5a36b]
I20260810 11:30:36.075374 26762 raft_consensus.cc:2454] T fc023d51790042ce978eb53a2979e29c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:36.075927 26849 leader_election.cc:302] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:36.076048 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 168) took 8566 ms. Trace:
I20260810 11:30:36.076238 28526 raft_consensus.cc:2781] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:36.076310 28526 raft_consensus.cc:482] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:36.076161 27974 rpcz_store.cc:276] 0810 11:30:27.509764 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.510052 (+ 288us) service_pool.cc:227] Handling call
0810 11:30:35.911737 (+8401685us) ts_tablet_manager.cc:1145] Deleting tablet 1a83391804894d268d0e603f4feb1745
0810 11:30:35.911752 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.972907 (+ 61155us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.005579 (+ 32672us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.076029 (+ 70450us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8399005}
I20260810 11:30:36.076370 28526 raft_consensus.cc:3037] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.076687 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 1a83391804894d268d0e603f4feb1745 (table default.Table_9329d33b857541719c3852e79fdc14b6 [id=d74c35e9ac524f3798c37c9b6a422a82]) successfully deleted
I20260810 11:30:36.073369 27999 rpcz_store.cc:276] 0810 11:30:26.552181 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.552882 (+ 701us) service_pool.cc:227] Handling call
0810 11:30:35.922841 (+9369959us) ts_tablet_manager.cc:1145] Deleting tablet ffeb0373c6124af291336ca9da50c318
0810 11:30:35.932742 (+ 9901us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:35.976294 (+ 43552us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:35.990805 (+ 14511us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.063102 (+ 72297us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9358679}
I20260810 11:30:36.077425 27974 tablet_replica.cc:330] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:36.077975 27974 raft_consensus.cc:2229] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:36.078511 27974 raft_consensus.cc:2258] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:36.079607 27999 tablet_replica.cc:330] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:36.079885 27999 raft_consensus.cc:2229] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:36.080309 27999 raft_consensus.cc:2258] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:36.080521 27286 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.253:34547, user_credentials={real_user=slave}} blocked reactor thread for 119452us
I20260810 11:30:36.081461 27999 ts_tablet_manager.cc:1905] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:36.082888 28526 raft_consensus.cc:504] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.085114 28498 raft_consensus.cc:2781] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:36.085232 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc023d51790042ce978eb53a2979e29c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:36.085479 26762 raft_consensus.cc:3037] T fc023d51790042ce978eb53a2979e29c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.085736 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc023d51790042ce978eb53a2979e29c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:36.086992 28498 raft_consensus.cc:686] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:36.087302 28498 consensus_queue.cc:237] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.089514 27974 ts_tablet_manager.cc:1905] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:36.089684 28519 consensus_queue.cc:1035] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:36.090138 26848 leader_election.cc:341] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:36.090939 26762 raft_consensus.cc:2454] T fc023d51790042ce978eb53a2979e29c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:36.091445 26849 leader_election.cc:302] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:36.091745 28519 raft_consensus.cc:2781] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:36.091871 28519 raft_consensus.cc:686] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:36.092092 28519 consensus_queue.cc:237] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.092850 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]
I20260810 11:30:36.096185 28526 leader_election.cc:288] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.096299 27248 raft_consensus.cc:2258] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:36.098598 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]
I20260810 11:30:36.099269 27222 tablet_bootstrap.cc:492] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:36.099462 27222 ts_tablet_manager.cc:1397] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.130s user 0.007s sys 0.016s
I20260810 11:30:36.098902 27231 tablet_bootstrap.cc:492] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:36.102602 27222 raft_consensus.cc:348] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.102895 27222 raft_consensus.cc:374] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.105528 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc023d51790042ce978eb53a2979e29c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
W20260810 11:30:36.106387 26848 leader_election.cc:341] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:36.107700 27231 ts_tablet_manager.cc:1397] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.203s user 0.006s sys 0.000s
I20260810 11:30:36.109042 27228 tablet_bootstrap.cc:492] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:36.102960 27222 raft_consensus.cc:729] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.109793 27222 consensus_queue.cc:260] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.112720 27228 ts_tablet_manager.cc:1397] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.087s user 0.006s sys 0.007s
I20260810 11:30:36.108340 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet ffeb0373c6124af291336ca9da50c318 (table default.Table_cc55e38123c6426fb73e83da0b48d081 [id=c1ed54f150864132aa31551870ffde82]) successfully deleted
I20260810 11:30:36.114576 28483 consensus_queue.cc:1035] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:36.116888 27248 ts_tablet_manager.cc:1905] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:36.116833 27286 leader_election.cc:334] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547): Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111)
I20260810 11:30:36.123663 27222 ts_tablet_manager.cc:1428] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.024s user 0.002s sys 0.002s
I20260810 11:30:36.125597 27228 raft_consensus.cc:348] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.130352 27231 raft_consensus.cc:348] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.130920 27231 raft_consensus.cc:374] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.131014 27231 raft_consensus.cc:729] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.131256 27231 consensus_queue.cc:260] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.132513 27222 tablet_bootstrap.cc:492] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:36.135465 27231 ts_tablet_manager.cc:1428] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20260810 11:30:36.135847 27231 tablet_bootstrap.cc:492] T 834c9c99ec424bb39e8a003e9204b2bc P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:36.146744 27222 tablet_bootstrap.cc:654] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.147007 27228 raft_consensus.cc:374] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.147554 27228 raft_consensus.cc:729] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.150368 27228 consensus_queue.cc:260] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.156713 27228 ts_tablet_manager.cc:1428] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.032s user 0.003s sys 0.000s
I20260810 11:30:36.145138 28519 raft_consensus.cc:482] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.157528 28519 raft_consensus.cc:504] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.158746 28519 leader_election.cc:288] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.159015 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "603fe104b7ab485eab6b225a58bddc1c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:36.159857 27058 raft_consensus.cc:2454] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:36.160439 26848 leader_election.cc:302] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:36.161031 28519 raft_consensus.cc:2781] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:36.161792 27228 tablet_bootstrap.cc:492] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:36.166350 27228 tablet_bootstrap.cc:654] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.161175 28519 raft_consensus.cc:482] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:36.170486 28519 raft_consensus.cc:3037] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.173595 28519 raft_consensus.cc:504] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.175493 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "603fe104b7ab485eab6b225a58bddc1c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
W20260810 11:30:36.176492 26849 leader_election.cc:341] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:36.180256 27228 tablet_bootstrap.cc:492] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:36.180490 27228 ts_tablet_manager.cc:1397] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.000s
I20260810 11:30:36.181277 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "603fe104b7ab485eab6b225a58bddc1c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:36.182024 26849 leader_election.cc:341] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:36.183957 27222 tablet_bootstrap.cc:492] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:36.186367 28526 consensus_queue.cc:1035] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:36.184521 27222 ts_tablet_manager.cc:1397] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.005s
I20260810 11:30:36.188012 27222 raft_consensus.cc:348] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.196117 27222 raft_consensus.cc:374] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.196733 27222 raft_consensus.cc:729] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.197121 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "603fe104b7ab485eab6b225a58bddc1c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:36.197296 28519 leader_election.cc:288] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.197178 27222 consensus_queue.cc:260] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.197371 27060 raft_consensus.cc:3037] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.199107 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_04e075d361354421aa7085057964f310 [id=94c8e7388b644043b77cb6b5087e87e8]
I20260810 11:30:36.181695 27228 raft_consensus.cc:348] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.199434 27228 raft_consensus.cc:374] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.199517 27228 raft_consensus.cc:729] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.199795 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]
I20260810 11:30:36.199818 27228 consensus_queue.cc:260] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:36.187841 26564 consensus_peers.cc:487] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 -> Peer c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547): Couldn't send request to peer c40c76e125b44de181b88b7f63a566f7. Status: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260810 11:30:36.202337 27222 ts_tablet_manager.cc:1428] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.015s user 0.000s sys 0.003s
I20260810 11:30:36.202625 27060 raft_consensus.cc:2454] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:36.202726 27228 ts_tablet_manager.cc:1428] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20260810 11:30:36.203361 27222 tablet_bootstrap.cc:492] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:36.203521 26848 leader_election.cc:302] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:36.205104 28345 raft_consensus.cc:2781] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:36.205307 28345 raft_consensus.cc:686] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:36.205608 28345 consensus_queue.cc:237] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.206090 27228 tablet_bootstrap.cc:492] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:36.208514 28485 consensus_queue.cc:1035] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:36.209733 27228 tablet_bootstrap.cc:654] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.211313 27222 tablet_bootstrap.cc:654] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.227449 27231 tablet_bootstrap.cc:654] T 834c9c99ec424bb39e8a003e9204b2bc P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.249090 28519 raft_consensus.cc:482] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.249327 27231 tablet_bootstrap.cc:492] T 834c9c99ec424bb39e8a003e9204b2bc P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:36.249528 27231 ts_tablet_manager.cc:1397] T 834c9c99ec424bb39e8a003e9204b2bc P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.114s user 0.030s sys 0.002s
I20260810 11:30:36.249413 28519 raft_consensus.cc:504] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.250380 28519 leader_election.cc:288] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.250291 27231 raft_consensus.cc:348] T 834c9c99ec424bb39e8a003e9204b2bc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.250542 27231 raft_consensus.cc:374] T 834c9c99ec424bb39e8a003e9204b2bc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.250626 27231 raft_consensus.cc:729] T 834c9c99ec424bb39e8a003e9204b2bc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.251647 27231 consensus_queue.cc:260] T 834c9c99ec424bb39e8a003e9204b2bc P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.254127 27231 ts_tablet_manager.cc:1428] T 834c9c99ec424bb39e8a003e9204b2bc P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 11:30:36.255385 27231 tablet_bootstrap.cc:492] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:36.257462 27231 tablet_bootstrap.cc:654] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.273329 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_5f7d17a1cdaa4396b5faf52b01518860 [id=973454ab92f84e73be26260d66ee9763]
I20260810 11:30:36.274953 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]
I20260810 11:30:36.276528 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_2c7697ec19204b3d823f5684c30978e2 [id=9d480f65788b486db55bbbe48a0ad5eb]
I20260810 11:30:36.282778 28519 raft_consensus.cc:482] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.283335 28519 raft_consensus.cc:504] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.284631 28519 leader_election.cc:288] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.297323 28586 raft_consensus.cc:482] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.298053 28586 raft_consensus.cc:504] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.304410 28586 leader_election.cc:288] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.306097 27228 tablet_bootstrap.cc:492] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:36.308118 27228 ts_tablet_manager.cc:1397] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.102s user 0.017s sys 0.012s
I20260810 11:30:36.309957 27228 raft_consensus.cc:348] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.316650 27228 raft_consensus.cc:374] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.318070 27228 raft_consensus.cc:729] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.307917 27999 ts_tablet_manager.cc:1918] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:36.318573 27999 log.cc:1196] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/f3c6bd6803c245b7bb3d78423de482b6
I20260810 11:30:36.318645 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_d863b14a3a96454e8ee5a85fb2ab30c8 [id=a40ab01e5be24248b3af7ef1dc456da6]
I20260810 11:30:36.319147 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]
I20260810 11:30:36.319267 27999 ts_tablet_manager.cc:1939] T f3c6bd6803c245b7bb3d78423de482b6 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:36.319293 27228 consensus_queue.cc:260] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.319728 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_883ee52a6394446eb2ca688ec956d44b [id=a47869d3574543b19e821bbfcb5d3785]
I20260810 11:30:36.320115 27228 ts_tablet_manager.cc:1428] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260810 11:30:36.320456 27228 tablet_bootstrap.cc:492] T 00c4599256684f5dbc745c9283f31a08 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:36.322502 27228 tablet_bootstrap.cc:654] T 00c4599256684f5dbc745c9283f31a08 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.322731 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 100) took 9758 ms. Trace:
I20260810 11:30:36.322928 27999 rpcz_store.cc:276] 0810 11:30:26.563939 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.564136 (+ 197us) service_pool.cc:227] Handling call
0810 11:30:36.079543 (+9515407us) ts_tablet_manager.cc:1145] Deleting tablet f3c6bd6803c245b7bb3d78423de482b6
0810 11:30:36.079558 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.259818 (+180260us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.307795 (+ 47977us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.322699 (+ 14904us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9515144}
I20260810 11:30:36.323429 27999 tablet_replica.cc:330] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:36.323422 27231 tablet_bootstrap.cc:492] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:36.323690 27231 ts_tablet_manager.cc:1397] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.068s user 0.026s sys 0.030s
I20260810 11:30:36.323832 27999 raft_consensus.cc:2229] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 2 LEADER]: Raft consensus shutting down.
I20260810 11:30:36.324235 27999 pending_rounds.cc:62] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700: Trying to abort 1 pending ops.
I20260810 11:30:36.324378 27999 pending_rounds.cc:68] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700: Aborting op as it isn't in flight: id { term: 2 index: 1 } timestamp: 7316936431912050688 op_type: NO_OP noop_request { }
I20260810 11:30:36.324661 27999 raft_consensus.cc:2866] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:36.324831 27999 raft_consensus.cc:2258] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:36.325559 27999 ts_tablet_manager.cc:1905] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:36.326483 27248 ts_tablet_manager.cc:1918] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:36.327739 27248 log.cc:1196] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/f2b555f18c1e485d9af7b08f98543c80
I20260810 11:30:36.326902 27231 raft_consensus.cc:348] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.329113 27231 raft_consensus.cc:374] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.329299 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet f3c6bd6803c245b7bb3d78423de482b6 (table default.Table_590ce8c7b9f647ecb1e81a793a66f3b1 [id=8de62290aa814a5492665eca65a37230]) successfully deleted
I20260810 11:30:36.329679 27231 raft_consensus.cc:729] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.332228 27248 ts_tablet_manager.cc:1939] T f2b555f18c1e485d9af7b08f98543c80 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:36.333818 27228 tablet_bootstrap.cc:492] T 00c4599256684f5dbc745c9283f31a08 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:36.333995 27228 ts_tablet_manager.cc:1397] T 00c4599256684f5dbc745c9283f31a08 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260810 11:30:36.331617 27231 consensus_queue.cc:260] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.334884 27228 raft_consensus.cc:348] T 00c4599256684f5dbc745c9283f31a08 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.335136 27228 raft_consensus.cc:374] T 00c4599256684f5dbc745c9283f31a08 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.335199 27228 raft_consensus.cc:729] T 00c4599256684f5dbc745c9283f31a08 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.335422 27228 consensus_queue.cc:260] T 00c4599256684f5dbc745c9283f31a08 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.336087 27228 ts_tablet_manager.cc:1428] T 00c4599256684f5dbc745c9283f31a08 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:36.338157 27228 tablet_bootstrap.cc:492] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:36.338616 27231 ts_tablet_manager.cc:1428] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.015s user 0.000s sys 0.003s
I20260810 11:30:36.340658 27228 tablet_bootstrap.cc:654] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.341361 27231 tablet_bootstrap.cc:492] T 00c4599256684f5dbc745c9283f31a08 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:36.341606 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 124) took 9898 ms. Trace:
I20260810 11:30:36.342327 27248 rpcz_store.cc:276] 0810 11:30:26.442922 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.442985 (+ 63us) service_pool.cc:227] Handling call
0810 11:30:36.052540 (+9609555us) ts_tablet_manager.cc:1145] Deleting tablet f2b555f18c1e485d9af7b08f98543c80
0810 11:30:36.052592 (+ 52us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.235667 (+183075us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.325605 (+ 89938us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.341429 (+ 15824us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9609177}
I20260810 11:30:36.345489 27999 ts_tablet_manager.cc:1918] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260810 11:30:36.346733 27999 log.cc:1196] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/8798892eb4604ee8ac9c95e64dbb14e9
I20260810 11:30:36.347224 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet f2b555f18c1e485d9af7b08f98543c80 (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]) successfully deleted
I20260810 11:30:36.347373 27231 tablet_bootstrap.cc:654] T 00c4599256684f5dbc745c9283f31a08 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.356863 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 125) took 9913 ms. Trace:
I20260810 11:30:36.357028 27248 rpcz_store.cc:276] 0810 11:30:26.443604 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.443655 (+ 51us) service_pool.cc:227] Handling call
0810 11:30:36.345843 (+9902188us) ts_tablet_manager.cc:1145] Deleting tablet 420ba6e9f74c4ae5bf450f369e7fbdb3
0810 11:30:36.356620 (+ 10777us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.356830 (+ 210us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9900321}
I20260810 11:30:36.357647 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 122) took 9915 ms. Trace:
I20260810 11:30:36.357736 27248 rpcz_store.cc:276] 0810 11:30:26.442269 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.443833 (+ 1564us) service_pool.cc:227] Handling call
0810 11:30:36.357379 (+9913546us) ts_tablet_manager.cc:1145] Deleting tablet 7ff5b980ce4e41d7a6e1ca0e740b739c
0810 11:30:36.357502 (+ 123us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.357614 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9911285}
W20260810 11:30:36.358163 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 already in progress: creating tablet
W20260810 11:30:36.358812 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ff5b980ce4e41d7a6e1ca0e740b739c already in progress: creating tablet
I20260810 11:30:36.359405 27231 tablet_bootstrap.cc:492] T 00c4599256684f5dbc745c9283f31a08 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:36.359455 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 123) took 9917 ms. Trace:
I20260810 11:30:36.359579 27231 ts_tablet_manager.cc:1397] T 00c4599256684f5dbc745c9283f31a08 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.002s
I20260810 11:30:36.359540 27248 rpcz_store.cc:276] 0810 11:30:26.442777 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.443926 (+ 1149us) service_pool.cc:227] Handling call
0810 11:30:36.357966 (+9914040us) ts_tablet_manager.cc:1145] Deleting tablet 4b5a7f67ec5b48c2b5a510add0282a76
0810 11:30:36.359295 (+ 1329us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.359425 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9911258}
I20260810 11:30:36.359951 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 121) took 9917 ms. Trace:
I20260810 11:30:36.360025 27248 rpcz_store.cc:276] 0810 11:30:26.442123 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.443878 (+ 1755us) service_pool.cc:227] Handling call
0810 11:30:36.359807 (+9915929us) ts_tablet_manager.cc:1145] Deleting tablet 2634beb347714fc7a2e05865adb34a22
0810 11:30:36.359816 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.359935 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9912827}
I20260810 11:30:36.360414 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 120) took 9940 ms. Trace:
I20260810 11:30:36.360514 27248 rpcz_store.cc:276] 0810 11:30:26.423153 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.423277 (+ 124us) service_pool.cc:227] Handling call
0810 11:30:36.360251 (+9936974us) ts_tablet_manager.cc:1145] Deleting tablet f7ada1df82eb44ecb9a6c615b5410e6f
0810 11:30:36.360260 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.360384 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9912999}
I20260810 11:30:36.361001 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 130) took 9889 ms. Trace:
I20260810 11:30:36.361109 27248 rpcz_store.cc:276] 0810 11:30:26.471242 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.471298 (+ 56us) service_pool.cc:227] Handling call
0810 11:30:36.360825 (+9889527us) ts_tablet_manager.cc:1145] Deleting tablet db59523b71224370bf5fce6b56592f71
0810 11:30:36.360835 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.360986 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9888553}
I20260810 11:30:36.360353 27231 raft_consensus.cc:348] T 00c4599256684f5dbc745c9283f31a08 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.361372 27248 tablet_replica.cc:330] T 834c9c99ec424bb39e8a003e9204b2bc P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:36.361562 27231 raft_consensus.cc:374] T 00c4599256684f5dbc745c9283f31a08 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.361698 27248 raft_consensus.cc:2229] T 834c9c99ec424bb39e8a003e9204b2bc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:36.361815 27231 raft_consensus.cc:729] T 00c4599256684f5dbc745c9283f31a08 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
W20260810 11:30:36.361953 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 4b5a7f67ec5b48c2b5a510add0282a76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b5a7f67ec5b48c2b5a510add0282a76 already in progress: creating tablet
I20260810 11:30:36.361944 27248 raft_consensus.cc:2258] T 834c9c99ec424bb39e8a003e9204b2bc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:36.362459 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 2634beb347714fc7a2e05865adb34a22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2634beb347714fc7a2e05865adb34a22 already in progress: creating tablet
I20260810 11:30:36.362567 27231 consensus_queue.cc:260] T 00c4599256684f5dbc745c9283f31a08 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:36.362852 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet f7ada1df82eb44ecb9a6c615b5410e6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7ada1df82eb44ecb9a6c615b5410e6f already in progress: creating tablet
I20260810 11:30:36.362977 27248 ts_tablet_manager.cc:1905] T 834c9c99ec424bb39e8a003e9204b2bc P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:36.363266 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet db59523b71224370bf5fce6b56592f71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db59523b71224370bf5fce6b56592f71 already in progress: creating tablet
I20260810 11:30:36.363677 27231 ts_tablet_manager.cc:1428] T 00c4599256684f5dbc745c9283f31a08 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260810 11:30:36.364091 27231 tablet_bootstrap.cc:492] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:36.366005 27231 tablet_bootstrap.cc:654] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.367240 27999 ts_tablet_manager.cc:1939] T 8798892eb4604ee8ac9c95e64dbb14e9 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:36.369081 27228 tablet_bootstrap.cc:492] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:36.369237 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 96) took 9816 ms. Trace:
I20260810 11:30:36.369395 27999 rpcz_store.cc:276] 0810 11:30:26.552263 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.552909 (+ 646us) service_pool.cc:227] Handling call
0810 11:30:36.323379 (+9770470us) ts_tablet_manager.cc:1145] Deleting tablet 8798892eb4604ee8ac9c95e64dbb14e9
0810 11:30:36.323392 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.329643 (+ 6251us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.345332 (+ 15689us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.369137 (+ 23805us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9758944}
I20260810 11:30:36.369870 27999 tablet_replica.cc:330] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:36.370154 27999 raft_consensus.cc:2229] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:36.370571 27999 raft_consensus.cc:2258] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:36.371253 27999 ts_tablet_manager.cc:1905] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:36.374751 26849 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.25.195.254:41125, user_credentials={real_user=slave}} blocked reactor thread for 44035.3us
I20260810 11:30:36.377094 27248 ts_tablet_manager.cc:1918] T 834c9c99ec424bb39e8a003e9204b2bc P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:36.377344 27248 log.cc:1196] T 834c9c99ec424bb39e8a003e9204b2bc P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/834c9c99ec424bb39e8a003e9204b2bc
I20260810 11:30:36.377370 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 8798892eb4604ee8ac9c95e64dbb14e9 (table default.Table_0d77c6da3c8349c9ad3caa2147b81827 [id=24870bec311f44e4a3a3afa3599437be]) successfully deleted
I20260810 11:30:36.377951 27248 ts_tablet_manager.cc:1939] T 834c9c99ec424bb39e8a003e9204b2bc P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:36.378706 27999 ts_tablet_manager.cc:1918] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:36.369237 27228 ts_tablet_manager.cc:1397] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.011s
I20260810 11:30:36.296532 27974 ts_tablet_manager.cc:1918] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:36.298002 28485 raft_consensus.cc:482] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.379168 27974 log.cc:1196] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/fbe0a0ab82a147a3b6164904b135d1ab
I20260810 11:30:36.379230 28485 raft_consensus.cc:504] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.379637 27974 ts_tablet_manager.cc:1939] T fbe0a0ab82a147a3b6164904b135d1ab P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:36.379908 28485 leader_election.cc:288] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.298026 26759 raft_consensus.cc:3037] T f85c0767ad164075b87ba672cafafb47 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.380213 27228 raft_consensus.cc:348] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.380475 27228 raft_consensus.cc:374] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.380549 27228 raft_consensus.cc:729] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.380705 27999 log.cc:1196] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/949f31fa0c124eefbee695cfc7f50cbe
I20260810 11:30:36.298547 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac4b1821ac30452cbe7a8f844d9b37e5" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:36.380906 26767 raft_consensus.cc:2454] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:36.380826 27228 consensus_queue.cc:260] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.381199 27999 ts_tablet_manager.cc:1939] T 949f31fa0c124eefbee695cfc7f50cbe P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:36.298941 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c9c99ec424bb39e8a003e9204b2bc" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:36.329036 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2801709d53614916abac370f7ae5e913" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:36.381814 26763 raft_consensus.cc:2454] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:36.381987 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 94) took 9829 ms. Trace:
I20260810 11:30:36.330024 28483 consensus_queue.cc:1035] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.052s
I20260810 11:30:36.382122 27999 rpcz_store.cc:276] 0810 11:30:26.552085 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.552825 (+ 740us) service_pool.cc:227] Handling call
0810 11:30:36.369782 (+9816957us) ts_tablet_manager.cc:1145] Deleting tablet 949f31fa0c124eefbee695cfc7f50cbe
0810 11:30:36.369795 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.375184 (+ 5389us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.378598 (+ 3414us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.381969 (+ 3371us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9805026}
I20260810 11:30:36.382474 27999 tablet_replica.cc:330] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:36.382918 27228 ts_tablet_manager.cc:1428] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 11:30:36.383841 27999 raft_consensus.cc:2229] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:36.384065 27999 raft_consensus.cc:2258] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:36.384476 27228 tablet_bootstrap.cc:492] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:36.384836 27999 ts_tablet_manager.cc:1905] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:36.386210 27228 tablet_bootstrap.cc:654] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.388762 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac4b1821ac30452cbe7a8f844d9b37e5" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:36.389201 27059 raft_consensus.cc:2454] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:36.318019 27222 tablet_bootstrap.cc:492] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:36.390766 26702 leader_election.cc:302] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:36.390815 27222 ts_tablet_manager.cc:1397] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.188s user 0.007s sys 0.022s
I20260810 11:30:36.391206 28483 raft_consensus.cc:2781] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:36.391307 28483 raft_consensus.cc:482] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:36.391376 28483 raft_consensus.cc:3037] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.391585 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac4b1821ac30452cbe7a8f844d9b37e5" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:36.391810 27058 raft_consensus.cc:2454] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:36.391919 27222 raft_consensus.cc:348] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.392186 27222 raft_consensus.cc:374] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.392256 27222 raft_consensus.cc:729] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.392488 27222 consensus_queue.cc:260] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.393194 27222 ts_tablet_manager.cc:1428] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:36.393736 27222 tablet_bootstrap.cc:492] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:36.394126 26848 leader_election.cc:341] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 834c9c99ec424bb39e8a003e9204b2bc
I20260810 11:30:36.394435 26848 leader_election.cc:302] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:36.394737 28588 raft_consensus.cc:2781] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:36.394860 28588 raft_consensus.cc:482] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:36.395015 28588 raft_consensus.cc:3037] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.396864 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 949f31fa0c124eefbee695cfc7f50cbe (table default.Table_d4cbe876014f4433b57552ea4db823b6 [id=de28bf5b1f604446a69f9651a1eb9b93]) successfully deleted
W20260810 11:30:36.397426 26849 leader_election.cc:341] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:36.397728 27222 tablet_bootstrap.cc:654] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.397845 26849 leader_election.cc:302] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:36.398603 28591 raft_consensus.cc:2726] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:36.398207 28588 raft_consensus.cc:504] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.399333 26849 leader_election.cc:302] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:36.399472 28588 leader_election.cc:288] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.399696 28591 raft_consensus.cc:2781] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:36.399976 28591 raft_consensus.cc:482] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:36.376760 28555 consensus_queue.cc:1035] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260810 11:30:36.400117 28591 raft_consensus.cc:3037] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:36.400331 26848 leader_election.cc:341] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 2801709d53614916abac370f7ae5e913
I20260810 11:30:36.403093 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac4b1821ac30452cbe7a8f844d9b37e5" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:36.403157 28591 raft_consensus.cc:504] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.403371 27059 raft_consensus.cc:3037] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.403966 28591 leader_election.cc:288] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.407049 27059 raft_consensus.cc:2454] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:36.408046 28591 raft_consensus.cc:482] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.408327 28591 raft_consensus.cc:504] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.409168 28591 leader_election.cc:288] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.411499 28591 consensus_queue.cc:1035] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:36.412613 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac4b1821ac30452cbe7a8f844d9b37e5" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:36.412920 26915 raft_consensus.cc:2379] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate b6079090b1124d84aa4477974bb53700 in this term.
I20260810 11:30:36.413267 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_835cdd4f3794466d808449e2e17bb15a [id=a483de6ef1fc453b93e3f183e9c15dd1]
I20260810 11:30:36.413818 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_307bbf62894b4edc922e0fd4afa1a91f [id=a700655211944205a74b75b8449abc29]
I20260810 11:30:36.414331 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_c447a9537b844dffa1767531896bf6fe [id=a74215a4f78c47348bc5a41e4b1232f8]
I20260810 11:30:36.415158 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]
I20260810 11:30:36.415331 27222 tablet_bootstrap.cc:492] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:36.415506 27222 ts_tablet_manager.cc:1397] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.010s
I20260810 11:30:36.415853 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]
I20260810 11:30:36.416042 28483 raft_consensus.cc:504] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.417030 27222 raft_consensus.cc:348] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.417522 27222 raft_consensus.cc:374] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.417608 27222 raft_consensus.cc:729] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.417838 27222 consensus_queue.cc:260] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.418437 27222 ts_tablet_manager.cc:1428] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 11:30:36.418951 27222 tablet_bootstrap.cc:492] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:36.422911 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac4b1821ac30452cbe7a8f844d9b37e5" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:36.423341 26759 raft_consensus.cc:2379] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:36.423658 27222 tablet_bootstrap.cc:654] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.424396 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2801709d53614916abac370f7ae5e913" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:36.424770 26759 raft_consensus.cc:3037] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:36.425007 26991 consensus_peers.cc:487] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a3406dc345e3429fb4bce5a59643b686. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:36.427747 26759 raft_consensus.cc:2454] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:36.428838 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44d5e146eeec4fe0be33c1c169d32e68" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:36.429657 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44d5e146eeec4fe0be33c1c169d32e68" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:36.430694 28483 leader_election.cc:288] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.430840 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac4b1821ac30452cbe7a8f844d9b37e5" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:36.431192 27058 raft_consensus.cc:2379] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate b6079090b1124d84aa4477974bb53700 in this term.
I20260810 11:30:36.432118 26848 leader_election.cc:302] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:36.432425 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac4b1821ac30452cbe7a8f844d9b37e5" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:36.432780 26912 raft_consensus.cc:2379] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate b6079090b1124d84aa4477974bb53700 in this term.
W20260810 11:30:36.432724 26848 leader_election.cc:341] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 2801709d53614916abac370f7ae5e913
W20260810 11:30:36.433063 26848 leader_election.cc:341] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:36.433353 28591 raft_consensus.cc:2781] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:36.433573 28591 raft_consensus.cc:686] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:36.433935 28591 consensus_queue.cc:237] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.434374 27231 tablet_bootstrap.cc:492] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:36.434542 27231 ts_tablet_manager.cc:1397] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.000s
I20260810 11:30:36.435267 27231 raft_consensus.cc:348] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.435536 27231 raft_consensus.cc:374] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.435622 27231 raft_consensus.cc:729] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.435839 27231 consensus_queue.cc:260] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.436673 27231 ts_tablet_manager.cc:1428] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 11:30:36.437000 27231 tablet_bootstrap.cc:492] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:36.439764 27231 tablet_bootstrap.cc:654] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.443581 26849 leader_election.cc:302] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:36.444137 28588 raft_consensus.cc:2781] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:36.444423 28588 raft_consensus.cc:686] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:36.444741 28588 consensus_queue.cc:237] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.445993 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 169) took 8930 ms. Trace:
I20260810 11:30:36.446139 27974 rpcz_store.cc:276] 0810 11:30:27.515634 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.520655 (+ 5021us) service_pool.cc:227] Handling call
0810 11:30:36.077364 (+8556709us) ts_tablet_manager.cc:1145] Deleting tablet fbe0a0ab82a147a3b6164904b135d1ab
0810 11:30:36.077378 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.214052 (+136674us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.296377 (+ 82325us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.445943 (+149566us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8556372}
I20260810 11:30:36.446774 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 175) took 8761 ms. Trace:
I20260810 11:30:36.446856 27974 rpcz_store.cc:276] 0810 11:30:27.685803 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.685872 (+ 69us) service_pool.cc:227] Handling call
0810 11:30:36.446596 (+8760724us) ts_tablet_manager.cc:1145] Deleting tablet 1860e56467624dcdb288e13b004f78cc
0810 11:30:36.446616 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.446754 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8760361}
I20260810 11:30:36.446918 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet fbe0a0ab82a147a3b6164904b135d1ab (table default.Table_61d778388656489cb2e7fe8312b8ac6e [id=b52c11bd73cd4d1f8f9dfc32562718a2]) successfully deleted
I20260810 11:30:36.447256 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 183) took 7052 ms. Trace:
I20260810 11:30:36.447408 27974 rpcz_store.cc:276] 0810 11:30:29.395165 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.441433 (+ 46268us) service_pool.cc:227] Handling call
0810 11:30:36.447125 (+7005692us) ts_tablet_manager.cc:1145] Deleting tablet 55c8749861874eca9b63d3db97afa2b1
0810 11:30:36.447138 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.447235 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6970925}
W20260810 11:30:36.447773 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 1860e56467624dcdb288e13b004f78cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1860e56467624dcdb288e13b004f78cc already in progress: creating tablet
I20260810 11:30:36.447826 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 185) took 6950 ms. Trace:
I20260810 11:30:36.447916 27974 rpcz_store.cc:276] 0810 11:30:29.497296 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.497378 (+ 82us) service_pool.cc:227] Handling call
0810 11:30:36.447701 (+6950323us) ts_tablet_manager.cc:1145] Deleting tablet 518c777e40ec40dcb3484c0374384959
0810 11:30:36.447716 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.447808 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6915702}
I20260810 11:30:36.448276 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 184) took 6951 ms. Trace:
I20260810 11:30:36.448385 27974 rpcz_store.cc:276] 0810 11:30:29.496719 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.502009 (+ 5290us) service_pool.cc:227] Handling call
0810 11:30:36.448159 (+6946150us) ts_tablet_manager.cc:1145] Deleting tablet 7c203cd90d2f472fa27cfabed5b87119
0810 11:30:36.448172 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.448257 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6910146}
W20260810 11:30:36.448475 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 55c8749861874eca9b63d3db97afa2b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55c8749861874eca9b63d3db97afa2b1 already in progress: creating tablet
W20260810 11:30:36.448978 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 518c777e40ec40dcb3484c0374384959 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 518c777e40ec40dcb3484c0374384959 already in progress: creating tablet
W20260810 11:30:36.455502 26849 leader_election.cc:341] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:36.455873 26849 leader_election.cc:302] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:36.456281 28586 raft_consensus.cc:2726] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:36.456856 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_b15d6127087043a186b912230d2fe666 [id=ac5dd73c5e8e40108a8b663241887081]
I20260810 11:30:36.457099 26700 leader_election.cc:302] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:36.456513 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 126) took 9985 ms. Trace:
I20260810 11:30:36.457156 27231 tablet_bootstrap.cc:492] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:36.457603 28483 raft_consensus.cc:2726] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 11:30:36.458276 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_6e9cd3888b17405bad2475ba3da34507 [id=ae57f634bfef4952bb4e0a170d67fbdb]
I20260810 11:30:36.457422 27231 ts_tablet_manager.cc:1397] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.005s
I20260810 11:30:36.459399 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_b2c244ee13d14619b9f1eac6ab1aba2a [id=afa11e2df47a4a739727c8d834e24b84]
I20260810 11:30:36.459875 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]
I20260810 11:30:36.459959 27231 raft_consensus.cc:348] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.460191 27231 raft_consensus.cc:374] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.460260 27231 raft_consensus.cc:729] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.460529 27231 consensus_queue.cc:260] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.461118 27231 ts_tablet_manager.cc:1428] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:36.457392 27248 rpcz_store.cc:276] 0810 11:30:26.470099 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.471684 (+ 1585us) service_pool.cc:227] Handling call
0810 11:30:36.361322 (+9889638us) ts_tablet_manager.cc:1145] Deleting tablet 834c9c99ec424bb39e8a003e9204b2bc
0810 11:30:36.361332 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.366773 (+ 5441us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.376896 (+ 10123us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.455097 (+ 78201us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9887104}
I20260810 11:30:36.463023 27231 tablet_bootstrap.cc:492] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:36.463634 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 834c9c99ec424bb39e8a003e9204b2bc (table default.Table_e930e7d079ef4035bde1d9a4ef134d62 [id=ad637cef46ef40eeb3182153bcd52f6d]) successfully deleted
W20260810 11:30:36.468021 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7c203cd90d2f472fa27cfabed5b87119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c203cd90d2f472fa27cfabed5b87119 already in progress: creating tablet
I20260810 11:30:36.468132 27974 tablet_replica.cc:330] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:36.468420 27974 raft_consensus.cc:2229] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:36.468734 27974 raft_consensus.cc:2258] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:36.469640 27974 ts_tablet_manager.cc:1905] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:36.470065 27231 tablet_bootstrap.cc:654] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:36.477244 26993 consensus_peers.cc:487] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fbe0a0ab82a147a3b6164904b135d1ab. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:36.490007 27231 tablet_bootstrap.cc:492] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:36.490196 27231 ts_tablet_manager.cc:1397] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.003s
I20260810 11:30:36.490947 27231 raft_consensus.cc:348] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.491189 27231 raft_consensus.cc:374] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.491255 27231 raft_consensus.cc:729] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.491461 27231 consensus_queue.cc:260] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.491892 27231 ts_tablet_manager.cc:1428] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 11:30:36.492179 27231 tablet_bootstrap.cc:492] T fc023d51790042ce978eb53a2979e29c P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:36.494745 27231 tablet_bootstrap.cc:654] T fc023d51790042ce978eb53a2979e29c P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.497182 27228 tablet_bootstrap.cc:492] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:36.497473 27228 ts_tablet_manager.cc:1397] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.113s user 0.011s sys 0.021s
I20260810 11:30:36.498843 27228 raft_consensus.cc:348] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.499228 27228 raft_consensus.cc:374] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.499406 27228 raft_consensus.cc:729] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.499702 27228 consensus_queue.cc:260] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.501180 27228 ts_tablet_manager.cc:1428] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:36.501648 27228 tablet_bootstrap.cc:492] T fccc21cfc1ce4eb586f03276ec6e987f P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:36.505127 27228 tablet_bootstrap.cc:654] T fccc21cfc1ce4eb586f03276ec6e987f P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.508409 27231 tablet_bootstrap.cc:492] T fc023d51790042ce978eb53a2979e29c P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:36.508836 27231 ts_tablet_manager.cc:1397] T fc023d51790042ce978eb53a2979e29c P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.000s
I20260810 11:30:36.466095 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 128) took 9994 ms. Trace:
I20260810 11:30:36.510464 27231 raft_consensus.cc:348] T fc023d51790042ce978eb53a2979e29c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.510738 27231 raft_consensus.cc:374] T fc023d51790042ce978eb53a2979e29c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.510825 27231 raft_consensus.cc:729] T fc023d51790042ce978eb53a2979e29c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.511070 27231 consensus_queue.cc:260] T fc023d51790042ce978eb53a2979e29c P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:36.511445 26848 consensus_peers.cc:487] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83631b421a614796bdf76335f1437e00. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:36.511767 27231 ts_tablet_manager.cc:1428] T fc023d51790042ce978eb53a2979e29c P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:36.512192 27231 tablet_bootstrap.cc:492] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:36.514415 27231 tablet_bootstrap.cc:654] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.509860 27248 rpcz_store.cc:276] 0810 11:30:26.470988 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.471523 (+ 535us) service_pool.cc:227] Handling call
0810 11:30:36.464447 (+9992924us) ts_tablet_manager.cc:1145] Deleting tablet fc558690dce44e999e55e9bf1b6ca172
0810 11:30:36.464595 (+ 148us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.465805 (+ 1210us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9989078}
W20260810 11:30:36.516517 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet fc558690dce44e999e55e9bf1b6ca172 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc558690dce44e999e55e9bf1b6ca172 already in progress: creating tablet
I20260810 11:30:36.517395 28555 consensus_queue.cc:1035] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:36.518688 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 129) took 10047 ms. Trace:
I20260810 11:30:36.519842 27248 rpcz_store.cc:276] 0810 11:30:26.471131 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.471399 (+ 268us) service_pool.cc:227] Handling call
0810 11:30:36.517074 (+10045675us) ts_tablet_manager.cc:1145] Deleting tablet 7d3406f12d9c492cbd0d86fa7a57de82
0810 11:30:36.517271 (+ 197us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.518658 (+ 1387us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10041386}
W20260810 11:30:36.523002 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7d3406f12d9c492cbd0d86fa7a57de82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d3406f12d9c492cbd0d86fa7a57de82 already in progress: creating tablet
I20260810 11:30:36.523815 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]
I20260810 11:30:36.524616 28555 raft_consensus.cc:482] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.524792 28555 raft_consensus.cc:504] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.524958 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_e0aa1ad6dfda4ef2b7c441f45f74c0f7 [id=b27cf2b15cb64704b6f447284daadd55]
I20260810 11:30:36.525499 28555 leader_election.cc:288] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.525671 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_a827339eadbd440bb3c0bfa6c52512ca [id=b457cccecbf24d6dab4e74bf16bb68eb]
I20260810 11:30:36.527272 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "603fe104b7ab485eab6b225a58bddc1c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:36.528388 27059 raft_consensus.cc:2379] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate b6079090b1124d84aa4477974bb53700 in this term.
I20260810 11:30:36.529776 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "603fe104b7ab485eab6b225a58bddc1c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:36.530534 26700 leader_election.cc:302] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:36.530035 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 127) took 10059 ms. Trace:
I20260810 11:30:36.531105 28555 raft_consensus.cc:3037] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.531165 27248 rpcz_store.cc:276] 0810 11:30:26.470849 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.471476 (+ 627us) service_pool.cc:227] Handling call
0810 11:30:36.523584 (+10052108us) ts_tablet_manager.cc:1145] Deleting tablet 44d5e146eeec4fe0be33c1c169d32e68
0810 11:30:36.523606 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.530008 (+ 6402us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10046726}
I20260810 11:30:36.533033 27222 tablet_bootstrap.cc:492] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:36.533215 27222 ts_tablet_manager.cc:1397] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.114s user 0.012s sys 0.007s
I20260810 11:30:36.534762 28555 raft_consensus.cc:2726] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:36.535526 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 44d5e146eeec4fe0be33c1c169d32e68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44d5e146eeec4fe0be33c1c169d32e68 already in progress: creating tablet
I20260810 11:30:36.535384 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 141) took 9928 ms. Trace:
I20260810 11:30:36.534783 27222 raft_consensus.cc:348] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.536276 27222 raft_consensus.cc:374] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.536345 27222 raft_consensus.cc:729] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.536653 27222 consensus_queue.cc:260] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.537374 27222 ts_tablet_manager.cc:1428] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 11:30:36.537717 27222 tablet_bootstrap.cc:492] T fccc21cfc1ce4eb586f03276ec6e987f P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:36.541302 27222 tablet_bootstrap.cc:654] T fccc21cfc1ce4eb586f03276ec6e987f P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.536952 27248 rpcz_store.cc:276] 0810 11:30:26.606514 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.606585 (+ 71us) service_pool.cc:227] Handling call
0810 11:30:36.533840 (+9927255us) ts_tablet_manager.cc:1145] Deleting tablet 7e78fb1bf0534deca5cc5a603fd77592
0810 11:30:36.533868 (+ 28us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.535179 (+ 1311us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9926580}
W20260810 11:30:36.546038 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7e78fb1bf0534deca5cc5a603fd77592 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e78fb1bf0534deca5cc5a603fd77592 already in progress: creating tablet
I20260810 11:30:36.548233 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 142) took 9932 ms. Trace:
I20260810 11:30:36.548790 27248 rpcz_store.cc:276] 0810 11:30:26.615497 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.615559 (+ 62us) service_pool.cc:227] Handling call
0810 11:30:36.547192 (+9931633us) ts_tablet_manager.cc:1145] Deleting tablet 2da86554bc51486e91f1ea5995a245b5
0810 11:30:36.547316 (+ 124us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.548170 (+ 854us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9928569}
I20260810 11:30:36.550444 27248 tablet_replica.cc:330] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:36.551833 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 2da86554bc51486e91f1ea5995a245b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2da86554bc51486e91f1ea5995a245b5 already in progress: creating tablet
I20260810 11:30:36.552155 27248 raft_consensus.cc:2229] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:36.555667 27248 raft_consensus.cc:2258] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:36.557432 27228 tablet_bootstrap.cc:492] T fccc21cfc1ce4eb586f03276ec6e987f P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:36.557770 27999 ts_tablet_manager.cc:1918] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:36.558063 27999 log.cc:1196] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/e25ae21cc8cc4749a507fcab5ee225a3
I20260810 11:30:36.558709 27999 ts_tablet_manager.cc:1939] T e25ae21cc8cc4749a507fcab5ee225a3 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:36.558764 27228 ts_tablet_manager.cc:1397] T fccc21cfc1ce4eb586f03276ec6e987f P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.056s user 0.012s sys 0.013s
I20260810 11:30:36.560171 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 92) took 10008 ms. Trace:
I20260810 11:30:36.560492 27999 rpcz_store.cc:276] 0810 11:30:26.551825 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.553045 (+ 1220us) service_pool.cc:227] Handling call
0810 11:30:36.382391 (+9829346us) ts_tablet_manager.cc:1145] Deleting tablet e25ae21cc8cc4749a507fcab5ee225a3
0810 11:30:36.382402 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.460436 (+ 78034us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.557444 (+ 97008us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.559852 (+ 2408us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":993,"tablet-delete.queue_time_us":9817516}
I20260810 11:30:36.566039 27248 ts_tablet_manager.cc:1905] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:36.573689 27222 tablet_bootstrap.cc:492] T fccc21cfc1ce4eb586f03276ec6e987f P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:36.574126 27222 ts_tablet_manager.cc:1397] T fccc21cfc1ce4eb586f03276ec6e987f P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.036s user 0.006s sys 0.000s
I20260810 11:30:36.575354 27222 raft_consensus.cc:348] T fccc21cfc1ce4eb586f03276ec6e987f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.575843 27222 raft_consensus.cc:374] T fccc21cfc1ce4eb586f03276ec6e987f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.575968 27222 raft_consensus.cc:729] T fccc21cfc1ce4eb586f03276ec6e987f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.576341 27222 consensus_queue.cc:260] T fccc21cfc1ce4eb586f03276ec6e987f P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.577265 27222 ts_tablet_manager.cc:1428] T fccc21cfc1ce4eb586f03276ec6e987f P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:36.578091 27231 tablet_bootstrap.cc:492] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:36.578253 27231 ts_tablet_manager.cc:1397] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.066s user 0.009s sys 0.013s
I20260810 11:30:36.579285 27231 raft_consensus.cc:348] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.579535 27231 raft_consensus.cc:374] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.579604 27231 raft_consensus.cc:729] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.580096 27231 consensus_queue.cc:260] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.580924 27231 ts_tablet_manager.cc:1428] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260810 11:30:36.581297 27231 tablet_bootstrap.cc:492] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:36.583832 27231 tablet_bootstrap.cc:654] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.586774 28497 raft_consensus.cc:482] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.586989 28497 raft_consensus.cc:504] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.587862 28497 leader_election.cc:288] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:36.588798 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fccc21cfc1ce4eb586f03276ec6e987f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:36.589152 26759 raft_consensus.cc:2454] T fccc21cfc1ce4eb586f03276ec6e987f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:36.589964 26993 leader_election.cc:302] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:36.590453 28497 raft_consensus.cc:2781] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:36.590536 28497 raft_consensus.cc:482] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:36.590651 28497 raft_consensus.cc:3037] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.593993 28497 raft_consensus.cc:504] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.597141 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fccc21cfc1ce4eb586f03276ec6e987f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:36.597389 26759 raft_consensus.cc:3037] T fccc21cfc1ce4eb586f03276ec6e987f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.597126 28497 leader_election.cc:288] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:36.601336 26759 raft_consensus.cc:2454] T fccc21cfc1ce4eb586f03276ec6e987f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:36.602263 26993 leader_election.cc:302] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:36.602703 28497 raft_consensus.cc:2781] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:36.561349 27228 raft_consensus.cc:348] T fccc21cfc1ce4eb586f03276ec6e987f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.591491 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fccc21cfc1ce4eb586f03276ec6e987f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:36.604242 28497 raft_consensus.cc:686] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:36.605470 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet e25ae21cc8cc4749a507fcab5ee225a3 (table default.Table_dc355f349bc9426eb26a69cf93c089cf [id=68a29d5ebf8140198fbf4da3cd974847]) successfully deleted
I20260810 11:30:36.606088 28497 consensus_queue.cc:237] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.607539 27222 tablet_bootstrap.cc:492] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:36.608942 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]
I20260810 11:30:36.610239 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_abbbb80ecbe4491d98912dcdcaab5dd3 [id=ba999b4084c84b2f8e0313b96849b169]
I20260810 11:30:36.611286 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85]
I20260810 11:30:36.613878 27228 raft_consensus.cc:374] T fccc21cfc1ce4eb586f03276ec6e987f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.614132 28588 consensus_queue.cc:1035] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260810 11:30:36.620468 27228 raft_consensus.cc:729] T fccc21cfc1ce4eb586f03276ec6e987f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.620986 27228 consensus_queue.cc:260] T fccc21cfc1ce4eb586f03276ec6e987f P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.622036 26915 raft_consensus.cc:2454] T fccc21cfc1ce4eb586f03276ec6e987f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:36.622618 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fccc21cfc1ce4eb586f03276ec6e987f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:36.622824 27231 tablet_bootstrap.cc:492] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:36.623044 27231 ts_tablet_manager.cc:1397] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.042s user 0.010s sys 0.023s
I20260810 11:30:36.626040 27231 raft_consensus.cc:348] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.626579 27231 raft_consensus.cc:374] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.626717 27231 raft_consensus.cc:729] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.627704 27228 ts_tablet_manager.cc:1428] T fccc21cfc1ce4eb586f03276ec6e987f P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.067s user 0.001s sys 0.003s
I20260810 11:30:36.627277 27231 consensus_queue.cc:260] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.629626 27974 ts_tablet_manager.cc:1918] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:36.629689 26912 raft_consensus.cc:3037] T fccc21cfc1ce4eb586f03276ec6e987f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.629802 27974 log.cc:1196] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/02ff6a9bc02441ddb7f307d6b3df31bd
W20260810 11:30:36.636003 26849 consensus_peers.cc:487] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:36.636318 28573 raft_consensus.cc:482] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.636457 28573 raft_consensus.cc:504] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.637028 28573 leader_election.cc:288] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:36.637828 27222 tablet_bootstrap.cc:654] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.637710 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3851d39aeb3142938a5ac558ab438c21" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:36.638288 27974 ts_tablet_manager.cc:1939] T 02ff6a9bc02441ddb7f307d6b3df31bd P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
W20260810 11:30:36.638512 26993 leader_election.cc:341] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:36.638110 26912 raft_consensus.cc:2454] T fccc21cfc1ce4eb586f03276ec6e987f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:36.641541 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3851d39aeb3142938a5ac558ab438c21" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:36.642073 26849 consensus_peers.cc:487] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83631b421a614796bdf76335f1437e00. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:36.642201 27248 ts_tablet_manager.cc:1918] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:36.642326 27248 log.cc:1196] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/587c6ce242c0411b886404a0df03b1bb
I20260810 11:30:36.642323 26912 raft_consensus.cc:2454] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:36.642781 27248 ts_tablet_manager.cc:1939] T 587c6ce242c0411b886404a0df03b1bb P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:36.642961 26991 leader_election.cc:302] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:36.643400 28573 raft_consensus.cc:2781] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:36.643487 28573 raft_consensus.cc:482] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:36.643563 28573 raft_consensus.cc:3037] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.645375 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 189) took 6064 ms. Trace:
I20260810 11:30:36.645913 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 91) took 10096 ms. Trace:
I20260810 11:30:36.646286 28573 raft_consensus.cc:504] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.646111 27999 rpcz_store.cc:276] 0810 11:30:26.549780 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.549876 (+ 96us) service_pool.cc:227] Handling call
0810 11:30:36.605905 (+10056029us) ts_tablet_manager.cc:1145] Deleting tablet 31888ddeafe14738b818016a9c0a4ad3
0810 11:30:36.645636 (+ 39731us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.645754 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10037539}
I20260810 11:30:36.646744 27999 tablet_replica.cc:330] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
W20260810 11:30:36.647020 27286 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 31888ddeafe14738b818016a9c0a4ad3 because the tablet was not found. No further retry: Not found: Tablet not found: 31888ddeafe14738b818016a9c0a4ad3
I20260810 11:30:36.647593 27999 raft_consensus.cc:2229] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:36.647857 27999 raft_consensus.cc:2258] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:36.647989 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3851d39aeb3142938a5ac558ab438c21" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:36.648329 28573 leader_election.cc:288] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:36.648792 27999 ts_tablet_manager.cc:1905] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:36.648753 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3851d39aeb3142938a5ac558ab438c21" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
W20260810 11:30:36.649349 26993 leader_election.cc:341] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:36.649765 26915 raft_consensus.cc:3037] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.649776 27231 ts_tablet_manager.cc:1428] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.027s user 0.002s sys 0.002s
I20260810 11:30:36.647233 27228 tablet_bootstrap.cc:492] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:36.654168 28588 raft_consensus.cc:482] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.654479 28588 raft_consensus.cc:504] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.655309 28588 leader_election.cc:288] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.655475 27231 tablet_bootstrap.cc:492] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:36.656454 27228 tablet_bootstrap.cc:654] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.656329 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "720ef9404cb44551aaf39687f0cf94c9" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:36.657723 26848 leader_election.cc:341] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:36.612124 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]
I20260810 11:30:36.659111 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "720ef9404cb44551aaf39687f0cf94c9" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:36.659698 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_3efc57bdbafc46dfab4d324acb0d5f73 [id=bcba186b6e93492fb06f70e033be3296]
I20260810 11:30:36.660435 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156]
I20260810 11:30:36.662302 27231 tablet_bootstrap.cc:654] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:36.663559 26849 leader_election.cc:341] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:36.663782 26849 leader_election.cc:302] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:36.664611 28588 raft_consensus.cc:2726] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:36.670159 28588 consensus_queue.cc:1035] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:36.671499 27999 ts_tablet_manager.cc:1918] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:36.671712 27999 log.cc:1196] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/0033d61d07d84262a98b0ebc54bd7960
I20260810 11:30:36.672448 27999 ts_tablet_manager.cc:1939] T 0033d61d07d84262a98b0ebc54bd7960 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:36.673317 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 143) took 9724 ms. Trace:
I20260810 11:30:36.645514 27974 rpcz_store.cc:276] 0810 11:30:30.580727 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.580829 (+ 102us) service_pool.cc:227] Handling call
0810 11:30:36.467977 (+5887148us) ts_tablet_manager.cc:1145] Deleting tablet 02ff6a9bc02441ddb7f307d6b3df31bd
0810 11:30:36.468068 (+ 91us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.563129 (+ 95061us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.627927 (+ 64798us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.645343 (+ 17416us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5882815}
I20260810 11:30:36.673426 27248 rpcz_store.cc:276] 0810 11:30:26.948422 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.948517 (+ 95us) service_pool.cc:227] Handling call
0810 11:30:36.550182 (+9601665us) ts_tablet_manager.cc:1145] Deleting tablet 587c6ce242c0411b886404a0df03b1bb
0810 11:30:36.550196 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.619457 (+ 69261us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.642080 (+ 22623us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.673288 (+ 31208us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9601240}
I20260810 11:30:36.673772 27248 tablet_replica.cc:330] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:36.674012 27248 raft_consensus.cc:2229] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:36.674075 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 587c6ce242c0411b886404a0df03b1bb (table default.Table_8326a5b5a7544e828699f8b41fdee4d1 [id=1ae6d36bfe0e427a9a996dff3cdccc91]) successfully deleted
I20260810 11:30:36.674158 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 02ff6a9bc02441ddb7f307d6b3df31bd (table default.Table_5f8ecc7877924d0f9871dd16aaeafdde [id=e1ca02b3f3f94632843632a15fc19245]) successfully deleted
I20260810 11:30:36.674443 27248 raft_consensus.cc:2258] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:36.674487 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 190) took 5947 ms. Trace:
I20260810 11:30:36.674551 28588 raft_consensus.cc:482] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.674602 27974 rpcz_store.cc:276] 0810 11:30:30.727057 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.727760 (+ 703us) service_pool.cc:227] Handling call
0810 11:30:36.674325 (+5946565us) ts_tablet_manager.cc:1145] Deleting tablet ee803ddf27594d2b9e19fe440fc269c7
0810 11:30:36.674343 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.674468 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5945343}
I20260810 11:30:36.674742 28588 raft_consensus.cc:504] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.674965 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 192) took 5918 ms. Trace:
I20260810 11:30:36.675046 27974 rpcz_store.cc:276] 0810 11:30:30.756831 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.756944 (+ 113us) service_pool.cc:227] Handling call
0810 11:30:36.674864 (+5917920us) ts_tablet_manager.cc:1145] Deleting tablet e276b0fa124d42dfb3fe750d245e44d8
0810 11:30:36.674873 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.674948 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5889171}
I20260810 11:30:36.675344 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 199) took 4092 ms. Trace:
I20260810 11:30:36.675414 27974 rpcz_store.cc:276] 0810 11:30:32.582624 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.582756 (+ 132us) service_pool.cc:227] Handling call
0810 11:30:36.675242 (+4092486us) ts_tablet_manager.cc:1145] Deleting tablet c60baf810a544a4a90dccd2337a39043
0810 11:30:36.675252 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.675329 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4092051}
I20260810 11:30:36.675462 28588 leader_election.cc:288] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:36.676956 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ee803ddf27594d2b9e19fe440fc269c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee803ddf27594d2b9e19fe440fc269c7 already in progress: creating tablet
W20260810 11:30:36.677343 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet e276b0fa124d42dfb3fe750d245e44d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e276b0fa124d42dfb3fe750d245e44d8 already in progress: creating tablet
W20260810 11:30:36.677623 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet c60baf810a544a4a90dccd2337a39043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c60baf810a544a4a90dccd2337a39043 already in progress: creating tablet
I20260810 11:30:36.678469 27248 ts_tablet_manager.cc:1905] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:36.681993 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_5f6a37537c33412a80f2642fb0162da6 [id=bfc3f2f94773444181545d43ecd88190]
I20260810 11:30:36.682339 27231 tablet_bootstrap.cc:492] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:36.682543 27231 ts_tablet_manager.cc:1397] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.006s
I20260810 11:30:36.683396 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8a65a0e8b1f4e4b8d9a82059b766cda" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:36.683636 27058 raft_consensus.cc:2454] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:36.684746 26848 leader_election.cc:302] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:36.685339 28586 raft_consensus.cc:2781] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:36.685494 28586 raft_consensus.cc:482] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:36.685690 28586 raft_consensus.cc:3037] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.685277 27231 raft_consensus.cc:348] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.685827 27231 raft_consensus.cc:374] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.685945 27231 raft_consensus.cc:729] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.686607 27228 tablet_bootstrap.cc:492] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:36.686380 27231 consensus_queue.cc:260] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.686842 27228 ts_tablet_manager.cc:1397] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.040s user 0.008s sys 0.000s
I20260810 11:30:36.687860 26915 raft_consensus.cc:2454] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:36.688726 26991 leader_election.cc:302] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:36.689010 27231 ts_tablet_manager.cc:1428] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260810 11:30:36.689018 27228 raft_consensus.cc:348] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.689666 27231 tablet_bootstrap.cc:492] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:36.689970 28573 raft_consensus.cc:2781] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:36.689744 27228 raft_consensus.cc:374] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.690184 28573 raft_consensus.cc:686] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:36.690260 27228 raft_consensus.cc:729] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.690455 28573 consensus_queue.cc:237] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.690627 27228 consensus_queue.cc:260] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.691368 27228 ts_tablet_manager.cc:1428] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 11:30:36.692153 27228 tablet_bootstrap.cc:492] T 39beb126ac324842b7e387c46bcb4099 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:36.693301 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8a65a0e8b1f4e4b8d9a82059b766cda" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:36.693616 26763 raft_consensus.cc:2454] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:36.693969 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_2d65cf26d2254f29a785321b186cb2c8 [id=c16570aaa0c7449191f68085a12017da]
I20260810 11:30:36.694902 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_094455b6d4f745fa83445cfc650e43b7 [id=c2f01a1417424ff6b61d8c4cb35a638a]
I20260810 11:30:36.695604 27231 tablet_bootstrap.cc:654] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.695773 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_52c39be8057948a49dfd7394b4152265 [id=c48cb5a0af7b4f0483e799a49fd5d307]
I20260810 11:30:36.693361 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 200) took 4094 ms. Trace:
I20260810 11:30:36.696655 27974 rpcz_store.cc:276] 0810 11:30:32.598728 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.598860 (+ 132us) service_pool.cc:227] Handling call
0810 11:30:36.675610 (+4076750us) ts_tablet_manager.cc:1145] Deleting tablet b6395bce17ee40c2822669246ce7eb42
0810 11:30:36.693137 (+ 17527us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.693331 (+ 194us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4074022}
I20260810 11:30:36.697551 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 201) took 3815 ms. Trace:
W20260810 11:30:36.697697 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet b6395bce17ee40c2822669246ce7eb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6395bce17ee40c2822669246ce7eb42 already in progress: creating tablet
I20260810 11:30:36.697744 27974 rpcz_store.cc:276] 0810 11:30:32.881803 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.882909 (+ 1106us) service_pool.cc:227] Handling call
0810 11:30:36.697426 (+3814517us) ts_tablet_manager.cc:1145] Deleting tablet 9311943eebaa4824bde96b4cb09f1e2c
0810 11:30:36.697441 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.697531 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3809164}
I20260810 11:30:36.698360 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 204) took 3809 ms. Trace:
W20260810 11:30:36.698395 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 9311943eebaa4824bde96b4cb09f1e2c because the tablet was not found. No further retry: Not found: Tablet not found: 9311943eebaa4824bde96b4cb09f1e2c
I20260810 11:30:36.698575 27974 rpcz_store.cc:276] 0810 11:30:32.888541 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.888842 (+ 301us) service_pool.cc:227] Handling call
0810 11:30:36.698182 (+3809340us) ts_tablet_manager.cc:1145] Deleting tablet 1aa4562a2247405187d9dbd1baa48f39
0810 11:30:36.698194 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.698340 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3805285}
I20260810 11:30:36.699035 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 207) took 3807 ms. Trace:
I20260810 11:30:36.699224 27974 rpcz_store.cc:276] 0810 11:30:32.891333 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.891534 (+ 201us) service_pool.cc:227] Handling call
0810 11:30:36.698939 (+3807405us) ts_tablet_manager.cc:1145] Deleting tablet 4b15cc8669b549a2b4461dccd66a0c5a
0810 11:30:36.698949 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.699019 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3801342}
W20260810 11:30:36.699360 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 1aa4562a2247405187d9dbd1baa48f39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1aa4562a2247405187d9dbd1baa48f39 already in progress: creating tablet
I20260810 11:30:36.699838 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 208) took 3806 ms. Trace:
W20260810 11:30:36.699951 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 4b15cc8669b549a2b4461dccd66a0c5a because the tablet was not found. No further retry: Not found: Tablet not found: 4b15cc8669b549a2b4461dccd66a0c5a
I20260810 11:30:36.702289 27248 ts_tablet_manager.cc:1918] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:36.702451 27248 log.cc:1196] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/a87f6835f0dc4ad4b3a23b297726100d
I20260810 11:30:36.703157 27248 ts_tablet_manager.cc:1939] T a87f6835f0dc4ad4b3a23b297726100d P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:36.704196 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 144) took 9726 ms. Trace:
I20260810 11:30:36.704313 27248 rpcz_store.cc:276] 0810 11:30:26.977878 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.978614 (+ 736us) service_pool.cc:227] Handling call
0810 11:30:36.673720 (+9695106us) ts_tablet_manager.cc:1145] Deleting tablet a87f6835f0dc4ad4b3a23b297726100d
0810 11:30:36.673732 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.697402 (+ 23670us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.702158 (+ 4756us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.704170 (+ 2012us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9694821}
I20260810 11:30:36.704713 27248 tablet_replica.cc:330] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:36.705005 27248 raft_consensus.cc:2229] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:36.705041 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet a87f6835f0dc4ad4b3a23b297726100d (table default.Table_cbf7fb0f0585465a9be24fa7e70d68d2 [id=82041e96f8de4fae85baf690bbbfc7a3]) successfully deleted
I20260810 11:30:36.705389 27248 raft_consensus.cc:2258] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:36.704411 27974 rpcz_store.cc:276] 0810 11:30:32.893615 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.893684 (+ 69us) service_pool.cc:227] Handling call
0810 11:30:36.699756 (+3806072us) ts_tablet_manager.cc:1145] Deleting tablet 1e0a8513171f4c39b74c08760a139d9e
0810 11:30:36.699768 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.699821 (+ 53us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3800150}
I20260810 11:30:36.706017 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 206) took 3814 ms. Trace:
W20260810 11:30:36.706079 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 1e0a8513171f4c39b74c08760a139d9e because the tablet was not found. No further retry: Not found: Tablet not found: 1e0a8513171f4c39b74c08760a139d9e
I20260810 11:30:36.706121 27248 ts_tablet_manager.cc:1905] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:36.706226 27974 rpcz_store.cc:276] 0810 11:30:32.891209 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.891657 (+ 448us) service_pool.cc:227] Handling call
0810 11:30:36.705827 (+3814170us) ts_tablet_manager.cc:1145] Deleting tablet 478c0c39658349c39e3afa1aa1653e82
0810 11:30:36.705843 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.705994 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3800825}
I20260810 11:30:36.703778 27222 tablet_bootstrap.cc:492] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:36.706650 27222 ts_tablet_manager.cc:1397] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.099s user 0.004s sys 0.004s
I20260810 11:30:36.708096 27222 raft_consensus.cc:348] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.708395 27222 raft_consensus.cc:374] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.708515 27222 raft_consensus.cc:729] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.708858 27222 consensus_queue.cc:260] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.709658 27222 ts_tablet_manager.cc:1428] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:36.715859 27231 tablet_bootstrap.cc:492] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:36.716044 27231 ts_tablet_manager.cc:1397] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.005s
I20260810 11:30:36.696390 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f3567f07068942e9a5d42f9877f39bb7 [id=c557d3488f464c5bbff89fd13e52b02a]
I20260810 11:30:36.718768 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_fabd7780b9224b7993ad4321be6f92e2 [id=c9c81bc9d6dc48c89ba4cc51ca4f8bd9]
W20260810 11:30:36.718776 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 478c0c39658349c39e3afa1aa1653e82 because the tablet was not found. No further retry: Not found: Tablet not found: 478c0c39658349c39e3afa1aa1653e82
I20260810 11:30:36.719154 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 205) took 3830 ms. Trace:
I20260810 11:30:36.719187 27231 raft_consensus.cc:348] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.719483 27231 raft_consensus.cc:374] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.718421 28573 raft_consensus.cc:482] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.719552 27231 raft_consensus.cc:729] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.719808 27231 consensus_queue.cc:260] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.721784 27231 ts_tablet_manager.cc:1428] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260810 11:30:36.722138 27231 tablet_bootstrap.cc:492] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:36.722906 28586 raft_consensus.cc:504] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.723302 27248 ts_tablet_manager.cc:1918] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:36.723412 27248 log.cc:1196] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/fbe0a0ab82a147a3b6164904b135d1ab
I20260810 11:30:36.726346 28586 leader_election.cc:288] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.727067 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8a65a0e8b1f4e4b8d9a82059b766cda" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:36.726758 27248 ts_tablet_manager.cc:1939] T fbe0a0ab82a147a3b6164904b135d1ab P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:36.727962 27058 raft_consensus.cc:3037] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.728917 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8a65a0e8b1f4e4b8d9a82059b766cda" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:36.727195 27231 tablet_bootstrap.cc:654] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.729545 26759 raft_consensus.cc:3037] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.729424 27974 rpcz_store.cc:276] 0810 11:30:32.890950 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.891700 (+ 750us) service_pool.cc:227] Handling call
0810 11:30:36.718418 (+3826718us) ts_tablet_manager.cc:1145] Deleting tablet 6e829d4bffeb4289a54b4d3d7a53c44e
0810 11:30:36.719002 (+ 584us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.719125 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3812990}
I20260810 11:30:36.730163 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 147) took 9734 ms. Trace:
I20260810 11:30:36.730546 27248 rpcz_store.cc:276] 0810 11:30:26.995615 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.996269 (+ 654us) service_pool.cc:227] Handling call
0810 11:30:36.704653 (+9708384us) ts_tablet_manager.cc:1145] Deleting tablet fbe0a0ab82a147a3b6164904b135d1ab
0810 11:30:36.704670 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.715118 (+ 10448us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.723194 (+ 8076us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.730139 (+ 6945us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9706876}
I20260810 11:30:36.731608 27058 raft_consensus.cc:2454] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:36.732239 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 152) took 9597 ms. Trace:
I20260810 11:30:36.732473 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 88) took 10187 ms. Trace:
I20260810 11:30:36.732599 27248 rpcz_store.cc:276] 0810 11:30:27.134911 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.135181 (+ 270us) service_pool.cc:227] Handling call
0810 11:30:36.731786 (+9596605us) ts_tablet_manager.cc:1145] Deleting tablet f3884736eec74c8992b8d51b37465875
0810 11:30:36.731801 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.732130 (+ 329us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9596124}
W20260810 11:30:36.733619 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 6e829d4bffeb4289a54b4d3d7a53c44e because the tablet was not found. No further retry: Not found: Tablet not found: 6e829d4bffeb4289a54b4d3d7a53c44e
I20260810 11:30:36.733693 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet fbe0a0ab82a147a3b6164904b135d1ab (table default.Table_61d778388656489cb2e7fe8312b8ac6e [id=b52c11bd73cd4d1f8f9dfc32562718a2]) successfully deleted
W20260810 11:30:36.734345 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet f3884736eec74c8992b8d51b37465875 because the tablet was not found. No further retry: Not found: Tablet not found: f3884736eec74c8992b8d51b37465875
I20260810 11:30:36.734717 26759 raft_consensus.cc:2454] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:36.735112 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 150) took 9600 ms. Trace:
I20260810 11:30:36.735200 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]
I20260810 11:30:36.735320 27248 rpcz_store.cc:276] 0810 11:30:27.134624 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.136340 (+ 1716us) service_pool.cc:227] Handling call
0810 11:30:36.734547 (+9598207us) ts_tablet_manager.cc:1145] Deleting tablet 6e829d4bffeb4289a54b4d3d7a53c44e
0810 11:30:36.734562 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.735088 (+ 526us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9586005}
W20260810 11:30:36.736025 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 6e829d4bffeb4289a54b4d3d7a53c44e because the tablet was not found. No further retry: Not found: Tablet not found: 6e829d4bffeb4289a54b4d3d7a53c44e
I20260810 11:30:36.736029 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 155) took 9591 ms. Trace:
I20260810 11:30:36.736166 27248 rpcz_store.cc:276] 0810 11:30:27.144310 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.144545 (+ 235us) service_pool.cc:227] Handling call
0810 11:30:36.735802 (+9591257us) ts_tablet_manager.cc:1145] Deleting tablet 96cae4eb16c84410926a317af70e44f7
0810 11:30:36.735814 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.736011 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9582441}
I20260810 11:30:36.736982 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_971ac96924ee4a09bc7bc1befdb296d1 [id=cbb462ed5c1f4adf9363f7ac03b78c8c]
I20260810 11:30:36.736948 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 160) took 9078 ms. Trace:
I20260810 11:30:36.737085 27248 rpcz_store.cc:276] 0810 11:30:27.658065 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.658124 (+ 59us) service_pool.cc:227] Handling call
0810 11:30:36.736742 (+9078618us) ts_tablet_manager.cc:1145] Deleting tablet 1860e56467624dcdb288e13b004f78cc
0810 11:30:36.736754 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.736904 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9078231}
I20260810 11:30:36.737720 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 167) took 7419 ms. Trace:
I20260810 11:30:36.737854 27248 rpcz_store.cc:276] 0810 11:30:29.318873 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.319002 (+ 129us) service_pool.cc:227] Handling call
0810 11:30:36.737477 (+7418475us) ts_tablet_manager.cc:1145] Deleting tablet 55c8749861874eca9b63d3db97afa2b1
0810 11:30:36.737488 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.737701 (+ 213us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7417805}
I20260810 11:30:36.738468 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 168) took 7367 ms. Trace:
I20260810 11:30:36.738523 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_b2381e8587204bffa96b34e428682d5d [id=d4074ee00ab24054b4121d5c9c74d9a4]
I20260810 11:30:36.738641 27248 rpcz_store.cc:276] 0810 11:30:29.370858 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.370998 (+ 140us) service_pool.cc:227] Handling call
0810 11:30:36.738206 (+7367208us) ts_tablet_manager.cc:1145] Deleting tablet 7c203cd90d2f472fa27cfabed5b87119
0810 11:30:36.738241 (+ 35us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.738451 (+ 210us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7358058}
W20260810 11:30:36.738864 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 96cae4eb16c84410926a317af70e44f7 because the tablet was not found. No further retry: Not found: Tablet not found: 96cae4eb16c84410926a317af70e44f7
W20260810 11:30:36.739207 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 1860e56467624dcdb288e13b004f78cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1860e56467624dcdb288e13b004f78cc already in progress: creating tablet
W20260810 11:30:36.739514 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 55c8749861874eca9b63d3db97afa2b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55c8749861874eca9b63d3db97afa2b1 already in progress: creating tablet
I20260810 11:30:36.739653 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 169) took 7321 ms. Trace:
W20260810 11:30:36.740123 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7c203cd90d2f472fa27cfabed5b87119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c203cd90d2f472fa27cfabed5b87119 already in progress: creating tablet
I20260810 11:30:36.739414 27222 tablet_bootstrap.cc:492] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:36.739981 27248 rpcz_store.cc:276] 0810 11:30:29.418630 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.418726 (+ 96us) service_pool.cc:227] Handling call
0810 11:30:36.739191 (+7320465us) ts_tablet_manager.cc:1145] Deleting tablet 518c777e40ec40dcb3484c0374384959
0810 11:30:36.739260 (+ 69us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.739586 (+ 326us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7319666}
I20260810 11:30:36.740823 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_174d1e3073a34beabbd10fd4f6d61bd4 [id=d538eb7fe6224d6895190c79c041b76f]
W20260810 11:30:36.741403 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 518c777e40ec40dcb3484c0374384959 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 518c777e40ec40dcb3484c0374384959 already in progress: creating tablet
I20260810 11:30:36.741573 27248 tablet_replica.cc:330] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:36.741878 27974 tablet_replica.cc:330] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:36.726339 28573 raft_consensus.cc:504] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.742236 27974 raft_consensus.cc:2229] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:36.742503 27974 raft_consensus.cc:2258] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:36.742405 27248 raft_consensus.cc:2229] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:36.743153 27248 raft_consensus.cc:2258] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:36.743536 27974 ts_tablet_manager.cc:1905] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:36.745652 27248 ts_tablet_manager.cc:1905] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:36.732906 26848 leader_election.cc:302] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:36.747648 28586 raft_consensus.cc:2781] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:36.747968 28586 raft_consensus.cc:686] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:36.748548 28586 consensus_queue.cc:237] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.751255 28345 raft_consensus.cc:482] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.751753 28345 raft_consensus.cc:504] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.753176 28345 leader_election.cc:288] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.753728 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0713f4f14a284050a7774a70ab974f30" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:36.754065 26759 raft_consensus.cc:2454] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:36.754427 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0713f4f14a284050a7774a70ab974f30" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:36.754689 26849 leader_election.cc:302] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:36.754722 27058 raft_consensus.cc:2454] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:36.755156 28345 raft_consensus.cc:2781] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:36.755286 28345 raft_consensus.cc:482] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:36.755379 28345 raft_consensus.cc:3037] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.757968 27248 ts_tablet_manager.cc:1918] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:36.758114 27248 log.cc:1196] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/02ff6a9bc02441ddb7f307d6b3df31bd
I20260810 11:30:36.758525 27248 ts_tablet_manager.cc:1939] T 02ff6a9bc02441ddb7f307d6b3df31bd P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:36.758378 28345 raft_consensus.cc:504] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.758806 27999 rpcz_store.cc:276] 0810 11:30:26.544811 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.545181 (+ 370us) service_pool.cc:227] Handling call
0810 11:30:36.646633 (+10101452us) ts_tablet_manager.cc:1145] Deleting tablet 0033d61d07d84262a98b0ebc54bd7960
0810 11:30:36.646648 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.667598 (+ 20950us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.671303 (+ 3705us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.732399 (+ 61096us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10076241}
I20260810 11:30:36.759850 27999 tablet_replica.cc:330] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:36.746845 27228 tablet_bootstrap.cc:654] T 39beb126ac324842b7e387c46bcb4099 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.761711 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 0033d61d07d84262a98b0ebc54bd7960 (table default.Table_c6cf8c999ed14a31aff5a1de22594c1f [id=0e600e92a46f45629433aa68978a93d7]) successfully deleted
I20260810 11:30:36.762212 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9b649e43a9456fa51cf3330290bb91" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:36.762578 26915 raft_consensus.cc:2379] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 482e605580be48cbbacce05a3e61c215 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:36.762607 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0713f4f14a284050a7774a70ab974f30" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:36.762935 26759 raft_consensus.cc:3037] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.764904 28588 raft_consensus.cc:482] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.765722 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 173) took 6185 ms. Trace:
I20260810 11:30:36.765841 27248 rpcz_store.cc:276] 0810 11:30:30.580727 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.580829 (+ 102us) service_pool.cc:227] Handling call
0810 11:30:36.741406 (+6160577us) ts_tablet_manager.cc:1145] Deleting tablet 02ff6a9bc02441ddb7f307d6b3df31bd
0810 11:30:36.741451 (+ 45us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.754599 (+ 13148us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.757861 (+ 3262us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.765690 (+ 7829us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":896,"tablet-delete.queue_time_us":6160008}
I20260810 11:30:36.766644 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 02ff6a9bc02441ddb7f307d6b3df31bd (table default.Table_5f8ecc7877924d0f9871dd16aaeafdde [id=e1ca02b3f3f94632843632a15fc19245]) successfully deleted
I20260810 11:30:36.766775 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 174) took 6036 ms. Trace:
I20260810 11:30:36.766878 27248 rpcz_store.cc:276] 0810 11:30:30.730215 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.730308 (+ 93us) service_pool.cc:227] Handling call
0810 11:30:36.766550 (+6036242us) ts_tablet_manager.cc:1145] Deleting tablet ee803ddf27594d2b9e19fe440fc269c7
0810 11:30:36.766563 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.766680 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6035685}
I20260810 11:30:36.767323 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 176) took 6009 ms. Trace:
I20260810 11:30:36.767395 27248 rpcz_store.cc:276] 0810 11:30:30.757961 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.758072 (+ 111us) service_pool.cc:227] Handling call
0810 11:30:36.767162 (+6009090us) ts_tablet_manager.cc:1145] Deleting tablet e276b0fa124d42dfb3fe750d245e44d8
0810 11:30:36.767171 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.767307 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6008564}
W20260810 11:30:36.767561 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet ee803ddf27594d2b9e19fe440fc269c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee803ddf27594d2b9e19fe440fc269c7 already in progress: creating tablet
I20260810 11:30:36.767746 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 183) took 4125 ms. Trace:
I20260810 11:30:36.767829 27248 rpcz_store.cc:276] 0810 11:30:32.651940 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.652000 (+ 60us) service_pool.cc:227] Handling call
0810 11:30:36.767618 (+4115618us) ts_tablet_manager.cc:1145] Deleting tablet c60baf810a544a4a90dccd2337a39043
0810 11:30:36.767627 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.767731 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4093772}
I20260810 11:30:36.768303 26759 raft_consensus.cc:2454] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
W20260810 11:30:36.769447 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet e276b0fa124d42dfb3fe750d245e44d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e276b0fa124d42dfb3fe750d245e44d8 already in progress: creating tablet
W20260810 11:30:36.769848 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet c60baf810a544a4a90dccd2337a39043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c60baf810a544a4a90dccd2337a39043 already in progress: creating tablet
I20260810 11:30:36.770262 27999 raft_consensus.cc:2229] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:36.771116 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 184) took 4100 ms. Trace:
I20260810 11:30:36.771212 27248 rpcz_store.cc:276] 0810 11:30:32.674128 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.674272 (+ 144us) service_pool.cc:227] Handling call
0810 11:30:36.770868 (+4096596us) ts_tablet_manager.cc:1145] Deleting tablet b6395bce17ee40c2822669246ce7eb42
0810 11:30:36.770880 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.771093 (+ 213us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4086924}
I20260810 11:30:36.771602 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 185) took 3959 ms. Trace:
W20260810 11:30:36.771729 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet b6395bce17ee40c2822669246ce7eb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6395bce17ee40c2822669246ce7eb42 already in progress: creating tablet
I20260810 11:30:36.771693 27248 rpcz_store.cc:276] 0810 11:30:32.812297 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.812409 (+ 112us) service_pool.cc:227] Handling call
0810 11:30:36.771473 (+3959064us) ts_tablet_manager.cc:1145] Deleting tablet b28f3dcbd6d74559b372d3452e13ce9f
0810 11:30:36.771484 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.771584 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3958007}
I20260810 11:30:36.771965 27248 tablet_replica.cc:330] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:36.772183 27248 raft_consensus.cc:2229] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
W20260810 11:30:36.772364 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet b28f3dcbd6d74559b372d3452e13ce9f because the tablet was not found. No further retry: Not found: Tablet not found: b28f3dcbd6d74559b372d3452e13ce9f
I20260810 11:30:36.772502 27248 raft_consensus.cc:2258] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:36.773228 27248 ts_tablet_manager.cc:1905] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:36.773236 28588 raft_consensus.cc:504] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.774890 28588 leader_election.cc:288] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.775136 26849 leader_election.cc:302] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:36.774894 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91b6078efadf496fb252f725bdf56b02" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:36.776758 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91b6078efadf496fb252f725bdf56b02" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:36.777014 26759 raft_consensus.cc:2379] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
I20260810 11:30:36.778117 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9b649e43a9456fa51cf3330290bb91" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:36.779874 28555 consensus_queue.cc:1035] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:36.781849 27222 tablet_bootstrap.cc:654] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.783116 28588 raft_consensus.cc:2781] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:36.783303 28588 raft_consensus.cc:686] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:36.777408 28573 leader_election.cc:288] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:36.789522 27248 ts_tablet_manager.cc:1918] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:36.789669 27248 log.cc:1196] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/a18cb43b4dc04a1290a6bade7ac1f3cf
I20260810 11:30:36.779069 26993 leader_election.cc:302] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:36.789618 28588 consensus_queue.cc:237] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.790776 28573 raft_consensus.cc:3037] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.791050 28345 leader_election.cc:288] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.791956 27248 ts_tablet_manager.cc:1939] T a18cb43b4dc04a1290a6bade7ac1f3cf P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:36.793434 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0713f4f14a284050a7774a70ab974f30" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:36.793742 27059 raft_consensus.cc:3037] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.793970 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 188) took 3953 ms. Trace:
I20260810 11:30:36.794090 27248 rpcz_store.cc:276] 0810 11:30:32.840678 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.841420 (+ 742us) service_pool.cc:227] Handling call
0810 11:30:36.771919 (+3930499us) ts_tablet_manager.cc:1145] Deleting tablet a18cb43b4dc04a1290a6bade7ac1f3cf
0810 11:30:36.771928 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.779682 (+ 7754us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.789357 (+ 9675us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.793950 (+ 4593us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3922784}
I20260810 11:30:36.794526 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 187) took 3954 ms. Trace:
I20260810 11:30:36.794623 27248 rpcz_store.cc:276] 0810 11:30:32.840109 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.841045 (+ 936us) service_pool.cc:227] Handling call
0810 11:30:36.794377 (+3953332us) ts_tablet_manager.cc:1145] Deleting tablet 10210204d5ff4e5e97c98fd255f674a5
0810 11:30:36.794390 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.794508 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3939763}
I20260810 11:30:36.795054 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 189) took 3954 ms. Trace:
I20260810 11:30:36.795145 27248 rpcz_store.cc:276] 0810 11:30:32.840917 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.841466 (+ 549us) service_pool.cc:227] Handling call
0810 11:30:36.794900 (+3953434us) ts_tablet_manager.cc:1145] Deleting tablet 1aa4562a2247405187d9dbd1baa48f39
0810 11:30:36.794909 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.795038 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3940128}
I20260810 11:30:36.795413 27248 tablet_replica.cc:330] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:36.795369 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet a18cb43b4dc04a1290a6bade7ac1f3cf (table default.Table_edb9387fb3ec47eab19fc13e046c5533 [id=5e2dc70c9ac641cb91652fe29c4c5e7b]) successfully deleted
I20260810 11:30:36.795629 27248 raft_consensus.cc:2229] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:36.795950 27248 raft_consensus.cc:2258] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:36.796348 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 10210204d5ff4e5e97c98fd255f674a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10210204d5ff4e5e97c98fd255f674a5 already in progress: creating tablet
W20260810 11:30:36.797016 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 1aa4562a2247405187d9dbd1baa48f39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1aa4562a2247405187d9dbd1baa48f39 already in progress: creating tablet
I20260810 11:30:36.797902 27059 raft_consensus.cc:2454] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:36.798269 26848 leader_election.cc:302] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:36.800040 27248 ts_tablet_manager.cc:1905] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:36.803098 28591 raft_consensus.cc:3037] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.806393 28591 raft_consensus.cc:2726] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:36.807412 27248 ts_tablet_manager.cc:1918] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:36.807548 27248 log.cc:1196] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/8a1e2e624fff4692a22e29b293cd82d6
I20260810 11:30:36.808023 27248 ts_tablet_manager.cc:1939] T 8a1e2e624fff4692a22e29b293cd82d6 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:36.810662 27999 raft_consensus.cc:2258] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:36.811641 27999 ts_tablet_manager.cc:1905] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:36.812254 28573 raft_consensus.cc:2726] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:36.816375 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 186) took 3976 ms. Trace:
I20260810 11:30:36.816515 27248 rpcz_store.cc:276] 0810 11:30:32.839857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.840996 (+ 1139us) service_pool.cc:227] Handling call
0810 11:30:36.795373 (+3954377us) ts_tablet_manager.cc:1145] Deleting tablet 8a1e2e624fff4692a22e29b293cd82d6
0810 11:30:36.795382 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.804175 (+ 8793us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.807299 (+ 3124us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.816344 (+ 9045us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3940443}
I20260810 11:30:36.818424 27248 tablet_replica.cc:330] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:36.818679 27248 raft_consensus.cc:2229] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:36.818840 27248 raft_consensus.cc:2258] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:36.819003 28483 consensus_queue.cc:1035] T dc2506b72a624cb388059efc326abbc1 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:36.820442 27248 ts_tablet_manager.cc:1905] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:36.826453 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 8a1e2e624fff4692a22e29b293cd82d6 (table default.Table_f974a4ceae4649bb9f17115103f554cd [id=8c06eb3e2a9245af8c8e8eb250215e0c]) successfully deleted
I20260810 11:30:36.836175 27248 ts_tablet_manager.cc:1918] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:36.836345 27248 log.cc:1196] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/ac4b1821ac30452cbe7a8f844d9b37e5
I20260810 11:30:36.836723 27248 ts_tablet_manager.cc:1939] T ac4b1821ac30452cbe7a8f844d9b37e5 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:36.837687 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 190) took 3704 ms. Trace:
I20260810 11:30:36.837802 27248 rpcz_store.cc:276] 0810 11:30:33.133240 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.134040 (+ 800us) service_pool.cc:227] Handling call
0810 11:30:36.818153 (+3684113us) ts_tablet_manager.cc:1145] Deleting tablet ac4b1821ac30452cbe7a8f844d9b37e5
0810 11:30:36.818366 (+ 213us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.823878 (+ 5512us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.836027 (+ 12149us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.837661 (+ 1634us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11520,"tablet-delete.queue_time_us":3683577}
I20260810 11:30:36.838300 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 191) took 3701 ms. Trace:
I20260810 11:30:36.838415 27248 rpcz_store.cc:276] 0810 11:30:33.137325 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.137595 (+ 270us) service_pool.cc:227] Handling call
0810 11:30:36.838153 (+3700558us) ts_tablet_manager.cc:1145] Deleting tablet 809b5b6b65d244cd9186517e39494839
0810 11:30:36.838164 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.838284 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3685220}
I20260810 11:30:36.838801 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 192) took 3694 ms. Trace:
I20260810 11:30:36.838598 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet ac4b1821ac30452cbe7a8f844d9b37e5 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]) successfully deleted
I20260810 11:30:36.838910 27248 rpcz_store.cc:276] 0810 11:30:33.144534 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.144662 (+ 128us) service_pool.cc:227] Handling call
0810 11:30:36.838665 (+3694003us) ts_tablet_manager.cc:1145] Deleting tablet 1e0a8513171f4c39b74c08760a139d9e
0810 11:30:36.838679 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.838785 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3682431}
I20260810 11:30:36.839233 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 193) took 3691 ms. Trace:
I20260810 11:30:36.839326 27248 rpcz_store.cc:276] 0810 11:30:33.148026 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.148183 (+ 157us) service_pool.cc:227] Handling call
0810 11:30:36.839146 (+3690963us) ts_tablet_manager.cc:1145] Deleting tablet 7aa16654b7f34f9baf856bf724cece8f
0810 11:30:36.839158 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.839214 (+ 56us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3679651}
W20260810 11:30:36.840262 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 809b5b6b65d244cd9186517e39494839 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 809b5b6b65d244cd9186517e39494839 already in progress: creating tablet
W20260810 11:30:36.840951 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 1e0a8513171f4c39b74c08760a139d9e because the tablet was not found. No further retry: Not found: Tablet not found: 1e0a8513171f4c39b74c08760a139d9e
W20260810 11:30:36.841361 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7aa16654b7f34f9baf856bf724cece8f because the tablet was not found. No further retry: Not found: Tablet not found: 7aa16654b7f34f9baf856bf724cece8f
I20260810 11:30:36.843538 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_53285a0af75e4705982c23850f7b27e2 [id=d58840daecc84b789f04a35ca6cd8393]
I20260810 11:30:36.844261 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]
I20260810 11:30:36.844878 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_7458a59fbdce4e9485d51df6fccf66a5 [id=d63533f5d837481889b34a78d860e018]
I20260810 11:30:36.845819 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_da82b7e264034027b41209e3a8be8903 [id=d7ee651e98084bd798d76ecf28546e83]
I20260810 11:30:36.846443 28573 raft_consensus.cc:482] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.846591 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_bcf64628ba2c463ba5acce6617ec4324 [id=d823bbbb98b14646a119632dc037ad03]
I20260810 11:30:36.847090 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_6efb1e8e65fa4f88ae25c9d2ebc6b4f4 [id=d83083bfedd542398d132e4bac9a7f12]
I20260810 11:30:36.846879 28573 raft_consensus.cc:504] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.847664 27248 tablet_replica.cc:330] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:36.847774 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_e18fcf91bf3b4fa0a993bc1aa1471e62 [id=de3117675bb34e7c91a3eb51e015b7c9]
I20260810 11:30:36.847936 27248 raft_consensus.cc:2229] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:36.848189 27248 raft_consensus.cc:2258] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:36.849707 27248 ts_tablet_manager.cc:1905] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:36.850008 27222 tablet_bootstrap.cc:492] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:36.850265 27222 ts_tablet_manager.cc:1397] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.116s user 0.006s sys 0.004s
I20260810 11:30:36.852219 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94bcb1739e5144559201479b82c07941" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:36.852412 27222 raft_consensus.cc:348] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.852816 27222 raft_consensus.cc:374] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.852903 27222 raft_consensus.cc:729] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
W20260810 11:30:36.853020 26993 leader_election.cc:341] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:36.853792 28573 leader_election.cc:288] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:36.853139 27222 consensus_queue.cc:260] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.863178 28573 raft_consensus.cc:482] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.864152 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94bcb1739e5144559201479b82c07941" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:36.868289 27222 ts_tablet_manager.cc:1428] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
W20260810 11:30:36.870301 27291 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8083fa130cd04dae9d61aeed977c1c63 consensus state has no leader
I20260810 11:30:36.871008 28483 raft_consensus.cc:482] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.871157 28483 raft_consensus.cc:504] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.871762 28483 leader_election.cc:288] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.872772 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c4599256684f5dbc745c9283f31a08" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:36.865279 26991 leader_election.cc:341] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:36.866701 27248 ts_tablet_manager.cc:1918] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:36.868479 27231 tablet_bootstrap.cc:492] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:36.873509 26991 leader_election.cc:302] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:36.874080 27231 ts_tablet_manager.cc:1397] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.152s user 0.031s sys 0.032s
I20260810 11:30:36.874147 28498 raft_consensus.cc:2726] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:36.874671 28573 raft_consensus.cc:504] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.876051 27231 raft_consensus.cc:348] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.876458 27231 raft_consensus.cc:374] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.876610 27231 raft_consensus.cc:729] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.877013 27231 consensus_queue.cc:260] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.878750 27231 ts_tablet_manager.cc:1428] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260810 11:30:36.878813 27248 log.cc:1196] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/0713f4f14a284050a7774a70ab974f30
I20260810 11:30:36.879936 28573 leader_election.cc:288] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:36.880996 27231 tablet_bootstrap.cc:492] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:36.876497 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]
I20260810 11:30:36.882826 27248 ts_tablet_manager.cc:1939] T 0713f4f14a284050a7774a70ab974f30 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:36.884622 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_5f8ecc7877924d0f9871dd16aaeafdde [id=e1ca02b3f3f94632843632a15fc19245]
I20260810 11:30:36.887581 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d512c335e340437fa32f2dc16dca6812" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:36.887900 26759 raft_consensus.cc:2454] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:36.888764 26993 leader_election.cc:302] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:36.889086 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 195) took 3728 ms. Trace:
I20260810 11:30:36.889362 27248 rpcz_store.cc:276] 0810 11:30:33.160201 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.160375 (+ 174us) service_pool.cc:227] Handling call
0810 11:30:36.839751 (+3679376us) ts_tablet_manager.cc:1145] Deleting tablet 0713f4f14a284050a7774a70ab974f30
0810 11:30:36.847596 (+ 7845us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.858433 (+ 10837us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.866582 (+ 8149us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.888940 (+ 22358us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3663024}
I20260810 11:30:36.890319 28573 raft_consensus.cc:2781] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:36.890472 28573 raft_consensus.cc:482] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:36.890719 28573 raft_consensus.cc:3037] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.891918 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d512c335e340437fa32f2dc16dca6812" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:36.892283 26915 raft_consensus.cc:2454] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:36.892643 27231 tablet_bootstrap.cc:654] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.893184 26912 raft_consensus.cc:2454] T 00c4599256684f5dbc745c9283f31a08 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:36.893759 26700 leader_election.cc:302] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:36.894045 28483 raft_consensus.cc:2781] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:36.894130 28483 raft_consensus.cc:482] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:36.894208 28483 raft_consensus.cc:3037] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.894177 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_ba61129cdf35481dbf06effd223949f6 [id=e20f1c45c6d743cba2c3cc60c78186a4]
I20260810 11:30:36.897190 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_fb8c5684b00a41eebe3f5b088bcbee33 [id=e22f19a993564e53b1cc76633f25f505]
I20260810 11:30:36.896432 27222 tablet_bootstrap.cc:492] T 720ef9404cb44551aaf39687f0cf94c9 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:36.898108 28483 raft_consensus.cc:504] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.898563 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_db5e3f1e3cf74bc0b15660e83ea59ad6 [id=e7142023363b432b803533be5da13aec]
I20260810 11:30:36.899693 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_1f48a9af47ad4e0c93ed4dd43ecd12a3 [id=e985b1ae60d94bfa998e1986bdf3fcd9]
I20260810 11:30:36.902235 27231 tablet_bootstrap.cc:492] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:36.903040 27231 ts_tablet_manager.cc:1397] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.002s
I20260810 11:30:36.902670 28588 raft_consensus.cc:482] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:36.904247 28573 raft_consensus.cc:504] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.905412 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d512c335e340437fa32f2dc16dca6812" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:36.904444 27231 raft_consensus.cc:348] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.905956 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 0713f4f14a284050a7774a70ab974f30 (table default.Table_a87ac76268094e76aafcb7a2766c0f1e [id=730b858701d54c73a1456c3821d069e2]) successfully deleted
I20260810 11:30:36.906031 28483 leader_election.cc:288] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.906193 27231 raft_consensus.cc:374] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.906425 27231 raft_consensus.cc:729] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:36.906800 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c4599256684f5dbc745c9283f31a08" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:36.906978 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 194) took 3747 ms. Trace:
I20260810 11:30:36.907145 27055 raft_consensus.cc:3037] T 00c4599256684f5dbc745c9283f31a08 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.907362 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c4599256684f5dbc745c9283f31a08" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:36.907693 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]
I20260810 11:30:36.907086 27248 rpcz_store.cc:276] 0810 11:30:33.159965 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.160302 (+ 337us) service_pool.cc:227] Handling call
0810 11:30:36.889907 (+3729605us) ts_tablet_manager.cc:1145] Deleting tablet 0713f4f14a284050a7774a70ab974f30
0810 11:30:36.906560 (+ 16653us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.906814 (+ 254us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3713023}
W20260810 11:30:36.908926 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 0713f4f14a284050a7774a70ab974f30 because the tablet was not found. No further retry: Not found: Tablet not found: 0713f4f14a284050a7774a70ab974f30
I20260810 11:30:36.909379 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d512c335e340437fa32f2dc16dca6812" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:36.909633 26759 raft_consensus.cc:3037] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.910622 27055 raft_consensus.cc:2454] T 00c4599256684f5dbc745c9283f31a08 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:36.913005 26702 leader_election.cc:302] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:36.906797 27231 consensus_queue.cc:260] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.913935 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_4857a0fc183c421382b9b70094d76ac3 [id=eb184bc24462433e89048f962a639600]
I20260810 11:30:36.916031 28485 raft_consensus.cc:2781] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:36.916193 28485 raft_consensus.cc:686] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:36.916477 28485 consensus_queue.cc:237] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.910791 28588 raft_consensus.cc:504] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.918069 26915 raft_consensus.cc:3037] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.918464 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_12d15f4d2bd3426788aadc76beeff465 [id=ec7fc14fabfd4c83adcb3ea82f0087e8]
I20260810 11:30:36.919456 26759 raft_consensus.cc:2454] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:36.919852 28555 consensus_queue.cc:1035] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:36.920101 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_ddaa0e35d54b49c894cbf994bb7fbbab [id=ed36f07f53e04f308770145b0d7435ac]
I20260810 11:30:36.920616 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]
I20260810 11:30:36.921145 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d512c335e340437fa32f2dc16dca6812" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:36.921836 26759 raft_consensus.cc:2379] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
I20260810 11:30:36.922040 26993 leader_election.cc:302] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:36.922431 28498 raft_consensus.cc:2781] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:36.922776 28498 raft_consensus.cc:686] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:36.923173 28498 consensus_queue.cc:237] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.923414 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c4599256684f5dbc745c9283f31a08" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:36.928711 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 196) took 3757 ms. Trace:
I20260810 11:30:36.928993 27248 rpcz_store.cc:276] 0810 11:30:33.164299 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.164364 (+ 65us) service_pool.cc:227] Handling call
0810 11:30:36.908538 (+3744174us) ts_tablet_manager.cc:1145] Deleting tablet 70f6017d4d01463398cb347779dacf90
0810 11:30:36.920089 (+ 11551us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.921873 (+ 1784us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3730564}
I20260810 11:30:36.931205 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 197) took 3760 ms. Trace:
I20260810 11:30:36.931408 27248 rpcz_store.cc:276] 0810 11:30:33.170701 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.181206 (+ 10505us) service_pool.cc:227] Handling call
0810 11:30:36.930860 (+3749654us) ts_tablet_manager.cc:1145] Deleting tablet 49db12565dbc4187b78a98ed35c40fed
0810 11:30:36.930876 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.931048 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3743383}
I20260810 11:30:36.943291 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 199) took 3748 ms. Trace:
I20260810 11:30:36.943478 27248 rpcz_store.cc:276] 0810 11:30:33.194980 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.195048 (+ 68us) service_pool.cc:227] Handling call
0810 11:30:36.942927 (+3747879us) ts_tablet_manager.cc:1145] Deleting tablet 9311943eebaa4824bde96b4cb09f1e2c
0810 11:30:36.942943 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.943150 (+ 207us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3739932}
I20260810 11:30:36.933436 28573 leader_election.cc:288] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:36.945477 26915 raft_consensus.cc:2454] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:36.945801 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 198) took 3754 ms. Trace:
I20260810 11:30:36.945950 27248 rpcz_store.cc:276] 0810 11:30:33.191154 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.191230 (+ 76us) service_pool.cc:227] Handling call
0810 11:30:36.945592 (+3754362us) ts_tablet_manager.cc:1145] Deleting tablet 0118ff9d21924aefa8c6c32977c10453
0810 11:30:36.945606 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.945712 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3739609}
I20260810 11:30:36.946586 26912 raft_consensus.cc:3037] T 00c4599256684f5dbc745c9283f31a08 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:36.947070 27231 ts_tablet_manager.cc:1428] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260810 11:30:36.948046 27231 tablet_bootstrap.cc:492] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:36.950738 27248 tablet_replica.cc:330] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:36.951098 27248 raft_consensus.cc:2229] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:36.951488 27248 raft_consensus.cc:2258] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:36.952237 27248 ts_tablet_manager.cc:1905] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:36.955848 27231 tablet_bootstrap.cc:654] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:36.929687 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 70f6017d4d01463398cb347779dacf90 because the tablet was not found. No further retry: Not found: Tablet not found: 70f6017d4d01463398cb347779dacf90
I20260810 11:30:36.959955 27222 tablet_bootstrap.cc:654] T 720ef9404cb44551aaf39687f0cf94c9 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:36.961568 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_6d8b58857bb84e579c8c308dcb0800f0 [id=f0f8365d722447a090e236fd1fcb0e98]
I20260810 11:30:36.963407 27228 tablet_bootstrap.cc:492] T 39beb126ac324842b7e387c46bcb4099 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:36.963778 27228 ts_tablet_manager.cc:1397] T 39beb126ac324842b7e387c46bcb4099 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.272s user 0.008s sys 0.015s
I20260810 11:30:36.965497 27228 raft_consensus.cc:348] T 39beb126ac324842b7e387c46bcb4099 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:36.966070 27228 raft_consensus.cc:374] T 39beb126ac324842b7e387c46bcb4099 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:36.966296 27228 raft_consensus.cc:729] T 39beb126ac324842b7e387c46bcb4099 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
W20260810 11:30:36.959666 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 49db12565dbc4187b78a98ed35c40fed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49db12565dbc4187b78a98ed35c40fed already in progress: creating tablet
W20260810 11:30:36.967963 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 9311943eebaa4824bde96b4cb09f1e2c because the tablet was not found. No further retry: Not found: Tablet not found: 9311943eebaa4824bde96b4cb09f1e2c
I20260810 11:30:36.968595 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e]
I20260810 11:30:36.969254 26912 raft_consensus.cc:2454] T 00c4599256684f5dbc745c9283f31a08 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:36.969976 28588 leader_election.cc:288] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:36.970649 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_9744be92699b40d1bae23bbb564db585 [id=f27ef087b00e469197a44c70d4bc979b]
I20260810 11:30:36.970824 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d512c335e340437fa32f2dc16dca6812" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:36.971930 26848 leader_election.cc:302] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:36.972728 28588 raft_consensus.cc:2726] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:36.969542 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 0118ff9d21924aefa8c6c32977c10453 because the tablet was not found. No further retry: Not found: Tablet not found: 0118ff9d21924aefa8c6c32977c10453
I20260810 11:30:36.973791 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]
I20260810 11:30:36.976171 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_2d72d964c7c54d639c11a02fc168152a [id=f49e68eaa81e49bb92ed473e754de42f]
I20260810 11:30:36.979727 28555 consensus_queue.cc:1035] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:36.990536 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_c32d1cb0b9e744fbacbd00c8736fad21 [id=f54b49f28880453aa7bc67b9c36a219b]
I20260810 11:30:36.994609 28346 catalog_manager.cc:669] Loaded metadata for table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]
I20260810 11:30:36.998152 27974 ts_tablet_manager.cc:1918] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:36.998706 27974 log.cc:1196] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/70f6017d4d01463398cb347779dacf90
I20260810 11:30:36.999292 27974 ts_tablet_manager.cc:1939] T 70f6017d4d01463398cb347779dacf90 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:37.000162 27231 tablet_bootstrap.cc:492] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:37.000622 27231 ts_tablet_manager.cc:1397] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.053s user 0.005s sys 0.000s
I20260810 11:30:37.000463 28483 consensus_queue.cc:1035] T b9195690e00b4f3cb3d5076dcca3519c P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:37.001125 27228 consensus_queue.cc:260] T 39beb126ac324842b7e387c46bcb4099 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.001816 27231 raft_consensus.cc:348] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.003367 27231 raft_consensus.cc:374] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.003587 27231 raft_consensus.cc:729] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.004052 27231 consensus_queue.cc:260] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.004818 27231 ts_tablet_manager.cc:1428] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 11:30:37.008749 27248 ts_tablet_manager.cc:1918] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:37.008961 27248 log.cc:1196] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/a3406dc345e3429fb4bce5a59643b686
I20260810 11:30:37.009609 27248 ts_tablet_manager.cc:1939] T a3406dc345e3429fb4bce5a59643b686 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:37.010612 27231 tablet_bootstrap.cc:492] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:37.011034 27228 ts_tablet_manager.cc:1428] T 39beb126ac324842b7e387c46bcb4099 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.047s user 0.003s sys 0.000s
I20260810 11:30:37.012470 27228 tablet_bootstrap.cc:492] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
W20260810 11:30:37.014703 26991 consensus_peers.cc:487] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0033d61d07d84262a98b0ebc54bd7960. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:37.017328 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 200) took 3812 ms. Trace:
I20260810 11:30:37.017922 28498 raft_consensus.cc:482] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:37.018435 28498 raft_consensus.cc:504] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.019936 28498 leader_election.cc:288] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:37.019922 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44d5e146eeec4fe0be33c1c169d32e68" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:37.020206 26914 raft_consensus.cc:2454] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:37.020757 26991 leader_election.cc:302] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:37.023659 28573 raft_consensus.cc:2781] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:37.023778 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 209) took 4123 ms. Trace:
I20260810 11:30:37.024088 27974 rpcz_store.cc:276] 0810 11:30:32.900042 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.900649 (+ 607us) service_pool.cc:227] Handling call
0810 11:30:36.729802 (+3829153us) ts_tablet_manager.cc:1145] Deleting tablet 70f6017d4d01463398cb347779dacf90
0810 11:30:36.741822 (+ 12020us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.856226 (+114404us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:36.997832 (+141606us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.023714 (+ 25882us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3824020}
I20260810 11:30:37.025105 27974 tablet_replica.cc:330] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
W20260810 11:30:37.025514 26848 consensus_peers.cc:487] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 02ff6a9bc02441ddb7f307d6b3df31bd. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:37.026058 27974 raft_consensus.cc:2229] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:37.026546 28573 raft_consensus.cc:482] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:37.026630 27974 raft_consensus.cc:2258] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:37.026916 28573 raft_consensus.cc:3037] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.030867 28573 raft_consensus.cc:504] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.032373 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44d5e146eeec4fe0be33c1c169d32e68" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:37.032480 28573 leader_election.cc:288] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:37.032652 26912 raft_consensus.cc:3037] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.035187 26912 raft_consensus.cc:2454] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:37.035773 26991 leader_election.cc:302] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:37.036321 27231 tablet_bootstrap.cc:654] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.041142 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 70f6017d4d01463398cb347779dacf90 (table default.Table_24bdc44050024c23aa90a182bdcecb50 [id=4ea7ee58aac74fba84dbbcc009017421]) successfully deleted
I20260810 11:30:37.043835 27228 tablet_bootstrap.cc:654] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.046842 28498 raft_consensus.cc:2781] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:37.048130 28498 raft_consensus.cc:686] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:37.048633 27222 tablet_bootstrap.cc:492] T 720ef9404cb44551aaf39687f0cf94c9 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:37.048897 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44d5e146eeec4fe0be33c1c169d32e68" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:37.049163 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44d5e146eeec4fe0be33c1c169d32e68" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:37.050146 28498 consensus_queue.cc:237] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:37.050900 26993 leader_election.cc:341] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:37.051527 26993 leader_election.cc:341] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:37.017508 27248 rpcz_store.cc:276] 0810 11:30:33.204902 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.205021 (+ 119us) service_pool.cc:227] Handling call
0810 11:30:36.950645 (+3745624us) ts_tablet_manager.cc:1145] Deleting tablet a3406dc345e3429fb4bce5a59643b686
0810 11:30:36.950657 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.966456 (+ 15799us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.008493 (+ 42037us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.017226 (+ 8733us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3743519}
I20260810 11:30:37.053021 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 201) took 3845 ms. Trace:
I20260810 11:30:37.053087 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet a3406dc345e3429fb4bce5a59643b686 (table default.Table_b9bd48d71fac4e03b0d84dcafd4cb4a5 [id=0db7b6eb26f8438caf57a129ba2c81fe]) successfully deleted
I20260810 11:30:37.053297 27248 rpcz_store.cc:276] 0810 11:30:33.207590 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.207649 (+ 59us) service_pool.cc:227] Handling call
0810 11:30:37.052781 (+3845132us) ts_tablet_manager.cc:1145] Deleting tablet d000f0ebaf0049a7bdaad93e307e16e2
0810 11:30:37.052800 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.052964 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3844631}
W20260810 11:30:37.054021 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet d000f0ebaf0049a7bdaad93e307e16e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d000f0ebaf0049a7bdaad93e307e16e2 already in progress: creating tablet
I20260810 11:30:37.054386 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 202) took 3845 ms. Trace:
I20260810 11:30:37.054741 27248 rpcz_store.cc:276] 0810 11:30:33.208420 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.208486 (+ 66us) service_pool.cc:227] Handling call
0810 11:30:37.053641 (+3845155us) ts_tablet_manager.cc:1145] Deleting tablet 81f24c84cdd945b78f39f24015eb1e43
0810 11:30:37.053659 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.054084 (+ 425us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3844427}
I20260810 11:30:37.055279 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 203) took 3843 ms. Trace:
W20260810 11:30:37.055536 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 81f24c84cdd945b78f39f24015eb1e43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81f24c84cdd945b78f39f24015eb1e43 already in progress: creating tablet
I20260810 11:30:37.055457 27248 rpcz_store.cc:276] 0810 11:30:33.240823 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.240890 (+ 67us) service_pool.cc:227] Handling call
0810 11:30:37.055100 (+3814210us) ts_tablet_manager.cc:1145] Deleting tablet 478c0c39658349c39e3afa1aa1653e82
0810 11:30:37.055117 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.055225 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3813903}
I20260810 11:30:37.055930 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 204) took 3814 ms. Trace:
I20260810 11:30:37.056197 27248 rpcz_store.cc:276] 0810 11:30:33.241681 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.241757 (+ 76us) service_pool.cc:227] Handling call
0810 11:30:37.055758 (+3814001us) ts_tablet_manager.cc:1145] Deleting tablet eb51618d37ac488fa7e3d23e5f85ec36
0810 11:30:37.055771 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.055848 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3813415}
W20260810 11:30:37.056365 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 478c0c39658349c39e3afa1aa1653e82 because the tablet was not found. No further retry: Not found: Tablet not found: 478c0c39658349c39e3afa1aa1653e82
I20260810 11:30:37.060051 27222 ts_tablet_manager.cc:1397] T 720ef9404cb44551aaf39687f0cf94c9 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.167s user 0.003s sys 0.005s
I20260810 11:30:37.064414 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 205) took 3821 ms. Trace:
I20260810 11:30:37.064718 27248 rpcz_store.cc:276] 0810 11:30:33.242486 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.242661 (+ 175us) service_pool.cc:227] Handling call
0810 11:30:37.064143 (+3821482us) ts_tablet_manager.cc:1145] Deleting tablet 34bd3c0edf6b49d1891c0ee9af344872
0810 11:30:37.064157 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.064322 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3821244}
I20260810 11:30:37.059990 27974 ts_tablet_manager.cc:1905] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:37.069550 27231 tablet_bootstrap.cc:492] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:37.069832 27231 ts_tablet_manager.cc:1397] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.059s user 0.006s sys 0.000s
I20260810 11:30:37.071591 27231 raft_consensus.cc:348] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.072317 27231 raft_consensus.cc:374] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.072623 27231 raft_consensus.cc:729] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.073040 27231 consensus_queue.cc:260] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:37.064761 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet eb51618d37ac488fa7e3d23e5f85ec36 because the tablet was not found. No further retry: Not found: Tablet not found: eb51618d37ac488fa7e3d23e5f85ec36
I20260810 11:30:37.076635 28346 tablet_loader.cc:96] loaded metadata for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14])
I20260810 11:30:37.077143 28346 tablet_loader.cc:96] loaded metadata for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7])
W20260810 11:30:37.077751 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 34bd3c0edf6b49d1891c0ee9af344872 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34bd3c0edf6b49d1891c0ee9af344872 already in progress: creating tablet
I20260810 11:30:37.079206 27231 ts_tablet_manager.cc:1428] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.009s user 0.003s sys 0.001s
I20260810 11:30:37.069854 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 206) took 3826 ms. Trace:
I20260810 11:30:37.079562 27248 rpcz_store.cc:276] 0810 11:30:33.243318 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.244036 (+ 718us) service_pool.cc:227] Handling call
0810 11:30:37.069460 (+3825424us) ts_tablet_manager.cc:1145] Deleting tablet f6e264e8507446809f3c386fdb3c34ae
0810 11:30:37.069504 (+ 44us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.069770 (+ 266us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3820324}
I20260810 11:30:37.080087 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 207) took 3831 ms. Trace:
I20260810 11:30:37.080324 27248 rpcz_store.cc:276] 0810 11:30:33.249038 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.249141 (+ 103us) service_pool.cc:227] Handling call
0810 11:30:37.079874 (+3830733us) ts_tablet_manager.cc:1145] Deleting tablet 43e42cc642544f779bb79cee7479c4f4
0810 11:30:37.079885 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.080002 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3830045}
I20260810 11:30:37.080829 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 208) took 3830 ms. Trace:
I20260810 11:30:37.080996 27248 rpcz_store.cc:276] 0810 11:30:33.250181 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.250519 (+ 338us) service_pool.cc:227] Handling call
0810 11:30:37.080609 (+3830090us) ts_tablet_manager.cc:1145] Deleting tablet 8228600e3f6b4f9993dd25e4ceb57e4d
0810 11:30:37.080619 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.080743 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3829522}
I20260810 11:30:37.081668 27231 tablet_bootstrap.cc:492] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:37.083343 27228 tablet_bootstrap.cc:492] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
W20260810 11:30:37.083238 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet f6e264e8507446809f3c386fdb3c34ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6e264e8507446809f3c386fdb3c34ae already in progress: creating tablet
I20260810 11:30:37.083514 27228 ts_tablet_manager.cc:1397] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.002s
I20260810 11:30:37.084549 27228 raft_consensus.cc:348] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.085266 27228 raft_consensus.cc:374] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.085397 27228 raft_consensus.cc:729] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.085623 28346 tablet_loader.cc:96] loaded metadata for tablet 00e63f994ff84941852b0cfee763c303 (table default.Table_b2381e8587204bffa96b34e428682d5d [id=d4074ee00ab24054b4121d5c9c74d9a4])
I20260810 11:30:37.085896 27228 consensus_queue.cc:260] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.086690 28346 tablet_loader.cc:96] loaded metadata for tablet 046fede13acf44e294fde386f78446a5 (table default.Table_b15d6127087043a186b912230d2fe666 [id=ac5dd73c5e8e40108a8b663241887081])
W20260810 11:30:37.086723 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 43e42cc642544f779bb79cee7479c4f4 because the tablet was not found. No further retry: Not found: Tablet not found: 43e42cc642544f779bb79cee7479c4f4
W20260810 11:30:37.087273 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 8228600e3f6b4f9993dd25e4ceb57e4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8228600e3f6b4f9993dd25e4ceb57e4d already in progress: creating tablet
I20260810 11:30:37.089104 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 209) took 3838 ms. Trace:
I20260810 11:30:37.089363 27248 rpcz_store.cc:276] 0810 11:30:33.250441 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.252399 (+ 1958us) service_pool.cc:227] Handling call
0810 11:30:37.081280 (+3828881us) ts_tablet_manager.cc:1145] Deleting tablet 3ae27bf110114b70a3e3f6cf64f31b98
0810 11:30:37.084373 (+ 3093us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.088979 (+ 4606us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3817215}
I20260810 11:30:37.089865 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 210) took 3836 ms. Trace:
I20260810 11:30:37.092690 28346 tablet_loader.cc:96] loaded metadata for tablet 0ad96bbd29ad4ce9a766ac84db1a9c60 (table default.Table_bc8bc2c9015443fb865751881638284b [id=3d0ee62af94a45ebb75470e84997368f])
I20260810 11:30:37.093732 27248 rpcz_store.cc:276] 0810 11:30:33.253050 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.253152 (+ 102us) service_pool.cc:227] Handling call
0810 11:30:37.089664 (+3836512us) ts_tablet_manager.cc:1145] Deleting tablet 5ca5c88585394dba87e201696afa6934
0810 11:30:37.089677 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.089741 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3824540}
I20260810 11:30:37.094309 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 211) took 3834 ms. Trace:
I20260810 11:30:37.094587 27248 rpcz_store.cc:276] 0810 11:30:33.259896 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.259997 (+ 101us) service_pool.cc:227] Handling call
0810 11:30:37.094066 (+3834069us) ts_tablet_manager.cc:1145] Deleting tablet e25ae21cc8cc4749a507fcab5ee225a3
0810 11:30:37.094086 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.094205 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3828375}
I20260810 11:30:37.094949 27248 tablet_replica.cc:330] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:37.095252 27248 raft_consensus.cc:2229] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:37.095824 27248 raft_consensus.cc:2258] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:37.097642 27231 tablet_bootstrap.cc:654] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.097604 27248 ts_tablet_manager.cc:1905] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:37.098219 28498 raft_consensus.cc:482] T fc023d51790042ce978eb53a2979e29c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:37.098479 28498 raft_consensus.cc:504] T fc023d51790042ce978eb53a2979e29c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.099915 28498 leader_election.cc:288] T fc023d51790042ce978eb53a2979e29c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:37.100069 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc023d51790042ce978eb53a2979e29c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:37.100242 28573 consensus_queue.cc:1035] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:37.101477 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc023d51790042ce978eb53a2979e29c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:37.102166 26759 raft_consensus.cc:2379] T fc023d51790042ce978eb53a2979e29c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 482e605580be48cbbacce05a3e61c215 in current term 1: Already voted for candidate b6079090b1124d84aa4477974bb53700 in this term.
I20260810 11:30:37.103343 27228 ts_tablet_manager.cc:1428] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.019s user 0.004s sys 0.000s
I20260810 11:30:37.107242 26993 leader_election.cc:302] T fc023d51790042ce978eb53a2979e29c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:37.109056 28573 raft_consensus.cc:3037] T fc023d51790042ce978eb53a2979e29c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.111328 27228 tablet_bootstrap.cc:492] T 37cecd4266eb47669e7fd5cfeb847adc P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:37.112953 28346 tablet_loader.cc:96] loaded metadata for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6])
I20260810 11:30:37.113668 28346 tablet_loader.cc:96] loaded metadata for tablet 0cc17c55109b47eeb91920c3ed8178e0 (table default.Table_fee5e058d63849c189e798c232542ad2 [id=2c6a659407bc4d8dad087cb73c16e229])
I20260810 11:30:37.114140 28346 tablet_loader.cc:96] loaded metadata for tablet 0d7a07e844984b88ab81610cb95bf21e (table default.Table_b2c244ee13d14619b9f1eac6ab1aba2a [id=afa11e2df47a4a739727c8d834e24b84])
I20260810 11:30:37.115386 28573 raft_consensus.cc:2726] T fc023d51790042ce978eb53a2979e29c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:37.115718 28346 tablet_loader.cc:96] loaded metadata for tablet 0edef936026743a896d5a73c134a8bca (table default.Table_bcf64628ba2c463ba5acce6617ec4324 [id=d823bbbb98b14646a119632dc037ad03])
I20260810 11:30:37.116179 28346 tablet_loader.cc:96] loaded metadata for tablet 0f048b690d764c83a4a9ce4cbadc75b0 (table default.Table_dc83172ee2e44eccab63bccfa35523fe [id=19ea42a81c4f471592628b27a3404c4b])
I20260810 11:30:37.117769 27231 tablet_bootstrap.cc:492] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:37.119812 28498 consensus_queue.cc:1035] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:37.120738 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 3ae27bf110114b70a3e3f6cf64f31b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae27bf110114b70a3e3f6cf64f31b98 already in progress: creating tablet
I20260810 11:30:37.122324 28498 raft_consensus.cc:482] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:37.122720 28498 raft_consensus.cc:504] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.123184 27222 raft_consensus.cc:348] T 720ef9404cb44551aaf39687f0cf94c9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.123646 28498 leader_election.cc:288] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:37.123793 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 93325.6us
I20260810 11:30:37.123883 27222 raft_consensus.cc:374] T 720ef9404cb44551aaf39687f0cf94c9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.124413 27222 raft_consensus.cc:729] T 720ef9404cb44551aaf39687f0cf94c9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.124606 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39beb126ac324842b7e387c46bcb4099" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:37.124874 26914 raft_consensus.cc:2454] T 39beb126ac324842b7e387c46bcb4099 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:37.124821 27222 consensus_queue.cc:260] T 720ef9404cb44551aaf39687f0cf94c9 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.125032 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39beb126ac324842b7e387c46bcb4099" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:37.124403 28555 consensus_queue.cc:1035] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260810 11:30:37.125564 27222 ts_tablet_manager.cc:1428] T 720ef9404cb44551aaf39687f0cf94c9 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.064s user 0.002s sys 0.000s
I20260810 11:30:37.125654 26991 leader_election.cc:302] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:37.125955 28497 raft_consensus.cc:482] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:37.126173 27222 tablet_bootstrap.cc:492] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:37.126143 28497 raft_consensus.cc:504] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.126981 28497 leader_election.cc:288] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:37.127235 28497 raft_consensus.cc:2781] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:37.127455 28497 raft_consensus.cc:482] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:37.127631 28497 raft_consensus.cc:3037] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.128538 27231 ts_tablet_manager.cc:1397] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.047s user 0.000s sys 0.008s
I20260810 11:30:37.129323 27222 tablet_bootstrap.cc:654] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.129498 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "720ef9404cb44551aaf39687f0cf94c9" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:37.129849 26914 raft_consensus.cc:2454] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:37.130030 27231 raft_consensus.cc:348] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.130367 27231 raft_consensus.cc:374] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.132597 28497 raft_consensus.cc:504] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.134559 28346 tablet_loader.cc:96] loaded metadata for tablet 12d5aaa533ad4d719c480098da979fc7 (table default.Table_f8b086b05e6b4174a3494b211543a5c8 [id=0332305d764840cd9789d29ac4527fee])
I20260810 11:30:37.130524 27231 raft_consensus.cc:729] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.135869 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "720ef9404cb44551aaf39687f0cf94c9" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:37.136256 26763 raft_consensus.cc:2454] T 720ef9404cb44551aaf39687f0cf94c9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:37.137267 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39beb126ac324842b7e387c46bcb4099" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:37.133322 26991 leader_election.cc:302] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:37.138983 28346 tablet_loader.cc:96] loaded metadata for tablet 1549a26ba0f6427fae87b204c5d49eff (table default.Table_f55e75edcec14683a44d60250c42dbc7 [id=4f456ea1fbfe40dc8ed31415b77d4743])
I20260810 11:30:37.139612 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39beb126ac324842b7e387c46bcb4099" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:37.139830 26914 raft_consensus.cc:3037] T 39beb126ac324842b7e387c46bcb4099 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.140376 28346 tablet_loader.cc:96] loaded metadata for tablet 16101a5784394d3aa570f4ecd8f2ac56 (table default.Table_645b3efca425434da139268167fec99f [id=51dc04b8252b4142a7ac67c5fc0dd1ad])
I20260810 11:30:37.134119 28497 leader_election.cc:288] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:37.135231 26993 leader_election.cc:341] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:37.141464 26993 leader_election.cc:341] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:37.141881 28346 tablet_loader.cc:96] loaded metadata for tablet 17ff4152fc6a449db3a172c5d948168f (table default.Table_91c2ed7bba91469685ccb4e15fb5c174 [id=163ec39724a44b518f07abf5938fbcb7])
I20260810 11:30:37.142371 28346 tablet_loader.cc:96] loaded metadata for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b])
I20260810 11:30:37.142438 28591 consensus_queue.cc:1035] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:37.143747 28346 tablet_loader.cc:96] loaded metadata for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0])
I20260810 11:30:37.138702 28498 raft_consensus.cc:2781] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:37.143694 26914 raft_consensus.cc:2454] T 39beb126ac324842b7e387c46bcb4099 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:37.144982 28498 raft_consensus.cc:482] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:37.146378 28498 raft_consensus.cc:3037] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.145977 26991 leader_election.cc:302] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:37.149482 28573 raft_consensus.cc:2781] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:37.149942 28573 raft_consensus.cc:686] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:37.150413 28573 consensus_queue.cc:237] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.135502 27231 consensus_queue.cc:260] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.152769 27231 ts_tablet_manager.cc:1428] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.024s user 0.002s sys 0.001s
I20260810 11:30:37.153157 27231 tablet_bootstrap.cc:492] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:37.155076 28498 raft_consensus.cc:504] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.157241 27228 tablet_bootstrap.cc:654] T 37cecd4266eb47669e7fd5cfeb847adc P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.163046 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "720ef9404cb44551aaf39687f0cf94c9" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:37.163422 26763 raft_consensus.cc:3037] T 720ef9404cb44551aaf39687f0cf94c9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.159909 27231 tablet_bootstrap.cc:654] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:37.166476 27288 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 48812.5us
W20260810 11:30:37.166860 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 5ca5c88585394dba87e201696afa6934 because the tablet was not found. No further retry: Not found: Tablet not found: 5ca5c88585394dba87e201696afa6934
I20260810 11:30:37.166854 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "720ef9404cb44551aaf39687f0cf94c9" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:37.167125 26914 raft_consensus.cc:3037] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:37.167460 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet e25ae21cc8cc4749a507fcab5ee225a3 because the tablet was not found. No further retry: Not found: Tablet not found: e25ae21cc8cc4749a507fcab5ee225a3
I20260810 11:30:37.168308 28573 raft_consensus.cc:482] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:37.170646 26763 raft_consensus.cc:2454] T 720ef9404cb44551aaf39687f0cf94c9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:37.171007 26914 raft_consensus.cc:2454] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:37.172187 27222 tablet_bootstrap.cc:492] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:37.172456 27222 ts_tablet_manager.cc:1397] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.046s user 0.005s sys 0.000s
W20260810 11:30:37.177176 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 147363us
W20260810 11:30:37.180830 27291 leader_election.cc:334] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489): Timed out: RequestConsensusVote RPC to 127.25.195.252:34489 timed out after 0.606s (SENT)
I20260810 11:30:37.181116 27291 leader_election.cc:302] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83cc8e39a3b9455f8242a6da6a54c38a; no voters: ac259bcf213a4aa297d1d8e73b262361, c40c76e125b44de181b88b7f63a566f7
I20260810 11:30:37.189050 28656 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 11:30:37.144354 28346 tablet_loader.cc:96] loaded metadata for tablet 2126d95992e549b7b2b3e662b0d39a36 (table default.Table_21a675494284471eaf3ea50b31b833d7 [id=46a8ee2948c04311b0d3c1a5174d08dc])
I20260810 11:30:37.191864 27222 raft_consensus.cc:348] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.191977 28573 raft_consensus.cc:504] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.192289 27222 raft_consensus.cc:374] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.192414 27222 raft_consensus.cc:729] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.192888 27222 consensus_queue.cc:260] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.193683 27222 ts_tablet_manager.cc:1428] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.021s user 0.003s sys 0.000s
I20260810 11:30:37.194435 28346 tablet_loader.cc:96] loaded metadata for tablet 214be3356fda4c8484596196c0985721 (table default.Table_5a4c04e087c3490fae87a17247850531 [id=323f239c11f84a69beaf74e68c0cf50a])
I20260810 11:30:37.194482 26993 leader_election.cc:302] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:37.195503 28498 leader_election.cc:288] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:37.195974 28346 tablet_loader.cc:96] loaded metadata for tablet 23637a02b6464e17aa2a69ea5cc4ddfe (table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85])
I20260810 11:30:37.204792 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64818ca5827e41d99428903ddb8688d9" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:37.206158 27248 ts_tablet_manager.cc:1918] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:37.208115 28651 raft_consensus.cc:2781] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 11:30:37.225445 26991 leader_election.cc:341] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:37.225805 28346 tablet_loader.cc:96] loaded metadata for tablet 262656cbd3944702ac0ce04222cda500 (table default.Table_174d1e3073a34beabbd10fd4f6d61bd4 [id=d538eb7fe6224d6895190c79c041b76f])
I20260810 11:30:37.226724 28573 leader_election.cc:288] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:37.228881 27248 log.cc:1196] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/0033d61d07d84262a98b0ebc54bd7960
I20260810 11:30:37.232995 28651 raft_consensus.cc:686] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:37.234144 27248 ts_tablet_manager.cc:1939] T 0033d61d07d84262a98b0ebc54bd7960 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:37.235356 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 212) took 3974 ms. Trace:
I20260810 11:30:37.235600 27248 rpcz_store.cc:276] 0810 11:30:33.260669 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.260777 (+ 108us) service_pool.cc:227] Handling call
0810 11:30:37.094854 (+3834077us) ts_tablet_manager.cc:1145] Deleting tablet 0033d61d07d84262a98b0ebc54bd7960
0810 11:30:37.094868 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.106797 (+ 11929us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.193912 (+ 87115us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.235204 (+ 41292us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3828741}
I20260810 11:30:37.236321 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 213) took 3974 ms. Trace:
I20260810 11:30:37.235355 28651 consensus_queue.cc:237] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.236799 27248 rpcz_store.cc:276] 0810 11:30:33.261269 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.261753 (+ 484us) service_pool.cc:227] Handling call
0810 11:30:37.235953 (+3974200us) ts_tablet_manager.cc:1145] Deleting tablet 110b5acc36bd4d6bba13735e5daec75f
0810 11:30:37.235965 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.236096 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3969650}
I20260810 11:30:37.237196 27974 ts_tablet_manager.cc:1918] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:37.237447 27974 log.cc:1196] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/a18cb43b4dc04a1290a6bade7ac1f3cf
I20260810 11:30:37.237473 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 214) took 3974 ms. Trace:
I20260810 11:30:37.237591 27248 rpcz_store.cc:276] 0810 11:30:33.262857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.349813 (+ 86956us) service_pool.cc:227] Handling call
0810 11:30:37.237132 (+3887319us) ts_tablet_manager.cc:1145] Deleting tablet 43fee1a9a6f9482fbbe6ab6599c27fb9
0810 11:30:37.237144 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.237311 (+ 167us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3887003}
I20260810 11:30:37.237995 27974 ts_tablet_manager.cc:1939] T a18cb43b4dc04a1290a6bade7ac1f3cf P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:37.238116 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 215) took 3887 ms. Trace:
I20260810 11:30:37.238330 27248 rpcz_store.cc:276] 0810 11:30:33.350655 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.350808 (+ 153us) service_pool.cc:227] Handling call
0810 11:30:37.237832 (+3887024us) ts_tablet_manager.cc:1145] Deleting tablet 256ad2e2d8e54a4caa1b5091bab60dd5
0810 11:30:37.237843 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.237970 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3886567}
I20260810 11:30:37.238857 27228 tablet_bootstrap.cc:492] T 37cecd4266eb47669e7fd5cfeb847adc P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:37.239282 27228 ts_tablet_manager.cc:1397] T 37cecd4266eb47669e7fd5cfeb847adc P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.131s user 0.007s sys 0.000s
I20260810 11:30:37.240434 27228 raft_consensus.cc:348] T 37cecd4266eb47669e7fd5cfeb847adc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.240808 27228 raft_consensus.cc:374] T 37cecd4266eb47669e7fd5cfeb847adc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.242103 27228 raft_consensus.cc:729] T 37cecd4266eb47669e7fd5cfeb847adc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.238827 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 216) took 3886 ms. Trace:
I20260810 11:30:37.243518 27228 consensus_queue.cc:260] T 37cecd4266eb47669e7fd5cfeb847adc P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.243887 27248 rpcz_store.cc:276] 0810 11:30:33.352103 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.352255 (+ 152us) service_pool.cc:227] Handling call
0810 11:30:37.238581 (+3886326us) ts_tablet_manager.cc:1145] Deleting tablet 31888ddeafe14738b818016a9c0a4ad3
0810 11:30:37.238591 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.238652 (+ 61us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3885817}
I20260810 11:30:37.244359 27999 ts_tablet_manager.cc:1918] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:37.244488 27999 log.cc:1196] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/eb9394f9ca2c44de93354e23973cf902
I20260810 11:30:37.245128 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 217) took 3891 ms. Trace:
I20260810 11:30:37.245254 27248 rpcz_store.cc:276] 0810 11:30:33.353335 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.353441 (+ 106us) service_pool.cc:227] Handling call
0810 11:30:37.244922 (+3891481us) ts_tablet_manager.cc:1145] Deleting tablet 3ff4e19071fc435fbae4490799325e37
0810 11:30:37.244939 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.245065 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3891140}
I20260810 11:30:37.245684 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 218) took 3891 ms. Trace:
I20260810 11:30:37.245817 27248 rpcz_store.cc:276] 0810 11:30:33.354399 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.460118 (+105719us) service_pool.cc:227] Handling call
0810 11:30:37.245538 (+3785420us) ts_tablet_manager.cc:1145] Deleting tablet 5adcec593b8c4d40997c8911e9f77c85
0810 11:30:37.245548 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.245630 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3756017}
I20260810 11:30:37.246199 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 220) took 3740 ms. Trace:
I20260810 11:30:37.246301 27248 rpcz_store.cc:276] 0810 11:30:33.505970 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.514596 (+ 8626us) service_pool.cc:227] Handling call
0810 11:30:37.246051 (+3731455us) ts_tablet_manager.cc:1145] Deleting tablet d729baae40a64e6e8c23e6870f230afb
0810 11:30:37.246062 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.246138 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3731115}
I20260810 11:30:37.246848 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 221) took 3731 ms. Trace:
I20260810 11:30:37.246976 27248 rpcz_store.cc:276] 0810 11:30:33.515522 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.516071 (+ 549us) service_pool.cc:227] Handling call
0810 11:30:37.246607 (+3730536us) ts_tablet_manager.cc:1145] Deleting tablet 60d56e162b4b41e2867ac845e524aca4
0810 11:30:37.246616 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.246665 (+ 49us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3730237}
I20260810 11:30:37.247411 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 222) took 3730 ms. Trace:
I20260810 11:30:37.247553 27248 rpcz_store.cc:276] 0810 11:30:33.516714 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.520530 (+ 3816us) service_pool.cc:227] Handling call
0810 11:30:37.247189 (+3726659us) ts_tablet_manager.cc:1145] Deleting tablet db5adccd80a04e328e13793b461c38b1
0810 11:30:37.247200 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.247283 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3726064}
I20260810 11:30:37.250701 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64818ca5827e41d99428903ddb8688d9" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:37.251915 28586 raft_consensus.cc:482] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:37.252082 28586 raft_consensus.cc:504] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.252214 27228 ts_tablet_manager.cc:1428] T 37cecd4266eb47669e7fd5cfeb847adc P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260810 11:30:37.252723 28586 leader_election.cc:288] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:37.253571 28345 consensus_queue.cc:1035] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:37.254410 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318d5b8453fe4c438d0fa32cb91c409e" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:37.255275 26849 leader_election.cc:341] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:37.256260 27222 tablet_bootstrap.cc:492] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:37.259024 27222 tablet_bootstrap.cc:654] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.272204 27288 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 0033d61d07d84262a98b0ebc54bd7960 (table default.Table_c6cf8c999ed14a31aff5a1de22594c1f [id=0e600e92a46f45629433aa68978a93d7]) successfully deleted
W20260810 11:30:37.272207 26993 leader_election.cc:341] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:37.272743 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 110b5acc36bd4d6bba13735e5daec75f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 110b5acc36bd4d6bba13735e5daec75f already in progress: creating tablet
I20260810 11:30:37.276778 27999 ts_tablet_manager.cc:1939] T eb9394f9ca2c44de93354e23973cf902 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
W20260810 11:30:37.277360 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 already in progress: creating tablet
W20260810 11:30:37.277802 27288 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 256ad2e2d8e54a4caa1b5091bab60dd5 already in progress: creating tablet
W20260810 11:30:37.278244 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 31888ddeafe14738b818016a9c0a4ad3 because the tablet was not found. No further retry: Not found: Tablet not found: 31888ddeafe14738b818016a9c0a4ad3
W20260810 11:30:37.278573 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 3ff4e19071fc435fbae4490799325e37 because the tablet was not found. No further retry: Not found: Tablet not found: 3ff4e19071fc435fbae4490799325e37
I20260810 11:30:37.278687 26993 leader_election.cc:302] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
W20260810 11:30:37.279145 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 5adcec593b8c4d40997c8911e9f77c85 because the tablet was not found. No further retry: Not found: Tablet not found: 5adcec593b8c4d40997c8911e9f77c85
W20260810 11:30:37.279376 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet d729baae40a64e6e8c23e6870f230afb because the tablet was not found. No further retry: Not found: Tablet not found: d729baae40a64e6e8c23e6870f230afb
W20260810 11:30:37.279989 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 60d56e162b4b41e2867ac845e524aca4 because the tablet was not found. No further retry: Not found: Tablet not found: 60d56e162b4b41e2867ac845e524aca4
W20260810 11:30:37.280330 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet db5adccd80a04e328e13793b461c38b1 because the tablet was not found. No further retry: Not found: Tablet not found: db5adccd80a04e328e13793b461c38b1
I20260810 11:30:37.294039 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 223) took 3772 ms. Trace:
I20260810 11:30:37.294143 28346 tablet_loader.cc:96] loaded metadata for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e])
I20260810 11:30:37.295461 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 210) took 4394 ms. Trace:
I20260810 11:30:37.296545 27222 tablet_bootstrap.cc:492] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:37.296932 27222 ts_tablet_manager.cc:1397] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.045s user 0.006s sys 0.000s
I20260810 11:30:37.298373 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 102) took 10734 ms. Trace:
I20260810 11:30:37.296967 27974 rpcz_store.cc:276] 0810 11:30:32.902210 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.902290 (+ 80us) service_pool.cc:227] Handling call
0810 11:30:37.024964 (+4122674us) ts_tablet_manager.cc:1145] Deleting tablet a18cb43b4dc04a1290a6bade7ac1f3cf
0810 11:30:37.024982 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.161196 (+136214us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.236975 (+ 75779us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.294410 (+ 57435us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4118437}
I20260810 11:30:37.298506 27999 rpcz_store.cc:276] 0810 11:30:26.564280 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.564801 (+ 521us) service_pool.cc:227] Handling call
0810 11:30:36.759270 (+10194469us) ts_tablet_manager.cc:1145] Deleting tablet eb9394f9ca2c44de93354e23973cf902
0810 11:30:36.759288 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:36.884148 (+124860us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.244222 (+360074us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.298320 (+ 54098us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10188292}
I20260810 11:30:37.298909 27999 tablet_replica.cc:330] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:37.299161 27999 raft_consensus.cc:2229] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:37.299226 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet eb9394f9ca2c44de93354e23973cf902 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]) successfully deleted
I20260810 11:30:37.301245 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet a18cb43b4dc04a1290a6bade7ac1f3cf (table default.Table_edb9387fb3ec47eab19fc13e046c5533 [id=5e2dc70c9ac641cb91652fe29c4c5e7b]) successfully deleted
I20260810 11:30:37.306531 28345 consensus_queue.cc:1035] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:37.306735 27228 tablet_bootstrap.cc:492] T 94bcb1739e5144559201479b82c07941 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:37.294200 27248 rpcz_store.cc:276] 0810 11:30:33.521490 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.523153 (+ 1663us) service_pool.cc:227] Handling call
0810 11:30:37.247782 (+3724629us) ts_tablet_manager.cc:1145] Deleting tablet 0938a2f3688246a2b46978eeb7d5d521
0810 11:30:37.247795 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.294001 (+ 46206us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3723982}
I20260810 11:30:37.312637 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 224) took 3759 ms. Trace:
I20260810 11:30:37.312852 27248 rpcz_store.cc:276] 0810 11:30:33.553010 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.553088 (+ 78us) service_pool.cc:227] Handling call
0810 11:30:37.312478 (+3759390us) ts_tablet_manager.cc:1145] Deleting tablet fdbe21b4f124411988dd35a0b864f868
0810 11:30:37.312492 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.312611 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3758952}
W20260810 11:30:37.312983 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 0938a2f3688246a2b46978eeb7d5d521 because the tablet was not found. No further retry: Not found: Tablet not found: 0938a2f3688246a2b46978eeb7d5d521
W20260810 11:30:37.313521 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet fdbe21b4f124411988dd35a0b864f868 because the tablet was not found. No further retry: Not found: Tablet not found: fdbe21b4f124411988dd35a0b864f868
I20260810 11:30:37.314613 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 225) took 3753 ms. Trace:
I20260810 11:30:37.314769 27248 rpcz_store.cc:276] 0810 11:30:33.562065 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.562946 (+ 881us) service_pool.cc:227] Handling call
0810 11:30:37.314490 (+3751544us) ts_tablet_manager.cc:1145] Deleting tablet a28849649c704f2fbdec1aced9ce01b1
0810 11:30:37.314507 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.314590 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3751004}
W20260810 11:30:37.315375 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet a28849649c704f2fbdec1aced9ce01b1 because the tablet was not found. No further retry: Not found: Tablet not found: a28849649c704f2fbdec1aced9ce01b1
I20260810 11:30:37.314774 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 211) took 4265 ms. Trace:
I20260810 11:30:37.318064 27222 raft_consensus.cc:348] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.320684 27248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33500 (request call id 226) took 3753 ms. Trace:
I20260810 11:30:37.319706 28346 tablet_loader.cc:96] loaded metadata for tablet 2b95f3ec8ff34c89a68cd1edf8391f9b (table default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e])
I20260810 11:30:37.326367 27231 tablet_bootstrap.cc:492] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:37.326840 27231 ts_tablet_manager.cc:1397] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.174s user 0.007s sys 0.004s
I20260810 11:30:37.320869 27248 rpcz_store.cc:276] 0810 11:30:33.566789 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.568479 (+ 1690us) service_pool.cc:227] Handling call
0810 11:30:37.315820 (+3747341us) ts_tablet_manager.cc:1145] Deleting tablet 725d2e70e1d441b497d56a278e1de0ad
0810 11:30:37.315831 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.320647 (+ 4816us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3746739}
W20260810 11:30:37.329027 27288 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 725d2e70e1d441b497d56a278e1de0ad because the tablet was not found. No further retry: Not found: Tablet not found: 725d2e70e1d441b497d56a278e1de0ad
I20260810 11:30:37.329135 27231 raft_consensus.cc:348] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.332686 27231 raft_consensus.cc:374] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.332809 27231 raft_consensus.cc:729] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.333189 27231 consensus_queue.cc:260] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.334172 27231 ts_tablet_manager.cc:1428] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260810 11:30:37.334465 27231 tablet_bootstrap.cc:492] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:37.340034 27231 tablet_bootstrap.cc:654] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.347244 28346 tablet_loader.cc:96] loaded metadata for tablet 34ed8c9efa634fc7b091b1bb6bc6d452 (table default.Table_fd64c13d7a514c7285b42e1c91a63cdf [id=7c8348b49b664bee8d8243efb2cdbb79])
I20260810 11:30:37.349099 28346 tablet_loader.cc:96] loaded metadata for tablet 3604b43dcdfc469db476f3d0e2f900bb (table default.Table_7d84624ac4e94437acb400decf3bb21b [id=0f6c3eaa5abb4fc5a07a723ed77c2e35])
I20260810 11:30:37.350178 28346 tablet_loader.cc:96] loaded metadata for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7])
I20260810 11:30:37.351032 28346 tablet_loader.cc:96] loaded metadata for tablet 37cecd4266eb47669e7fd5cfeb847adc (table default.Table_7c178d343d8246599a00f6d1c602a818 [id=0e39402016b54f588ea123ee4ea9788a])
I20260810 11:30:37.352669 28346 tablet_loader.cc:96] loaded metadata for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_56b4699099fd417496e71ccbed272638 [id=72829be151bc48dba287b32c7028caf7])
I20260810 11:30:37.352761 27999 raft_consensus.cc:2258] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:37.317224 27974 rpcz_store.cc:276] 0810 11:30:33.047805 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.047908 (+ 103us) service_pool.cc:227] Handling call
0810 11:30:37.302111 (+4254203us) ts_tablet_manager.cc:1145] Deleting tablet 809b5b6b65d244cd9186517e39494839
0810 11:30:37.302337 (+ 226us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.313237 (+ 10900us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4253591}
I20260810 11:30:37.353916 27222 raft_consensus.cc:374] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.354108 27222 raft_consensus.cc:729] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.354302 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 212) took 4306 ms. Trace:
I20260810 11:30:37.354485 27974 rpcz_store.cc:276] 0810 11:30:33.048161 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.048663 (+ 502us) service_pool.cc:227] Handling call
0810 11:30:37.354046 (+4305383us) ts_tablet_manager.cc:1145] Deleting tablet eb51618d37ac488fa7e3d23e5f85ec36
0810 11:30:37.354067 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.354186 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4304992}
I20260810 11:30:37.354502 27222 consensus_queue.cc:260] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.354904 27974 tablet_replica.cc:330] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:37.323896 28640 raft_consensus.cc:482] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:37.353783 27228 tablet_bootstrap.cc:654] T 94bcb1739e5144559201479b82c07941 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.355327 27222 ts_tablet_manager.cc:1428] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.058s user 0.002s sys 0.000s
I20260810 11:30:37.355114 28640 raft_consensus.cc:504] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.355800 27222 tablet_bootstrap.cc:492] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:37.355882 28640 leader_election.cc:288] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:37.353521 27999 ts_tablet_manager.cc:1905] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:37.357098 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 809b5b6b65d244cd9186517e39494839 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 809b5b6b65d244cd9186517e39494839 already in progress: creating tablet
W20260810 11:30:37.357411 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet eb51618d37ac488fa7e3d23e5f85ec36 because the tablet was not found. No further retry: Not found: Tablet not found: eb51618d37ac488fa7e3d23e5f85ec36
W20260810 11:30:37.361862 26702 leader_election.cc:341] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 834c9c99ec424bb39e8a003e9204b2bc
I20260810 11:30:37.363198 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c9c99ec424bb39e8a003e9204b2bc" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:37.363463 26912 raft_consensus.cc:2454] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:37.365237 26700 leader_election.cc:302] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:37.365932 28640 raft_consensus.cc:2781] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:37.366161 28640 raft_consensus.cc:482] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:37.366288 28640 raft_consensus.cc:3037] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.367760 28588 consensus_queue.cc:1035] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:37.369719 27974 raft_consensus.cc:2229] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:37.370569 27974 raft_consensus.cc:2258] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:37.371336 27974 ts_tablet_manager.cc:1905] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:37.377061 28640 raft_consensus.cc:504] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.378633 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c9c99ec424bb39e8a003e9204b2bc" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:37.378924 26912 raft_consensus.cc:3037] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.382627 26912 raft_consensus.cc:2454] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:37.383622 26700 leader_election.cc:302] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:37.384100 28555 raft_consensus.cc:2781] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:37.384325 28555 raft_consensus.cc:686] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:37.384661 28555 consensus_queue.cc:237] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.385797 28640 leader_election.cc:288] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:37.387450 26702 leader_election.cc:341] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 834c9c99ec424bb39e8a003e9204b2bc
I20260810 11:30:37.397033 27999 ts_tablet_manager.cc:1918] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:37.397303 27999 log.cc:1196] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/31cafb7c691d40a48a40f7d4190c4f8d
I20260810 11:30:37.397876 27999 ts_tablet_manager.cc:1939] T 31cafb7c691d40a48a40f7d4190c4f8d P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:37.401932 28651 raft_consensus.cc:482] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:37.402134 28651 raft_consensus.cc:504] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.402837 28651 leader_election.cc:288] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:37.403299 27222 tablet_bootstrap.cc:654] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.403831 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ada1df82eb44ecb9a6c615b5410e6f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:37.404538 26991 leader_election.cc:341] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:37.407271 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 97) took 10854 ms. Trace:
I20260810 11:30:37.411935 27999 rpcz_store.cc:276] 0810 11:30:26.552354 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.552426 (+ 72us) service_pool.cc:227] Handling call
0810 11:30:37.298851 (+10746425us) ts_tablet_manager.cc:1145] Deleting tablet 31cafb7c691d40a48a40f7d4190c4f8d
0810 11:30:37.298866 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.365692 (+ 66826us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.396890 (+ 31198us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.407243 (+ 10353us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10727756}
I20260810 11:30:37.412645 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 90) took 10863 ms. Trace:
I20260810 11:30:37.412755 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 31cafb7c691d40a48a40f7d4190c4f8d (table default.Table_891d3f4e3019401fbb1b13496065cb5c [id=7213c582179a43c1b80901a2266e5477]) successfully deleted
I20260810 11:30:37.415072 27999 rpcz_store.cc:276] 0810 11:30:26.549649 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.549910 (+ 261us) service_pool.cc:227] Handling call
0810 11:30:37.412495 (+10862585us) ts_tablet_manager.cc:1145] Deleting tablet 4b15cc8669b549a2b4461dccd66a0c5a
0810 11:30:37.412509 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.412623 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10841254}
I20260810 11:30:37.414779 28346 tablet_loader.cc:96] loaded metadata for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea])
I20260810 11:30:37.417464 27228 tablet_bootstrap.cc:492] T 94bcb1739e5144559201479b82c07941 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:37.418068 27999 tablet_replica.cc:330] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:37.418118 27228 ts_tablet_manager.cc:1397] T 94bcb1739e5144559201479b82c07941 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.112s user 0.006s sys 0.004s
I20260810 11:30:37.418422 27999 raft_consensus.cc:2229] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
W20260810 11:30:37.418428 27286 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 4b15cc8669b549a2b4461dccd66a0c5a because the tablet was not found. No further retry: Not found: Tablet not found: 4b15cc8669b549a2b4461dccd66a0c5a
I20260810 11:30:37.419250 27999 raft_consensus.cc:2258] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:37.421783 28346 tablet_loader.cc:96] loaded metadata for tablet 3a0284718f694a0591888e81357721b0 (table default.Table_ddaa0e35d54b49c894cbf994bb7fbbab [id=ed36f07f53e04f308770145b0d7435ac])
I20260810 11:30:37.419713 27228 raft_consensus.cc:348] T 94bcb1739e5144559201479b82c07941 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.424763 27228 raft_consensus.cc:374] T 94bcb1739e5144559201479b82c07941 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.425026 27228 raft_consensus.cc:729] T 94bcb1739e5144559201479b82c07941 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.425537 27999 ts_tablet_manager.cc:1905] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:37.425766 27228 consensus_queue.cc:260] T 94bcb1739e5144559201479b82c07941 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.428511 27228 ts_tablet_manager.cc:1428] T 94bcb1739e5144559201479b82c07941 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.010s user 0.002s sys 0.001s
I20260810 11:30:37.427624 28346 tablet_loader.cc:96] loaded metadata for tablet 3a1e46f80f7f4e3a84638421892e6236 (table default.Table_49be430f1e8f475482b54850772c0430 [id=82e113439bc04ce9955f59612ba480dc])
I20260810 11:30:37.430378 27228 tablet_bootstrap.cc:492] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:37.430949 28651 raft_consensus.cc:2726] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:37.431612 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 178647us
I20260810 11:30:37.432827 27231 tablet_bootstrap.cc:492] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:37.433969 27231 ts_tablet_manager.cc:1397] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.100s user 0.006s sys 0.004s
I20260810 11:30:37.435096 27231 raft_consensus.cc:348] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.435318 27231 raft_consensus.cc:374] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.435379 27231 raft_consensus.cc:729] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.435592 27231 consensus_queue.cc:260] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.436179 27231 ts_tablet_manager.cc:1428] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 11:30:37.440492 27222 tablet_bootstrap.cc:492] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:37.440806 27231 tablet_bootstrap.cc:492] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:37.443651 27222 ts_tablet_manager.cc:1397] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.085s user 0.005s sys 0.001s
I20260810 11:30:37.444438 27974 ts_tablet_manager.cc:1918] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:37.445101 27222 raft_consensus.cc:348] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.445502 27222 raft_consensus.cc:374] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.446123 27222 raft_consensus.cc:729] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.446560 27974 log.cc:1196] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/0118ff9d21924aefa8c6c32977c10453
I20260810 11:30:37.448273 27231 tablet_bootstrap.cc:654] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.449057 28346 tablet_loader.cc:96] loaded metadata for tablet 3ccef06fa06c4c519d8760fa948d6c8b (table default.Table_abbbb80ecbe4491d98912dcdcaab5dd3 [id=ba999b4084c84b2f8e0313b96849b169])
I20260810 11:30:37.449260 28651 raft_consensus.cc:482] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:37.449402 28651 raft_consensus.cc:504] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.449903 27974 ts_tablet_manager.cc:1939] T 0118ff9d21924aefa8c6c32977c10453 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:37.450026 28651 leader_election.cc:288] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:37.450117 26849 consensus_peers.cc:487] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:37.450870 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 216) took 4376 ms. Trace:
I20260810 11:30:37.450841 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37cecd4266eb47669e7fd5cfeb847adc" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:37.451053 26912 raft_consensus.cc:2454] T 37cecd4266eb47669e7fd5cfeb847adc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:37.451108 27974 rpcz_store.cc:276] 0810 11:30:33.074215 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.074460 (+ 245us) service_pool.cc:227] Handling call
0810 11:30:37.354799 (+4280339us) ts_tablet_manager.cc:1145] Deleting tablet 0118ff9d21924aefa8c6c32977c10453
0810 11:30:37.354810 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.396990 (+ 42180us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.433051 (+ 36061us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.450832 (+ 17781us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14466,"tablet-delete.queue_time_us":4279541}
I20260810 11:30:37.451738 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 213) took 4389 ms. Trace:
I20260810 11:30:37.451977 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 0118ff9d21924aefa8c6c32977c10453 (table default.Table_9f14d3d9ba454257a07c6eb8b0ead5e6 [id=737e0806636e4c8ca0307a46408cbdec]) successfully deleted
I20260810 11:30:37.452026 27974 rpcz_store.cc:276] 0810 11:30:33.062375 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.067777 (+ 5402us) service_pool.cc:227] Handling call
0810 11:30:37.451462 (+4383685us) ts_tablet_manager.cc:1145] Deleting tablet 49db12565dbc4187b78a98ed35c40fed
0810 11:30:37.451475 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.451651 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4357574}
I20260810 11:30:37.452461 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 214) took 4378 ms. Trace:
I20260810 11:30:37.446580 27222 consensus_queue.cc:260] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:37.452756 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 49db12565dbc4187b78a98ed35c40fed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49db12565dbc4187b78a98ed35c40fed already in progress: creating tablet
I20260810 11:30:37.447495 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ada1df82eb44ecb9a6c615b5410e6f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:37.453147 27222 ts_tablet_manager.cc:1428] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.009s user 0.002s sys 0.001s
I20260810 11:30:37.453621 26991 leader_election.cc:302] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:37.453989 28651 raft_consensus.cc:2781] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:37.454079 28651 raft_consensus.cc:482] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:37.454144 28651 raft_consensus.cc:3037] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.455084 27228 tablet_bootstrap.cc:654] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.456358 28346 tablet_loader.cc:96] loaded metadata for tablet 3ddb6e67c316416681074e454ab9b01e (table default.Table_1e1ca07e9c824349af23675b66b77321 [id=755202f095f04307a11ce87087df835c])
I20260810 11:30:37.457193 28346 tablet_loader.cc:96] loaded metadata for tablet 40f5eecfc66a4711aef60c1a2bff6b97 (table default.Table_3efc57bdbafc46dfab4d324acb0d5f73 [id=bcba186b6e93492fb06f70e033be3296])
I20260810 11:30:37.457736 28651 raft_consensus.cc:504] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.458871 28346 tablet_loader.cc:96] loaded metadata for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599])
I20260810 11:30:37.459100 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37cecd4266eb47669e7fd5cfeb847adc" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:37.459347 26912 raft_consensus.cc:3037] T 37cecd4266eb47669e7fd5cfeb847adc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.462584 26912 raft_consensus.cc:2454] T 37cecd4266eb47669e7fd5cfeb847adc P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:37.463565 26991 leader_election.cc:302] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:37.463871 28660 raft_consensus.cc:2781] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:37.463985 28660 raft_consensus.cc:686] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:37.464259 28660 consensus_queue.cc:237] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.466014 27222 tablet_bootstrap.cc:492] T 39beb126ac324842b7e387c46bcb4099 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:37.468918 27222 tablet_bootstrap.cc:654] T 39beb126ac324842b7e387c46bcb4099 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.469430 28651 leader_election.cc:288] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:37.470721 27974 rpcz_store.cc:276] 0810 11:30:33.073550 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.073677 (+ 127us) service_pool.cc:227] Handling call
0810 11:30:37.452269 (+4378592us) ts_tablet_manager.cc:1145] Deleting tablet f6e264e8507446809f3c386fdb3c34ae
0810 11:30:37.452279 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.452354 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4357986}
W20260810 11:30:37.471364 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet f6e264e8507446809f3c386fdb3c34ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6e264e8507446809f3c386fdb3c34ae already in progress: creating tablet
I20260810 11:30:37.475458 27974 tablet_replica.cc:330] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:37.476608 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318d5b8453fe4c438d0fa32cb91c409e" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:37.477005 27058 raft_consensus.cc:2454] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:37.480810 28346 tablet_loader.cc:96] loaded metadata for tablet 490ada0a918d48c3a07e12eed58bda19 (table default.Table_ba61129cdf35481dbf06effd223949f6 [id=e20f1c45c6d743cba2c3cc60c78186a4])
I20260810 11:30:37.480126 27974 raft_consensus.cc:2229] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:37.481194 27974 raft_consensus.cc:2258] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:37.481810 28346 tablet_loader.cc:96] loaded metadata for tablet 499be709844f4a2cbc88e55dd628f985 (table default.Table_711dc900ac3b45b8897cd1fbc2964dec [id=5e0aa4c382c24a7d9380bec9f8a50ad7])
I20260810 11:30:37.479774 27222 tablet_bootstrap.cc:492] T 39beb126ac324842b7e387c46bcb4099 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:37.482667 27222 ts_tablet_manager.cc:1397] T 39beb126ac324842b7e387c46bcb4099 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.005s
I20260810 11:30:37.483659 27228 tablet_bootstrap.cc:492] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:37.483821 27228 ts_tablet_manager.cc:1397] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.054s user 0.004s sys 0.003s
I20260810 11:30:37.484129 27974 ts_tablet_manager.cc:1905] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:37.485018 27228 raft_consensus.cc:348] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.485244 27228 raft_consensus.cc:374] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.485304 27228 raft_consensus.cc:729] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.485576 27228 consensus_queue.cc:260] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.486230 27228 ts_tablet_manager.cc:1428] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 11:30:37.486546 27228 tablet_bootstrap.cc:492] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:37.486716 27222 raft_consensus.cc:348] T 39beb126ac324842b7e387c46bcb4099 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.489166 28346 tablet_loader.cc:96] loaded metadata for tablet 4efa31ad2ce8436b9638e6759d9b5421 (table default.Table_f3567f07068942e9a5d42f9877f39bb7 [id=c557d3488f464c5bbff89fd13e52b02a])
I20260810 11:30:37.493456 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37cecd4266eb47669e7fd5cfeb847adc" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:37.494866 27231 tablet_bootstrap.cc:492] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:37.495035 27231 ts_tablet_manager.cc:1397] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.059s user 0.005s sys 0.000s
I20260810 11:30:37.495178 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37cecd4266eb47669e7fd5cfeb847adc" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:37.496096 26848 leader_election.cc:302] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:37.496250 27231 raft_consensus.cc:348] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.496474 27231 raft_consensus.cc:374] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.496490 28586 raft_consensus.cc:2781] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:37.496543 27231 raft_consensus.cc:729] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.496594 28586 raft_consensus.cc:482] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:37.496662 28586 raft_consensus.cc:3037] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.496778 27231 consensus_queue.cc:260] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.497344 27231 ts_tablet_manager.cc:1428] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 11:30:37.497653 27231 tablet_bootstrap.cc:492] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:37.498966 27228 tablet_bootstrap.cc:654] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.499159 27231 tablet_bootstrap.cc:654] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.500236 28586 raft_consensus.cc:504] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.501297 28346 tablet_loader.cc:96] loaded metadata for tablet 501defb075d142ec8b22e5e8236a009c (table default.Table_a48c8668e73f4919a9c32c9c3e95f485 [id=46bda36574e1430dbada751ccf16703c])
I20260810 11:30:37.502290 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318d5b8453fe4c438d0fa32cb91c409e" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:37.503293 28346 tablet_loader.cc:96] loaded metadata for tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae])
W20260810 11:30:37.503450 26849 leader_election.cc:341] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:37.503816 28586 leader_election.cc:288] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:37.507709 26848 consensus_peers.cc:487] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2801709d53614916abac370f7ae5e913. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:37.508416 28586 consensus_queue.cc:1035] T fc023d51790042ce978eb53a2979e29c P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:37.509929 28346 tablet_loader.cc:96] loaded metadata for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070])
I20260810 11:30:37.510408 28346 tablet_loader.cc:96] loaded metadata for tablet 5409c96c1949416e85cfcaa8f2f61227 (table default.Table_da82b7e264034027b41209e3a8be8903 [id=d7ee651e98084bd798d76ecf28546e83])
I20260810 11:30:37.511575 28346 tablet_loader.cc:96] loaded metadata for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a])
I20260810 11:30:37.512146 28346 tablet_loader.cc:96] loaded metadata for tablet 5a2e1b54043444989ac64c87f30ffc07 (table default.Table_341bf544f7b94ef2ba94afc342f8bc1f [id=193e8263e8a54ee798e1d4406074a52f])
W20260810 11:30:37.512619 26848 consensus_peers.cc:487] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96cae4eb16c84410926a317af70e44f7. This is attempt 6: this message will repeat every 5th retry.
W20260810 11:30:37.519017 26993 leader_election.cc:341] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:37.525837 26993 leader_election.cc:302] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:37.526328 28651 raft_consensus.cc:2726] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:37.526899 26993 leader_election.cc:341] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:37.530155 27974 ts_tablet_manager.cc:1918] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:37.530325 27974 log.cc:1196] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/0033d61d07d84262a98b0ebc54bd7960
I20260810 11:30:37.530824 27974 ts_tablet_manager.cc:1939] T 0033d61d07d84262a98b0ebc54bd7960 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
W20260810 11:30:37.531234 26993 leader_election.cc:341] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:37.531795 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 215) took 4458 ms. Trace:
I20260810 11:30:37.531922 27974 rpcz_store.cc:276] 0810 11:30:33.073865 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.074011 (+ 146us) service_pool.cc:227] Handling call
0810 11:30:37.475375 (+4401364us) ts_tablet_manager.cc:1145] Deleting tablet 0033d61d07d84262a98b0ebc54bd7960
0810 11:30:37.475389 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.504403 (+ 29014us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.529994 (+ 25591us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.531770 (+ 1776us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4380657}
I20260810 11:30:37.532335 27974 tablet_replica.cc:330] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:37.532738 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 0033d61d07d84262a98b0ebc54bd7960 (table default.Table_c6cf8c999ed14a31aff5a1de22594c1f [id=0e600e92a46f45629433aa68978a93d7]) successfully deleted
I20260810 11:30:37.533464 28346 tablet_loader.cc:96] loaded metadata for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14])
I20260810 11:30:37.537469 28346 tablet_loader.cc:96] loaded metadata for tablet 5ea85f89d7a64080a66f1251cd038039 (table default.Table_84fd493f2b9e4a46aa2035a43a9069a1 [id=773fafc7914a45dabad64680fc3a4a27])
I20260810 11:30:37.538021 27999 ts_tablet_manager.cc:1918] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:37.538137 28346 tablet_loader.cc:96] loaded metadata for tablet 5eb3dd7bd54c485d9ea0c2186f799d0f (table default.Table_4eef50b9dbea413f91b6b6a35c997283 [id=6eb74fbbf5db4f2f8434c3c9a83188b7])
I20260810 11:30:37.538697 28346 tablet_loader.cc:96] loaded metadata for tablet 5eff8ccaa3ad4187aa00c33abd7131ae (table default.Table_8589a61b5c4e42c0a92a80a3576db8ac [id=0d2a77edfa664f679468b8b3cac2d9ee])
I20260810 11:30:37.538882 27231 tablet_bootstrap.cc:492] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:37.540053 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318d5b8453fe4c438d0fa32cb91c409e" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:37.540313 27058 raft_consensus.cc:3037] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.541127 27231 ts_tablet_manager.cc:1397] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.003s
I20260810 11:30:37.541621 28346 tablet_loader.cc:96] loaded metadata for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219])
I20260810 11:30:37.542622 28346 tablet_loader.cc:96] loaded metadata for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_f3f00d1fa4db4cd4bbaaeefeef68897d [id=4cda0e139cc34db8ae99e56a074f5557])
I20260810 11:30:37.543267 28346 tablet_loader.cc:96] loaded metadata for tablet 6926d0dc68fa48ae8ffabf5b5272b3d0 (table default.Table_96d4976d4de649c4a98910a1b7fd1b59 [id=777f92ce815f4314898abce665fec1eb])
I20260810 11:30:37.543257 27058 raft_consensus.cc:2454] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:37.544451 28346 tablet_loader.cc:96] loaded metadata for tablet 6c5b650bc02f4fa393bada5b54c77f1f (table default.Table_afde78ad5bfa4a23828df391f669e7fa [id=3d8c46d7a15e457a93fd615ad99a4f36])
I20260810 11:30:37.532544 27974 raft_consensus.cc:2229] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:37.545145 27974 raft_consensus.cc:2258] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:37.548247 27974 ts_tablet_manager.cc:1905] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:37.549024 27231 raft_consensus.cc:348] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.551286 27231 raft_consensus.cc:374] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.551738 27231 raft_consensus.cc:729] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.552630 28346 tablet_loader.cc:96] loaded metadata for tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05])
I20260810 11:30:37.552858 27231 consensus_queue.cc:260] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.555784 27231 ts_tablet_manager.cc:1428] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.014s user 0.000s sys 0.004s
I20260810 11:30:37.556766 27231 tablet_bootstrap.cc:492] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:37.557612 28346 tablet_loader.cc:96] loaded metadata for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4])
I20260810 11:30:37.540516 27228 tablet_bootstrap.cc:492] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:37.562614 26848 leader_election.cc:302] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:37.564462 27228 ts_tablet_manager.cc:1397] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.078s user 0.010s sys 0.004s
W20260810 11:30:37.564836 26848 consensus_peers.cc:487] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ac4b1821ac30452cbe7a8f844d9b37e5. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:37.565186 28591 raft_consensus.cc:2781] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:37.565464 28591 raft_consensus.cc:686] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:37.565605 27228 raft_consensus.cc:348] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.565693 28591 consensus_queue.cc:237] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.565886 27228 raft_consensus.cc:374] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.565939 27228 raft_consensus.cc:729] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.564989 27231 tablet_bootstrap.cc:654] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.566095 27228 consensus_queue.cc:260] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.566661 27228 ts_tablet_manager.cc:1428] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 11:30:37.567543 27228 tablet_bootstrap.cc:492] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:37.573431 27228 tablet_bootstrap.cc:654] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.578649 27999 log.cc:1196] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/bb0357271cfd46478867a3cc0660bcdc
I20260810 11:30:37.581879 28640 raft_consensus.cc:482] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6079090b1124d84aa4477974bb53700)
I20260810 11:30:37.582091 28640 raft_consensus.cc:504] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:37.583055 28640 leader_election.cc:288] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:37.584709 28660 consensus_queue.cc:1035] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:37.585088 26702 leader_election.cc:341] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 43e42cc642544f779bb79cee7479c4f4
W20260810 11:30:37.585438 26700 leader_election.cc:341] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 43e42cc642544f779bb79cee7479c4f4
I20260810 11:30:37.585561 26700 leader_election.cc:302] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:37.586179 28640 raft_consensus.cc:2726] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:37.590665 28346 tablet_loader.cc:96] loaded metadata for tablet 713663be70014b17b17056a865e7db63 (table default.Table_12d15f4d2bd3426788aadc76beeff465 [id=ec7fc14fabfd4c83adcb3ea82f0087e8])
I20260810 11:30:37.591964 28346 tablet_loader.cc:96] loaded metadata for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e])
I20260810 11:30:37.593144 27231 tablet_bootstrap.cc:492] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:37.593652 27231 ts_tablet_manager.cc:1397] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.037s user 0.010s sys 0.002s
I20260810 11:30:37.595295 28346 tablet_loader.cc:96] loaded metadata for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8])
I20260810 11:30:37.601744 28346 tablet_loader.cc:96] loaded metadata for tablet 728f273a89cd48f8bf0d8616645f5eed (table default.Table_9a25589f61c844cab9a7d2db84a7eba2 [id=744c7bf0857b476cabce9efa16d7d885])
I20260810 11:30:37.602039 28640 raft_consensus.cc:482] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:37.602229 28640 raft_consensus.cc:504] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.602929 28640 leader_election.cc:288] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:37.603382 27999 ts_tablet_manager.cc:1939] T bb0357271cfd46478867a3cc0660bcdc P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:37.604388 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 93) took 11052 ms. Trace:
I20260810 11:30:37.606328 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94bcb1739e5144559201479b82c07941" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:37.606652 27058 raft_consensus.cc:2454] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:37.607146 26702 leader_election.cc:302] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:37.607594 28640 raft_consensus.cc:2781] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:37.607721 28640 raft_consensus.cc:482] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:37.607822 28640 raft_consensus.cc:3037] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.607362 27231 raft_consensus.cc:348] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.608217 27231 raft_consensus.cc:374] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.608385 27231 raft_consensus.cc:729] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.608994 27231 consensus_queue.cc:260] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.610999 28640 raft_consensus.cc:504] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.612605 28640 leader_election.cc:288] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:37.612531 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94bcb1739e5144559201479b82c07941" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:37.612771 27055 raft_consensus.cc:3037] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.615609 28346 tablet_loader.cc:96] loaded metadata for tablet 72e0b69e7c7e4343b309d16c030d4306 (table default.Table_c32d1cb0b9e744fbacbd00c8736fad21 [id=f54b49f28880453aa7bc67b9c36a219b])
I20260810 11:30:37.616294 27055 raft_consensus.cc:2454] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:37.616840 26702 leader_election.cc:302] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:37.617189 28640 raft_consensus.cc:2781] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:37.617847 28640 raft_consensus.cc:686] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:37.618186 28640 consensus_queue.cc:237] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.619990 27231 ts_tablet_manager.cc:1428] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.026s user 0.002s sys 0.002s
I20260810 11:30:37.621274 28346 tablet_loader.cc:96] loaded metadata for tablet 750950c424184d08bf6777774db3a0b2 (table default.Table_9eee8b010360415faceef1c43fea61d9 [id=41dfd71fd24040a392812bca04e2baf6])
I20260810 11:30:37.621367 27231 tablet_bootstrap.cc:492] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:37.622490 28346 tablet_loader.cc:96] loaded metadata for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e])
I20260810 11:30:37.623008 27974 ts_tablet_manager.cc:1918] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:37.623579 27974 log.cc:1196] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/eb9394f9ca2c44de93354e23973cf902
I20260810 11:30:37.624073 28346 tablet_loader.cc:96] loaded metadata for tablet 77f0c916ccf24e86b0ec29de1ba54b84 (table default.Table_bbae9d833ed04fc89a867eb497163403 [id=822d8386d19c4a2bb83cc63fbc186792])
I20260810 11:30:37.624734 27974 ts_tablet_manager.cc:1939] T eb9394f9ca2c44de93354e23973cf902 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:37.630532 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 218) took 4538 ms. Trace:
I20260810 11:30:37.631196 28346 tablet_loader.cc:96] loaded metadata for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_10b2af8299224f5db4a63bd1fae61155 [id=6a421de2b28a46088fd0bad429a52bad])
I20260810 11:30:37.632342 28346 tablet_loader.cc:96] loaded metadata for tablet 78633fbe048b4534ae3277ce6b7c4313 (table default.Table_6e9cd3888b17405bad2475ba3da34507 [id=ae57f634bfef4952bb4e0a170d67fbdb])
I20260810 11:30:37.633903 28346 tablet_loader.cc:96] loaded metadata for tablet 7acf847a1fd74ccc89b5bffe1bbb76f3 (table default.Table_2d6c3a53213a458aaee6bd445240041c [id=097ff3abe81b415799933e50feab6c39])
I20260810 11:30:37.635088 27974 rpcz_store.cc:276] 0810 11:30:33.091981 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.092072 (+ 91us) service_pool.cc:227] Handling call
0810 11:30:37.532280 (+4440208us) ts_tablet_manager.cc:1145] Deleting tablet eb9394f9ca2c44de93354e23973cf902
0810 11:30:37.532295 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.589652 (+ 57357us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.622884 (+ 33232us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.630471 (+ 7587us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4435070}
I20260810 11:30:37.637180 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet eb9394f9ca2c44de93354e23973cf902 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]) successfully deleted
I20260810 11:30:37.638351 28346 tablet_loader.cc:96] loaded metadata for tablet 7c9e437989e54e459f74b49617dabf52 (table default.Table_e91c3002bfab499aad3c1d686b4f4437 [id=5f8a0b38bb0d428c8bf6253bfbf40650])
I20260810 11:30:37.639060 28346 tablet_loader.cc:96] loaded metadata for tablet 7cd4f555b5d840c182a31b3c94da9619 (table default.Table_061b7dfbcc074ad6a0d99d49113a354f [id=0186ddbf3c144b4e86ae21cbdac555d2])
I20260810 11:30:37.640645 28346 tablet_loader.cc:96] loaded metadata for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5])
I20260810 11:30:37.642079 28346 tablet_loader.cc:96] loaded metadata for tablet 7de2d60cf87c48459e6663a68ac96714 (table default.Table_53285a0af75e4705982c23850f7b27e2 [id=d58840daecc84b789f04a35ca6cd8393])
I20260810 11:30:37.644701 28346 tablet_loader.cc:96] loaded metadata for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d])
I20260810 11:30:37.649240 26762 raft_consensus.cc:3037] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.606276 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94bcb1739e5144559201479b82c07941" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:37.653301 26914 raft_consensus.cc:2454] T 94bcb1739e5144559201479b82c07941 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:37.612534 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94bcb1739e5144559201479b82c07941" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:37.653625 26915 raft_consensus.cc:3037] T 94bcb1739e5144559201479b82c07941 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.636435 28345 consensus_queue.cc:1035] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:37.655128 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 219) took 4562 ms. Trace:
I20260810 11:30:37.655273 27974 rpcz_store.cc:276] 0810 11:30:33.092549 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.092628 (+ 79us) service_pool.cc:227] Handling call
0810 11:30:37.654941 (+4562313us) ts_tablet_manager.cc:1145] Deleting tablet 3ae27bf110114b70a3e3f6cf64f31b98
0810 11:30:37.654963 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.655100 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4539385}
I20260810 11:30:37.655659 27974 tablet_replica.cc:330] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:37.655889 27974 raft_consensus.cc:2229] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:37.655856 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 3ae27bf110114b70a3e3f6cf64f31b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae27bf110114b70a3e3f6cf64f31b98 already in progress: creating tablet
I20260810 11:30:37.656085 27974 raft_consensus.cc:2258] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:37.653200 27999 rpcz_store.cc:276] 0810 11:30:26.551982 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.553076 (+ 1094us) service_pool.cc:227] Handling call
0810 11:30:37.418001 (+10864925us) ts_tablet_manager.cc:1145] Deleting tablet bb0357271cfd46478867a3cc0660bcdc
0810 11:30:37.418014 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.479358 (+ 61344us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.537893 (+ 58535us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.604364 (+ 66471us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10846469}
I20260810 11:30:37.656952 27974 ts_tablet_manager.cc:1905] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:37.657727 26915 raft_consensus.cc:2454] T 94bcb1739e5144559201479b82c07941 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:37.658080 27222 raft_consensus.cc:374] T 39beb126ac324842b7e387c46bcb4099 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.658172 27222 raft_consensus.cc:729] T 39beb126ac324842b7e387c46bcb4099 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.658315 28646 raft_consensus.cc:482] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:37.648720 28588 consensus_queue.cc:1035] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:37.658456 28646 raft_consensus.cc:504] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.658433 27222 consensus_queue.cc:260] T 39beb126ac324842b7e387c46bcb4099 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.659276 28646 leader_election.cc:288] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:37.659531 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet bb0357271cfd46478867a3cc0660bcdc (table default.Table_23889fedecbf43c09cf2ab7717d5801b [id=ea4def2ac652452aaca61214b2d04cc6]) successfully deleted
I20260810 11:30:37.660002 28588 consensus_queue.cc:1035] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:37.660791 28660 consensus_queue.cc:1035] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:37.662731 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3851d39aeb3142938a5ac558ab438c21" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:37.664247 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3851d39aeb3142938a5ac558ab438c21" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:37.664513 26915 raft_consensus.cc:2454] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:37.665541 26700 leader_election.cc:302] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:37.665854 28646 raft_consensus.cc:2781] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 11:30:37.665951 28646 raft_consensus.cc:482] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:37.666023 28646 raft_consensus.cc:3037] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:37.671968 27222 ts_tablet_manager.cc:1428] T 39beb126ac324842b7e387c46bcb4099 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.189s user 0.020s sys 0.004s
I20260810 11:30:37.672950 27222 tablet_bootstrap.cc:492] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:37.675861 27222 tablet_bootstrap.cc:654] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.676470 27228 tablet_bootstrap.cc:492] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:37.676702 27228 ts_tablet_manager.cc:1397] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.109s user 0.021s sys 0.005s
I20260810 11:30:37.677599 27228 raft_consensus.cc:348] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.677912 27228 raft_consensus.cc:374] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.677981 27228 raft_consensus.cc:729] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.678200 27228 consensus_queue.cc:260] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.678885 27228 ts_tablet_manager.cc:1428] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 11:30:37.679776 28660 consensus_queue.cc:1035] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:37.675943 28646 raft_consensus.cc:504] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.691051 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3851d39aeb3142938a5ac558ab438c21" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:37.690565 28646 leader_election.cc:288] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:37.691603 26762 raft_consensus.cc:1226] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [term 2 FOLLOWER]: Rejecting Update request from peer 482e605580be48cbbacce05a3e61c215 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260810 11:30:37.692936 28346 tablet_loader.cc:96] loaded metadata for tablet 82de53efa73447fe84e70dbb11a16a5f (table default.Table_67580ad3fe7a47d6a051e7da7005c171 [id=5ae9efa77fb54cf58ff2a1662eee03f7])
I20260810 11:30:37.695436 28346 tablet_loader.cc:96] loaded metadata for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655])
I20260810 11:30:37.696854 28660 consensus_queue.cc:1046] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:37.697566 28651 raft_consensus.cc:3032] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 11:30:37.697714 28651 raft_consensus.cc:729] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:37.698171 28651 consensus_queue.cc:260] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.699108 28651 raft_consensus.cc:3037] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:37.704713 28346 tablet_loader.cc:96] loaded metadata for tablet 8400c601e9894ea9b68679f6d7927456 (table default.Table_ce10a5f4bedc411da7e7089a730e9cc8 [id=807b3a26a49f446797962bb532b4c58e])
I20260810 11:30:37.706451 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3851d39aeb3142938a5ac558ab438c21" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:37.706753 26915 raft_consensus.cc:3037] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:37.706949 27228 tablet_bootstrap.cc:492] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:37.708505 28588 consensus_queue.cc:1035] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:37.706451 27999 tablet_replica.cc:330] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:37.709174 27228 tablet_bootstrap.cc:654] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.709537 27999 raft_consensus.cc:2229] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:37.710172 26915 raft_consensus.cc:2454] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 2.
I20260810 11:30:37.710992 26700 leader_election.cc:302] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:37.711645 28646 raft_consensus.cc:2781] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [term 2 FOLLOWER]: Leader election won for term 2
I20260810 11:30:37.711840 28646 raft_consensus.cc:686] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [term 2 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:37.712251 28646 consensus_queue.cc:237] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.713068 27999 pending_rounds.cc:62] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700: Trying to abort 1 pending ops.
I20260810 11:30:37.713263 27999 pending_rounds.cc:68] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936385379848192 op_type: NO_OP noop_request { }
I20260810 11:30:37.714524 27999 raft_consensus.cc:2866] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:37.717862 27999 raft_consensus.cc:2258] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:37.722978 28345 raft_consensus.cc:482] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:37.723147 28345 raft_consensus.cc:504] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.723806 28345 leader_election.cc:288] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:37.726253 28345 raft_consensus.cc:482] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:37.726403 28345 raft_consensus.cc:504] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:37.727010 28345 leader_election.cc:288] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:37.728775 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ada1df82eb44ecb9a6c615b5410e6f" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:37.729019 27059 raft_consensus.cc:2454] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
W20260810 11:30:37.729552 26849 leader_election.cc:341] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: a7a2cb1d2e8e40f58144908e34438d53
I20260810 11:30:37.729950 27228 tablet_bootstrap.cc:492] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:37.730093 27228 ts_tablet_manager.cc:1397] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.004s
I20260810 11:30:37.726018 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ada1df82eb44ecb9a6c615b5410e6f" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:37.731139 26849 leader_election.cc:341] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:37.731062 27228 raft_consensus.cc:348] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.731388 27228 raft_consensus.cc:374] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.731465 27228 raft_consensus.cc:729] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.732470 26848 leader_election.cc:302] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:37.732960 28345 raft_consensus.cc:2781] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:37.733047 28345 raft_consensus.cc:482] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:37.733120 28345 raft_consensus.cc:3037] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.733322 27999 ts_tablet_manager.cc:1905] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:37.735872 28345 raft_consensus.cc:504] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.737005 28345 leader_election.cc:288] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:37.737912 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ada1df82eb44ecb9a6c615b5410e6f" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
W20260810 11:30:37.738548 26849 leader_election.cc:341] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:37.740801 27228 consensus_queue.cc:260] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.741416 28346 tablet_loader.cc:96] loaded metadata for tablet 859477ecf37240a4888542d2559f99cd (table default.Table_c447a9537b844dffa1767531896bf6fe [id=a74215a4f78c47348bc5a41e4b1232f8])
I20260810 11:30:37.741842 27222 tablet_bootstrap.cc:492] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:37.742137 27228 ts_tablet_manager.cc:1428] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.012s user 0.001s sys 0.002s
I20260810 11:30:37.742396 27222 ts_tablet_manager.cc:1397] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.070s user 0.004s sys 0.004s
I20260810 11:30:37.742787 27228 tablet_bootstrap.cc:492] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:37.743271 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ada1df82eb44ecb9a6c615b5410e6f" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:37.743503 27061 raft_consensus.cc:3037] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.743669 27222 raft_consensus.cc:348] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.743918 27222 raft_consensus.cc:374] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.743971 27222 raft_consensus.cc:729] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.744172 27222 consensus_queue.cc:260] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.745285 28346 tablet_loader.cc:96] loaded metadata for tablet 88268e3571884ac88c1a617ce74499f3 (table default.Table_ad3534a46309483687ef9dd9471f1008 [id=0f9e142b43214fa8b2e362c54fabcb42])
I20260810 11:30:37.746018 28346 tablet_loader.cc:96] loaded metadata for tablet 9079c8fec89043be9d0040a3728e93f4 (table default.Table_fabd7780b9224b7993ad4321be6f92e2 [id=c9c81bc9d6dc48c89ba4cc51ca4f8bd9])
I20260810 11:30:37.746411 27061 raft_consensus.cc:2454] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:37.746937 27228 tablet_bootstrap.cc:654] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.747010 28346 tablet_loader.cc:96] loaded metadata for tablet 932ac2ae54324e6e830291ed449a31a8 (table default.Table_168dc06875d64f40830cac1440688bd0 [id=167c03593b73416ab0f9607c87937a60])
W20260810 11:30:37.747867 26848 consensus_peers.cc:487] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0713f4f14a284050a7774a70ab974f30. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:37.748409 26848 leader_election.cc:302] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:37.748919 28345 raft_consensus.cc:2781] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:37.749105 28345 raft_consensus.cc:686] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:37.749378 28345 consensus_queue.cc:237] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.754045 27222 ts_tablet_manager.cc:1428] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260810 11:30:37.754390 27222 tablet_bootstrap.cc:492] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:37.755224 26848 leader_election.cc:341] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: a7a2cb1d2e8e40f58144908e34438d53
I20260810 11:30:37.755357 26848 leader_election.cc:302] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:37.755827 28588 raft_consensus.cc:2726] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:37.759253 28346 tablet_loader.cc:96] loaded metadata for tablet 94bcb1739e5144559201479b82c07941 (table default.Table_e7f8305a313f47b0a219cb6a9cb15049 [id=329af78463204d2da90569d268b49eb3])
I20260810 11:30:37.761014 27222 tablet_bootstrap.cc:654] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.761976 27231 tablet_bootstrap.cc:654] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.763655 28346 tablet_loader.cc:96] loaded metadata for tablet 960104be1fa345d0a495b5686503b96a (table default.Table_9c70c3590985497fbaae37e05c4db1e4 [id=03fe9b9970bd450e890e1cddf9b5a43b])
I20260810 11:30:37.764676 28346 tablet_loader.cc:96] loaded metadata for tablet 9744f59d7e49430e91080f56f3342038 (table default.Table_835cdd4f3794466d808449e2e17bb15a [id=a483de6ef1fc453b93e3f183e9c15dd1])
I20260810 11:30:37.765489 28346 tablet_loader.cc:96] loaded metadata for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a])
I20260810 11:30:37.766016 28346 tablet_loader.cc:96] loaded metadata for tablet 98de7ce411bb4b54ada2df3b78b72190 (table default.Table_6471724ce77d490abaf4ad26ff7ae126 [id=068f712315544485a6fae8452986a3fa])
I20260810 11:30:37.766489 28346 tablet_loader.cc:96] loaded metadata for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9])
I20260810 11:30:37.767271 28346 tablet_loader.cc:96] loaded metadata for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_a827339eadbd440bb3c0bfa6c52512ca [id=b457cccecbf24d6dab4e74bf16bb68eb])
I20260810 11:30:37.767731 28346 tablet_loader.cc:96] loaded metadata for tablet 9de57b6d03e34ee783b822b30090c077 (table default.Table_09ff2cfcae6d4c1b96479fd190b3c084 [id=7d0dd215c30648438a460f730b0b7ba4])
I20260810 11:30:37.768093 28660 consensus_queue.cc:1035] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:37.768798 28346 tablet_loader.cc:96] loaded metadata for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53])
I20260810 11:30:37.770027 28346 tablet_loader.cc:96] loaded metadata for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82])
I20260810 11:30:37.771847 28346 tablet_loader.cc:96] loaded metadata for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd])
I20260810 11:30:37.773028 28651 raft_consensus.cc:482] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:37.773212 28651 raft_consensus.cc:504] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.773952 28707 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac259bcf213a4aa297d1d8e73b262361)
I20260810 11:30:37.774585 28651 leader_election.cc:288] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:37.775230 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f64d4b9320c4cb39f57573d781a47d3" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:37.774501 28707 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
W20260810 11:30:37.776002 26991 leader_election.cc:341] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:37.774710 27974 ts_tablet_manager.cc:1918] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:37.777276 27974 log.cc:1196] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/bb0357271cfd46478867a3cc0660bcdc
I20260810 11:30:37.779548 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f64d4b9320c4cb39f57573d781a47d3" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:37.782774 26993 leader_election.cc:341] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:37.783397 26993 leader_election.cc:302] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:37.783907 28651 raft_consensus.cc:2726] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:37.784416 27974 ts_tablet_manager.cc:1939] T bb0357271cfd46478867a3cc0660bcdc P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:37.785079 27222 tablet_bootstrap.cc:492] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:37.785238 27222 ts_tablet_manager.cc:1397] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.000s
I20260810 11:30:37.786098 27222 raft_consensus.cc:348] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.786221 28588 raft_consensus.cc:482] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:37.786334 27222 raft_consensus.cc:374] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.786403 27222 raft_consensus.cc:729] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.786577 28588 raft_consensus.cc:504] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.786633 27222 consensus_queue.cc:260] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.787869 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "420ba6e9f74c4ae5bf450f369e7fbdb3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:37.787974 27222 ts_tablet_manager.cc:1428] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:37.788434 28346 tablet_loader.cc:96] loaded metadata for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079])
W20260810 11:30:37.788511 26849 leader_election.cc:341] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:37.789201 28588 leader_election.cc:288] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:37.790038 27222 tablet_bootstrap.cc:492] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:37.791993 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "420ba6e9f74c4ae5bf450f369e7fbdb3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:37.802778 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 220) took 4709 ms. Trace:
W20260810 11:30:37.807065 26848 leader_election.cc:341] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:37.807204 26848 leader_election.cc:302] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:37.807765 28588 raft_consensus.cc:2726] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:37.806999 27974 rpcz_store.cc:276] 0810 11:30:33.093208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.093310 (+ 102us) service_pool.cc:227] Handling call
0810 11:30:37.655611 (+4562301us) ts_tablet_manager.cc:1145] Deleting tablet bb0357271cfd46478867a3cc0660bcdc
0810 11:30:37.655624 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.681924 (+ 26300us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.771459 (+ 89535us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.802472 (+ 31013us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4557967}
I20260810 11:30:37.814889 28707 leader_election.cc:288] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
I20260810 11:30:37.789285 28346 tablet_loader.cc:96] loaded metadata for tablet a4dde1d1eef74911b20498149e8c1785 (table default.Table_aa56bd03f9eb42468dce12fd81958879 [id=851eb82758954da2b3ec9bf0007880fa])
I20260810 11:30:37.818701 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet bb0357271cfd46478867a3cc0660bcdc (table default.Table_23889fedecbf43c09cf2ab7717d5801b [id=ea4def2ac652452aaca61214b2d04cc6]) successfully deleted
I20260810 11:30:37.819082 27974 tablet_replica.cc:330] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:37.820456 27222 tablet_bootstrap.cc:654] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.820590 28346 tablet_loader.cc:96] loaded metadata for tablet a63227e69df14a4ea935087fd31ece63 (table default.Table_d863b14a3a96454e8ee5a85fb2ab30c8 [id=a40ab01e5be24248b3af7ef1dc456da6])
I20260810 11:30:37.824168 28651 consensus_queue.cc:1035] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:37.825930 28346 tablet_loader.cc:96] loaded metadata for tablet a74acd5078ec4a45987d68a1e4d138b9 (table default.Table_2d65cf26d2254f29a785321b186cb2c8 [id=c16570aaa0c7449191f68085a12017da])
I20260810 11:30:37.831058 27974 raft_consensus.cc:2229] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:37.834357 27974 raft_consensus.cc:2258] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:37.836052 27231 tablet_bootstrap.cc:492] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:37.836484 27231 ts_tablet_manager.cc:1397] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.215s user 0.002s sys 0.009s
I20260810 11:30:37.841032 27231 raft_consensus.cc:348] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.844405 27231 raft_consensus.cc:374] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.845350 27974 ts_tablet_manager.cc:1905] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:37.847975 27228 tablet_bootstrap.cc:492] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:37.848141 27228 ts_tablet_manager.cc:1397] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.106s user 0.020s sys 0.005s
I20260810 11:30:37.845160 27231 raft_consensus.cc:729] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.849080 27228 raft_consensus.cc:348] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.849332 27228 raft_consensus.cc:374] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.849459 27228 raft_consensus.cc:729] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.849608 27222 tablet_bootstrap.cc:492] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:37.849823 27228 consensus_queue.cc:260] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.850769 27222 ts_tablet_manager.cc:1397] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.061s user 0.006s sys 0.000s
I20260810 11:30:37.851614 28346 tablet_loader.cc:96] loaded metadata for tablet a835d30ef9fc474ab927bb119a95d83c (table default.Table_eecd0244ecc849339f452f38db67c973 [id=41d3dec833b54d1e855194862cb1726b])
I20260810 11:30:37.856124 27228 ts_tablet_manager.cc:1428] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 11:30:37.857226 27228 tablet_bootstrap.cc:492] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:37.854390 27231 consensus_queue.cc:260] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.863936 28555 raft_consensus.cc:482] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:37.864151 28555 raft_consensus.cc:504] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.865433 28555 leader_election.cc:288] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:37.865911 27231 ts_tablet_manager.cc:1428] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.029s user 0.004s sys 0.000s
I20260810 11:30:37.866387 27231 tablet_bootstrap.cc:492] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:37.866724 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318d5b8453fe4c438d0fa32cb91c409e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:37.867069 27055 raft_consensus.cc:2379] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate b6079090b1124d84aa4477974bb53700 in this term.
I20260810 11:30:37.869226 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318d5b8453fe4c438d0fa32cb91c409e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:37.870184 26700 leader_election.cc:302] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:37.870690 27222 raft_consensus.cc:348] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.870939 27222 raft_consensus.cc:374] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.871001 27222 raft_consensus.cc:729] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.871229 27222 consensus_queue.cc:260] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.871245 27999 ts_tablet_manager.cc:1918] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:37.871809 27222 ts_tablet_manager.cc:1428] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.018s user 0.001s sys 0.000s
I20260810 11:30:37.872128 27222 tablet_bootstrap.cc:492] T 37cecd4266eb47669e7fd5cfeb847adc P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:37.873791 28640 raft_consensus.cc:3037] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:37.876180 28346 tablet_loader.cc:96] loaded metadata for tablet aaef5a4d651e4bc2b0b76cf6f51b0751 (table default.Table_5f8ecc7877924d0f9871dd16aaeafdde [id=e1ca02b3f3f94632843632a15fc19245])
I20260810 11:30:37.876649 28346 tablet_loader.cc:96] loaded metadata for tablet ab2471d06e0841e7bebae4ca1865618c (table default.Table_db5e3f1e3cf74bc0b15660e83ea59ad6 [id=e7142023363b432b803533be5da13aec])
I20260810 11:30:37.877254 28346 tablet_loader.cc:96] loaded metadata for tablet ad85aa3d1ec54f0ea3a299e33292738a (table default.Table_e0aa1ad6dfda4ef2b7c441f45f74c0f7 [id=b27cf2b15cb64704b6f447284daadd55])
I20260810 11:30:37.877599 28346 tablet_loader.cc:96] loaded metadata for tablet add1743851c34d58afb7e4886325d659 (table default.Table_2d72d964c7c54d639c11a02fc168152a [id=f49e68eaa81e49bb92ed473e754de42f])
I20260810 11:30:37.877959 28346 tablet_loader.cc:96] loaded metadata for tablet adecd2f0952b4f4c83919c78d563e429 (table default.Table_6f7fdd85630648659dcfe3b52e5ab365 [id=862df0152eda418da6110067b4ab588b])
I20260810 11:30:37.878336 28640 raft_consensus.cc:2726] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:37.878474 28346 tablet_loader.cc:96] loaded metadata for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa])
I20260810 11:30:37.878945 28346 tablet_loader.cc:96] loaded metadata for tablet b121c13e9241468aa224e17093eb38f4 (table default.Table_2c7697ec19204b3d823f5684c30978e2 [id=9d480f65788b486db55bbbe48a0ad5eb])
I20260810 11:30:37.879721 28346 tablet_loader.cc:96] loaded metadata for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3])
W20260810 11:30:37.882511 27286 leader_election.cc:334] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547): Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111)
I20260810 11:30:37.884573 27231 tablet_bootstrap.cc:654] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.885743 27222 tablet_bootstrap.cc:654] T 37cecd4266eb47669e7fd5cfeb847adc P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.884039 27999 log.cc:1196] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/2e2c9112462f442e8de5b4a944cfdc6b
I20260810 11:30:37.889878 28346 tablet_loader.cc:96] loaded metadata for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96])
I20260810 11:30:37.892778 28346 tablet_loader.cc:96] loaded metadata for tablet b6a3b1e37ac943e391d54640987136f8 (table default.Table_acbcb3a347b647a19e81cfcf5636677f [id=56dee621acfa4f73b3bd69fefa7cb7e1])
I20260810 11:30:37.893297 28346 tablet_loader.cc:96] loaded metadata for tablet b6eb6dc4b6f34e598933853717b86866 (table default.Table_e18fcf91bf3b4fa0a993bc1aa1471e62 [id=de3117675bb34e7c91a3eb51e015b7c9])
I20260810 11:30:37.893774 28346 tablet_loader.cc:96] loaded metadata for tablet b755744059b04967857c1b00e951b8ee (table default.Table_04e075d361354421aa7085057964f310 [id=94c8e7388b644043b77cb6b5087e87e8])
I20260810 11:30:37.894644 28346 tablet_loader.cc:96] loaded metadata for tablet b9195690e00b4f3cb3d5076dcca3519c (table default.Table_6f7ae1749f224614a4fdaa33b125864d [id=339298a1ea1747d59a035a6a3cadfb30])
I20260810 11:30:37.893920 27999 ts_tablet_manager.cc:1939] T 2e2c9112462f442e8de5b4a944cfdc6b P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:37.895094 28346 tablet_loader.cc:96] loaded metadata for tablet b945038c03e343489af6ae7e50131d97 (table default.Table_9744be92699b40d1bae23bbb564db585 [id=f27ef087b00e469197a44c70d4bc979b])
I20260810 11:30:37.901118 28346 tablet_loader.cc:96] loaded metadata for tablet b945cb22353f4d99a3836e3c0b8e26e3 (table default.Table_307bbf62894b4edc922e0fd4afa1a91f [id=a700655211944205a74b75b8449abc29])
I20260810 11:30:37.901690 28346 tablet_loader.cc:96] loaded metadata for tablet ba9d15002e6a40f58a7be07f46e7c328 (table default.Table_d4313ebe5ce04c1aa10d064712cbf3ab [id=5f6080c52e46443e9b4ba99dd4352b12])
I20260810 11:30:37.902472 28346 tablet_loader.cc:96] loaded metadata for tablet bbe34108a7604fa6aa667758be11f569 (table default.Table_5f6a37537c33412a80f2642fb0162da6 [id=bfc3f2f94773444181545d43ecd88190])
I20260810 11:30:37.903483 27222 tablet_bootstrap.cc:492] T 37cecd4266eb47669e7fd5cfeb847adc P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:37.903643 27222 ts_tablet_manager.cc:1397] T 37cecd4266eb47669e7fd5cfeb847adc P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.004s
I20260810 11:30:37.904451 27222 raft_consensus.cc:348] T 37cecd4266eb47669e7fd5cfeb847adc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.904739 27222 raft_consensus.cc:374] T 37cecd4266eb47669e7fd5cfeb847adc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.904806 27222 raft_consensus.cc:729] T 37cecd4266eb47669e7fd5cfeb847adc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.905083 27222 consensus_queue.cc:260] T 37cecd4266eb47669e7fd5cfeb847adc P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.905683 27228 tablet_bootstrap.cc:654] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.907342 27222 ts_tablet_manager.cc:1428] T 37cecd4266eb47669e7fd5cfeb847adc P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260810 11:30:37.907481 28346 tablet_loader.cc:96] loaded metadata for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6])
I20260810 11:30:37.907599 27231 tablet_bootstrap.cc:492] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:37.907738 27231 ts_tablet_manager.cc:1397] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.000s
I20260810 11:30:37.908174 28346 tablet_loader.cc:96] loaded metadata for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6])
I20260810 11:30:37.909071 28346 tablet_loader.cc:96] loaded metadata for tablet c317ccebde05457d9e81c5c871638092 (table default.Table_0b6cd084cecf499e9091685515cb1a3b [id=7b4e4650915f4c16bef68adf43618b89])
I20260810 11:30:37.908943 27231 raft_consensus.cc:348] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.909349 27231 raft_consensus.cc:374] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.909459 27231 raft_consensus.cc:729] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.909878 28346 tablet_loader.cc:96] loaded metadata for tablet c3a5d7b8b0a14134ac55fa17a7dac21e (table default.Table_14f7e10124574ccdb41f7b14117603c6 [id=0cf740b2e59643899dac59acdf576fe2])
I20260810 11:30:37.910377 28346 tablet_loader.cc:96] loaded metadata for tablet c4124999339e4133b2bd47b3739da373 (table default.Table_9efdfb09fd194dc2a9cbdc9a87749126 [id=8afbc0cc8e704a03a064974937b5a36b])
I20260810 11:30:37.911137 28346 tablet_loader.cc:96] loaded metadata for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704])
I20260810 11:30:37.911989 27222 tablet_bootstrap.cc:492] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:37.911568 27231 consensus_queue.cc:260] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.914067 27222 tablet_bootstrap.cc:654] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.913461 27231 ts_tablet_manager.cc:1428] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260810 11:30:37.914636 27231 tablet_bootstrap.cc:492] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:37.915030 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 98) took 11362 ms. Trace:
I20260810 11:30:37.920248 28346 tablet_loader.cc:96] loaded metadata for tablet cc032509e78c4a04bbe504f54e9d6c6b (table default.Table_44f89aa654e84f22a77580060f057750 [id=3cadcafa2d524a5892f6c315c30881ae])
I20260810 11:30:37.921072 27999 rpcz_store.cc:276] 0810 11:30:26.552462 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.553022 (+ 560us) service_pool.cc:227] Handling call
0810 11:30:37.656335 (+11103313us) ts_tablet_manager.cc:1145] Deleting tablet 2e2c9112462f442e8de5b4a944cfdc6b
0810 11:30:37.706281 (+ 49946us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.810297 (+104016us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.870215 (+ 59918us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:37.914586 (+ 44371us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11083263}
I20260810 11:30:37.921952 28346 tablet_loader.cc:96] loaded metadata for tablet cc76d30f37094391b75076c92ccc277f (table default.Table_03a616a243fc4350b4a01d7f5bb86949 [id=4e2dc56dde3346a0917e58c6c7e921eb])
I20260810 11:30:37.922274 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 2e2c9112462f442e8de5b4a944cfdc6b (table default.Table_bc8bc2c9015443fb865751881638284b [id=3d0ee62af94a45ebb75470e84997368f]) successfully deleted
I20260810 11:30:37.923142 27999 tablet_replica.cc:330] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:37.923265 28346 tablet_loader.cc:96] loaded metadata for tablet cd3575197c464c7fb51f9592831959bb (table default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156])
I20260810 11:30:37.924050 28346 tablet_loader.cc:96] loaded metadata for tablet d14091e1c111438bac8bcf3d36123d80 (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda])
I20260810 11:30:37.924599 28346 tablet_loader.cc:96] loaded metadata for tablet d1d0d55b526749059470504a27887b22 (table default.Table_57b6151125a144fcb6230ee986bff7ee [id=62f404c62e4040fc801f70cafddf9d95])
I20260810 11:30:37.925557 28346 tablet_loader.cc:96] loaded metadata for tablet d24726d0214947beab0bb31b1597c1c3 (table default.Table_3fd59f07e4ee4f54bce7829aec4cf4c4 [id=3719720e5ca241b1a500a1aaf7f310c4])
I20260810 11:30:37.925233 27999 raft_consensus.cc:2229] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:37.926810 28346 tablet_loader.cc:96] loaded metadata for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_a406a8172095498abc9c54697f00f4a0 [id=34056ce268f8490c94a38351b43357a6])
I20260810 11:30:37.927981 28346 tablet_loader.cc:96] loaded metadata for tablet d4873fe8318040a2b7e021708a875f43 (table default.Table_f33a13096a144e538af2795c149abdcd [id=60ce1267de814f218c27ac084a08a26a])
I20260810 11:30:37.929126 28346 tablet_loader.cc:96] loaded metadata for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9])
I20260810 11:30:37.930280 28346 tablet_loader.cc:96] loaded metadata for tablet d560157da0624333b91a18481b058f91 (table default.Table_5f7d17a1cdaa4396b5faf52b01518860 [id=973454ab92f84e73be26260d66ee9763])
I20260810 11:30:37.930395 27231 tablet_bootstrap.cc:654] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.931493 28346 tablet_loader.cc:96] loaded metadata for tablet d722b93fe27f4c08a592bc393046b6bd (table default.Table_99cbe48a0bd54425b588a46ae1132cad [id=0faf073b01654e38b8f6083f5012abd7])
I20260810 11:30:37.934573 28346 tablet_loader.cc:96] loaded metadata for tablet d91cb30457a74d51885ad81c4ab89d71 (table default.Table_1f48a9af47ad4e0c93ed4dd43ecd12a3 [id=e985b1ae60d94bfa998e1986bdf3fcd9])
I20260810 11:30:37.933063 27999 raft_consensus.cc:2258] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:37.941315 28346 tablet_loader.cc:96] loaded metadata for tablet dc10f61181794e2bba099ca46881e94d (table default.Table_971ac96924ee4a09bc7bc1befdb296d1 [id=cbb462ed5c1f4adf9363f7ac03b78c8c])
I20260810 11:30:37.942548 28346 tablet_loader.cc:96] loaded metadata for tablet dc2506b72a624cb388059efc326abbc1 (table default.Table_b7e6c83a5d5340b5b960f65b82d4939a [id=553f87ed39f148aba3be0a6fcd13e25d])
I20260810 11:30:37.942890 27228 tablet_bootstrap.cc:492] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:37.943343 27228 ts_tablet_manager.cc:1397] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.087s user 0.004s sys 0.004s
I20260810 11:30:37.943984 28346 tablet_loader.cc:96] loaded metadata for tablet dd04642dea1f47318871b4e078fd234c (table default.Table_dd41dff7d9584a46821b6a187e5c52a4 [id=1f1a6853eb434bc1988eeda6224a2ff7])
I20260810 11:30:37.944960 28346 tablet_loader.cc:96] loaded metadata for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_883ee52a6394446eb2ca688ec956d44b [id=a47869d3574543b19e821bbfcb5d3785])
I20260810 11:30:37.946278 28346 tablet_loader.cc:96] loaded metadata for tablet e25557126afd4f51a31fba73cd7da219 (table default.Table_4857a0fc183c421382b9b70094d76ac3 [id=eb184bc24462433e89048f962a639600])
I20260810 11:30:37.946440 27228 raft_consensus.cc:348] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.947412 27228 raft_consensus.cc:374] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.947865 27228 raft_consensus.cc:729] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:37.951557 28346 tablet_loader.cc:96] loaded metadata for tablet e69916a35fba4714bbc565921738888f (table default.Table_c40dd8e327db40b59167de093a5c616d [id=10ebb746a2b343b08b5b13d1107a7cd8])
I20260810 11:30:37.952977 28346 tablet_loader.cc:96] loaded metadata for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a])
I20260810 11:30:37.954226 28346 tablet_loader.cc:96] loaded metadata for tablet e9732b90bc054f8a83fc17c0df9dfafe (table default.Table_094455b6d4f745fa83445cfc650e43b7 [id=c2f01a1417424ff6b61d8c4cb35a638a])
I20260810 11:30:37.955235 28646 consensus_queue.cc:1035] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:37.955374 28346 tablet_loader.cc:96] loaded metadata for tablet ea66da5bc20e4718901ffc473677421c (table default.Table_23ac53b1a7794ddda0a697254fff0ede [id=80a1649fe2d74dd4bf5aa5e07a762de3])
I20260810 11:30:37.956336 28346 tablet_loader.cc:96] loaded metadata for tablet ebaf046e524b485c8b3ebf419c8035bb (table default.Table_52c39be8057948a49dfd7394b4152265 [id=c48cb5a0af7b4f0483e799a49fd5d307])
I20260810 11:30:37.955924 27999 ts_tablet_manager.cc:1905] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:37.952219 27228 consensus_queue.cc:260] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.959015 28346 tablet_loader.cc:96] loaded metadata for tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743])
I20260810 11:30:37.961885 28346 tablet_loader.cc:96] loaded metadata for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57])
I20260810 11:30:37.962788 28346 tablet_loader.cc:96] loaded metadata for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe])
I20260810 11:30:37.963905 28346 tablet_loader.cc:96] loaded metadata for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f (table default.Table_7458a59fbdce4e9485d51df6fccf66a5 [id=d63533f5d837481889b34a78d860e018])
I20260810 11:30:37.965121 28346 tablet_loader.cc:96] loaded metadata for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b])
I20260810 11:30:37.966281 28346 tablet_loader.cc:96] loaded metadata for tablet fa14fea852c24cd7bb3d57094af2e178 (table default.Table_6d8b58857bb84e579c8c308dcb0800f0 [id=f0f8365d722447a090e236fd1fcb0e98])
I20260810 11:30:37.966980 28346 tablet_loader.cc:96] loaded metadata for tablet faff8489499e4e318b127d9c1b19d2e4 (table default.Table_6efb1e8e65fa4f88ae25c9d2ebc6b4f4 [id=d83083bfedd542398d132e4bac9a7f12])
I20260810 11:30:37.967937 28346 tablet_loader.cc:96] loaded metadata for tablet fc023d51790042ce978eb53a2979e29c (table default.Table_66b8d163284b4347b99dea499ed256fc [id=304e1529f45d4d3c8799a22009066ce5])
I20260810 11:30:37.969298 28346 tablet_loader.cc:96] loaded metadata for tablet fccc21cfc1ce4eb586f03276ec6e987f (table default.Table_fb8c5684b00a41eebe3f5b088bcbee33 [id=e22f19a993564e53b1cc76633f25f505])
I20260810 11:30:37.970958 28651 raft_consensus.cc:482] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:37.971149 28651 raft_consensus.cc:504] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.971920 28651 leader_election.cc:288] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:37.972934 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ff5b980ce4e41d7a6e1ca0e740b739c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:37.974368 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ff5b980ce4e41d7a6e1ca0e740b739c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:37.974869 27222 tablet_bootstrap.cc:492] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:37.975032 27222 ts_tablet_manager.cc:1397] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.063s user 0.002s sys 0.015s
W20260810 11:30:37.975545 26991 leader_election.cc:341] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:37.976123 27222 raft_consensus.cc:348] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.976408 27222 raft_consensus.cc:374] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:37.976495 27222 raft_consensus.cc:729] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
W20260810 11:30:37.978101 26993 leader_election.cc:341] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:37.978246 26993 leader_election.cc:302] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:37.980229 28651 raft_consensus.cc:2726] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:37.979127 27228 ts_tablet_manager.cc:1428] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.035s user 0.003s sys 0.003s
I20260810 11:30:37.980788 27222 consensus_queue.cc:260] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:37.981601 27222 ts_tablet_manager.cc:1428] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260810 11:30:37.982898 27222 tablet_bootstrap.cc:492] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:37.986683 27222 tablet_bootstrap.cc:654] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:37.987342 27228 tablet_bootstrap.cc:492] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:37.970532 28346 tablet_loader.cc:96] loaded metadata for tablet fdeba015c2364ec385e8b06c18a2a9d2 (table default.Table_5d3880885d6342738dd22e168d08e660 [id=31e5d2935c2f44e4b272255fbd4c948a])
W20260810 11:30:38.010232 28346 catalog_manager.cc:1476] Time spent T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Loading table and tablet metadata into memory: real 2.680s user 0.232s sys 0.076s
I20260810 11:30:38.010877 26590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" candidate_term: 7 candidate_status { last_received { term: 6 index: 605 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361" is_pre_election: true
I20260810 11:30:38.013091 26591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" candidate_term: 7 candidate_status { last_received { term: 6 index: 605 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361" is_pre_election: true
W20260810 11:30:38.013459 26591 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57848 (request call id 142) took 1439 ms (client timeout 606 ms). Trace:
W20260810 11:30:38.013686 26591 rpcz_store.cc:269] 0810 11:30:36.573588 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:36.573645 (+ 57us) service_pool.cc:227] Handling call
0810 11:30:38.013298 (+1439653us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:38.013789 27291 leader_election.cc:302] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83cc8e39a3b9455f8242a6da6a54c38a; no voters: ac259bcf213a4aa297d1d8e73b262361, c40c76e125b44de181b88b7f63a566f7
I20260810 11:30:38.012480 26577 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:51252 (request call id 83) took 2661 ms. Trace:
I20260810 11:30:38.014117 26577 rpcz_store.cc:276] 0810 11:30:35.350618 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:35.350989 (+ 371us) service_pool.cc:227] Handling call
0810 11:30:38.012300 (+2661311us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:38.014374 28707 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 11:30:38.012773 26589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" candidate_term: 7 candidate_status { last_received { term: 6 index: 605 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361" is_pre_election: true
I20260810 11:30:38.014942 28346 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260810 11:30:38.015192 26589 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57848 (request call id 141) took 2051 ms (client timeout 606 ms). Trace:
W20260810 11:30:38.015352 26589 rpcz_store.cc:269] 0810 11:30:35.963830 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:35.963908 (+ 78us) service_pool.cc:227] Handling call
0810 11:30:38.015015 (+2051107us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:38.018649 27231 tablet_bootstrap.cc:492] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:38.018823 27231 ts_tablet_manager.cc:1397] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.104s user 0.005s sys 0.008s
I20260810 11:30:38.019088 27974 ts_tablet_manager.cc:1918] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:38.022192 27974 log.cc:1196] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/43e42cc642544f779bb79cee7479c4f4
I20260810 11:30:38.023332 27974 ts_tablet_manager.cc:1939] T 43e42cc642544f779bb79cee7479c4f4 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:38.020980 28646 raft_consensus.cc:482] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.024061 28646 raft_consensus.cc:504] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.024500 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 217) took 4933 ms. Trace:
I20260810 11:30:38.024650 27974 rpcz_store.cc:276] 0810 11:30:33.091315 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.091411 (+ 96us) service_pool.cc:227] Handling call
0810 11:30:37.817332 (+4725921us) ts_tablet_manager.cc:1145] Deleting tablet 43e42cc642544f779bb79cee7479c4f4
0810 11:30:37.817680 (+ 348us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:37.913812 (+ 96132us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.003965 (+ 90153us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.024466 (+ 20501us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4718698}
I20260810 11:30:38.024896 28646 leader_election.cc:288] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.025602 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 43e42cc642544f779bb79cee7479c4f4 (table default.Table_38ce4003d8e84bec8c910d35efb2a64e [id=9a87e462e8834e0ab7d9a8ae87f06e09]) successfully deleted
I20260810 11:30:38.025586 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64818ca5827e41d99428903ddb8688d9" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:38.025774 27228 tablet_bootstrap.cc:654] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.025844 26915 raft_consensus.cc:2454] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:38.026607 26700 leader_election.cc:302] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:38.027578 28555 raft_consensus.cc:2781] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:38.027668 28555 raft_consensus.cc:482] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:38.027755 28555 raft_consensus.cc:3037] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.032111 28555 raft_consensus.cc:504] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.035408 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64818ca5827e41d99428903ddb8688d9" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:38.035655 27058 raft_consensus.cc:2454] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:38.037556 27999 ts_tablet_manager.cc:1918] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:38.037716 27999 log.cc:1196] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/603fe104b7ab485eab6b225a58bddc1c
I20260810 11:30:38.038143 27999 ts_tablet_manager.cc:1939] T 603fe104b7ab485eab6b225a58bddc1c P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:38.039052 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 101) took 11474 ms. Trace:
I20260810 11:30:38.039141 27999 rpcz_store.cc:276] 0810 11:30:26.564121 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.564487 (+ 366us) service_pool.cc:227] Handling call
0810 11:30:37.922844 (+11358357us) ts_tablet_manager.cc:1145] Deleting tablet 603fe104b7ab485eab6b225a58bddc1c
0810 11:30:37.922863 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.021373 (+ 98510us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.037422 (+ 16049us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.039030 (+ 1608us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11349530}
I20260810 11:30:38.039531 27999 tablet_replica.cc:330] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:38.039750 27999 raft_consensus.cc:2229] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:38.039757 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 603fe104b7ab485eab6b225a58bddc1c (table default.Table_a5fcf59dae954757a15883ee4da1bf29 [id=758863f16efe460e90394a491cad8914]) successfully deleted
I20260810 11:30:38.040089 27999 raft_consensus.cc:2258] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:38.033782 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 225) took 4923 ms. Trace:
I20260810 11:30:38.041054 27974 rpcz_store.cc:276] 0810 11:30:33.110236 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.110485 (+ 249us) service_pool.cc:227] Handling call
0810 11:30:38.025114 (+4914629us) ts_tablet_manager.cc:1145] Deleting tablet 60d56e162b4b41e2867ac845e524aca4
0810 11:30:38.025128 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.033753 (+ 8625us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4912080}
I20260810 11:30:38.041522 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 221) took 4935 ms. Trace:
I20260810 11:30:38.041601 27974 rpcz_store.cc:276] 0810 11:30:33.105860 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.106043 (+ 183us) service_pool.cc:227] Handling call
0810 11:30:38.041384 (+4935341us) ts_tablet_manager.cc:1145] Deleting tablet 8798892eb4604ee8ac9c95e64dbb14e9
0810 11:30:38.041414 (+ 30us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.041502 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4928227}
W20260810 11:30:38.041683 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 60d56e162b4b41e2867ac845e524aca4 because the tablet was not found. No further retry: Not found: Tablet not found: 60d56e162b4b41e2867ac845e524aca4
I20260810 11:30:38.041957 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 222) took 4935 ms. Trace:
I20260810 11:30:38.042035 27974 rpcz_store.cc:276] 0810 11:30:33.106770 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.106861 (+ 91us) service_pool.cc:227] Handling call
0810 11:30:38.041813 (+4934952us) ts_tablet_manager.cc:1145] Deleting tablet 8228600e3f6b4f9993dd25e4ceb57e4d
0810 11:30:38.041824 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.041939 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4928198}
W20260810 11:30:38.042148 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 8798892eb4604ee8ac9c95e64dbb14e9 because the tablet was not found. No further retry: Not found: Tablet not found: 8798892eb4604ee8ac9c95e64dbb14e9
I20260810 11:30:38.042284 27974 tablet_replica.cc:330] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:38.042559 27974 raft_consensus.cc:2229] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:38.042737 27974 raft_consensus.cc:2258] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:38.043426 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 8228600e3f6b4f9993dd25e4ceb57e4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8228600e3f6b4f9993dd25e4ceb57e4d already in progress: creating tablet
I20260810 11:30:38.044445 27974 ts_tablet_manager.cc:1905] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:38.044476 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64818ca5827e41d99428903ddb8688d9" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:38.044812 26915 raft_consensus.cc:3037] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.049540 27222 tablet_bootstrap.cc:492] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:38.049769 27222 ts_tablet_manager.cc:1397] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.068s user 0.001s sys 0.018s
I20260810 11:30:38.050769 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64818ca5827e41d99428903ddb8688d9" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:38.050983 27222 raft_consensus.cc:348] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.051151 27228 tablet_bootstrap.cc:492] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:38.051205 27222 raft_consensus.cc:374] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.051259 27222 raft_consensus.cc:729] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.051287 27228 ts_tablet_manager.cc:1397] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.065s user 0.000s sys 0.007s
I20260810 11:30:38.051553 27222 consensus_queue.cc:260] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.052395 27222 ts_tablet_manager.cc:1428] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260810 11:30:38.052336 27228 raft_consensus.cc:348] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.052577 27228 raft_consensus.cc:374] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.052649 27228 raft_consensus.cc:729] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.053365 28555 leader_election.cc:288] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.053237 27228 consensus_queue.cc:260] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.053848 27228 ts_tablet_manager.cc:1428] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:38.054203 27228 tablet_bootstrap.cc:492] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:38.056720 27055 raft_consensus.cc:3037] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.051759 26915 raft_consensus.cc:2454] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:38.057582 26700 leader_election.cc:302] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:38.057725 27222 tablet_bootstrap.cc:492] T 460a679219cb4a7f9aecfec58a98238b P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:38.058041 27999 ts_tablet_manager.cc:1905] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:38.058604 28555 raft_consensus.cc:2781] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:38.061383 28588 raft_consensus.cc:482] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.061535 28588 raft_consensus.cc:504] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.063131 28555 raft_consensus.cc:686] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:38.063409 28588 leader_election.cc:288] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.064304 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4873fe8318040a2b7e021708a875f43" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:38.064962 26848 leader_election.cc:341] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.063853 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4873fe8318040a2b7e021708a875f43" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:38.065955 26849 leader_election.cc:341] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.066071 26849 leader_election.cc:302] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:38.066197 27222 tablet_bootstrap.cc:654] T 460a679219cb4a7f9aecfec58a98238b P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.066519 28588 raft_consensus.cc:2726] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:38.067217 28555 consensus_queue.cc:237] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.070273 28346 catalog_manager.cc:1259] Loaded cluster ID: 5081849c8420415b9be91728667896d5
I20260810 11:30:38.070508 28346 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 11:30:38.071468 27055 raft_consensus.cc:2454] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:38.073197 27228 tablet_bootstrap.cc:654] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.080709 27231 raft_consensus.cc:348] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.082337 27231 raft_consensus.cc:374] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.082732 27231 raft_consensus.cc:729] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.083318 27231 consensus_queue.cc:260] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.084890 27231 ts_tablet_manager.cc:1428] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.066s user 0.003s sys 0.000s
I20260810 11:30:38.085486 26759 raft_consensus.cc:3037] T 39beb126ac324842b7e387c46bcb4099 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.090355 28651 consensus_queue.cc:1035] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:38.094725 28651 raft_consensus.cc:482] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.094882 28651 raft_consensus.cc:504] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.095641 28651 leader_election.cc:288] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:38.097401 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9744f59d7e49430e91080f56f3342038" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:38.098073 26993 leader_election.cc:341] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.098538 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9744f59d7e49430e91080f56f3342038" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:38.099509 26991 leader_election.cc:341] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.099679 26991 leader_election.cc:302] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:38.099917 27231 tablet_bootstrap.cc:492] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:38.100311 28651 raft_consensus.cc:2726] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:38.102718 27974 ts_tablet_manager.cc:1918] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:38.107627 28651 consensus_queue.cc:1035] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:38.114190 27222 tablet_bootstrap.cc:492] T 460a679219cb4a7f9aecfec58a98238b P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:38.114390 27222 ts_tablet_manager.cc:1397] T 460a679219cb4a7f9aecfec58a98238b P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.057s user 0.007s sys 0.006s
I20260810 11:30:38.115535 27222 raft_consensus.cc:348] T 460a679219cb4a7f9aecfec58a98238b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.115757 27222 raft_consensus.cc:374] T 460a679219cb4a7f9aecfec58a98238b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.115810 27222 raft_consensus.cc:729] T 460a679219cb4a7f9aecfec58a98238b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.116732 28651 raft_consensus.cc:482] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.117359 28651 raft_consensus.cc:504] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.117038 27974 log.cc:1196] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/ac4b1821ac30452cbe7a8f844d9b37e5
I20260810 11:30:38.119253 28725 consensus_queue.cc:1035] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:38.119838 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "460a679219cb4a7f9aecfec58a98238b" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:38.120198 28651 leader_election.cc:288] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:38.120535 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "460a679219cb4a7f9aecfec58a98238b" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:38.121022 27228 tablet_bootstrap.cc:492] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:38.121191 27228 ts_tablet_manager.cc:1397] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.067s user 0.006s sys 0.001s
W20260810 11:30:38.121482 26991 leader_election.cc:341] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.118439 27974 ts_tablet_manager.cc:1939] T ac4b1821ac30452cbe7a8f844d9b37e5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:38.127308 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 223) took 5020 ms. Trace:
I20260810 11:30:38.127440 27974 rpcz_store.cc:276] 0810 11:30:33.107285 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.109270 (+ 1985us) service_pool.cc:227] Handling call
0810 11:30:38.042242 (+4932972us) ts_tablet_manager.cc:1145] Deleting tablet ac4b1821ac30452cbe7a8f844d9b37e5
0810 11:30:38.042251 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.058828 (+ 16577us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.102568 (+ 43740us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.127267 (+ 24699us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4928363}
I20260810 11:30:38.127918 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 224) took 5018 ms. Trace:
I20260810 11:30:38.128171 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet ac4b1821ac30452cbe7a8f844d9b37e5 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]) successfully deleted
I20260810 11:30:38.130622 27228 raft_consensus.cc:348] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.130908 27228 raft_consensus.cc:374] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.130963 27228 raft_consensus.cc:729] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.131175 27228 consensus_queue.cc:260] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.131824 27228 ts_tablet_manager.cc:1428] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260810 11:30:38.132212 27228 tablet_bootstrap.cc:492] T c62ae41d2dd74eedbe252c4de70fbe1e P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:38.133098 27231 tablet_bootstrap.cc:654] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.128005 27974 rpcz_store.cc:276] 0810 11:30:33.109524 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.109991 (+ 467us) service_pool.cc:227] Handling call
0810 11:30:38.127762 (+5017771us) ts_tablet_manager.cc:1145] Deleting tablet 110b5acc36bd4d6bba13735e5daec75f
0810 11:30:38.127776 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.127900 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5013515}
W20260810 11:30:38.134045 27290 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 110b5acc36bd4d6bba13735e5daec75f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 110b5acc36bd4d6bba13735e5daec75f already in progress: creating tablet
I20260810 11:30:38.116015 27222 consensus_queue.cc:260] T 460a679219cb4a7f9aecfec58a98238b P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.134935 26759 raft_consensus.cc:2454] T 460a679219cb4a7f9aecfec58a98238b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:38.135310 27222 ts_tablet_manager.cc:1428] T 460a679219cb4a7f9aecfec58a98238b P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.021s user 0.001s sys 0.002s
I20260810 11:30:38.135618 27222 tablet_bootstrap.cc:492] T 1f64d4b9320c4cb39f57573d781a47d3 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:38.137694 28660 consensus_queue.cc:1035] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:38.137935 26993 leader_election.cc:302] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:38.138428 27222 tablet_bootstrap.cc:654] T 1f64d4b9320c4cb39f57573d781a47d3 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.138516 28660 raft_consensus.cc:2781] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:38.138674 28660 raft_consensus.cc:482] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:38.138736 28660 raft_consensus.cc:3037] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.138720 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 226) took 5025 ms. Trace:
I20260810 11:30:38.138803 27974 rpcz_store.cc:276] 0810 11:30:33.113392 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.114212 (+ 820us) service_pool.cc:227] Handling call
0810 11:30:38.133720 (+5019508us) ts_tablet_manager.cc:1145] Deleting tablet 0938a2f3688246a2b46978eeb7d5d521
0810 11:30:38.133735 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.138699 (+ 4964us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5019280}
I20260810 11:30:38.139293 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 229) took 5023 ms. Trace:
I20260810 11:30:38.139366 27974 rpcz_store.cc:276] 0810 11:30:33.116181 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.116622 (+ 441us) service_pool.cc:227] Handling call
0810 11:30:38.139057 (+5022435us) ts_tablet_manager.cc:1145] Deleting tablet 23d8ce485cb84495a6e964b6d5977f0d
0810 11:30:38.139067 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.139140 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5017729}
I20260810 11:30:38.139642 27974 tablet_replica.cc:330] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:38.139830 27974 raft_consensus.cc:2229] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:38.140024 27974 raft_consensus.cc:2258] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:38.140035 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 0938a2f3688246a2b46978eeb7d5d521 because the tablet was not found. No further retry: Not found: Tablet not found: 0938a2f3688246a2b46978eeb7d5d521
I20260810 11:30:38.140300 27999 ts_tablet_manager.cc:1918] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260810 11:30:38.140447 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 23d8ce485cb84495a6e964b6d5977f0d because the tablet was not found. No further retry: Not found: Tablet not found: 23d8ce485cb84495a6e964b6d5977f0d
I20260810 11:30:38.140511 27999 log.cc:1196] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/0118ff9d21924aefa8c6c32977c10453
I20260810 11:30:38.141803 27999 ts_tablet_manager.cc:1939] T 0118ff9d21924aefa8c6c32977c10453 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:38.142022 28660 raft_consensus.cc:504] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.142843 28660 leader_election.cc:288] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:38.143503 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "460a679219cb4a7f9aecfec58a98238b" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:38.144285 26991 leader_election.cc:341] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.144760 27228 tablet_bootstrap.cc:654] T c62ae41d2dd74eedbe252c4de70fbe1e P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.145916 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 103) took 11581 ms. Trace:
I20260810 11:30:38.146243 27999 rpcz_store.cc:276] 0810 11:30:26.564493 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.564547 (+ 54us) service_pool.cc:227] Handling call
0810 11:30:38.039479 (+11474932us) ts_tablet_manager.cc:1145] Deleting tablet 0118ff9d21924aefa8c6c32977c10453
0810 11:30:38.039492 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.100851 (+ 61359us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.134438 (+ 33587us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.145807 (+ 11369us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11465351}
I20260810 11:30:38.146723 27999 tablet_replica.cc:330] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:38.147037 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 0118ff9d21924aefa8c6c32977c10453 (table default.Table_9f14d3d9ba454257a07c6eb8b0ead5e6 [id=737e0806636e4c8ca0307a46408cbdec]) successfully deleted
I20260810 11:30:38.147850 27974 ts_tablet_manager.cc:1905] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:38.148826 27999 raft_consensus.cc:2229] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:38.149111 27999 raft_consensus.cc:2258] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:38.156885 28728 raft_consensus.cc:482] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.162497 28588 raft_consensus.cc:482] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.163316 27999 ts_tablet_manager.cc:1905] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:38.163229 28588 raft_consensus.cc:504] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.164469 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "460a679219cb4a7f9aecfec58a98238b" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:38.164873 26771 raft_consensus.cc:3037] T 460a679219cb4a7f9aecfec58a98238b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.164963 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10e6c41db71a4146840f06c5b7412d9c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:38.165831 27055 raft_consensus.cc:2454] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:38.166611 28588 leader_election.cc:288] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.168442 26848 leader_election.cc:302] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:38.169335 27231 tablet_bootstrap.cc:492] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:38.169519 27231 ts_tablet_manager.cc:1397] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.082s user 0.006s sys 0.001s
I20260810 11:30:38.169952 28588 raft_consensus.cc:2781] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:38.170364 28588 raft_consensus.cc:482] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:38.170631 28588 raft_consensus.cc:3037] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.170722 27231 raft_consensus.cc:348] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.170986 27231 raft_consensus.cc:374] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.171053 27231 raft_consensus.cc:729] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.171296 27231 consensus_queue.cc:260] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.171893 27231 ts_tablet_manager.cc:1428] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 11:30:38.178674 28346 catalog_manager.cc:1504] Loading token signing keys...
I20260810 11:30:38.180819 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10e6c41db71a4146840f06c5b7412d9c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:38.181535 26849 leader_election.cc:341] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.181958 26771 raft_consensus.cc:2454] T 460a679219cb4a7f9aecfec58a98238b P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:38.183746 26993 leader_election.cc:302] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:38.176330 28728 raft_consensus.cc:504] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.184249 28651 raft_consensus.cc:2781] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:38.184389 28651 raft_consensus.cc:686] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:38.184736 28651 consensus_queue.cc:237] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.187980 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ada1df82eb44ecb9a6c615b5410e6f" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:38.188279 27055 raft_consensus.cc:2379] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate b6079090b1124d84aa4477974bb53700 in this term.
I20260810 11:30:38.190141 27974 ts_tablet_manager.cc:1918] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:38.190308 27974 log.cc:1196] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/603fe104b7ab485eab6b225a58bddc1c
I20260810 11:30:38.190765 27974 ts_tablet_manager.cc:1939] T 603fe104b7ab485eab6b225a58bddc1c P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:38.190896 28591 raft_consensus.cc:482] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 443ec871f1ed4232b932ecfb0b18510d)
I20260810 11:30:38.192755 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ada1df82eb44ecb9a6c615b5410e6f" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:38.193203 28591 raft_consensus.cc:504] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:38.193884 28591 leader_election.cc:288] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:38.185421 28728 leader_election.cc:288] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.202708 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 227) took 5088 ms. Trace:
W20260810 11:30:38.202834 26848 leader_election.cc:341] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 4c595e0892634348b64418ae9dbbd4c2
I20260810 11:30:38.202884 27974 rpcz_store.cc:276] 0810 11:30:33.114611 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.115721 (+ 1110us) service_pool.cc:227] Handling call
0810 11:30:38.139593 (+5023872us) ts_tablet_manager.cc:1145] Deleting tablet 603fe104b7ab485eab6b225a58bddc1c
0810 11:30:38.139604 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.186004 (+ 46400us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.189990 (+ 3986us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.202675 (+ 12685us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5017037}
I20260810 11:30:38.203325 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 230) took 5072 ms. Trace:
I20260810 11:30:38.203418 27974 rpcz_store.cc:276] 0810 11:30:33.131268 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.131388 (+ 120us) service_pool.cc:227] Handling call
0810 11:30:38.203203 (+5071815us) ts_tablet_manager.cc:1145] Deleting tablet cb01e54d817c4b0dbcc80f90f82923c0
0810 11:30:38.203217 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.203307 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4908020}
I20260810 11:30:38.203620 27290 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 603fe104b7ab485eab6b225a58bddc1c (table default.Table_a5fcf59dae954757a15883ee4da1bf29 [id=758863f16efe460e90394a491cad8914]) successfully deleted
I20260810 11:30:38.203763 27974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32816 (request call id 232) took 4889 ms. Trace:
I20260810 11:30:38.203831 27974 rpcz_store.cc:276] 0810 11:30:33.314224 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:33.314854 (+ 630us) service_pool.cc:227] Handling call
0810 11:30:38.203685 (+4888831us) ts_tablet_manager.cc:1145] Deleting tablet 31cafb7c691d40a48a40f7d4190c4f8d
0810 11:30:38.203695 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.203749 (+ 54us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4888160}
W20260810 11:30:38.204219 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet cb01e54d817c4b0dbcc80f90f82923c0 because the tablet was not found. No further retry: Not found: Tablet not found: cb01e54d817c4b0dbcc80f90f82923c0
W20260810 11:30:38.204984 27290 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 31cafb7c691d40a48a40f7d4190c4f8d because the tablet was not found. No further retry: Not found: Tablet not found: 31cafb7c691d40a48a40f7d4190c4f8d
I20260810 11:30:38.206319 27231 tablet_bootstrap.cc:492] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:38.208690 26700 leader_election.cc:302] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:38.209468 28640 raft_consensus.cc:3037] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.209893 28728 consensus_queue.cc:1035] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:38.214278 28728 raft_consensus.cc:482] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.214458 28728 raft_consensus.cc:504] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.215174 28728 leader_election.cc:288] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.216020 28728 raft_consensus.cc:482] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.216171 28728 raft_consensus.cc:504] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.216452 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44d5e146eeec4fe0be33c1c169d32e68" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:38.216876 28728 leader_election.cc:288] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.216989 28640 raft_consensus.cc:2726] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:38.217469 28728 raft_consensus.cc:482] T 37cecd4266eb47669e7fd5cfeb847adc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.217590 28728 raft_consensus.cc:504] T 37cecd4266eb47669e7fd5cfeb847adc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.217676 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ff5b980ce4e41d7a6e1ca0e740b739c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:38.217860 27055 raft_consensus.cc:2454] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:38.218154 28728 leader_election.cc:288] T 37cecd4266eb47669e7fd5cfeb847adc P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.218608 26702 leader_election.cc:302] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:38.219264 28728 raft_consensus.cc:2781] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:38.219213 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37cecd4266eb47669e7fd5cfeb847adc" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:38.219365 28728 raft_consensus.cc:482] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:38.219422 28728 raft_consensus.cc:3037] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.226322 28728 raft_consensus.cc:504] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.227599 28728 leader_election.cc:288] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.228744 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ff5b980ce4e41d7a6e1ca0e740b739c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:38.229089 27055 raft_consensus.cc:3037] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.229553 27231 tablet_bootstrap.cc:654] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.232254 27055 raft_consensus.cc:2454] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:38.232764 26702 leader_election.cc:302] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:38.234655 28640 raft_consensus.cc:2781] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:38.234637 28660 consensus_queue.cc:1035] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:38.235816 28640 raft_consensus.cc:686] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:38.237737 26771 raft_consensus.cc:3037] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.242471 27999 ts_tablet_manager.cc:1918] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:38.242435 28588 raft_consensus.cc:504] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.244657 28660 consensus_queue.cc:1035] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:38.245245 27231 tablet_bootstrap.cc:492] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:38.245365 27231 ts_tablet_manager.cc:1397] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.039s user 0.000s sys 0.004s
I20260810 11:30:38.246291 27231 raft_consensus.cc:348] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.246482 27231 raft_consensus.cc:374] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.246551 27231 raft_consensus.cc:729] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.246728 27231 consensus_queue.cc:260] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.247282 27231 ts_tablet_manager.cc:1428] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 11:30:38.247570 27231 tablet_bootstrap.cc:492] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:38.247632 28345 raft_consensus.cc:482] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.236143 28640 consensus_queue.cc:237] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.248349 28660 consensus_queue.cc:1035] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:38.250156 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10e6c41db71a4146840f06c5b7412d9c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:38.250499 27055 raft_consensus.cc:3037] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.250519 27231 tablet_bootstrap.cc:654] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:38.259819 26849 leader_election.cc:341] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 4c595e0892634348b64418ae9dbbd4c2
I20260810 11:30:38.260129 28591 raft_consensus.cc:482] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 443ec871f1ed4232b932ecfb0b18510d)
I20260810 11:30:38.260324 28588 leader_election.cc:288] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.262827 27055 raft_consensus.cc:2454] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:38.266089 26849 leader_election.cc:302] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:38.266571 28591 raft_consensus.cc:504] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:38.267750 27999 log.cc:1196] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/1a83391804894d268d0e603f4feb1745
I20260810 11:30:38.267829 26848 leader_election.cc:302] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:38.268425 28586 raft_consensus.cc:2781] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:38.268513 27999 ts_tablet_manager.cc:1939] T 1a83391804894d268d0e603f4feb1745 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:38.273684 28345 raft_consensus.cc:504] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.275254 28588 raft_consensus.cc:2726] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 11:30:38.275723 26848 leader_election.cc:341] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: f2b555f18c1e485d9af7b08f98543c80
I20260810 11:30:38.276392 28345 leader_election.cc:288] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.276759 28591 leader_election.cc:288] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:38.276981 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 52599.1us
I20260810 11:30:38.278249 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44d5e146eeec4fe0be33c1c169d32e68" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:38.279173 26700 leader_election.cc:302] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:38.279367 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 104) took 11698 ms. Trace:
I20260810 11:30:38.279510 27999 rpcz_store.cc:276] 0810 11:30:26.571949 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.572001 (+ 52us) service_pool.cc:227] Handling call
0810 11:30:38.146585 (+11574584us) ts_tablet_manager.cc:1145] Deleting tablet 1a83391804894d268d0e603f4feb1745
0810 11:30:38.146599 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.171943 (+ 25344us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.209154 (+ 37211us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.270108 (+ 60954us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11572284}
I20260810 11:30:38.279996 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ff5b980ce4e41d7a6e1ca0e740b739c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:38.281785 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f64d4b9320c4cb39f57573d781a47d3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:38.282035 27058 raft_consensus.cc:2454] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:38.282024 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f64d4b9320c4cb39f57573d781a47d3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:38.283183 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 1a83391804894d268d0e603f4feb1745 (table default.Table_9329d33b857541719c3852e79fdc14b6 [id=d74c35e9ac524f3798c37c9b6a422a82]) successfully deleted
W20260810 11:30:38.283612 26849 leader_election.cc:341] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: f2b555f18c1e485d9af7b08f98543c80
I20260810 11:30:38.283722 27999 tablet_replica.cc:330] T a18cb43b4dc04a1290a6bade7ac1f3cf P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:38.283872 26849 leader_election.cc:302] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:38.283790 26848 leader_election.cc:302] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:38.284077 27999 raft_consensus.cc:2229] T a18cb43b4dc04a1290a6bade7ac1f3cf P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:38.285295 26700 leader_election.cc:341] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.286075 27999 raft_consensus.cc:2258] T a18cb43b4dc04a1290a6bade7ac1f3cf P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:38.286198 28591 raft_consensus.cc:2726] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:38.286594 28588 raft_consensus.cc:2781] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:38.287864 28588 raft_consensus.cc:482] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260810 11:30:38.288026 26702 consensus_peers.cc:487] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 834c9c99ec424bb39e8a003e9204b2bc. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:38.288028 28588 raft_consensus.cc:3037] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.287948 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37cecd4266eb47669e7fd5cfeb847adc" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:38.288525 28497 raft_consensus.cc:482] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 11:30:38.288719 26849 leader_election.cc:341] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.288749 28497 raft_consensus.cc:504] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.289357 28497 leader_election.cc:288] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:38.289386 26916 raft_consensus.cc:2379] T 37cecd4266eb47669e7fd5cfeb847adc P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
I20260810 11:30:38.290354 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4a37afa17d04e3181e7513ac8d23c24" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:38.290978 26993 leader_election.cc:341] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.291642 26700 leader_election.cc:302] T 37cecd4266eb47669e7fd5cfeb847adc P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:38.292116 28726 raft_consensus.cc:3037] T 37cecd4266eb47669e7fd5cfeb847adc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.294728 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10e6c41db71a4146840f06c5b7412d9c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:38.292681 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ff5b980ce4e41d7a6e1ca0e740b739c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:38.295446 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4a37afa17d04e3181e7513ac8d23c24" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:38.295974 27999 ts_tablet_manager.cc:1905] T a18cb43b4dc04a1290a6bade7ac1f3cf P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:38.296103 26991 leader_election.cc:341] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.296231 26991 leader_election.cc:302] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:38.296772 28651 raft_consensus.cc:2726] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:38.297847 27228 tablet_bootstrap.cc:492] T c62ae41d2dd74eedbe252c4de70fbe1e P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
W20260810 11:30:38.298115 26700 leader_election.cc:341] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.300316 28727 raft_consensus.cc:2726] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:38.303803 28346 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Loaded TSK: 0
I20260810 11:30:38.311019 28346 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 11:30:38.319959 28588 raft_consensus.cc:504] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.321972 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f64d4b9320c4cb39f57573d781a47d3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:38.322314 27055 raft_consensus.cc:3037] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:38.323582 26849 leader_election.cc:341] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.324712 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f64d4b9320c4cb39f57573d781a47d3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
W20260810 11:30:38.325426 26849 leader_election.cc:341] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.325534 27055 raft_consensus.cc:2454] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:38.337931 28726 raft_consensus.cc:2726] T 37cecd4266eb47669e7fd5cfeb847adc P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:38.338541 26848 leader_election.cc:302] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:38.339306 27228 ts_tablet_manager.cc:1397] T c62ae41d2dd74eedbe252c4de70fbe1e P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.191s user 0.006s sys 0.006s
I20260810 11:30:38.339562 28345 raft_consensus.cc:2781] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:38.339824 28345 raft_consensus.cc:686] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:38.346402 28345 consensus_queue.cc:237] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.347208 27999 ts_tablet_manager.cc:1918] T a18cb43b4dc04a1290a6bade7ac1f3cf P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:38.347399 27999 log.cc:1196] T a18cb43b4dc04a1290a6bade7ac1f3cf P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/a18cb43b4dc04a1290a6bade7ac1f3cf
I20260810 11:30:38.348287 27999 ts_tablet_manager.cc:1939] T a18cb43b4dc04a1290a6bade7ac1f3cf P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:38.349512 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 89) took 11800 ms. Trace:
I20260810 11:30:38.349840 27999 rpcz_store.cc:276] 0810 11:30:26.549482 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.550309 (+ 827us) service_pool.cc:227] Handling call
0810 11:30:38.279819 (+11729510us) ts_tablet_manager.cc:1145] Deleting tablet a18cb43b4dc04a1290a6bade7ac1f3cf
0810 11:30:38.283514 (+ 3695us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.322516 (+ 39002us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.345380 (+ 22864us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.349458 (+ 4078us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11704218}
I20260810 11:30:38.350340 27999 tablet_replica.cc:330] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:38.350606 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet a18cb43b4dc04a1290a6bade7ac1f3cf (table default.Table_edb9387fb3ec47eab19fc13e046c5533 [id=5e2dc70c9ac641cb91652fe29c4c5e7b]) successfully deleted
I20260810 11:30:38.352110 27222 tablet_bootstrap.cc:492] T 1f64d4b9320c4cb39f57573d781a47d3 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:38.352310 27222 ts_tablet_manager.cc:1397] T 1f64d4b9320c4cb39f57573d781a47d3 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.217s user 0.012s sys 0.016s
I20260810 11:30:38.353487 27222 raft_consensus.cc:348] T 1f64d4b9320c4cb39f57573d781a47d3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.353834 27222 raft_consensus.cc:374] T 1f64d4b9320c4cb39f57573d781a47d3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.353896 27222 raft_consensus.cc:729] T 1f64d4b9320c4cb39f57573d781a47d3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.355907 27228 raft_consensus.cc:348] T c62ae41d2dd74eedbe252c4de70fbe1e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.356258 27228 raft_consensus.cc:374] T c62ae41d2dd74eedbe252c4de70fbe1e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.339161 28588 leader_election.cc:288] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.356665 27228 raft_consensus.cc:729] T c62ae41d2dd74eedbe252c4de70fbe1e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.357024 27228 consensus_queue.cc:260] T c62ae41d2dd74eedbe252c4de70fbe1e P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.362625 27228 ts_tablet_manager.cc:1428] T c62ae41d2dd74eedbe252c4de70fbe1e P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.018s user 0.000s sys 0.002s
I20260810 11:30:38.363546 27228 tablet_bootstrap.cc:492] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:38.369863 27228 tablet_bootstrap.cc:654] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.373083 27231 tablet_bootstrap.cc:492] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:38.379525 28586 raft_consensus.cc:686] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:38.381054 28586 consensus_queue.cc:237] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.393671 26578 catalog_manager.cc:5495] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:38.395079 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]). Expected version 2 got 0
I20260810 11:30:38.402878 27222 consensus_queue.cc:260] T 1f64d4b9320c4cb39f57573d781a47d3 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.405481 27222 ts_tablet_manager.cc:1428] T 1f64d4b9320c4cb39f57573d781a47d3 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.053s user 0.004s sys 0.000s
I20260810 11:30:38.406755 27222 tablet_bootstrap.cc:492] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:38.410096 27231 ts_tablet_manager.cc:1397] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.163s user 0.003s sys 0.005s
I20260810 11:30:38.411260 27231 raft_consensus.cc:348] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.411623 27231 raft_consensus.cc:374] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.411746 27231 raft_consensus.cc:729] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.412009 26541 master_runner.cc:186] Error getting master registration for 127.25.195.253:34547: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111),
I20260810 11:30:38.412292 26541 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 11:30:38.412060 27231 consensus_queue.cc:260] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.413055 27231 ts_tablet_manager.cc:1428] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:38.413470 27231 tablet_bootstrap.cc:492] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:38.416139 27231 tablet_bootstrap.cc:654] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.393395 27228 tablet_bootstrap.cc:492] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:38.419595 27228 ts_tablet_manager.cc:1397] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.056s user 0.011s sys 0.002s
I20260810 11:30:38.420766 27228 raft_consensus.cc:348] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.421175 27228 raft_consensus.cc:374] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.421299 27228 raft_consensus.cc:729] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.421660 27228 consensus_queue.cc:260] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.422421 27228 ts_tablet_manager.cc:1428] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:38.422860 27228 tablet_bootstrap.cc:492] T 34ed8c9efa634fc7b091b1bb6bc6d452 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:38.427574 27228 tablet_bootstrap.cc:654] T 34ed8c9efa634fc7b091b1bb6bc6d452 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.427837 26581 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_dcca9eca711c4c6e9a0a5f4d9f370eb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:38.426510 26575 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_feb78e30519943298329752c4fd77a59" } new_table_name: "default.Table_5ba00bd0ab7d4cdcb1494f9491c64291" modify_external_catalogs: true
I20260810 11:30:38.427505 26573 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935" } modify_external_catalogs: true
I20260810 11:30:38.431980 26573 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935" } modify_external_catalogs: true
I20260810 11:30:38.429042 26574 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_12d15f4d2bd3426788aadc76beeff465" } modify_external_catalogs: true
I20260810 11:30:38.434221 26574 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_12d15f4d2bd3426788aadc76beeff465" } modify_external_catalogs: true
I20260810 11:30:38.429581 26572 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_abbbb80ecbe4491d98912dcdcaab5dd3" } modify_external_catalogs: true
I20260810 11:30:38.438853 26577 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_10b2af8299224f5db4a63bd1fae61155" } new_table_name: "default.Table_4a2c6a140b7b448c91b9da7043c93c05" modify_external_catalogs: true
I20260810 11:30:38.440269 26580 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_0c1c960361be4daaab7ecd5cc74c33aa" } new_table_name: "default.Table_dc1b23eedbd04b3eaff47cd2e647b29c" modify_external_catalogs: true
I20260810 11:30:38.440202 28726 consensus_queue.cc:1035] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:38.443979 26572 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_abbbb80ecbe4491d98912dcdcaab5dd3" } modify_external_catalogs: true
I20260810 11:30:38.444371 27222 tablet_bootstrap.cc:654] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.444648 26576 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_a827339eadbd440bb3c0bfa6c52512ca" } new_table_name: "default.Table_dff842ea56e74537a3124efd9e956e11" modify_external_catalogs: true
I20260810 11:30:38.450681 27999 raft_consensus.cc:2229] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
W20260810 11:30:38.450937 26581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dcca9eca711c4c6e9a0a5f4d9f370eb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:38.451504 27999 pending_rounds.cc:62] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700: Trying to abort 1 pending ops.
I20260810 11:30:38.451689 27999 pending_rounds.cc:68] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936451768774656 op_type: NO_OP noop_request { }
W20260810 11:30:38.450387 26564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111) [suppressed 11 similar messages]
I20260810 11:30:38.452132 27999 raft_consensus.cc:2866] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:38.452406 27999 raft_consensus.cc:2258] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:38.430334 26571 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_a28f24b6d9034bdbb5e3e055eafbcb5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:38.455009 28748 consensus_queue.cc:1035] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:38.455667 26571 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a28f24b6d9034bdbb5e3e055eafbcb5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:38.458786 27999 ts_tablet_manager.cc:1905] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:38.437508 28497 consensus_queue.cc:1035] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:38.464042 28752 raft_consensus.cc:482] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.466909 28752 raft_consensus.cc:504] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.467867 28752 leader_election.cc:288] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:38.468752 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9079c8fec89043be9d0040a3728e93f4" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:38.468865 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9079c8fec89043be9d0040a3728e93f4" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:38.469099 26911 raft_consensus.cc:2454] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:38.469496 26991 leader_election.cc:302] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
W20260810 11:30:38.469676 26993 leader_election.cc:341] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.469777 28752 raft_consensus.cc:2781] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:38.469869 28752 raft_consensus.cc:482] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:38.469935 28752 raft_consensus.cc:3037] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.472960 27222 tablet_bootstrap.cc:492] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:38.473975 28752 raft_consensus.cc:504] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.474782 27222 ts_tablet_manager.cc:1397] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.004s
I20260810 11:30:38.475469 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9079c8fec89043be9d0040a3728e93f4" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:38.475850 26911 raft_consensus.cc:3037] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.476449 27222 raft_consensus.cc:348] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.477006 28752 leader_election.cc:288] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:38.479269 27222 raft_consensus.cc:374] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.479383 27222 raft_consensus.cc:729] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.477710 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9079c8fec89043be9d0040a3728e93f4" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:38.479725 27222 consensus_queue.cc:260] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:38.479947 26993 leader_election.cc:341] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.480654 26911 raft_consensus.cc:2454] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:38.481125 26991 leader_election.cc:302] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:38.481914 28752 raft_consensus.cc:2781] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:38.482144 28752 raft_consensus.cc:686] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:38.482506 28752 consensus_queue.cc:237] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.485900 27228 tablet_bootstrap.cc:492] T 34ed8c9efa634fc7b091b1bb6bc6d452 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:38.486215 27228 ts_tablet_manager.cc:1397] T 34ed8c9efa634fc7b091b1bb6bc6d452 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.063s user 0.005s sys 0.005s
I20260810 11:30:38.487567 27228 raft_consensus.cc:348] T 34ed8c9efa634fc7b091b1bb6bc6d452 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.487936 27228 raft_consensus.cc:374] T 34ed8c9efa634fc7b091b1bb6bc6d452 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.488150 27228 raft_consensus.cc:729] T 34ed8c9efa634fc7b091b1bb6bc6d452 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.488683 27222 ts_tablet_manager.cc:1428] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260810 11:30:38.492057 27222 tablet_bootstrap.cc:492] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:38.493631 28726 raft_consensus.cc:482] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.493844 28726 raft_consensus.cc:504] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.495873 28726 leader_election.cc:288] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.496901 26821 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:38.497826 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10e6c41db71a4146840f06c5b7412d9c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:38.498206 27055 raft_consensus.cc:2379] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate b6079090b1124d84aa4477974bb53700 in this term.
I20260810 11:30:38.500164 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10e6c41db71a4146840f06c5b7412d9c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:38.501605 26700 leader_election.cc:341] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: Tablet not RUNNING: STOPPED
I20260810 11:30:38.501749 26700 leader_election.cc:302] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:38.501989 28748 consensus_queue.cc:1035] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:38.503746 28727 raft_consensus.cc:3037] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.512825 28497 consensus_queue.cc:1035] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:38.518966 27999 ts_tablet_manager.cc:1918] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:38.519270 27999 log.cc:1196] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/10e6c41db71a4146840f06c5b7412d9c
I20260810 11:30:38.521581 28727 raft_consensus.cc:2726] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:38.488495 27228 consensus_queue.cc:260] T 34ed8c9efa634fc7b091b1bb6bc6d452 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.526144 27228 ts_tablet_manager.cc:1428] T 34ed8c9efa634fc7b091b1bb6bc6d452 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.040s user 0.003s sys 0.000s
I20260810 11:30:38.526363 27999 ts_tablet_manager.cc:1939] T 10e6c41db71a4146840f06c5b7412d9c P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:38.530676 27228 tablet_bootstrap.cc:492] T 7d3406f12d9c492cbd0d86fa7a57de82 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:38.532195 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 106) took 11953 ms. Trace:
I20260810 11:30:38.532675 28591 raft_consensus.cc:482] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:38.532953 28591 raft_consensus.cc:504] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.533397 27999 rpcz_store.cc:276] 0810 11:30:26.578339 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.578390 (+ 51us) service_pool.cc:227] Handling call
0810 11:30:38.350198 (+11771808us) ts_tablet_manager.cc:1145] Deleting tablet 10e6c41db71a4146840f06c5b7412d9c
0810 11:30:38.350211 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.451228 (+101017us) spinlock_profiling.cc:243] Waited 99.9 ms on lock 0x6150002a5ba4. stack: 00007f7f891ce66e 00007f7f891ce430 00007f7f882555ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f7f9470604d 00007f7f959aa5ec 00007f7f983392e6 00007f7f9836b404 00007f7f9834c870 00007f7f9834c5fd 00000000009edb7c 00007f7f89214344 00007f7f8921791b 00007f7f89217798
0810 11:30:38.469557 (+ 18329us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.494610 (+ 25053us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.532076 (+ 37466us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":229785472,"tablet-delete.queue_time_us":11771396}
I20260810 11:30:38.533905 27999 tablet_replica.cc:330] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:38.533968 28591 leader_election.cc:288] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.535302 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 10e6c41db71a4146840f06c5b7412d9c (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]) successfully deleted
W20260810 11:30:38.535382 26848 leader_election.cc:341] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: d91a02b22044429fb3e25840c7947a02
I20260810 11:30:38.537151 27228 tablet_bootstrap.cc:654] T 7d3406f12d9c492cbd0d86fa7a57de82 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:38.537591 26849 leader_election.cc:341] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: d91a02b22044429fb3e25840c7947a02
I20260810 11:30:38.538133 26849 leader_election.cc:302] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:38.539506 28588 raft_consensus.cc:2726] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:38.549969 27999 raft_consensus.cc:2229] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:38.550225 27999 raft_consensus.cc:2258] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:38.556727 28728 consensus_queue.cc:1035] T 94bcb1739e5144559201479b82c07941 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:38.550949 27999 ts_tablet_manager.cc:1905] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:38.569839 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet ff9b649e43a9456fa51cf3330290bb91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:38.570231 27974 tablet_replica.cc:330] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:38.570523 27974 raft_consensus.cc:2229] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:38.570950 27974 raft_consensus.cc:2258] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:38.571728 27974 ts_tablet_manager.cc:1905] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:38.573242 27999 ts_tablet_manager.cc:1918] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:38.573401 27999 log.cc:1196] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/cb6805a5dd264939850ea2cd9a850a1f
I20260810 11:30:38.573832 27999 ts_tablet_manager.cc:1939] T cb6805a5dd264939850ea2cd9a850a1f P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:38.574952 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 105) took 11996 ms. Trace:
W20260810 11:30:38.580334 26564 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.253:34547, user_credentials={real_user=slave}} blocked reactor thread for 170895us
I20260810 11:30:38.580461 27228 tablet_bootstrap.cc:492] T 7d3406f12d9c492cbd0d86fa7a57de82 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:38.580740 27228 ts_tablet_manager.cc:1397] T 7d3406f12d9c492cbd0d86fa7a57de82 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.050s user 0.001s sys 0.008s
I20260810 11:30:38.582492 27228 raft_consensus.cc:348] T 7d3406f12d9c492cbd0d86fa7a57de82 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.582940 27228 raft_consensus.cc:374] T 7d3406f12d9c492cbd0d86fa7a57de82 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.583074 27228 raft_consensus.cc:729] T 7d3406f12d9c492cbd0d86fa7a57de82 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.583449 27228 consensus_queue.cc:260] T 7d3406f12d9c492cbd0d86fa7a57de82 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.588744 27110 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:38.589939 27228 ts_tablet_manager.cc:1428] T 7d3406f12d9c492cbd0d86fa7a57de82 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.009s user 0.000s sys 0.003s
I20260810 11:30:38.590329 27228 tablet_bootstrap.cc:492] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:38.593783 27228 tablet_bootstrap.cc:654] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.575132 27999 rpcz_store.cc:276] 0810 11:30:26.578168 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.578568 (+ 400us) service_pool.cc:227] Handling call
0810 11:30:38.533748 (+11955180us) ts_tablet_manager.cc:1145] Deleting tablet cb6805a5dd264939850ea2cd9a850a1f
0810 11:30:38.533760 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.568351 (+ 34591us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.573114 (+ 4763us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.574905 (+ 1791us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15773,"tablet-delete.queue_time_us":11952375}
I20260810 11:30:38.598976 27999 tablet_replica.cc:330] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:38.599663 27999 raft_consensus.cc:2229] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:38.598395 28660 raft_consensus.cc:482] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.600001 27999 raft_consensus.cc:2258] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:38.599951 28660 raft_consensus.cc:504] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:38.600183 26575 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c62ae41d2dd74eedbe252c4de70fbe1e consensus state has no leader
I20260810 11:30:38.600426 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet cb6805a5dd264939850ea2cd9a850a1f (table default.Table_057f1bf3995143138dd2954a212a480b [id=2db59831074f4dd2b4603d6f8215b1d0]) successfully deleted
I20260810 11:30:38.600656 27999 ts_tablet_manager.cc:1905] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:38.603953 28660 leader_election.cc:288] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:38.603855 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2634beb347714fc7a2e05865adb34a22" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:38.604692 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2634beb347714fc7a2e05865adb34a22" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:38.604808 26991 leader_election.cc:341] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:38.605360 26993 leader_election.cc:341] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.605508 26993 leader_election.cc:302] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:38.605887 28660 raft_consensus.cc:2726] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:38.610363 27974 ts_tablet_manager.cc:1918] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:38.610646 27974 log.cc:1196] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/ff9b649e43a9456fa51cf3330290bb91
I20260810 11:30:38.611207 27974 ts_tablet_manager.cc:1939] T ff9b649e43a9456fa51cf3330290bb91 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:38.615463 26575 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_c68a4d11e9de4ef5a80903d5658bd5f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:38.616638 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet ff9b649e43a9456fa51cf3330290bb91 (table default.Table_4ce8a3965b484cdb8c1f9b7d7e318755 [id=1ef3626d71d5408692ce0f62d2d5eca1]) successfully deleted
W20260810 11:30:38.616760 26575 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c68a4d11e9de4ef5a80903d5658bd5f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:38.619529 27999 ts_tablet_manager.cc:1918] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:38.619684 27999 log.cc:1196] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/a7a2cb1d2e8e40f58144908e34438d53
I20260810 11:30:38.620066 27999 ts_tablet_manager.cc:1939] T a7a2cb1d2e8e40f58144908e34438d53 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:38.623306 26916 raft_consensus.cc:1261] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700 [term 2 FOLLOWER]: Refusing update from remote peer 443ec871f1ed4232b932ecfb0b18510d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260810 11:30:38.625109 28727 consensus_queue.cc:1035] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:38.625437 27228 tablet_bootstrap.cc:492] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:38.625603 27228 ts_tablet_manager.cc:1397] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.035s user 0.006s sys 0.003s
I20260810 11:30:38.629788 27231 tablet_bootstrap.cc:492] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:38.629995 27231 ts_tablet_manager.cc:1397] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.217s user 0.005s sys 0.001s
I20260810 11:30:38.630771 27231 raft_consensus.cc:348] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.630990 27231 raft_consensus.cc:374] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.631057 27231 raft_consensus.cc:729] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.631419 27231 consensus_queue.cc:260] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.631982 27231 ts_tablet_manager.cc:1428] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 11:30:38.632280 27231 tablet_bootstrap.cc:492] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:38.634258 27231 tablet_bootstrap.cc:654] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.634425 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 108) took 12052 ms. Trace:
I20260810 11:30:38.637377 27228 raft_consensus.cc:348] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.637670 27228 raft_consensus.cc:374] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.637745 27228 raft_consensus.cc:729] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.637976 27228 consensus_queue.cc:260] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.638574 27228 ts_tablet_manager.cc:1428] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260810 11:30:38.638891 27228 tablet_bootstrap.cc:492] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:38.640550 27228 tablet_bootstrap.cc:654] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.641176 27999 rpcz_store.cc:276] 0810 11:30:26.581708 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.581776 (+ 68us) service_pool.cc:227] Handling call
0810 11:30:38.598917 (+12017141us) ts_tablet_manager.cc:1145] Deleting tablet a7a2cb1d2e8e40f58144908e34438d53
0810 11:30:38.598932 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.609320 (+ 10388us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.619386 (+ 10066us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.634396 (+ 15010us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12016871}
I20260810 11:30:38.642436 27999 tablet_replica.cc:330] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:38.642575 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet a7a2cb1d2e8e40f58144908e34438d53 (table default.Table_05a7698994184d6bbed238252235f5f8 [id=7d1bf48b16db41a0a41a092bb07b8753]) successfully deleted
I20260810 11:30:38.642683 27999 raft_consensus.cc:2229] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:38.643025 27999 pending_rounds.cc:62] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700: Trying to abort 1 pending ops.
I20260810 11:30:38.643112 27999 pending_rounds.cc:68] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936439606345728 op_type: NO_OP noop_request { }
I20260810 11:30:38.643239 27999 raft_consensus.cc:2866] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:38.643321 27999 raft_consensus.cc:2258] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:38.643936 27999 ts_tablet_manager.cc:1905] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:38.645133 27222 tablet_bootstrap.cc:654] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:38.654721 26566 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_5ba00bd0ab7d4cdcb1494f9491c64291 [id=5c8a2cbef71f4c9fb038a49e1ca7f704], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet c62ae41d2dd74eedbe252c4de70fbe1e consensus state has no leader
I20260810 11:30:38.656705 27061 raft_consensus.cc:1261] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Refusing update from remote peer 443ec871f1ed4232b932ecfb0b18510d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260810 11:30:38.656852 27061 pending_rounds.cc:76] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215: Aborting all ops after (but not including) 0
I20260810 11:30:38.656894 27061 pending_rounds.cc:97] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260810 11:30:38.659653 27061 raft_consensus.cc:2866] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260810 11:30:38.659945 26573 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 6c715bdcff8c4cdabfddf871f6fdc388
I20260810 11:30:38.661517 27231 tablet_bootstrap.cc:492] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:38.661448 28727 consensus_queue.cc:1035] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:38.661724 27231 ts_tablet_manager.cc:1397] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20260810 11:30:38.661983 27228 tablet_bootstrap.cc:492] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:38.662149 27228 ts_tablet_manager.cc:1397] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260810 11:30:38.663256 27228 raft_consensus.cc:348] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.663486 27228 raft_consensus.cc:374] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.663547 27228 raft_consensus.cc:729] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.663810 27228 consensus_queue.cc:260] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.664487 27228 ts_tablet_manager.cc:1428] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 11:30:38.665032 27228 tablet_bootstrap.cc:492] T 460a679219cb4a7f9aecfec58a98238b P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:38.666447 27231 raft_consensus.cc:348] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.666702 27231 raft_consensus.cc:374] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.666769 27231 raft_consensus.cc:729] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.666952 27231 consensus_queue.cc:260] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.667595 27231 ts_tablet_manager.cc:1428] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260810 11:30:38.667896 27231 tablet_bootstrap.cc:492] T 9e329b95fc8e41c3967079896294942a P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:38.670606 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c715bdcff8c4cdabfddf871f6fdc388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:38.671311 27974 tablet_replica.cc:330] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:38.671634 27974 raft_consensus.cc:2229] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:38.671942 27974 raft_consensus.cc:2258] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:38.672734 27974 ts_tablet_manager.cc:1905] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:38.673101 28727 raft_consensus.cc:482] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.673259 28752 raft_consensus.cc:482] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.673313 28727 raft_consensus.cc:504] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.673413 28752 raft_consensus.cc:504] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.674588 28727 leader_election.cc:288] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.674643 28752 leader_election.cc:288] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:38.675623 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "420ba6e9f74c4ae5bf450f369e7fbdb3" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:38.675871 27055 raft_consensus.cc:2454] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:38.675873 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34ed8c9efa634fc7b091b1bb6bc6d452" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:38.676419 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "420ba6e9f74c4ae5bf450f369e7fbdb3" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:38.676715 26915 raft_consensus.cc:2454] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:38.677417 26702 leader_election.cc:302] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
W20260810 11:30:38.677732 26993 leader_election.cc:341] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.678304 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34ed8c9efa634fc7b091b1bb6bc6d452" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:38.678582 26916 raft_consensus.cc:2454] T 34ed8c9efa634fc7b091b1bb6bc6d452 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:38.678970 28727 raft_consensus.cc:2781] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:38.679073 26991 leader_election.cc:302] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:38.679206 28727 raft_consensus.cc:482] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:38.679396 28727 raft_consensus.cc:3037] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.679667 28752 raft_consensus.cc:2781] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:38.679778 28752 raft_consensus.cc:482] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:38.679868 28752 raft_consensus.cc:3037] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.683301 28752 raft_consensus.cc:504] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.684176 28727 raft_consensus.cc:504] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.685154 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34ed8c9efa634fc7b091b1bb6bc6d452" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:38.685289 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "420ba6e9f74c4ae5bf450f369e7fbdb3" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:38.685369 26916 raft_consensus.cc:3037] T 34ed8c9efa634fc7b091b1bb6bc6d452 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.685411 26915 raft_consensus.cc:3037] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.687094 27222 tablet_bootstrap.cc:492] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:38.687299 27222 ts_tablet_manager.cc:1397] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.198s user 0.004s sys 0.000s
I20260810 11:30:38.688232 26915 raft_consensus.cc:2454] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:38.688820 26916 raft_consensus.cc:2454] T 34ed8c9efa634fc7b091b1bb6bc6d452 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:38.689211 26700 leader_election.cc:302] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:38.689647 28640 raft_consensus.cc:2781] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:38.689873 28640 raft_consensus.cc:686] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:38.690160 27228 tablet_bootstrap.cc:654] T 460a679219cb4a7f9aecfec58a98238b P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.690196 28640 consensus_queue.cc:237] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.691102 26991 leader_election.cc:302] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:38.691541 28497 raft_consensus.cc:2781] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:38.691730 28497 raft_consensus.cc:686] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:38.691975 28497 consensus_queue.cc:237] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.692644 28727 leader_election.cc:288] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.693260 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "420ba6e9f74c4ae5bf450f369e7fbdb3" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:38.693531 27055 raft_consensus.cc:3037] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.696375 27999 ts_tablet_manager.cc:1918] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:38.696537 27999 log.cc:1196] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/83631b421a614796bdf76335f1437e00
I20260810 11:30:38.696993 27999 ts_tablet_manager.cc:1939] T 83631b421a614796bdf76335f1437e00 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:38.698344 27055 raft_consensus.cc:2454] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:38.700644 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c715bdcff8c4cdabfddf871f6fdc388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:38.705099 27222 raft_consensus.cc:348] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.706398 27222 raft_consensus.cc:374] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.706805 28752 leader_election.cc:288] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:38.707088 27222 raft_consensus.cc:729] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.708210 27222 consensus_queue.cc:260] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.712625 27974 ts_tablet_manager.cc:1918] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:38.712849 27974 log.cc:1196] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/6c715bdcff8c4cdabfddf871f6fdc388
W20260810 11:30:38.712896 26577 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 77ffda3325af4096bbec689397f7a324 consensus state has no leader
I20260810 11:30:38.713387 27974 ts_tablet_manager.cc:1939] T 6c715bdcff8c4cdabfddf871f6fdc388 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:38.713694 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34ed8c9efa634fc7b091b1bb6bc6d452" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:38.714432 27222 ts_tablet_manager.cc:1428] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.027s user 0.004s sys 0.000s
I20260810 11:30:38.714948 27222 tablet_bootstrap.cc:492] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:38.715262 26993 leader_election.cc:341] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.716987 26572 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 3ccef06fa06c4c519d8760fa948d6c8b
I20260810 11:30:38.718320 27231 tablet_bootstrap.cc:654] T 9e329b95fc8e41c3967079896294942a P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.719095 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ccef06fa06c4c519d8760fa948d6c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:38.720060 26574 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 713663be70014b17b17056a865e7db63
I20260810 11:30:38.724262 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 713663be70014b17b17056a865e7db63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:38.724018 27222 tablet_bootstrap.cc:654] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.729895 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]) successfully deleted
I20260810 11:30:38.730969 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ccef06fa06c4c519d8760fa948d6c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:38.731213 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet 713663be70014b17b17056a865e7db63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:38.731870 27231 tablet_bootstrap.cc:492] T 9e329b95fc8e41c3967079896294942a P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:38.732048 27231 ts_tablet_manager.cc:1397] T 9e329b95fc8e41c3967079896294942a P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.064s user 0.000s sys 0.005s
I20260810 11:30:38.733081 27231 raft_consensus.cc:348] T 9e329b95fc8e41c3967079896294942a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.733345 27231 raft_consensus.cc:374] T 9e329b95fc8e41c3967079896294942a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.733399 27231 raft_consensus.cc:729] T 9e329b95fc8e41c3967079896294942a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.733743 27974 tablet_replica.cc:330] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:38.734125 27974 raft_consensus.cc:2229] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:38.734508 27974 raft_consensus.cc:2258] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:38.735312 27974 ts_tablet_manager.cc:1905] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:38.736271 27231 consensus_queue.cc:260] T 9e329b95fc8e41c3967079896294942a P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.737057 27231 ts_tablet_manager.cc:1428] T 9e329b95fc8e41c3967079896294942a P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260810 11:30:38.737576 27231 tablet_bootstrap.cc:492] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:38.740661 28588 raft_consensus.cc:482] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.740967 28588 raft_consensus.cc:504] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.742372 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ff5b980ce4e41d7a6e1ca0e740b739c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:38.743590 28588 leader_election.cc:288] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.743893 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ff5b980ce4e41d7a6e1ca0e740b739c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:38.744393 27061 raft_consensus.cc:2379] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:38.745278 26848 leader_election.cc:302] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:38.746218 28799 tablet.cc:1722] T 39beb126ac324842b7e387c46bcb4099 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260810 11:30:38.746656 26849 consensus_peers.cc:487] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ac4b1821ac30452cbe7a8f844d9b37e5. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:38.747076 28588 raft_consensus.cc:3037] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.750432 28588 raft_consensus.cc:2726] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:38.757655 28797 tablet.cc:1722] T 39beb126ac324842b7e387c46bcb4099 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:38.759217 28795 tablet.cc:1722] T 39beb126ac324842b7e387c46bcb4099 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:38.763480 27228 tablet_bootstrap.cc:492] T 460a679219cb4a7f9aecfec58a98238b P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:38.765558 27222 tablet_bootstrap.cc:492] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:38.765829 27222 ts_tablet_manager.cc:1397] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.051s user 0.001s sys 0.004s
I20260810 11:30:38.754410 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 109) took 12172 ms. Trace:
I20260810 11:30:38.766001 27999 rpcz_store.cc:276] 0810 11:30:26.582296 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.582344 (+ 48us) service_pool.cc:227] Handling call
0810 11:30:38.642323 (+12059979us) ts_tablet_manager.cc:1145] Deleting tablet 83631b421a614796bdf76335f1437e00
0810 11:30:38.642356 (+ 33us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.667894 (+ 25538us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.696266 (+ 28372us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.754372 (+ 58106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12059668}
I20260810 11:30:38.766532 27999 tablet_replica.cc:330] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:38.766654 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 83631b421a614796bdf76335f1437e00 (table default.Table_7257f6125cd44735b0cfde14a574b1e6 [id=0bcc4778f70e44b8952915c4ba9d6ed8]) successfully deleted
I20260810 11:30:38.767071 28794 tablet_replica.cc:330] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:38.767132 27999 raft_consensus.cc:2229] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:38.767328 27999 raft_consensus.cc:2258] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:38.767407 28794 raft_consensus.cc:2229] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:38.768216 27222 raft_consensus.cc:348] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.768127 26572 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_7df687282e5d42448878a624cddcac77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:38.768738 27222 raft_consensus.cc:374] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.768868 27222 raft_consensus.cc:729] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.766762 27228 ts_tablet_manager.cc:1397] T 460a679219cb4a7f9aecfec58a98238b P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.102s user 0.005s sys 0.002s
I20260810 11:30:38.769230 28794 raft_consensus.cc:2258] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:38.769279 26572 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7df687282e5d42448878a624cddcac77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:38.769145 27222 consensus_queue.cc:260] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.769986 28794 ts_tablet_manager.cc:1905] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:38.771309 26574 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_710852962fc94eebadae58bb908b6a3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:38.772092 26574 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_710852962fc94eebadae58bb908b6a3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:38.772187 28588 raft_consensus.cc:482] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.772357 28588 raft_consensus.cc:504] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.773648 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e329b95fc8e41c3967079896294942a" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:38.774264 26849 leader_election.cc:341] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.774861 27999 ts_tablet_manager.cc:1905] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:38.775472 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e329b95fc8e41c3967079896294942a" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:38.775789 27061 raft_consensus.cc:2454] T 9e329b95fc8e41c3967079896294942a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:38.776232 26848 leader_election.cc:302] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:38.776499 28588 leader_election.cc:288] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.778215 27222 ts_tablet_manager.cc:1428] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.012s user 0.000s sys 0.003s
I20260810 11:30:38.778651 27222 tablet_bootstrap.cc:492] T c62ae41d2dd74eedbe252c4de70fbe1e P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:38.781088 27231 tablet_bootstrap.cc:654] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.785739 27222 tablet_bootstrap.cc:654] T c62ae41d2dd74eedbe252c4de70fbe1e P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.788368 27974 ts_tablet_manager.cc:1918] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 11:30:38.788655 27974 log.cc:1196] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/3ccef06fa06c4c519d8760fa948d6c8b
I20260810 11:30:38.789297 27974 ts_tablet_manager.cc:1939] T 3ccef06fa06c4c519d8760fa948d6c8b P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:38.793079 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 3ccef06fa06c4c519d8760fa948d6c8b (table default.Table_abbbb80ecbe4491d98912dcdcaab5dd3 [id=ba999b4084c84b2f8e0313b96849b169]) successfully deleted
W20260810 11:30:38.794070 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 713663be70014b17b17056a865e7db63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 713663be70014b17b17056a865e7db63 already in progress: creating tablet
I20260810 11:30:38.796670 28660 raft_consensus.cc:482] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.805284 28660 raft_consensus.cc:504] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.806151 28660 leader_election.cc:288] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:38.806856 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b5a7f67ec5b48c2b5a510add0282a76" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:38.807148 26916 raft_consensus.cc:2454] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:38.808218 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b5a7f67ec5b48c2b5a510add0282a76" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:38.809242 26993 leader_election.cc:341] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.816195 28794 ts_tablet_manager.cc:1918] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:38.819720 26991 leader_election.cc:302] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:38.823707 28794 log.cc:1196] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/6c715bdcff8c4cdabfddf871f6fdc388
I20260810 11:30:38.824203 28497 raft_consensus.cc:2781] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:38.824018 26571 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_faf9f4a916e7439dbefd685a103109aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:38.824390 28497 raft_consensus.cc:482] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:38.824618 28497 raft_consensus.cc:3037] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.824738 28794 ts_tablet_manager.cc:1939] T 6c715bdcff8c4cdabfddf871f6fdc388 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
W20260810 11:30:38.824781 26571 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_faf9f4a916e7439dbefd685a103109aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:38.822453 27231 tablet_bootstrap.cc:492] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:38.825506 27231 ts_tablet_manager.cc:1397] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.088s user 0.006s sys 0.009s
I20260810 11:30:38.825883 28794 tablet_replica.cc:330] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:38.826247 28794 raft_consensus.cc:2229] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:38.826521 28794 raft_consensus.cc:2258] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:38.826683 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]) successfully deleted
I20260810 11:30:38.827409 28794 ts_tablet_manager.cc:1905] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:38.827131 27231 raft_consensus.cc:348] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.827692 28497 raft_consensus.cc:504] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.827742 27231 raft_consensus.cc:374] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.827999 27231 raft_consensus.cc:729] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.828383 27231 consensus_queue.cc:260] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.829254 27231 ts_tablet_manager.cc:1428] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 11:30:38.829747 27231 tablet_bootstrap.cc:492] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:38.830514 28591 raft_consensus.cc:2781] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:38.830668 28591 raft_consensus.cc:482] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:38.830746 28591 raft_consensus.cc:3037] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.832237 27231 tablet_bootstrap.cc:654] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.833410 27222 tablet_bootstrap.cc:492] T c62ae41d2dd74eedbe252c4de70fbe1e P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:38.833673 27222 ts_tablet_manager.cc:1397] T c62ae41d2dd74eedbe252c4de70fbe1e P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.055s user 0.013s sys 0.004s
I20260810 11:30:38.834703 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b5a7f67ec5b48c2b5a510add0282a76" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:38.835094 27222 raft_consensus.cc:348] T c62ae41d2dd74eedbe252c4de70fbe1e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.835386 27222 raft_consensus.cc:374] T c62ae41d2dd74eedbe252c4de70fbe1e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 11:30:38.835448 26993 leader_election.cc:341] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.835536 27222 raft_consensus.cc:729] T c62ae41d2dd74eedbe252c4de70fbe1e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.835732 28497 leader_election.cc:288] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:38.835949 27222 consensus_queue.cc:260] T c62ae41d2dd74eedbe252c4de70fbe1e P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.832643 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b5a7f67ec5b48c2b5a510add0282a76" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:38.841029 26915 raft_consensus.cc:3037] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.843842 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]). Expected version 2 got 0
I20260810 11:30:38.844498 26578 catalog_manager.cc:5495] T 00c4599256684f5dbc745c9283f31a08 P b6079090b1124d84aa4477974bb53700 reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:38.845284 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]). Expected version 1 got 0
I20260810 11:30:38.845633 26578 catalog_manager.cc:5495] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:38.846199 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]). Expected version 2 got 0
I20260810 11:30:38.850868 27222 ts_tablet_manager.cc:1428] T c62ae41d2dd74eedbe252c4de70fbe1e P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.017s user 0.003s sys 0.000s
I20260810 11:30:38.853796 27021 tablet_service.cc:1467] Processing CreateTablet for tablet e0e4e8f9ba3448a0b50081c8cd22642c (DEFAULT_TABLE table=default.Table_883ee52a6394446eb2ca688ec956d44b [id=a47869d3574543b19e821bbfcb5d3785]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:38.854089 28794 ts_tablet_manager.cc:1918] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 11:30:38.854497 28794 log.cc:1196] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/3ccef06fa06c4c519d8760fa948d6c8b
I20260810 11:30:38.855108 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0e4e8f9ba3448a0b50081c8cd22642c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:38.855932 27999 ts_tablet_manager.cc:1918] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:38.856067 27999 log.cc:1196] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/4c595e0892634348b64418ae9dbbd4c2
I20260810 11:30:38.856609 26730 tablet_service.cc:1467] Processing CreateTablet for tablet e0e4e8f9ba3448a0b50081c8cd22642c (DEFAULT_TABLE table=default.Table_883ee52a6394446eb2ca688ec956d44b [id=a47869d3574543b19e821bbfcb5d3785]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:38.856769 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 82de53efa73447fe84e70dbb11a16a5f (DEFAULT_TABLE table=default.Table_67580ad3fe7a47d6a051e7da7005c171 [id=5ae9efa77fb54cf58ff2a1662eee03f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:38.857082 26730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0e4e8f9ba3448a0b50081c8cd22642c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:38.857390 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82de53efa73447fe84e70dbb11a16a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:38.857290 27037 tablet_service.cc:1467] Processing CreateTablet for tablet 82de53efa73447fe84e70dbb11a16a5f (DEFAULT_TABLE table=default.Table_67580ad3fe7a47d6a051e7da7005c171 [id=5ae9efa77fb54cf58ff2a1662eee03f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:38.857704 27031 tablet_service.cc:1467] Processing CreateTablet for tablet 7acf847a1fd74ccc89b5bffe1bbb76f3 (DEFAULT_TABLE table=default.Table_2d6c3a53213a458aaee6bd445240041c [id=097ff3abe81b415799933e50feab6c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:38.857800 26743 tablet_service.cc:1467] Processing CreateTablet for tablet b945cb22353f4d99a3836e3c0b8e26e3 (DEFAULT_TABLE table=default.Table_307bbf62894b4edc922e0fd4afa1a91f [id=a700655211944205a74b75b8449abc29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:38.858206 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b945cb22353f4d99a3836e3c0b8e26e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:38.858208 27039 tablet_service.cc:1467] Processing CreateTablet for tablet b945cb22353f4d99a3836e3c0b8e26e3 (DEFAULT_TABLE table=default.Table_307bbf62894b4edc922e0fd4afa1a91f [id=a700655211944205a74b75b8449abc29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:38.861002 26741 tablet_service.cc:1467] Processing CreateTablet for tablet 7acf847a1fd74ccc89b5bffe1bbb76f3 (DEFAULT_TABLE table=default.Table_2d6c3a53213a458aaee6bd445240041c [id=097ff3abe81b415799933e50feab6c39]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:38.861296 26564 consensus_peers.cc:487] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 -> Peer c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547): Couldn't send request to peer c40c76e125b44de181b88b7f63a566f7. Status: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260810 11:30:38.861557 26748 tablet_service.cc:1467] Processing CreateTablet for tablet aaef5a4d651e4bc2b0b76cf6f51b0751 (DEFAULT_TABLE table=default.Table_5f8ecc7877924d0f9871dd16aaeafdde [id=e1ca02b3f3f94632843632a15fc19245]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:38.862653 27031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7acf847a1fd74ccc89b5bffe1bbb76f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:38.863430 27999 ts_tablet_manager.cc:1939] T 4c595e0892634348b64418ae9dbbd4c2 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:38.864159 27034 tablet_service.cc:1467] Processing CreateTablet for tablet aaef5a4d651e4bc2b0b76cf6f51b0751 (DEFAULT_TABLE table=default.Table_5f8ecc7877924d0f9871dd16aaeafdde [id=e1ca02b3f3f94632843632a15fc19245]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:38.864960 28497 raft_consensus.cc:482] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.861595 26741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7acf847a1fd74ccc89b5bffe1bbb76f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:38.865794 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aaef5a4d651e4bc2b0b76cf6f51b0751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:38.868373 27222 tablet_bootstrap.cc:492] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:38.869242 28497 raft_consensus.cc:504] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.870042 28497 leader_election.cc:288] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:38.870741 27039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b945cb22353f4d99a3836e3c0b8e26e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:38.870743 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f24c84cdd945b78f39f24015eb1e43" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:38.872272 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f24c84cdd945b78f39f24015eb1e43" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:38.874605 27222 tablet_bootstrap.cc:654] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.875507 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aaef5a4d651e4bc2b0b76cf6f51b0751. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:38.876231 26993 leader_election.cc:341] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.879361 26915 raft_consensus.cc:2454] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:38.880437 27228 raft_consensus.cc:348] T 460a679219cb4a7f9aecfec58a98238b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.880674 27228 raft_consensus.cc:374] T 460a679219cb4a7f9aecfec58a98238b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.880725 27228 raft_consensus.cc:729] T 460a679219cb4a7f9aecfec58a98238b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.880934 27228 consensus_queue.cc:260] T 460a679219cb4a7f9aecfec58a98238b P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.881529 27228 ts_tablet_manager.cc:1428] T 460a679219cb4a7f9aecfec58a98238b P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.112s user 0.002s sys 0.000s
W20260810 11:30:38.884724 26991 leader_election.cc:341] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.885030 26991 leader_election.cc:302] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:38.886023 26575 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_2f65140b022e401693ca5cba15d62a04"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:38.886610 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c715bdcff8c4cdabfddf871f6fdc388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:38.886741 26893 tablet_service.cc:1467] Processing CreateTablet for tablet 7acf847a1fd74ccc89b5bffe1bbb76f3 (DEFAULT_TABLE table=default.Table_2d6c3a53213a458aaee6bd445240041c [id=097ff3abe81b415799933e50feab6c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:38.886878 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ccef06fa06c4c519d8760fa948d6c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:38.887022 26575 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f65140b022e401693ca5cba15d62a04 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:38.887207 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 713663be70014b17b17056a865e7db63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:38.887596 26883 tablet_service.cc:1467] Processing CreateTablet for tablet e0e4e8f9ba3448a0b50081c8cd22642c (DEFAULT_TABLE table=default.Table_883ee52a6394446eb2ca688ec956d44b [id=a47869d3574543b19e821bbfcb5d3785]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:38.887864 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 82de53efa73447fe84e70dbb11a16a5f (DEFAULT_TABLE table=default.Table_67580ad3fe7a47d6a051e7da7005c171 [id=5ae9efa77fb54cf58ff2a1662eee03f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:38.888223 26889 tablet_service.cc:1467] Processing CreateTablet for tablet b945cb22353f4d99a3836e3c0b8e26e3 (DEFAULT_TABLE table=default.Table_307bbf62894b4edc922e0fd4afa1a91f [id=a700655211944205a74b75b8449abc29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:38.888697 26886 tablet_service.cc:1467] Processing CreateTablet for tablet aaef5a4d651e4bc2b0b76cf6f51b0751 (DEFAULT_TABLE table=default.Table_5f8ecc7877924d0f9871dd16aaeafdde [id=e1ca02b3f3f94632843632a15fc19245]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:38.889140 26572 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_7fdd2b7a6d02462b92ed03909ab16141"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:38.889922 28591 raft_consensus.cc:504] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:38.890187 26572 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fdd2b7a6d02462b92ed03909ab16141 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:38.890496 28591 leader_election.cc:288] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:38.892330 26581 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_8cce8390a37245e1be3c2c0812761958"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:38.893528 26581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8cce8390a37245e1be3c2c0812761958 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:38.900830 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82de53efa73447fe84e70dbb11a16a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:38.902371 26574 master_service.cc:946] ReplaceTablet: received request to replace tablet fbe0a0ab82a147a3b6164904b135d1ab from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:38.903548 26574 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_269e9aeec3ef452bb70afc88654f3a93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:38.904448 26574 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_269e9aeec3ef452bb70afc88654f3a93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:38.904927 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b945cb22353f4d99a3836e3c0b8e26e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:38.909350 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0e4e8f9ba3448a0b50081c8cd22642c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:38.913508 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aaef5a4d651e4bc2b0b76cf6f51b0751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:38.916864 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7acf847a1fd74ccc89b5bffe1bbb76f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:38.917260 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 110) took 12334 ms. Trace:
I20260810 11:30:38.917368 27999 rpcz_store.cc:276] 0810 11:30:26.582820 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.582867 (+ 47us) service_pool.cc:227] Handling call
0810 11:30:38.766468 (+12183601us) ts_tablet_manager.cc:1145] Deleting tablet 4c595e0892634348b64418ae9dbbd4c2
0810 11:30:38.766485 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.831125 (+ 64640us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.855779 (+ 24654us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.917235 (+ 61456us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12183366}
I20260810 11:30:38.917814 27999 tablet_replica.cc:330] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:38.918057 27999 raft_consensus.cc:2229] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:38.918231 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 4c595e0892634348b64418ae9dbbd4c2 (table default.Table_10b1b7ecd6ab43dfab0e6a29facddaf7 [id=ad429e3004674df1a8535523c4718f62]) successfully deleted
I20260810 11:30:38.918359 27999 raft_consensus.cc:2258] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:38.918995 27999 ts_tablet_manager.cc:1905] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:38.924782 26571 master_service.cc:946] ReplaceTablet: received request to replace tablet a835d30ef9fc474ab927bb119a95d83c from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:38.931017 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82de53efa73447fe84e70dbb11a16a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:38.932411 27228 tablet_bootstrap.cc:492] T b4a37afa17d04e3181e7513ac8d23c24 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:38.932511 26991 leader_election.cc:302] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:38.932902 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e329b95fc8e41c3967079896294942a" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:38.933569 26575 master_service.cc:946] ReplaceTablet: received request to replace tablet 2801709d53614916abac370f7ae5e913 from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:38.934598 26575 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_03a616a243fc4350b4a01d7f5bb86949" } modify_external_catalogs: true
I20260810 11:30:38.935135 28497 raft_consensus.cc:2726] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:38.935114 26575 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_03a616a243fc4350b4a01d7f5bb86949" } modify_external_catalogs: true
I20260810 11:30:38.935735 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 5ea85f89d7a64080a66f1251cd038039 (DEFAULT_TABLE table=default.Table_84fd493f2b9e4a46aa2035a43a9069a1 [id=773fafc7914a45dabad64680fc3a4a27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:38.936287 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ea85f89d7a64080a66f1251cd038039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:38.937430 27999 ts_tablet_manager.cc:1918] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:38.937561 27999 log.cc:1196] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/a8a65a0e8b1f4e4b8d9a82059b766cda
I20260810 11:30:38.937706 26581 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_883ee52a6394446eb2ca688ec956d44b" } new_table_name: "default.Table_0008c2b497d34b5b9534d3601c9fae49" modify_external_catalogs: true
I20260810 11:30:38.937942 27999 ts_tablet_manager.cc:1939] T a8a65a0e8b1f4e4b8d9a82059b766cda P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:38.938804 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 111) took 12355 ms. Trace:
I20260810 11:30:38.938957 27999 rpcz_store.cc:276] 0810 11:30:26.583460 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.583618 (+ 158us) service_pool.cc:227] Handling call
0810 11:30:38.917746 (+12334128us) ts_tablet_manager.cc:1145] Deleting tablet a8a65a0e8b1f4e4b8d9a82059b766cda
0810 11:30:38.917759 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:38.927644 (+ 9885us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.937333 (+ 9689us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:38.938783 (+ 1450us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12333911}
I20260810 11:30:38.939374 27999 tablet_replica.cc:330] T 7d3406f12d9c492cbd0d86fa7a57de82 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:38.939563 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet a8a65a0e8b1f4e4b8d9a82059b766cda (table default.Table_ad62ebe50ede4d7d96922bac3e954f9e [id=a9ff451e18b54994abfa288ecac98560]) successfully deleted
W20260810 11:30:38.942013 26991 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 47393us
I20260810 11:30:38.944645 28753 raft_consensus.cc:2781] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:38.945201 27231 tablet_bootstrap.cc:492] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:38.944860 28753 raft_consensus.cc:686] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:38.946676 26891 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d5e146eeec4fe0be33c1c169d32e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:38.947270 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 10e6c41db71a4146840f06c5b7412d9c with delete_type TABLET_DATA_DELETED (replaced by tablet 72209a805e3e4b4ea1bf99508e0f75db) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:38.947623 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 834c9c99ec424bb39e8a003e9204b2bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:38.947770 27228 tablet_bootstrap.cc:654] T b4a37afa17d04e3181e7513ac8d23c24 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:38.949260 27231 ts_tablet_manager.cc:1397] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.116s user 0.019s sys 0.026s
I20260810 11:30:38.951030 28794 ts_tablet_manager.cc:1939] T 3ccef06fa06c4c519d8760fa948d6c8b P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:38.954691 26572 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_15f8b33002864cd2872dc2a70e613456" } modify_external_catalogs: true
I20260810 11:30:38.955075 26572 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_15f8b33002864cd2872dc2a70e613456" } modify_external_catalogs: true
I20260810 11:30:38.956845 26578 master_service.cc:946] ReplaceTablet: received request to replace tablet d14091e1c111438bac8bcf3d36123d80 from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:38.958493 26963 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:38.959136 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e329b95fc8e41c3967079896294942a" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:38.960196 27231 raft_consensus.cc:348] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:38.964104 26849 leader_election.cc:341] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:38.965260 28797 tablet.cc:1722] T 720ef9404cb44551aaf39687f0cf94c9 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:38.966120 28591 consensus_queue.cc:1035] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:38.971750 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 5ea85f89d7a64080a66f1251cd038039 (DEFAULT_TABLE table=default.Table_84fd493f2b9e4a46aa2035a43a9069a1 [id=773fafc7914a45dabad64680fc3a4a27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:38.973151 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ea85f89d7a64080a66f1251cd038039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:38.985101 27061 raft_consensus.cc:3037] T 9e329b95fc8e41c3967079896294942a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.989831 28660 raft_consensus.cc:482] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:38.990396 27061 raft_consensus.cc:2454] T 9e329b95fc8e41c3967079896294942a P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:38.990141 28660 raft_consensus.cc:504] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.991137 28660 leader_election.cc:288] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:38.991273 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 3ccef06fa06c4c519d8760fa948d6c8b (table default.Table_abbbb80ecbe4491d98912dcdcaab5dd3 [id=ba999b4084c84b2f8e0313b96849b169]) successfully deleted
W20260810 11:30:38.991729 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 713663be70014b17b17056a865e7db63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 713663be70014b17b17056a865e7db63 already in progress: creating tablet
I20260810 11:30:38.991889 26848 leader_election.cc:302] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:38.992292 28591 raft_consensus.cc:2781] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:38.992870 28591 raft_consensus.cc:686] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:38.992939 26571 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet a835d30ef9fc474ab927bb119a95d83c
I20260810 11:30:38.990212 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 5ea85f89d7a64080a66f1251cd038039 (DEFAULT_TABLE table=default.Table_84fd493f2b9e4a46aa2035a43a9069a1 [id=773fafc7914a45dabad64680fc3a4a27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:38.993114 28591 consensus_queue.cc:237] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.993453 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ea85f89d7a64080a66f1251cd038039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:38.993836 26571 catalog_manager.cc:6565] ReplaceTablet: tablet a835d30ef9fc474ab927bb119a95d83c deleted and replaced by tablet 2a1fbf3890ee4a829b4c8c61fe1e978f
I20260810 11:30:38.994464 26571 master_service.cc:946] ReplaceTablet: received request to replace tablet a63227e69df14a4ea935087fd31ece63 from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:38.994560 27231 raft_consensus.cc:374] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:38.994784 27231 raft_consensus.cc:729] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:38.994671 26574 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_56b4699099fd417496e71ccbed272638" } new_table_name: "default.Table_5905efbf8298477abec7629be773b347" modify_external_catalogs: true
I20260810 11:30:38.995105 27231 consensus_queue.cc:260] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:38.995879 27231 ts_tablet_manager.cc:1428] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.046s user 0.002s sys 0.000s
I20260810 11:30:38.996346 27231 tablet_bootstrap.cc:492] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:38.996426 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c62ae41d2dd74eedbe252c4de70fbe1e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:38.996748 26916 raft_consensus.cc:2454] T c62ae41d2dd74eedbe252c4de70fbe1e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:38.997469 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet a835d30ef9fc474ab927bb119a95d83c with delete_type TABLET_DATA_DELETED (replaced by tablet 2a1fbf3890ee4a829b4c8c61fe1e978f) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:38.997728 26991 leader_election.cc:302] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:38.998416 28660 raft_consensus.cc:2781] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:38.998687 28660 raft_consensus.cc:482] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:38.998859 28660 raft_consensus.cc:3037] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:38.999440 28797 tablet.cc:1722] T 00c4599256684f5dbc745c9283f31a08 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:39.000412 26578 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet d14091e1c111438bac8bcf3d36123d80
I20260810 11:30:39.000792 28799 tablet.cc:1722] T 720ef9404cb44551aaf39687f0cf94c9 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:39.001210 26578 catalog_manager.cc:6565] ReplaceTablet: tablet d14091e1c111438bac8bcf3d36123d80 deleted and replaced by tablet ce73798a721b4a6d892f0c24b6b40e2c
I20260810 11:30:39.001837 26578 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_23ac53b1a7794ddda0a697254fff0ede" } modify_external_catalogs: true
I20260810 11:30:39.002133 26578 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_23ac53b1a7794ddda0a697254fff0ede" } modify_external_catalogs: true
I20260810 11:30:39.003350 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet d14091e1c111438bac8bcf3d36123d80 with delete_type TABLET_DATA_DELETED (replaced by tablet ce73798a721b4a6d892f0c24b6b40e2c) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:39.003753 28795 tablet.cc:1722] T 720ef9404cb44551aaf39687f0cf94c9 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:39.006050 28345 consensus_queue.cc:1035] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:39.006799 26581 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e0e4e8f9ba3448a0b50081c8cd22642c consensus state has no leader
I20260810 11:30:39.007515 26581 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_6e9cd3888b17405bad2475ba3da34507" } modify_external_catalogs: true
I20260810 11:30:39.007994 26581 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_6e9cd3888b17405bad2475ba3da34507" } modify_external_catalogs: true
I20260810 11:30:39.008090 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet a835d30ef9fc474ab927bb119a95d83c with delete_type TABLET_DATA_DELETED (replaced by tablet 2a1fbf3890ee4a829b4c8c61fe1e978f) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:39.008282 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c62ae41d2dd74eedbe252c4de70fbe1e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:39.009238 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet a835d30ef9fc474ab927bb119a95d83c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a835d30ef9fc474ab927bb119a95d83c already in progress: creating tablet
I20260810 11:30:39.010496 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet a835d30ef9fc474ab927bb119a95d83c with delete_type TABLET_DATA_DELETED (replaced by tablet 2a1fbf3890ee4a829b4c8c61fe1e978f) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:39.010496 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet d14091e1c111438bac8bcf3d36123d80 with delete_type TABLET_DATA_DELETED (replaced by tablet ce73798a721b4a6d892f0c24b6b40e2c) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:39.011166 28640 consensus_queue.cc:1035] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:39.014696 26763 raft_consensus.cc:2454] T c62ae41d2dd74eedbe252c4de70fbe1e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
W20260810 11:30:39.015455 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet a835d30ef9fc474ab927bb119a95d83c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a835d30ef9fc474ab927bb119a95d83c already in progress: creating tablet
I20260810 11:30:39.017557 28345 raft_consensus.cc:482] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:39.017731 28345 raft_consensus.cc:504] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:39.018455 28345 leader_election.cc:288] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:39.024205 26849 leader_election.cc:341] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 587c6ce242c0411b886404a0df03b1bb
I20260810 11:30:39.024834 28640 raft_consensus.cc:482] T 1f64d4b9320c4cb39f57573d781a47d3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:39.025133 28640 raft_consensus.cc:504] T 1f64d4b9320c4cb39f57573d781a47d3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.026610 28640 leader_election.cc:288] T 1f64d4b9320c4cb39f57573d781a47d3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:39.026654 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f64d4b9320c4cb39f57573d781a47d3" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:38.960307 28753 consensus_queue.cc:237] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.010048 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet d14091e1c111438bac8bcf3d36123d80 with delete_type TABLET_DATA_DELETED (replaced by tablet ce73798a721b4a6d892f0c24b6b40e2c) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:39.030356 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f64d4b9320c4cb39f57573d781a47d3" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:39.031031 26848 leader_election.cc:341] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 587c6ce242c0411b886404a0df03b1bb
I20260810 11:30:39.031177 26848 leader_election.cc:302] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:39.031566 28345 raft_consensus.cc:2726] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:39.034401 27974 tablet_replica.cc:330] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:39.034756 27974 raft_consensus.cc:2229] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:39.035082 27974 raft_consensus.cc:2258] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:39.035729 27974 ts_tablet_manager.cc:1905] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:39.040614 28799 tablet.cc:1722] T 00c4599256684f5dbc745c9283f31a08 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:39.048465 27059 raft_consensus.cc:2379] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate b6079090b1124d84aa4477974bb53700 in this term.
I20260810 11:30:39.049178 26702 leader_election.cc:302] T 1f64d4b9320c4cb39f57573d781a47d3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:39.049865 28640 raft_consensus.cc:3037] T 1f64d4b9320c4cb39f57573d781a47d3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:39.052390 27974 ts_tablet_manager.cc:1918] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:39.052660 27974 log.cc:1196] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/d14091e1c111438bac8bcf3d36123d80
I20260810 11:30:39.053243 27974 ts_tablet_manager.cc:1939] T d14091e1c111438bac8bcf3d36123d80 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:39.054574 28640 raft_consensus.cc:2726] T 1f64d4b9320c4cb39f57573d781a47d3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:39.061348 26916 raft_consensus.cc:3037] T 460a679219cb4a7f9aecfec58a98238b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:39.077011 28726 consensus_queue.cc:1035] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:39.081171 28726 raft_consensus.cc:482] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:39.081501 28726 raft_consensus.cc:504] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.082362 28726 leader_election.cc:288] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:39.082969 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4a37afa17d04e3181e7513ac8d23c24" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:39.083410 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
W20260810 11:30:39.083781 26700 leader_election.cc:341] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:39.083845 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:39.084240 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:39.084492 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:39.085058 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 1 got 0
I20260810 11:30:39.085345 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]). Expected version 1 got 0
I20260810 11:30:39.080660 28497 consensus_queue.cc:1035] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260810 11:30:39.086006 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:39.086305 26573 catalog_manager.cc:5495] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } }
I20260810 11:30:39.086800 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:39.087098 26573 catalog_manager.cc:5495] T dc2506b72a624cb388059efc326abbc1 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:39.088326 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:39.088773 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:39.089288 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:39.089589 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:39.089867 26573 catalog_manager.cc:5495] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:39.091150 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:39.091475 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]). Expected version 2 got 0
I20260810 11:30:39.092175 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet d14091e1c111438bac8bcf3d36123d80 (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]) successfully deleted
I20260810 11:30:39.091998 26573 catalog_manager.cc:5495] T 592be61b7e524941931264125b33d92c P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:39.100447 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 2 got 0
I20260810 11:30:39.101150 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:39.101823 26573 catalog_manager.cc:5495] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:39.102692 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:39.103137 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:39.103775 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:39.084631 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4a37afa17d04e3181e7513ac8d23c24" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:39.104225 27060 raft_consensus.cc:2454] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:39.104918 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:39.080726 28660 raft_consensus.cc:504] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.105677 26573 catalog_manager.cc:5495] T 83992214ba314d3fa674e00d8eaddec6 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:39.078600 27231 tablet_bootstrap.cc:654] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.084661 28795 tablet.cc:1722] T 00c4599256684f5dbc745c9283f31a08 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:39.109953 28588 raft_consensus.cc:482] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:39.110216 28588 raft_consensus.cc:504] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:39.110913 28588 leader_election.cc:288] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:39.075029 28794 tablet_replica.cc:330] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:39.112063 28651 consensus_queue.cc:1035] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260810 11:30:39.115877 26848 leader_election.cc:341] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 8a1e2e624fff4692a22e29b293cd82d6
I20260810 11:30:39.122473 26702 leader_election.cc:302] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:39.122938 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:39.123188 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c62ae41d2dd74eedbe252c4de70fbe1e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:39.123462 26915 raft_consensus.cc:3037] T c62ae41d2dd74eedbe252c4de70fbe1e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:39.123840 26849 leader_election.cc:341] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 8a1e2e624fff4692a22e29b293cd82d6
I20260810 11:30:39.123976 26849 leader_election.cc:302] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:39.124660 28588 raft_consensus.cc:2726] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:39.124729 28726 raft_consensus.cc:2781] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:39.125010 28726 raft_consensus.cc:482] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:39.125262 28726 raft_consensus.cc:3037] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:39.125329 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:39.126678 26573 catalog_manager.cc:5495] T fc023d51790042ce978eb53a2979e29c P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:39.127274 26915 raft_consensus.cc:2454] T c62ae41d2dd74eedbe252c4de70fbe1e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:39.130841 26573 catalog_manager.cc:5495] T b9195690e00b4f3cb3d5076dcca3519c P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:39.132309 28726 raft_consensus.cc:504] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.133538 27231 tablet_bootstrap.cc:492] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:39.133867 27231 ts_tablet_manager.cc:1397] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.138s user 0.008s sys 0.005s
I20260810 11:30:39.134193 28794 raft_consensus.cc:2229] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:39.134859 28794 raft_consensus.cc:2258] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:39.135637 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:39.136266 27231 raft_consensus.cc:348] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.136718 27231 raft_consensus.cc:374] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.136950 27231 raft_consensus.cc:729] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.137254 27231 consensus_queue.cc:260] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.138053 27231 ts_tablet_manager.cc:1428] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 11:30:39.138458 27231 tablet_bootstrap.cc:492] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:39.142414 28794 ts_tablet_manager.cc:1905] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:39.147679 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:39.158157 28660 leader_election.cc:288] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:39.170553 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c62ae41d2dd74eedbe252c4de70fbe1e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:39.171030 26762 raft_consensus.cc:3037] T c62ae41d2dd74eedbe252c4de70fbe1e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:39.128866 28345 raft_consensus.cc:482] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:39.152384 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4a37afa17d04e3181e7513ac8d23c24" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:39.180143 28345 raft_consensus.cc:504] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:39.181193 26700 leader_election.cc:341] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:39.182080 28345 leader_election.cc:288] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:39.184764 26848 leader_election.cc:341] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: fbe0a0ab82a147a3b6164904b135d1ab
W20260810 11:30:39.185345 26849 leader_election.cc:341] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: fbe0a0ab82a147a3b6164904b135d1ab
I20260810 11:30:39.185560 26849 leader_election.cc:302] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:39.185976 28345 raft_consensus.cc:2726] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:39.186184 27999 raft_consensus.cc:2229] T 7d3406f12d9c492cbd0d86fa7a57de82 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:39.186759 27999 raft_consensus.cc:2258] T 7d3406f12d9c492cbd0d86fa7a57de82 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:39.186848 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4a37afa17d04e3181e7513ac8d23c24" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:39.187320 27055 raft_consensus.cc:3037] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:39.187884 27999 ts_tablet_manager.cc:1905] T 7d3406f12d9c492cbd0d86fa7a57de82 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:39.190742 27055 raft_consensus.cc:2454] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:39.192749 26762 raft_consensus.cc:2454] T c62ae41d2dd74eedbe252c4de70fbe1e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:39.193171 26991 leader_election.cc:302] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:39.196616 26702 leader_election.cc:302] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:39.196758 26573 catalog_manager.cc:5495] T 2126d95992e549b7b2b3e662b0d39a36 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } }
I20260810 11:30:39.197343 28640 raft_consensus.cc:2781] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:39.197666 27231 tablet_bootstrap.cc:654] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.209002 28726 leader_election.cc:288] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:39.211299 28727 consensus_queue.cc:1035] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:39.212822 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:39.217972 27222 tablet_bootstrap.cc:492] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:39.218513 27222 ts_tablet_manager.cc:1397] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.364s user 0.008s sys 0.015s
I20260810 11:30:39.217522 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:39.221796 28753 raft_consensus.cc:482] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:39.221973 28753 raft_consensus.cc:504] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.222604 28753 leader_election.cc:288] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:39.219445 26573 catalog_manager.cc:5495] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:39.228775 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:39.229815 27222 raft_consensus.cc:348] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.230314 27222 raft_consensus.cc:374] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.229389 26573 catalog_manager.cc:5495] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:39.236874 27222 raft_consensus.cc:729] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.237437 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:39.238334 27222 consensus_queue.cc:260] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.238937 27231 tablet_bootstrap.cc:492] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:39.238987 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:39.239137 27231 ts_tablet_manager.cc:1397] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.101s user 0.001s sys 0.005s
I20260810 11:30:39.239538 26573 catalog_manager.cc:5495] T 750950c424184d08bf6777774db3a0b2 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:39.240084 27231 raft_consensus.cc:348] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.240303 27231 raft_consensus.cc:374] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.240370 27231 raft_consensus.cc:729] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.240650 27231 consensus_queue.cc:260] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.241127 27222 ts_tablet_manager.cc:1428] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.019s user 0.004s sys 0.000s
I20260810 11:30:39.245289 27222 tablet_bootstrap.cc:492] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:39.246038 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_5ba00bd0ab7d4cdcb1494f9491c64291 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 2 got 0
I20260810 11:30:39.246932 28640 raft_consensus.cc:686] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:39.249039 27231 ts_tablet_manager.cc:1428] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260810 11:30:39.247565 28640 consensus_queue.cc:237] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.249372 27222 tablet_bootstrap.cc:654] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.249465 27231 tablet_bootstrap.cc:492] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:39.251642 27231 tablet_bootstrap.cc:654] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.252938 26573 catalog_manager.cc:5495] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:39.253899 26573 catalog_manager.cc:5495] T e8dc3dece9d84d47a638707d10de6fd4 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:39.254570 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:39.255214 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:39.260684 27222 tablet_bootstrap.cc:492] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:39.260922 27222 ts_tablet_manager.cc:1397] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.004s
I20260810 11:30:39.262348 27228 tablet_bootstrap.cc:492] T b4a37afa17d04e3181e7513ac8d23c24 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:39.262508 27228 ts_tablet_manager.cc:1397] T b4a37afa17d04e3181e7513ac8d23c24 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.330s user 0.032s sys 0.059s
I20260810 11:30:39.262485 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]). Expected version 1 got 0
I20260810 11:30:39.263445 27228 raft_consensus.cc:348] T b4a37afa17d04e3181e7513ac8d23c24 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.265345 27228 raft_consensus.cc:374] T b4a37afa17d04e3181e7513ac8d23c24 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.265548 27228 raft_consensus.cc:729] T b4a37afa17d04e3181e7513ac8d23c24 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.266105 27228 consensus_queue.cc:260] T b4a37afa17d04e3181e7513ac8d23c24 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.267771 27228 ts_tablet_manager.cc:1428] T b4a37afa17d04e3181e7513ac8d23c24 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260810 11:30:39.268944 27228 tablet_bootstrap.cc:492] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:39.270610 27222 raft_consensus.cc:348] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.270938 27222 raft_consensus.cc:374] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.271111 27222 raft_consensus.cc:729] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.271473 27222 consensus_queue.cc:260] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.272253 27222 ts_tablet_manager.cc:1428] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260810 11:30:39.262933 26573 catalog_manager.cc:5495] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:39.273896 27228 tablet_bootstrap.cc:654] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.274201 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:39.274844 26573 catalog_manager.cc:5495] T 94bcb1739e5144559201479b82c07941 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:39.285914 26573 catalog_manager.cc:5495] T 37cecd4266eb47669e7fd5cfeb847adc P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:39.288509 28728 consensus_queue.cc:1035] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:39.288749 27222 tablet_bootstrap.cc:492] T 4b5a7f67ec5b48c2b5a510add0282a76 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:39.290515 27231 tablet_bootstrap.cc:492] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:39.291182 27231 ts_tablet_manager.cc:1397] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.002s
I20260810 11:30:39.292073 27231 raft_consensus.cc:348] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.292387 27231 raft_consensus.cc:374] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.292495 27231 raft_consensus.cc:729] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.293118 27231 consensus_queue.cc:260] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.293804 27231 ts_tablet_manager.cc:1428] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:39.294153 27231 tablet_bootstrap.cc:492] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:39.294917 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]). Expected version 2 got 0
I20260810 11:30:39.296782 27231 tablet_bootstrap.cc:654] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.298180 27222 tablet_bootstrap.cc:654] T 4b5a7f67ec5b48c2b5a510add0282a76 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.298892 26573 catalog_manager.cc:5495] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:39.300601 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:39.301123 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:39.301636 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
W20260810 11:30:39.317595 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 124020us
W20260810 11:30:39.327493 26848 consensus_peers.cc:487] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ccef06fa06c4c519d8760fa948d6c8b. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:39.329295 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3406f12d9c492cbd0d86fa7a57de82" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:39.330171 26993 leader_election.cc:341] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:39.330475 28497 raft_consensus.cc:2781] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:39.330603 28497 raft_consensus.cc:686] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:39.330860 28497 consensus_queue.cc:237] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.331674 28779 consensus_queue.cc:1035] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:39.336709 26991 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 143608us
I20260810 11:30:39.344503 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3406f12d9c492cbd0d86fa7a57de82" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:39.351374 27999 ts_tablet_manager.cc:1918] T 7d3406f12d9c492cbd0d86fa7a57de82 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:39.351536 27999 log.cc:1196] T 7d3406f12d9c492cbd0d86fa7a57de82 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/7d3406f12d9c492cbd0d86fa7a57de82
I20260810 11:30:39.351869 27999 ts_tablet_manager.cc:1939] T 7d3406f12d9c492cbd0d86fa7a57de82 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:39.352272 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 113) took 12768 ms. Trace:
W20260810 11:30:39.352355 26991 leader_election.cc:341] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: Tablet not RUNNING: STOPPED
I20260810 11:30:39.354628 26991 leader_election.cc:302] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:39.386706 27222 tablet_bootstrap.cc:492] T 4b5a7f67ec5b48c2b5a510add0282a76 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:39.387053 27222 ts_tablet_manager.cc:1397] T 4b5a7f67ec5b48c2b5a510add0282a76 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.112s user 0.009s sys 0.009s
I20260810 11:30:39.388736 27222 raft_consensus.cc:348] T 4b5a7f67ec5b48c2b5a510add0282a76 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.389333 27222 raft_consensus.cc:374] T 4b5a7f67ec5b48c2b5a510add0282a76 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.389523 27222 raft_consensus.cc:729] T 4b5a7f67ec5b48c2b5a510add0282a76 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.390093 27222 consensus_queue.cc:260] T 4b5a7f67ec5b48c2b5a510add0282a76 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.390949 27222 ts_tablet_manager.cc:1428] T 4b5a7f67ec5b48c2b5a510add0282a76 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 11:30:39.391564 27222 tablet_bootstrap.cc:492] T 9744f59d7e49430e91080f56f3342038 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:39.411070 26571 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet a63227e69df14a4ea935087fd31ece63
I20260810 11:30:39.411844 26571 catalog_manager.cc:6565] ReplaceTablet: tablet a63227e69df14a4ea935087fd31ece63 deleted and replaced by tablet aa71cedba3d34c288a3e3be99d474ce4
I20260810 11:30:39.419014 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet a63227e69df14a4ea935087fd31ece63 with delete_type TABLET_DATA_DELETED (replaced by tablet aa71cedba3d34c288a3e3be99d474ce4) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:39.425824 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet a63227e69df14a4ea935087fd31ece63 with delete_type TABLET_DATA_DELETED (replaced by tablet aa71cedba3d34c288a3e3be99d474ce4) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:39.426862 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet a63227e69df14a4ea935087fd31ece63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a63227e69df14a4ea935087fd31ece63 already in progress: creating tablet
I20260810 11:30:39.431902 27222 tablet_bootstrap.cc:654] T 9744f59d7e49430e91080f56f3342038 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.432617 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:39.433327 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:39.435384 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:39.440281 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet a63227e69df14a4ea935087fd31ece63 with delete_type TABLET_DATA_DELETED (replaced by tablet aa71cedba3d34c288a3e3be99d474ce4) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:39.441705 28651 raft_consensus.cc:2726] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:39.443347 28794 ts_tablet_manager.cc:1918] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:39.443524 28794 log.cc:1196] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/d14091e1c111438bac8bcf3d36123d80
I20260810 11:30:39.444104 28794 ts_tablet_manager.cc:1939] T d14091e1c111438bac8bcf3d36123d80 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:39.451458 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:39.455466 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:39.461295 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:39.462585 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]). Expected version 1 got 0
I20260810 11:30:39.463835 28640 raft_consensus.cc:482] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:39.464404 28640 raft_consensus.cc:504] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.466782 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9079c8fec89043be9d0040a3728e93f4" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:39.467224 26915 raft_consensus.cc:2379] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
I20260810 11:30:39.469645 27222 tablet_bootstrap.cc:492] T 9744f59d7e49430e91080f56f3342038 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:39.469925 27222 ts_tablet_manager.cc:1397] T 9744f59d7e49430e91080f56f3342038 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.079s user 0.000s sys 0.008s
I20260810 11:30:39.470909 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet d14091e1c111438bac8bcf3d36123d80 (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]) successfully deleted
W20260810 11:30:39.471356 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet a63227e69df14a4ea935087fd31ece63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a63227e69df14a4ea935087fd31ece63 already in progress: creating tablet
I20260810 11:30:39.449898 27231 tablet_bootstrap.cc:492] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:39.462031 28660 consensus_queue.cc:1035] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:39.471688 27231 ts_tablet_manager.cc:1397] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.178s user 0.003s sys 0.012s
I20260810 11:30:39.469004 28345 consensus_queue.cc:1035] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260810 11:30:39.472815 27231 raft_consensus.cc:348] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.473040 27231 raft_consensus.cc:374] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.473104 27231 raft_consensus.cc:729] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.473282 27231 consensus_queue.cc:260] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.473553 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9079c8fec89043be9d0040a3728e93f4" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:39.473968 27231 ts_tablet_manager.cc:1428] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 11:30:39.474241 27231 tablet_bootstrap.cc:492] T 88268e3571884ac88c1a617ce74499f3 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:39.474334 26702 leader_election.cc:302] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:39.476167 27231 tablet_bootstrap.cc:654] T 88268e3571884ac88c1a617ce74499f3 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.477371 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:39.480758 28640 leader_election.cc:288] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:39.480942 28660 raft_consensus.cc:482] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:39.481081 28660 raft_consensus.cc:504] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.481201 27222 raft_consensus.cc:348] T 9744f59d7e49430e91080f56f3342038 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.481479 27222 raft_consensus.cc:374] T 9744f59d7e49430e91080f56f3342038 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.481752 27228 tablet_bootstrap.cc:492] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:39.481747 28660 leader_election.cc:288] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:39.481895 27228 ts_tablet_manager.cc:1397] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.214s user 0.038s sys 0.071s
I20260810 11:30:39.482273 27222 raft_consensus.cc:729] T 9744f59d7e49430e91080f56f3342038 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.482699 28728 raft_consensus.cc:3037] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:39.482749 27222 consensus_queue.cc:260] T 9744f59d7e49430e91080f56f3342038 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.483563 27228 raft_consensus.cc:348] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.484004 27228 raft_consensus.cc:374] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.484081 27228 raft_consensus.cc:729] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.484058 27222 ts_tablet_manager.cc:1428] T 9744f59d7e49430e91080f56f3342038 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.014s user 0.002s sys 0.002s
I20260810 11:30:39.484293 27228 consensus_queue.cc:260] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.485216 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:39.486049 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:39.486603 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d7a07e844984b88ab81610cb95bf21e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:39.487195 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_5ba00bd0ab7d4cdcb1494f9491c64291 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 2 got 0
I20260810 11:30:39.487654 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:39.487877 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d7a07e844984b88ab81610cb95bf21e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:39.487973 27228 ts_tablet_manager.cc:1428] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.006s user 0.002s sys 0.002s
I20260810 11:30:39.488390 27228 tablet_bootstrap.cc:492] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:39.488315 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 2 got 0
I20260810 11:30:39.488382 28728 raft_consensus.cc:2726] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:39.488632 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
W20260810 11:30:39.488768 26993 leader_election.cc:341] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:39.488911 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:39.489454 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:39.489885 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:39.492496 27222 tablet_bootstrap.cc:492] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:39.495882 26991 leader_election.cc:341] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:39.496045 26991 leader_election.cc:302] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:39.496682 27999 rpcz_store.cc:276] 0810 11:30:26.584216 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.584261 (+ 45us) service_pool.cc:227] Handling call
0810 11:30:38.939316 (+12355055us) ts_tablet_manager.cc:1145] Deleting tablet 7d3406f12d9c492cbd0d86fa7a57de82
0810 11:30:38.939331 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:39.347687 (+408356us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.351234 (+ 3547us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.352247 (+ 1013us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12354883}
I20260810 11:30:39.496938 28651 raft_consensus.cc:2726] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:39.497792 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 114) took 12913 ms. Trace:
I20260810 11:30:39.497895 27999 rpcz_store.cc:276] 0810 11:30:26.584747 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.584906 (+ 159us) service_pool.cc:227] Handling call
0810 11:30:39.497630 (+12912724us) ts_tablet_manager.cc:1145] Deleting tablet db59523b71224370bf5fce6b56592f71
0810 11:30:39.497645 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:39.497770 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12912421}
I20260810 11:30:39.498234 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 115) took 12913 ms. Trace:
I20260810 11:30:39.498335 27999 rpcz_store.cc:276] 0810 11:30:26.584863 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.585269 (+ 406us) service_pool.cc:227] Handling call
0810 11:30:39.498152 (+12912883us) ts_tablet_manager.cc:1145] Deleting tablet a28849649c704f2fbdec1aced9ce01b1
0810 11:30:39.498163 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:39.498217 (+ 54us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12912666}
I20260810 11:30:39.498641 27999 tablet_replica.cc:330] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
W20260810 11:30:39.498881 26993 consensus_peers.cc:487] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:39.498888 27999 raft_consensus.cc:2229] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:39.499080 27999 raft_consensus.cc:2258] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:39.499728 27999 ts_tablet_manager.cc:1905] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:39.501040 28497 consensus_queue.cc:1035] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:39.505156 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:39.507007 28728 consensus_queue.cc:1035] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 11:30:39.508534 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:39.510208 27231 tablet_bootstrap.cc:492] T 88268e3571884ac88c1a617ce74499f3 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:39.510375 27231 ts_tablet_manager.cc:1397] T 88268e3571884ac88c1a617ce74499f3 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260810 11:30:39.511623 27231 raft_consensus.cc:348] T 88268e3571884ac88c1a617ce74499f3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.511852 27231 raft_consensus.cc:374] T 88268e3571884ac88c1a617ce74499f3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.511837 28345 raft_consensus.cc:482] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:39.511905 27231 raft_consensus.cc:729] T 88268e3571884ac88c1a617ce74499f3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.512097 27231 consensus_queue.cc:260] T 88268e3571884ac88c1a617ce74499f3 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.512777 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:39.512997 28591 raft_consensus.cc:482] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:39.513193 28591 raft_consensus.cc:504] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.514153 28591 leader_election.cc:288] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:39.517474 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:39.517853 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 720ef9404cb44551aaf39687f0cf94c9 (table default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e]). Expected version 2 got 0
I20260810 11:30:39.518357 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9744f59d7e49430e91080f56f3342038" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:39.518682 27058 raft_consensus.cc:2454] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:39.511997 28345 raft_consensus.cc:504] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:39.519651 28345 leader_election.cc:288] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:39.506274 28640 raft_consensus.cc:482] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:39.520262 28640 raft_consensus.cc:504] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:39.520955 26849 leader_election.cc:341] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: a87f6835f0dc4ad4b3a23b297726100d
I20260810 11:30:39.521692 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2634beb347714fc7a2e05865adb34a22" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:39.521931 26916 raft_consensus.cc:2454] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:39.522096 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9744f59d7e49430e91080f56f3342038" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:39.523463 28660 consensus_queue.cc:1035] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:39.524225 26848 leader_election.cc:302] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
W20260810 11:30:39.524650 26848 leader_election.cc:341] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: a87f6835f0dc4ad4b3a23b297726100d
I20260810 11:30:39.524776 26848 leader_election.cc:302] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:39.525465 28591 raft_consensus.cc:2781] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:39.525573 28591 raft_consensus.cc:482] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:39.525655 28591 raft_consensus.cc:3037] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:39.526908 28345 raft_consensus.cc:2726] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:39.529382 27231 ts_tablet_manager.cc:1428] T 88268e3571884ac88c1a617ce74499f3 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260810 11:30:39.529814 27231 tablet_bootstrap.cc:492] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:39.533567 27231 tablet_bootstrap.cc:654] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.535486 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:39.535965 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2634beb347714fc7a2e05865adb34a22" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:39.536298 27058 raft_consensus.cc:2454] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:39.536967 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:39.537415 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 1 got 0
I20260810 11:30:39.543217 27228 tablet_bootstrap.cc:654] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.543931 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:39.544477 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:39.544930 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:39.546262 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:39.546913 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:39.547713 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]). Expected version 1 got 0
I20260810 11:30:39.547892 28591 raft_consensus.cc:504] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.548154 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:39.548652 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:39.549677 26700 leader_election.cc:302] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:39.550063 26762 raft_consensus.cc:2454] T 9744f59d7e49430e91080f56f3342038 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:39.550850 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 39beb126ac324842b7e387c46bcb4099 (table default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea]). Expected version 2 got 0
I20260810 11:30:39.552062 28640 leader_election.cc:288] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:39.555526 27222 tablet_bootstrap.cc:654] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.556108 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:39.556846 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:39.557197 28591 leader_election.cc:288] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:39.557909 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9744f59d7e49430e91080f56f3342038" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:39.558030 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
I20260810 11:30:39.558383 26577 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:39.558791 27058 raft_consensus.cc:3037] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:39.561007 28823 consensus_queue.cc:1035] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260810 11:30:39.564379 28727 raft_consensus.cc:2781] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:39.574712 28727 raft_consensus.cc:482] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:39.574859 28727 raft_consensus.cc:3037] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:39.575554 27231 tablet_bootstrap.cc:492] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:39.575724 27231 ts_tablet_manager.cc:1397] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.046s user 0.005s sys 0.001s
I20260810 11:30:39.574443 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9744f59d7e49430e91080f56f3342038" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:39.575951 26762 raft_consensus.cc:3037] T 9744f59d7e49430e91080f56f3342038 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:39.576683 27231 raft_consensus.cc:348] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.576951 27231 raft_consensus.cc:374] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.577023 27231 raft_consensus.cc:729] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.577142 27058 raft_consensus.cc:2454] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:39.577250 27231 consensus_queue.cc:260] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.577864 26848 leader_election.cc:302] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:39.578447 28345 raft_consensus.cc:2781] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:39.578573 28345 raft_consensus.cc:686] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:39.578842 28345 consensus_queue.cc:237] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.581111 27231 ts_tablet_manager.cc:1428] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 11:30:39.581624 27231 tablet_bootstrap.cc:492] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:39.497349 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 7d3406f12d9c492cbd0d86fa7a57de82 (table default.Table_c32d1cb0b9e744fbacbd00c8736fad21 [id=f54b49f28880453aa7bc67b9c36a219b]) successfully deleted
W20260810 11:30:39.591423 27286 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 94119.5us
W20260810 11:30:39.591889 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet db59523b71224370bf5fce6b56592f71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db59523b71224370bf5fce6b56592f71 already in progress: creating tablet
W20260810 11:30:39.593827 27286 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet a28849649c704f2fbdec1aced9ce01b1 because the tablet was not found. No further retry: Not found: Tablet not found: a28849649c704f2fbdec1aced9ce01b1
I20260810 11:30:39.594076 27231 tablet_bootstrap.cc:654] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.597672 28727 raft_consensus.cc:504] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.598986 28727 leader_election.cc:288] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:39.601933 26762 raft_consensus.cc:2454] T 9744f59d7e49430e91080f56f3342038 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:39.603091 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2634beb347714fc7a2e05865adb34a22" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:39.603330 27059 raft_consensus.cc:3037] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:39.603632 27231 tablet_bootstrap.cc:492] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:39.603775 27231 ts_tablet_manager.cc:1397] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20260810 11:30:39.604727 27231 raft_consensus.cc:348] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.604969 27231 raft_consensus.cc:374] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.605031 27231 raft_consensus.cc:729] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.605242 27231 consensus_queue.cc:260] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.605790 27231 ts_tablet_manager.cc:1428] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:39.606096 27231 tablet_bootstrap.cc:492] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:39.607540 27059 raft_consensus.cc:2454] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:39.607923 27231 tablet_bootstrap.cc:654] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.609373 28651 raft_consensus.cc:482] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:39.609586 28651 raft_consensus.cc:504] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.610183 28651 leader_election.cc:288] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:39.611475 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4873fe8318040a2b7e021708a875f43" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:39.611575 26702 leader_election.cc:302] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:39.611732 26916 raft_consensus.cc:2454] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:39.612361 28728 raft_consensus.cc:2781] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:39.612671 28728 raft_consensus.cc:686] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:39.612975 28728 consensus_queue.cc:237] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.614530 26991 leader_election.cc:302] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:39.614986 28651 raft_consensus.cc:2781] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:39.615072 28651 raft_consensus.cc:482] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:39.615139 28651 raft_consensus.cc:3037] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:39.615082 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2634beb347714fc7a2e05865adb34a22" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:39.618507 28651 raft_consensus.cc:504] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.619884 26915 raft_consensus.cc:3037] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:39.623420 28651 leader_election.cc:288] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:39.623566 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 8b303be24f4e46d0b966e8191d76297b (DEFAULT_TABLE table=default.Table_7df687282e5d42448878a624cddcac77 [id=1db29e28c564433e892b958e027b5f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.624082 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b303be24f4e46d0b966e8191d76297b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.624253 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 8b303be24f4e46d0b966e8191d76297b (DEFAULT_TABLE table=default.Table_7df687282e5d42448878a624cddcac77 [id=1db29e28c564433e892b958e027b5f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.624663 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b303be24f4e46d0b966e8191d76297b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.624727 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4873fe8318040a2b7e021708a875f43" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:39.624836 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4873fe8318040a2b7e021708a875f43" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:39.624982 26771 raft_consensus.cc:3037] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:39.627717 26771 raft_consensus.cc:2454] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:39.628369 27999 ts_tablet_manager.cc:1918] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:39.628494 27999 log.cc:1196] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/d91a02b22044429fb3e25840c7947a02
I20260810 11:30:39.628983 27999 ts_tablet_manager.cc:1939] T d91a02b22044429fb3e25840c7947a02 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:39.629369 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4873fe8318040a2b7e021708a875f43" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:39.629550 26916 raft_consensus.cc:3037] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:39.629842 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 116) took 13044 ms. Trace:
I20260810 11:30:39.629920 27999 rpcz_store.cc:276] 0810 11:30:26.585759 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.585805 (+ 46us) service_pool.cc:227] Handling call
0810 11:30:39.498590 (+12912785us) ts_tablet_manager.cc:1145] Deleting tablet d91a02b22044429fb3e25840c7947a02
0810 11:30:39.498604 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:39.503973 (+ 5369us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.628258 (+124285us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.629821 (+ 1563us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12912545}
I20260810 11:30:39.630475 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet d91a02b22044429fb3e25840c7947a02 (table default.Table_ed278fa8f2db4fe8a3215e71eb2d3f9f [id=0b49f313222c437d921a10d967a953de]) successfully deleted
I20260810 11:30:39.632290 27110 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:39.632746 26993 leader_election.cc:302] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:39.633095 26916 raft_consensus.cc:2454] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:39.634155 28651 raft_consensus.cc:2781] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:39.634464 28651 raft_consensus.cc:686] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:39.634789 28651 consensus_queue.cc:237] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.615427 27228 tablet_bootstrap.cc:492] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:39.637471 27228 ts_tablet_manager.cc:1397] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.149s user 0.002s sys 0.012s
I20260810 11:30:39.638427 27228 raft_consensus.cc:348] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.638706 27228 raft_consensus.cc:374] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.638780 27228 raft_consensus.cc:729] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.640331 27228 consensus_queue.cc:260] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.642329 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:39.643944 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 8b303be24f4e46d0b966e8191d76297b (DEFAULT_TABLE table=default.Table_7df687282e5d42448878a624cddcac77 [id=1db29e28c564433e892b958e027b5f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.644421 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b303be24f4e46d0b966e8191d76297b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.647413 26915 raft_consensus.cc:2454] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:39.650949 27999 tablet_replica.cc:330] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:39.651192 27999 raft_consensus.cc:2229] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:39.651369 27999 raft_consensus.cc:2258] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:39.651587 28345 raft_consensus.cc:482] T b4a37afa17d04e3181e7513ac8d23c24 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:39.651793 28345 raft_consensus.cc:504] T b4a37afa17d04e3181e7513ac8d23c24 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.653153 28345 leader_election.cc:288] T b4a37afa17d04e3181e7513ac8d23c24 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:39.651958 27999 ts_tablet_manager.cc:1905] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:39.655637 27228 ts_tablet_manager.cc:1428] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.018s user 0.000s sys 0.001s
I20260810 11:30:39.656039 26744 tablet_service.cc:1467] Processing CreateTablet for tablet c7538de3fa19456eb18ac6ff738c1d91 (DEFAULT_TABLE table=default.Table_dcca9eca711c4c6e9a0a5f4d9f370eb1 [id=4a2d7a649f5141249e6eabfbeaa20eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.656489 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7538de3fa19456eb18ac6ff738c1d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.656545 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4a37afa17d04e3181e7513ac8d23c24" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:39.656857 27058 raft_consensus.cc:2379] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:39.657333 27228 tablet_bootstrap.cc:492] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:39.658833 27021 tablet_service.cc:1467] Processing CreateTablet for tablet c7538de3fa19456eb18ac6ff738c1d91 (DEFAULT_TABLE table=default.Table_dcca9eca711c4c6e9a0a5f4d9f370eb1 [id=4a2d7a649f5141249e6eabfbeaa20eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.659102 26881 tablet_service.cc:1467] Processing CreateTablet for tablet c7538de3fa19456eb18ac6ff738c1d91 (DEFAULT_TABLE table=default.Table_dcca9eca711c4c6e9a0a5f4d9f370eb1 [id=4a2d7a649f5141249e6eabfbeaa20eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.659219 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7538de3fa19456eb18ac6ff738c1d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.659458 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7538de3fa19456eb18ac6ff738c1d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.661007 26821 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:39.664239 27037 tablet_service.cc:1467] Processing CreateTablet for tablet 41e7ace2693b4b8c8a978e7853e42472 (DEFAULT_TABLE table=default.Table_a28f24b6d9034bdbb5e3e055eafbcb5c [id=ac295842a377405890198a17654d63ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.664223 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 41e7ace2693b4b8c8a978e7853e42472 (DEFAULT_TABLE table=default.Table_a28f24b6d9034bdbb5e3e055eafbcb5c [id=ac295842a377405890198a17654d63ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.664708 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41e7ace2693b4b8c8a978e7853e42472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.664721 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41e7ace2693b4b8c8a978e7853e42472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.674140 27222 tablet_bootstrap.cc:492] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:39.674363 27222 ts_tablet_manager.cc:1397] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.182s user 0.001s sys 0.011s
I20260810 11:30:39.675558 27222 raft_consensus.cc:348] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.675887 27222 raft_consensus.cc:374] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.675971 27222 raft_consensus.cc:729] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.676249 27222 consensus_queue.cc:260] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.676874 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:39.677307 27222 ts_tablet_manager.cc:1428] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 11:30:39.677670 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:39.677735 27222 tablet_bootstrap.cc:492] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:39.679785 27222 tablet_bootstrap.cc:654] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.681143 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 41e7ace2693b4b8c8a978e7853e42472 (DEFAULT_TABLE table=default.Table_a28f24b6d9034bdbb5e3e055eafbcb5c [id=ac295842a377405890198a17654d63ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.681629 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41e7ace2693b4b8c8a978e7853e42472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.691282 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:39.691713 27228 tablet_bootstrap.cc:654] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.691787 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4a37afa17d04e3181e7513ac8d23c24" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:39.692975 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:39.692960 26744 tablet_service.cc:1467] Processing CreateTablet for tablet bb078d7c0d0e4cf5aa841a802e78d8ff (DEFAULT_TABLE table=default.Table_c68a4d11e9de4ef5a80903d5658bd5f8 [id=65218ea1c77a4098a4f1145607695dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.692523 26849 leader_election.cc:302] T b4a37afa17d04e3181e7513ac8d23c24 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:39.693388 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb078d7c0d0e4cf5aa841a802e78d8ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.695536 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]). Expected version 1 got 0
I20260810 11:30:39.697297 27037 tablet_service.cc:1467] Processing CreateTablet for tablet bb078d7c0d0e4cf5aa841a802e78d8ff (DEFAULT_TABLE table=default.Table_c68a4d11e9de4ef5a80903d5658bd5f8 [id=65218ea1c77a4098a4f1145607695dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.697857 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb078d7c0d0e4cf5aa841a802e78d8ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.701189 28779 raft_consensus.cc:3037] T b4a37afa17d04e3181e7513ac8d23c24 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:39.703774 28779 raft_consensus.cc:2726] T b4a37afa17d04e3181e7513ac8d23c24 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:39.707302 26894 tablet_service.cc:1467] Processing CreateTablet for tablet bb078d7c0d0e4cf5aa841a802e78d8ff (DEFAULT_TABLE table=default.Table_c68a4d11e9de4ef5a80903d5658bd5f8 [id=65218ea1c77a4098a4f1145607695dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.707839 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb078d7c0d0e4cf5aa841a802e78d8ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.710835 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:39.712190 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:39.712728 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:39.714128 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:39.714450 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:39.716058 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:39.716625 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 2 got 0
I20260810 11:30:39.717262 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:39.719807 27222 tablet_bootstrap.cc:492] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:39.719974 27222 ts_tablet_manager.cc:1397] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.000s
I20260810 11:30:39.720276 27999 ts_tablet_manager.cc:1918] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:39.720425 27999 log.cc:1196] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/ff9b649e43a9456fa51cf3330290bb91
I20260810 11:30:39.720837 27999 ts_tablet_manager.cc:1939] T ff9b649e43a9456fa51cf3330290bb91 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:39.721331 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 107) took 13139 ms. Trace:
I20260810 11:30:39.721462 27999 rpcz_store.cc:276] 0810 11:30:26.581537 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.590854 (+ 9317us) service_pool.cc:227] Handling call
0810 11:30:39.650903 (+13060049us) ts_tablet_manager.cc:1145] Deleting tablet ff9b649e43a9456fa51cf3330290bb91
0810 11:30:39.650911 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:39.685778 (+ 34867us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.720127 (+ 34349us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.721308 (+ 1181us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13059760}
I20260810 11:30:39.721925 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet ff9b649e43a9456fa51cf3330290bb91 (table default.Table_4ce8a3965b484cdb8c1f9b7d7e318755 [id=1ef3626d71d5408692ce0f62d2d5eca1]) successfully deleted
I20260810 11:30:39.721388 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:39.725464 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:39.726567 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:39.726822 27222 raft_consensus.cc:348] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.727074 27222 raft_consensus.cc:374] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.727137 27222 raft_consensus.cc:729] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.727723 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:39.730098 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:39.730726 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_5ba00bd0ab7d4cdcb1494f9491c64291 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 2 got 0
W20260810 11:30:39.731020 26566 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_5ba00bd0ab7d4cdcb1494f9491c64291 [id=5c8a2cbef71f4c9fb038a49e1ca7f704], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet c62ae41d2dd74eedbe252c4de70fbe1e consensus state has no leader
I20260810 11:30:39.731741 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:39.731644 27222 consensus_queue.cc:260] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.732256 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:39.734094 27228 tablet_bootstrap.cc:492] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:39.734308 27228 ts_tablet_manager.cc:1397] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.078s user 0.005s sys 0.001s
I20260810 11:30:39.734686 27222 ts_tablet_manager.cc:1428] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.015s user 0.002s sys 0.001s
I20260810 11:30:39.735139 27228 raft_consensus.cc:348] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.735423 27228 raft_consensus.cc:374] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.735515 27228 raft_consensus.cc:729] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.735759 27228 consensus_queue.cc:260] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.736960 27999 tablet_replica.cc:330] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:39.737174 27999 raft_consensus.cc:2229] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:39.737365 27999 raft_consensus.cc:2258] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:39.737921 27228 ts_tablet_manager.cc:1428] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 11:30:39.739503 27228 tablet_bootstrap.cc:492] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:39.740217 27222 tablet_bootstrap.cc:492] T 88268e3571884ac88c1a617ce74499f3 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:39.740479 27999 ts_tablet_manager.cc:1905] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:39.744959 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:39.747781 27228 tablet_bootstrap.cc:654] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.750259 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:39.751767 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:39.752503 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:39.754612 28845 raft_consensus.cc:482] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:39.754851 28845 raft_consensus.cc:504] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.755987 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a835d30ef9fc474ab927bb119a95d83c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:39.756685 26991 leader_election.cc:341] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:39.756789 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_0c1c960361be4daaab7ecd5cc74c33aa [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 1 got 0
I20260810 11:30:39.757491 28845 leader_election.cc:288] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:39.758437 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a835d30ef9fc474ab927bb119a95d83c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:39.758666 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:39.759084 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
W20260810 11:30:39.760103 26993 leader_election.cc:341] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:39.760268 26993 leader_election.cc:302] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:39.760854 27222 tablet_bootstrap.cc:654] T 88268e3571884ac88c1a617ce74499f3 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.760880 28651 raft_consensus.cc:2726] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:39.761401 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:39.761874 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:39.764027 27231 tablet_bootstrap.cc:492] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:39.764180 27231 ts_tablet_manager.cc:1397] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.158s user 0.010s sys 0.025s
I20260810 11:30:39.764518 27999 ts_tablet_manager.cc:1918] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:39.764660 27999 log.cc:1196] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/64818ca5827e41d99428903ddb8688d9
I20260810 11:30:39.765080 27999 ts_tablet_manager.cc:1939] T 64818ca5827e41d99428903ddb8688d9 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:39.765328 27231 raft_consensus.cc:348] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.765545 27231 raft_consensus.cc:374] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.765601 27231 raft_consensus.cc:729] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.765827 27231 consensus_queue.cc:260] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.766530 27231 ts_tablet_manager.cc:1428] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260810 11:30:39.767385 27231 tablet_bootstrap.cc:492] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:39.769964 27231 tablet_bootstrap.cc:654] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.771683 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 123) took 13163 ms. Trace:
I20260810 11:30:39.771814 27999 rpcz_store.cc:276] 0810 11:30:26.607975 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.608156 (+ 181us) service_pool.cc:227] Handling call
0810 11:30:39.721757 (+13113601us) ts_tablet_manager.cc:1145] Deleting tablet 64818ca5827e41d99428903ddb8688d9
0810 11:30:39.721767 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:39.754737 (+ 32970us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.764393 (+ 9656us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.771654 (+ 7261us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13113270}
I20260810 11:30:39.772440 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 64818ca5827e41d99428903ddb8688d9 (table default.Table_fb7b13261243442c9c4d8749871c1d1a [id=926b5b59f3fc4de6baeac9dbfdeed8f5]) successfully deleted
I20260810 11:30:39.774142 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00c4599256684f5dbc745c9283f31a08 (table default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14]). Expected version 1 got 0
I20260810 11:30:39.774652 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:39.776671 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:39.777531 27999 tablet_replica.cc:330] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:39.777845 27999 raft_consensus.cc:2229] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:39.778072 27999 raft_consensus.cc:2258] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:39.780668 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
I20260810 11:30:39.781309 27999 ts_tablet_manager.cc:1905] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:39.781996 27228 tablet_bootstrap.cc:492] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:39.782177 27228 ts_tablet_manager.cc:1397] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.001s
I20260810 11:30:39.783021 27228 raft_consensus.cc:348] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.783309 27228 raft_consensus.cc:374] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.783463 27228 raft_consensus.cc:729] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.783757 27228 consensus_queue.cc:260] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.788450 27228 ts_tablet_manager.cc:1428] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260810 11:30:39.790337 27222 tablet_bootstrap.cc:492] T 88268e3571884ac88c1a617ce74499f3 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:39.790531 27222 ts_tablet_manager.cc:1397] T 88268e3571884ac88c1a617ce74499f3 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.050s user 0.005s sys 0.001s
I20260810 11:30:39.791260 27222 raft_consensus.cc:348] T 88268e3571884ac88c1a617ce74499f3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.791488 27222 raft_consensus.cc:374] T 88268e3571884ac88c1a617ce74499f3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.791533 27222 raft_consensus.cc:729] T 88268e3571884ac88c1a617ce74499f3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.792936 27999 ts_tablet_manager.cc:1918] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:39.793129 27999 log.cc:1196] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/91b6078efadf496fb252f725bdf56b02
I20260810 11:30:39.793440 27222 consensus_queue.cc:260] T 88268e3571884ac88c1a617ce74499f3 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.793735 27228 tablet_bootstrap.cc:492] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:39.794209 27999 ts_tablet_manager.cc:1939] T 91b6078efadf496fb252f725bdf56b02 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:39.796149 26571 catalog_manager.cc:5495] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:39.797029 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 112) took 13213 ms. Trace:
I20260810 11:30:39.797145 27999 rpcz_store.cc:276] 0810 11:30:26.583582 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.583906 (+ 324us) service_pool.cc:227] Handling call
0810 11:30:39.773247 (+13189341us) ts_tablet_manager.cc:1145] Deleting tablet 91b6078efadf496fb252f725bdf56b02
0810 11:30:39.777474 (+ 4227us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:39.785492 (+ 8018us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.792700 (+ 7208us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.797006 (+ 4306us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13135947}
I20260810 11:30:39.797401 27231 tablet_bootstrap.cc:492] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:39.797559 27231 ts_tablet_manager.cc:1397] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.005s
I20260810 11:30:39.797684 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 91b6078efadf496fb252f725bdf56b02 (table default.Table_f5acadd3f7ff49d4883a695e2348164f [id=02cec75d98d0411ba2eb17ae8f083f00]) successfully deleted
I20260810 11:30:39.798015 27222 ts_tablet_manager.cc:1428] T 88268e3571884ac88c1a617ce74499f3 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260810 11:30:39.798375 27999 tablet_replica.cc:330] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:39.798377 27231 raft_consensus.cc:348] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.798609 27231 raft_consensus.cc:374] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.798660 27231 raft_consensus.cc:729] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.798835 27231 consensus_queue.cc:260] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.799353 27231 ts_tablet_manager.cc:1428] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 11:30:39.799633 27231 tablet_bootstrap.cc:492] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:39.799268 27999 raft_consensus.cc:2229] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:39.800839 27999 raft_consensus.cc:2258] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:39.800249 27228 tablet_bootstrap.cc:654] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.802668 27222 tablet_bootstrap.cc:492] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:39.803216 27999 ts_tablet_manager.cc:1905] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:39.800490 26571 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:39.804253 26573 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_acbcb3a347b647a19e81cfcf5636677f [id=56dee621acfa4f73b3bd69fefa7cb7e1] alter complete (version 1)
W20260810 11:30:39.804612 26580 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a3079a68c1c74b64bf13877bd0ee68c3 consensus state has no leader
W20260810 11:30:39.804877 26574 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3853603eac544d769cef8cff9a008784 consensus state has no leader
I20260810 11:30:39.804878 26580 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 99) took 1379 ms. Trace:
I20260810 11:30:39.805102 26574 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 122) took 1002 ms. Trace:
I20260810 11:30:39.805198 26574 rpcz_store.cc:276] 0810 11:30:38.802531 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:38.994233 (+191702us) service_pool.cc:227] Handling call
0810 11:30:38.994932 (+ 699us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:38.995195 (+ 263us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:38.995465 (+ 270us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:38.995575 (+ 110us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:39.065186 (+ 69611us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:39.805032 (+739846us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:39.056486 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:39.056724 (+ 238us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:39.056742 (+ 18us) write_op.cc:435] Acquired schema lock
0810 11:30:39.056745 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:39.056872 (+ 127us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:39.056888 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:39.056894 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:39.056968 (+ 74us) tablet.cc:699] Row locks acquired
0810 11:30:39.056973 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:39.057036 (+ 63us) write_op.cc:270] Start()
0810 11:30:39.057109 (+ 73us) write_op.cc:276] Timestamp: P: 1786361439056995 usec, L: 0
0810 11:30:39.057113 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:39.057378 (+ 265us) log.cc:842] Serialized 405 byte log entry
0810 11:30:39.064211 (+ 6833us) op_driver.cc:444] REPLICATION: finished
0810 11:30:39.064422 (+ 211us) write_op.cc:301] APPLY: starting
0810 11:30:39.064445 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:39.064503 (+ 58us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:39.064542 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:39.064648 (+ 106us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:39.064700 (+ 52us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:39.064710 (+ 10us) write_op.cc:312] APPLY: finished
0810 11:30:39.064821 (+ 111us) log.cc:842] Serialized 23 byte log entry
0810 11:30:39.064903 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.064929 (+ 26us) write_op.cc:454] Released schema lock
0810 11:30:39.064939 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:39.065017 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.065033 (+ 16us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":130,"apply.run_cpu_time_us":678,"apply.run_wall_time_us":677,"num_ops":1,"prepare.queue_time_us":60168,"prepare.run_cpu_time_us":1074,"prepare.run_wall_time_us":3593,"raft.queue_time_us":72,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":377,"replication_time_us":7058}]]}
I20260810 11:30:39.805073 26580 rpcz_store.cc:276] 0810 11:30:38.425030 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:38.426949 (+ 1919us) service_pool.cc:227] Handling call
0810 11:30:38.440517 (+ 13568us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:38.440875 (+ 358us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:38.441133 (+ 258us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:38.441235 (+ 102us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:38.792823 (+351588us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:39.804787 (+1011964us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:38.663099 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:38.663242 (+ 143us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:38.663250 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:38.663253 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:38.663389 (+ 136us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:38.663407 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:38.663412 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:38.663488 (+ 76us) tablet.cc:699] Row locks acquired
0810 11:30:38.663491 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:38.663583 (+ 92us) write_op.cc:270] Start()
0810 11:30:38.663636 (+ 53us) write_op.cc:276] Timestamp: P: 1786361438663487 usec, L: 0
0810 11:30:38.663641 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:38.709164 (+ 45523us) log.cc:842] Serialized 405 byte log entry
0810 11:30:38.791043 (+ 81879us) op_driver.cc:444] REPLICATION: finished
0810 11:30:38.791992 (+ 949us) write_op.cc:301] APPLY: starting
0810 11:30:38.792007 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:38.792048 (+ 41us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:38.792081 (+ 33us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:38.792137 (+ 56us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:38.792178 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:38.792188 (+ 10us) write_op.cc:312] APPLY: finished
0810 11:30:38.792269 (+ 81us) log.cc:842] Serialized 23 byte log entry
0810 11:30:38.792320 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:38.792335 (+ 15us) write_op.cc:454] Released schema lock
0810 11:30:38.792342 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:38.792405 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:38.792411 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":906,"apply.run_cpu_time_us":469,"apply.run_wall_time_us":469,"num_ops":1,"prepare.queue_time_us":200211,"prepare.run_cpu_time_us":1112,"prepare.run_wall_time_us":47446,"raft.queue_time_us":198,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":8,"replication_time_us":127382}]]}
I20260810 11:30:39.804276 26575 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet cc76d30f37094391b75076c92ccc277f
I20260810 11:30:39.811214 26575 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 117) took 1348 ms. Trace:
I20260810 11:30:39.811327 26575 rpcz_store.cc:276] 0810 11:30:38.462988 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:38.934315 (+471327us) service_pool.cc:227] Handling call
0810 11:30:38.935341 (+ 1026us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:38.935810 (+ 469us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:38.935948 (+ 138us) catalog_manager.cc:2761] Locking tablets
0810 11:30:38.936208 (+ 260us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:39.009660 (+ 73452us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:39.009791 (+ 131us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:39.804212 (+794421us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:39.811140 (+ 6928us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:38.976075 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:38.976280 (+ 205us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:38.976290 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:38.976294 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:38.978727 (+ 2433us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:38.978741 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:38.978747 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:38.978873 (+ 126us) tablet.cc:699] Row locks acquired
0810 11:30:38.978876 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:38.978920 (+ 44us) write_op.cc:270] Start()
0810 11:30:38.978960 (+ 40us) write_op.cc:276] Timestamp: P: 1786361438978888 usec, L: 0
0810 11:30:38.978964 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:38.979187 (+ 223us) log.cc:842] Serialized 734 byte log entry
0810 11:30:38.991144 (+ 11957us) op_driver.cc:444] REPLICATION: finished
0810 11:30:38.993280 (+ 2136us) write_op.cc:301] APPLY: starting
0810 11:30:38.993293 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:38.993329 (+ 36us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:38.993385 (+ 56us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:38.993445 (+ 60us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:38.993490 (+ 45us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:38.993496 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:38.993553 (+ 57us) log.cc:842] Serialized 29 byte log entry
0810 11:30:38.993591 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:38.993605 (+ 14us) write_op.cc:454] Released schema lock
0810 11:30:38.993610 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:38.993660 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:38.993663 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":2099,"apply.run_cpu_time_us":435,"apply.run_wall_time_us":434,"num_ops":2,"prepare.queue_time_us":14754,"prepare.run_cpu_time_us":1033,"prepare.run_wall_time_us":3657,"raft.queue_time_us":50,"raft.run_cpu_time_us":12,"raft.run_wall_time_us":13,"replication_time_us":12166,"spinlock_wait_cycles":23296}]]}
I20260810 11:30:39.812261 26575 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_f33a13096a144e538af2795c149abdcd" } new_table_name: "default.Table_065fc82a2823470b89b4cff36ca03027" modify_external_catalogs: true
I20260810 11:30:39.813334 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet cc76d30f37094391b75076c92ccc277f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:39.814143 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet cc76d30f37094391b75076c92ccc277f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:39.815828 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet cc76d30f37094391b75076c92ccc277f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc76d30f37094391b75076c92ccc277f already in progress: creating tablet
I20260810 11:30:39.816613 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet cc76d30f37094391b75076c92ccc277f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:39.817400 27999 ts_tablet_manager.cc:1918] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:39.817543 27999 log.cc:1196] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/4b5a7f67ec5b48c2b5a510add0282a76
I20260810 11:30:39.817914 27999 ts_tablet_manager.cc:1939] T 4b5a7f67ec5b48c2b5a510add0282a76 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:39.820546 27231 tablet_bootstrap.cc:654] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.821003 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 124) took 13212 ms. Trace:
I20260810 11:30:39.821116 27999 rpcz_store.cc:276] 0810 11:30:26.608796 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.655462 (+ 46666us) service_pool.cc:227] Handling call
0810 11:30:39.798073 (+13142611us) ts_tablet_manager.cc:1145] Deleting tablet 4b5a7f67ec5b48c2b5a510add0282a76
0810 11:30:39.798086 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:39.809682 (+ 11596us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.817229 (+ 7547us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.820977 (+ 3748us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13140404}
I20260810 11:30:39.821673 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 4b5a7f67ec5b48c2b5a510add0282a76 (table default.Table_393d03f5197d43b6977bf48bd7818a0e [id=bc7f10791af946e5957625fb1f912c4e]) successfully deleted
I20260810 11:30:39.822045 27999 tablet_replica.cc:330] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:39.822264 27999 raft_consensus.cc:2229] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:39.822439 27999 raft_consensus.cc:2258] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:39.823053 27999 ts_tablet_manager.cc:1905] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:39.842998 27999 ts_tablet_manager.cc:1918] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:39.843161 27999 log.cc:1196] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/f2b555f18c1e485d9af7b08f98543c80
I20260810 11:30:39.843634 27999 ts_tablet_manager.cc:1939] T f2b555f18c1e485d9af7b08f98543c80 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
W20260810 11:30:39.844143 26849 consensus_peers.cc:487] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ccef06fa06c4c519d8760fa948d6c8b. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:39.844805 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 125) took 13180 ms. Trace:
W20260810 11:30:39.854935 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet cc76d30f37094391b75076c92ccc277f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc76d30f37094391b75076c92ccc277f already in progress: creating tablet
I20260810 11:30:39.869537 27222 tablet_bootstrap.cc:654] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.870137 27231 tablet_bootstrap.cc:492] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:39.870402 27231 ts_tablet_manager.cc:1397] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.071s user 0.009s sys 0.004s
I20260810 11:30:39.871490 27231 raft_consensus.cc:348] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.872339 27231 raft_consensus.cc:374] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.872473 27231 raft_consensus.cc:729] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.872785 27231 consensus_queue.cc:260] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.873364 27231 ts_tablet_manager.cc:1428] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 11:30:39.873703 27231 tablet_bootstrap.cc:492] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:39.887005 27231 tablet_bootstrap.cc:654] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.894518 27222 tablet_bootstrap.cc:492] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:39.894697 27222 ts_tablet_manager.cc:1397] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.092s user 0.003s sys 0.000s
I20260810 11:30:39.901594 27222 raft_consensus.cc:348] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.901916 27222 raft_consensus.cc:374] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.901979 27222 raft_consensus.cc:729] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.903035 27999 rpcz_store.cc:276] 0810 11:30:26.664230 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.664323 (+ 93us) service_pool.cc:227] Handling call
0810 11:30:39.821983 (+13157660us) ts_tablet_manager.cc:1145] Deleting tablet f2b555f18c1e485d9af7b08f98543c80
0810 11:30:39.822000 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:39.827943 (+ 5943us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.842854 (+ 14911us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.844779 (+ 1925us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13152027}
I20260810 11:30:39.903957 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet f2b555f18c1e485d9af7b08f98543c80 (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]) successfully deleted
I20260810 11:30:39.906572 27999 tablet_replica.cc:330] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:39.907653 27999 raft_consensus.cc:2229] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:39.907925 27999 raft_consensus.cc:2258] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:39.909514 27231 tablet_bootstrap.cc:492] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:39.909675 27231 ts_tablet_manager.cc:1397] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.003s
I20260810 11:30:39.910238 27999 ts_tablet_manager.cc:1905] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:39.910729 27231 raft_consensus.cc:348] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.910989 27231 raft_consensus.cc:374] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.911048 27231 raft_consensus.cc:729] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.911257 27231 consensus_queue.cc:260] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.911996 27231 ts_tablet_manager.cc:1428] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 11:30:39.912289 27231 tablet_bootstrap.cc:492] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:39.914885 27231 tablet_bootstrap.cc:654] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.919202 27222 consensus_queue.cc:260] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.921495 26763 raft_consensus.cc:3037] T 4b5a7f67ec5b48c2b5a510add0282a76 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:39.921633 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 2acbbbd72845428384d65c8c423c0db6 (DEFAULT_TABLE table=default.Table_7fdd2b7a6d02462b92ed03909ab16141 [id=e2a272a0f465472d869a1f0f169557b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.922111 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2acbbbd72845428384d65c8c423c0db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.925700 27037 tablet_service.cc:1467] Processing CreateTablet for tablet 2acbbbd72845428384d65c8c423c0db6 (DEFAULT_TABLE table=default.Table_7fdd2b7a6d02462b92ed03909ab16141 [id=e2a272a0f465472d869a1f0f169557b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.925832 28651 consensus_queue.cc:1035] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:39.926194 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2acbbbd72845428384d65c8c423c0db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.927153 27222 ts_tablet_manager.cc:1428] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.032s user 0.002s sys 0.001s
I20260810 11:30:39.927501 27222 tablet_bootstrap.cc:492] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:39.932528 27999 ts_tablet_manager.cc:1918] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:39.933056 27999 log.cc:1196] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/834c9c99ec424bb39e8a003e9204b2bc
I20260810 11:30:39.933246 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 2acbbbd72845428384d65c8c423c0db6 (DEFAULT_TABLE table=default.Table_7fdd2b7a6d02462b92ed03909ab16141 [id=e2a272a0f465472d869a1f0f169557b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.933764 27999 ts_tablet_manager.cc:1939] T 834c9c99ec424bb39e8a003e9204b2bc P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:39.933837 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2acbbbd72845428384d65c8c423c0db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.934374 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 4639b8019c04435daab65d83ddf1a0e1 (DEFAULT_TABLE table=default.Table_faf9f4a916e7439dbefd685a103109aa [id=19461f2b0b184290a9eba683ef3825e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.934815 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4639b8019c04435daab65d83ddf1a0e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.934979 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 127) took 13253 ms. Trace:
I20260810 11:30:39.935075 27999 rpcz_store.cc:276] 0810 11:30:26.681375 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.681443 (+ 68us) service_pool.cc:227] Handling call
0810 11:30:39.906506 (+13225063us) ts_tablet_manager.cc:1145] Deleting tablet 834c9c99ec424bb39e8a003e9204b2bc
0810 11:30:39.906527 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:39.919384 (+ 12857us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.932374 (+ 12990us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.934943 (+ 2569us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13224752}
I20260810 11:30:39.935657 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 834c9c99ec424bb39e8a003e9204b2bc (table default.Table_e930e7d079ef4035bde1d9a4ef134d62 [id=ad637cef46ef40eeb3182153bcd52f6d]) successfully deleted
I20260810 11:30:39.936044 27999 tablet_replica.cc:330] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:39.936296 27999 raft_consensus.cc:2229] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:39.936721 27999 raft_consensus.cc:2258] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:39.933373 26741 tablet_service.cc:1467] Processing CreateTablet for tablet 4639b8019c04435daab65d83ddf1a0e1 (DEFAULT_TABLE table=default.Table_faf9f4a916e7439dbefd685a103109aa [id=19461f2b0b184290a9eba683ef3825e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.937282 26741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4639b8019c04435daab65d83ddf1a0e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.937463 27999 ts_tablet_manager.cc:1905] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:39.938350 26881 tablet_service.cc:1467] Processing CreateTablet for tablet bcc69e8f87134d25a1329be52b08e794 (DEFAULT_TABLE table=default.Table_710852962fc94eebadae58bb908b6a3b [id=b4c0c92ef07f432cbb00a36ecd17d394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.938741 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcc69e8f87134d25a1329be52b08e794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.940753 28651 raft_consensus.cc:482] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:39.940917 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 635e97f64d5945099b05667ab733348c (DEFAULT_TABLE table=default.Table_2f65140b022e401693ca5cba15d62a04 [id=0cca8d1f9067479f96d45dfd952543b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.940900 28651 raft_consensus.cc:504] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.941308 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 635e97f64d5945099b05667ab733348c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.941537 28651 leader_election.cc:288] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:39.942239 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adecd2f0952b4f4c83919c78d563e429" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:39.942840 26991 leader_election.cc:341] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:39.943516 26883 tablet_service.cc:1467] Processing CreateTablet for tablet ce73798a721b4a6d892f0c24b6b40e2c (DEFAULT_TABLE table=default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.943718 27039 tablet_service.cc:1467] Processing CreateTablet for tablet bcc69e8f87134d25a1329be52b08e794 (DEFAULT_TABLE table=default.Table_710852962fc94eebadae58bb908b6a3b [id=b4c0c92ef07f432cbb00a36ecd17d394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.943897 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce73798a721b4a6d892f0c24b6b40e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.944000 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adecd2f0952b4f4c83919c78d563e429" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:39.944140 27039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcc69e8f87134d25a1329be52b08e794. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:39.944550 26993 leader_election.cc:341] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:39.944666 26993 leader_election.cc:302] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:39.944928 27031 tablet_service.cc:1467] Processing CreateTablet for tablet 635e97f64d5945099b05667ab733348c (DEFAULT_TABLE table=default.Table_2f65140b022e401693ca5cba15d62a04 [id=0cca8d1f9067479f96d45dfd952543b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.945055 28651 raft_consensus.cc:2726] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:39.945485 27034 tablet_service.cc:1467] Processing CreateTablet for tablet ce73798a721b4a6d892f0c24b6b40e2c (DEFAULT_TABLE table=default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.948678 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce73798a721b4a6d892f0c24b6b40e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.949043 26748 tablet_service.cc:1467] Processing CreateTablet for tablet bcc69e8f87134d25a1329be52b08e794 (DEFAULT_TABLE table=default.Table_710852962fc94eebadae58bb908b6a3b [id=b4c0c92ef07f432cbb00a36ecd17d394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.949115 26730 tablet_service.cc:1467] Processing CreateTablet for tablet 635e97f64d5945099b05667ab733348c (DEFAULT_TABLE table=default.Table_2f65140b022e401693ca5cba15d62a04 [id=0cca8d1f9067479f96d45dfd952543b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.949494 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcc69e8f87134d25a1329be52b08e794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.949643 26732 tablet_service.cc:1467] Processing CreateTablet for tablet 24252b72ed76450d8457527159dd569f (DEFAULT_TABLE table=default.Table_8cce8390a37245e1be3c2c0812761958 [id=8498cfc3b7944310b55638daade9e691]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.950050 27031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 635e97f64d5945099b05667ab733348c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.951571 27999 ts_tablet_manager.cc:1918] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:39.951838 27999 log.cc:1196] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/96cae4eb16c84410926a317af70e44f7
I20260810 11:30:39.952198 27999 ts_tablet_manager.cc:1939] T 96cae4eb16c84410926a317af70e44f7 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:39.953024 26743 tablet_service.cc:1467] Processing CreateTablet for tablet ce73798a721b4a6d892f0c24b6b40e2c (DEFAULT_TABLE table=default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.953436 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24252b72ed76450d8457527159dd569f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.954229 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 128) took 13272 ms. Trace:
I20260810 11:30:39.954314 27999 rpcz_store.cc:276] 0810 11:30:26.681964 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.682022 (+ 58us) service_pool.cc:227] Handling call
0810 11:30:39.935983 (+13253961us) ts_tablet_manager.cc:1145] Deleting tablet 96cae4eb16c84410926a317af70e44f7
0810 11:30:39.935996 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:39.940532 (+ 4536us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.951492 (+ 10960us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:39.954205 (+ 2713us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13246650}
I20260810 11:30:39.955331 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 96cae4eb16c84410926a317af70e44f7 (table default.Table_bd735fb392144c6b97d5678685645108 [id=b471e1c958484bbc95c4cbb4c79bea91]) successfully deleted
I20260810 11:30:39.956818 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce73798a721b4a6d892f0c24b6b40e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.957046 26730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 635e97f64d5945099b05667ab733348c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.963414 26886 tablet_service.cc:1467] Processing CreateTablet for tablet 24252b72ed76450d8457527159dd569f (DEFAULT_TABLE table=default.Table_8cce8390a37245e1be3c2c0812761958 [id=8498cfc3b7944310b55638daade9e691]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.964098 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24252b72ed76450d8457527159dd569f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:39.966192 26991 consensus_peers.cc:487] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b5a7f67ec5b48c2b5a510add0282a76. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:39.966866 27028 tablet_service.cc:1467] Processing CreateTablet for tablet aa71cedba3d34c288a3e3be99d474ce4 (DEFAULT_TABLE table=default.Table_d863b14a3a96454e8ee5a85fb2ab30c8 [id=a40ab01e5be24248b3af7ef1dc456da6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.966950 27025 tablet_service.cc:1467] Processing CreateTablet for tablet 2a1fbf3890ee4a829b4c8c61fe1e978f (DEFAULT_TABLE table=default.Table_eecd0244ecc849339f452f38db67c973 [id=41d3dec833b54d1e855194862cb1726b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.966950 27033 tablet_service.cc:1467] Processing CreateTablet for tablet 68360dabfbd84026adfb6874a5d92e2a (DEFAULT_TABLE table=default.Table_269e9aeec3ef452bb70afc88654f3a93 [id=b909a6430e1d4d458f83dbd7a2bf82b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.967379 26893 tablet_service.cc:1467] Processing CreateTablet for tablet aa71cedba3d34c288a3e3be99d474ce4 (DEFAULT_TABLE table=default.Table_d863b14a3a96454e8ee5a85fb2ab30c8 [id=a40ab01e5be24248b3af7ef1dc456da6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.967561 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa71cedba3d34c288a3e3be99d474ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.967912 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa71cedba3d34c288a3e3be99d474ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.968966 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 2a1fbf3890ee4a829b4c8c61fe1e978f (DEFAULT_TABLE table=default.Table_eecd0244ecc849339f452f38db67c973 [id=41d3dec833b54d1e855194862cb1726b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.969383 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a1fbf3890ee4a829b4c8c61fe1e978f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.972951 26885 tablet_service.cc:1467] Processing CreateTablet for tablet 68360dabfbd84026adfb6874a5d92e2a (DEFAULT_TABLE table=default.Table_269e9aeec3ef452bb70afc88654f3a93 [id=b909a6430e1d4d458f83dbd7a2bf82b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.973410 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68360dabfbd84026adfb6874a5d92e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.974996 27999 tablet_replica.cc:330] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:39.975255 27999 raft_consensus.cc:2229] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:39.976477 27228 tablet_bootstrap.cc:492] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:39.976737 28651 raft_consensus.cc:482] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:39.976914 28651 raft_consensus.cc:504] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.977582 28651 leader_election.cc:288] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:39.978443 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3079a68c1c74b64bf13877bd0ee68c3" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:39.979094 26991 leader_election.cc:341] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:39.980187 27033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68360dabfbd84026adfb6874a5d92e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.980650 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3079a68c1c74b64bf13877bd0ee68c3" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:39.980818 27999 raft_consensus.cc:2258] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:39.981225 27228 ts_tablet_manager.cc:1397] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.192s user 0.010s sys 0.021s
W20260810 11:30:39.981474 26993 leader_election.cc:341] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:39.981586 26993 leader_election.cc:302] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:39.982069 28651 raft_consensus.cc:2726] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:39.982007 27228 raft_consensus.cc:348] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.983285 27999 ts_tablet_manager.cc:1905] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:39.984588 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a1fbf3890ee4a829b4c8c61fe1e978f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.988654 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 24252b72ed76450d8457527159dd569f (DEFAULT_TABLE table=default.Table_8cce8390a37245e1be3c2c0812761958 [id=8498cfc3b7944310b55638daade9e691]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:39.989089 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24252b72ed76450d8457527159dd569f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:39.991309 27228 raft_consensus.cc:374] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:39.991446 27228 raft_consensus.cc:729] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:39.991714 27228 consensus_queue.cc:260] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:39.993633 27228 ts_tablet_manager.cc:1428] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260810 11:30:39.993983 27228 tablet_bootstrap.cc:492] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:39.995560 27228 tablet_bootstrap.cc:654] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.997166 27222 tablet_bootstrap.cc:654] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:39.998968 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:40.000131 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:40.003836 26743 tablet_service.cc:1467] Processing CreateTablet for tablet aa71cedba3d34c288a3e3be99d474ce4 (DEFAULT_TABLE table=default.Table_d863b14a3a96454e8ee5a85fb2ab30c8 [id=a40ab01e5be24248b3af7ef1dc456da6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:40.004685 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa71cedba3d34c288a3e3be99d474ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:40.007113 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 2a1fbf3890ee4a829b4c8c61fe1e978f (DEFAULT_TABLE table=default.Table_eecd0244ecc849339f452f38db67c973 [id=41d3dec833b54d1e855194862cb1726b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:40.007642 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a1fbf3890ee4a829b4c8c61fe1e978f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:40.013571 26741 tablet_service.cc:1467] Processing CreateTablet for tablet 68360dabfbd84026adfb6874a5d92e2a (DEFAULT_TABLE table=default.Table_269e9aeec3ef452bb70afc88654f3a93 [id=b909a6430e1d4d458f83dbd7a2bf82b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:40.014765 27231 tablet_bootstrap.cc:492] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:40.014828 26741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68360dabfbd84026adfb6874a5d92e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:40.014945 27231 ts_tablet_manager.cc:1397] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.103s user 0.005s sys 0.001s
I20260810 11:30:40.015107 28726 raft_consensus.cc:482] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.015285 28726 raft_consensus.cc:504] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.015717 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:40.016001 28726 leader_election.cc:288] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.016368 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:40.016840 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:40.017220 27231 raft_consensus.cc:348] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.017448 27231 raft_consensus.cc:374] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.017655 27231 raft_consensus.cc:729] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.018095 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10210204d5ff4e5e97c98fd255f674a5" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:40.018374 27231 consensus_queue.cc:260] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.018610 27058 raft_consensus.cc:2454] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:40.019613 27999 ts_tablet_manager.cc:1918] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:40.019762 27999 log.cc:1196] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/420ba6e9f74c4ae5bf450f369e7fbdb3
I20260810 11:30:40.025148 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10210204d5ff4e5e97c98fd255f674a5" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:40.028829 27231 ts_tablet_manager.cc:1428] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.014s user 0.004s sys 0.000s
I20260810 11:30:40.029174 27231 tablet_bootstrap.cc:492] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:40.030550 27999 ts_tablet_manager.cc:1939] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:40.030913 26702 leader_election.cc:302] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:40.031044 27231 tablet_bootstrap.cc:654] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.031430 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 126) took 13360 ms. Trace:
I20260810 11:30:40.031525 27999 rpcz_store.cc:276] 0810 11:30:26.670736 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.670823 (+ 87us) service_pool.cc:227] Handling call
0810 11:30:39.974941 (+13304118us) ts_tablet_manager.cc:1145] Deleting tablet 420ba6e9f74c4ae5bf450f369e7fbdb3
0810 11:30:39.974953 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:39.986263 (+ 11310us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.019500 (+ 33237us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.031409 (+ 11909us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13219301}
I20260810 11:30:40.031854 27999 tablet_replica.cc:330] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
W20260810 11:30:40.031956 26991 consensus_peers.cc:487] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91b6078efadf496fb252f725bdf56b02. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:40.032078 27999 raft_consensus.cc:2229] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:40.032150 28726 raft_consensus.cc:2781] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:40.032229 27999 raft_consensus.cc:2258] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:40.032228 28726 raft_consensus.cc:482] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:40.032310 28726 raft_consensus.cc:3037] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.032949 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 (table default.Table_4e27e43aa8d9444ca022be053fcd700e [id=b6297673b9854cf79ae182f5f51ebd36]) successfully deleted
I20260810 11:30:40.017284 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]). Expected version 1 got 0
I20260810 11:30:40.034754 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:40.034961 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:40.035290 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:40.035655 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_5ba00bd0ab7d4cdcb1494f9491c64291 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 2 got 0
I20260810 11:30:40.035883 28726 raft_consensus.cc:504] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.036152 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:40.036298 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:40.037451 28726 leader_election.cc:288] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.037555 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10210204d5ff4e5e97c98fd255f674a5" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:40.037786 27058 raft_consensus.cc:3037] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:40.040467 26700 consensus_peers.cc:487] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64818ca5827e41d99428903ddb8688d9. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:40.040832 26700 leader_election.cc:341] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.041914 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10210204d5ff4e5e97c98fd255f674a5" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:40.042243 26700 consensus_peers.cc:487] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 834c9c99ec424bb39e8a003e9204b2bc. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:40.043443 26700 leader_election.cc:341] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.043892 27999 ts_tablet_manager.cc:1905] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:40.044998 27058 raft_consensus.cc:2454] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:40.045478 26702 leader_election.cc:302] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.046123 28640 raft_consensus.cc:2781] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:40.046242 28640 raft_consensus.cc:686] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:40.046301 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 4639b8019c04435daab65d83ddf1a0e1 (DEFAULT_TABLE table=default.Table_faf9f4a916e7439dbefd685a103109aa [id=19461f2b0b184290a9eba683ef3825e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:40.046485 28640 consensus_queue.cc:237] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.047112 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4639b8019c04435daab65d83ddf1a0e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:40.048938 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 2 got 0
I20260810 11:30:40.050621 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:40.051086 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:40.051399 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:40.051682 28345 consensus_queue.cc:1035] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:40.051879 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:40.069160 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:40.070142 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:40.071339 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:40.071632 27222 tablet_bootstrap.cc:492] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:40.071787 27222 ts_tablet_manager.cc:1397] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.144s user 0.003s sys 0.003s
I20260810 11:30:40.071784 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:40.072654 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:40.073966 28727 raft_consensus.cc:482] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.074115 28727 raft_consensus.cc:504] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.074713 28727 leader_election.cc:288] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.076768 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e78fb1bf0534deca5cc5a603fd77592" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:40.076900 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e78fb1bf0534deca5cc5a603fd77592" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:40.077008 27058 raft_consensus.cc:2454] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:40.077458 26702 leader_election.cc:302] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
W20260810 11:30:40.077611 26700 leader_election.cc:341] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.077755 28727 raft_consensus.cc:2781] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:40.077827 28727 raft_consensus.cc:482] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:40.077884 28727 raft_consensus.cc:3037] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.081041 28727 raft_consensus.cc:504] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.082087 28727 leader_election.cc:288] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.082813 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e78fb1bf0534deca5cc5a603fd77592" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:40.083065 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e78fb1bf0534deca5cc5a603fd77592" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:40.083437 27058 raft_consensus.cc:3037] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:40.083415 26700 leader_election.cc:341] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.089332 27058 raft_consensus.cc:2454] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:40.074231 27222 raft_consensus.cc:348] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.089977 27222 raft_consensus.cc:374] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.090102 26702 leader_election.cc:302] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.090265 27222 raft_consensus.cc:729] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.090590 28727 raft_consensus.cc:2781] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:40.091065 28727 raft_consensus.cc:686] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:40.091392 28727 consensus_queue.cc:237] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.091651 27228 tablet_bootstrap.cc:492] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:40.091799 27228 ts_tablet_manager.cc:1397] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.098s user 0.005s sys 0.005s
I20260810 11:30:40.073596 26574 catalog_manager.cc:5495] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:40.092511 27228 raft_consensus.cc:348] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.092733 27228 raft_consensus.cc:374] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.092797 27228 raft_consensus.cc:729] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.093010 27228 consensus_queue.cc:260] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.093052 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:40.093734 27228 ts_tablet_manager.cc:1428] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:40.093626 27222 consensus_queue.cc:260] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.094054 27228 tablet_bootstrap.cc:492] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:40.094465 27999 ts_tablet_manager.cc:1918] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:40.094606 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:40.094861 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:40.095041 27999 log.cc:1196] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/2634beb347714fc7a2e05865adb34a22
I20260810 11:30:40.095505 27999 ts_tablet_manager.cc:1939] T 2634beb347714fc7a2e05865adb34a22 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:40.096046 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:40.096664 28846 raft_consensus.cc:482] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.096809 28846 raft_consensus.cc:504] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.097479 28846 leader_election.cc:288] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:40.098073 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db59523b71224370bf5fce6b56592f71" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:40.098701 26991 leader_election.cc:341] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.099061 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 129) took 13342 ms. Trace:
I20260810 11:30:40.099140 27999 rpcz_store.cc:276] 0810 11:30:26.756196 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.756253 (+ 57us) service_pool.cc:227] Handling call
0810 11:30:40.031806 (+13275553us) ts_tablet_manager.cc:1145] Deleting tablet 2634beb347714fc7a2e05865adb34a22
0810 11:30:40.031818 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.065554 (+ 33736us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.094048 (+ 28494us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.099043 (+ 4995us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13249818}
I20260810 11:30:40.099444 27999 tablet_replica.cc:330] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:40.099627 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 2634beb347714fc7a2e05865adb34a22 (table default.Table_538c35ba9808453e870597b4257cefaa [id=e74be4ed04f542bda950d5f318b74c65]) successfully deleted
I20260810 11:30:40.099663 27999 raft_consensus.cc:2229] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:40.099829 27999 raft_consensus.cc:2258] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:40.100322 27222 ts_tablet_manager.cc:1428] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260810 11:30:40.101668 28345 raft_consensus.cc:482] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.101819 28345 raft_consensus.cc:504] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.102202 27222 tablet_bootstrap.cc:492] T 9e329b95fc8e41c3967079896294942a P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:40.102468 28345 leader_election.cc:288] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.102653 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db59523b71224370bf5fce6b56592f71" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:40.103595 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88268e3571884ac88c1a617ce74499f3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:40.103786 26771 raft_consensus.cc:2454] T 88268e3571884ac88c1a617ce74499f3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:40.104616 26849 leader_election.cc:302] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:40.104811 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:40.105044 28345 raft_consensus.cc:2781] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:40.105098 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:40.105152 28345 raft_consensus.cc:482] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:40.105224 28345 raft_consensus.cc:3037] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.105319 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:40.105674 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:40.105846 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:40.096009 27228 tablet_bootstrap.cc:654] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.107300 27999 ts_tablet_manager.cc:1905] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:40.107972 28345 raft_consensus.cc:504] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.109088 27222 tablet_bootstrap.cc:654] T 9e329b95fc8e41c3967079896294942a P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.109440 28345 leader_election.cc:288] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.110165 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88268e3571884ac88c1a617ce74499f3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:40.110390 26771 raft_consensus.cc:3037] T 88268e3571884ac88c1a617ce74499f3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.110904 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:40.111407 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:40.111600 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:40.111872 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:40.112195 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:40.112748 26574 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
I20260810 11:30:40.113586 27231 tablet_bootstrap.cc:492] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:40.113765 27231 ts_tablet_manager.cc:1397] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.085s user 0.001s sys 0.015s
I20260810 11:30:40.114625 27231 raft_consensus.cc:348] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.114840 27231 raft_consensus.cc:374] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.114900 27231 raft_consensus.cc:729] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.115221 27231 consensus_queue.cc:260] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.115911 27231 ts_tablet_manager.cc:1428] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:40.116210 27231 tablet_bootstrap.cc:492] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:40.116297 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88268e3571884ac88c1a617ce74499f3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:40.117998 27058 raft_consensus.cc:2454] T 88268e3571884ac88c1a617ce74499f3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:40.126518 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88268e3571884ac88c1a617ce74499f3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:40.127266 27059 raft_consensus.cc:3037] T 88268e3571884ac88c1a617ce74499f3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.122872 27231 tablet_bootstrap.cc:654] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:40.123217 26993 leader_election.cc:341] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.128296 26993 leader_election.cc:302] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.128619 28846 raft_consensus.cc:2726] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:40.128780 27999 ts_tablet_manager.cc:1918] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:40.128969 27999 log.cc:1196] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/7ff5b980ce4e41d7a6e1ca0e740b739c
I20260810 11:30:40.129108 28846 consensus_queue.cc:1035] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:40.129415 27999 ts_tablet_manager.cc:1939] T 7ff5b980ce4e41d7a6e1ca0e740b739c P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:40.130707 26771 raft_consensus.cc:2454] T 88268e3571884ac88c1a617ce74499f3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:40.132753 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 130) took 13373 ms. Trace:
I20260810 11:30:40.132867 27999 rpcz_store.cc:276] 0810 11:30:26.766967 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.767064 (+ 97us) service_pool.cc:227] Handling call
0810 11:30:40.099399 (+13332335us) ts_tablet_manager.cc:1145] Deleting tablet 7ff5b980ce4e41d7a6e1ca0e740b739c
0810 11:30:40.099411 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.114712 (+ 15301us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.118464 (+ 3752us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.132726 (+ 14262us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13305680}
I20260810 11:30:40.133215 27999 tablet_replica.cc:330] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:40.133486 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 7ff5b980ce4e41d7a6e1ca0e740b739c (table default.Table_2d72673d9e86472ca07d3c7d36f51108 [id=7f2c916845a443209bff1b685821499f]) successfully deleted
I20260810 11:30:40.140700 26849 leader_election.cc:302] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:40.141546 28345 raft_consensus.cc:2781] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:40.142311 28345 raft_consensus.cc:686] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:40.142609 28345 consensus_queue.cc:237] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.153548 27999 raft_consensus.cc:2229] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:40.153913 27999 raft_consensus.cc:2258] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:40.158879 27999 ts_tablet_manager.cc:1905] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:40.159426 27059 raft_consensus.cc:2454] T 88268e3571884ac88c1a617ce74499f3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:40.161726 26963 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:40.172240 27231 tablet_bootstrap.cc:492] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:40.172422 27231 ts_tablet_manager.cc:1397] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.003s
I20260810 11:30:40.173527 27231 raft_consensus.cc:348] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.173815 27231 raft_consensus.cc:374] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.173873 27231 raft_consensus.cc:729] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.174136 27231 consensus_queue.cc:260] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.175108 27231 ts_tablet_manager.cc:1428] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 11:30:40.175377 27231 tablet_bootstrap.cc:492] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:40.179342 27231 tablet_bootstrap.cc:654] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.185765 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
W20260810 11:30:40.189978 26849 consensus_peers.cc:487] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:40.191213 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:40.194197 27999 ts_tablet_manager.cc:1918] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:40.194362 27999 log.cc:1196] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/44d5e146eeec4fe0be33c1c169d32e68
I20260810 11:30:40.194787 27999 ts_tablet_manager.cc:1939] T 44d5e146eeec4fe0be33c1c169d32e68 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:40.195185 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 131) took 13398 ms. Trace:
I20260810 11:30:40.195282 27999 rpcz_store.cc:276] 0810 11:30:26.809912 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.810219 (+ 307us) service_pool.cc:227] Handling call
0810 11:30:40.133163 (+13322944us) ts_tablet_manager.cc:1145] Deleting tablet 44d5e146eeec4fe0be33c1c169d32e68
0810 11:30:40.133173 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.177340 (+ 44167us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.194071 (+ 16731us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.195165 (+ 1094us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13265244}
I20260810 11:30:40.195801 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 44d5e146eeec4fe0be33c1c169d32e68 (table default.Table_733cd3d375dd4cf9b1297c9395073c3c [id=9b6492211433453495bdb14155a56a85]) successfully deleted
I20260810 11:30:40.197016 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:40.197371 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:40.197901 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:40.198181 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]). Expected version 1 got 0
I20260810 11:30:40.198866 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:40.205749 27228 tablet_bootstrap.cc:492] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:40.205922 27228 ts_tablet_manager.cc:1397] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.112s user 0.007s sys 0.013s
I20260810 11:30:40.208302 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:40.209311 28640 raft_consensus.cc:482] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.209455 28640 raft_consensus.cc:504] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.210023 28640 leader_election.cc:288] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:40.211582 26702 leader_election.cc:341] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: cb6805a5dd264939850ea2cd9a850a1f
I20260810 11:30:40.211941 27228 raft_consensus.cc:348] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.212203 27228 raft_consensus.cc:374] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.212283 27228 raft_consensus.cc:729] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.212551 27228 consensus_queue.cc:260] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.213269 27228 ts_tablet_manager.cc:1428] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.007s user 0.000s sys 0.003s
W20260810 11:30:40.214184 26700 leader_election.cc:341] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: cb6805a5dd264939850ea2cd9a850a1f
I20260810 11:30:40.214303 26700 leader_election.cc:302] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.214790 28640 raft_consensus.cc:2726] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:40.216575 27222 tablet_bootstrap.cc:492] T 9e329b95fc8e41c3967079896294942a P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:40.217092 27228 tablet_bootstrap.cc:492] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:40.217901 27231 tablet_bootstrap.cc:492] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:40.218146 27231 ts_tablet_manager.cc:1397] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.043s user 0.008s sys 0.004s
I20260810 11:30:40.219111 27222 ts_tablet_manager.cc:1397] T 9e329b95fc8e41c3967079896294942a P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.119s user 0.004s sys 0.012s
I20260810 11:30:40.219473 27228 tablet_bootstrap.cc:654] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.219566 28846 consensus_queue.cc:1035] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:40.209020 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:40.220884 27231 raft_consensus.cc:348] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.213562 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 137) took 13253 ms. Trace:
I20260810 11:30:40.221099 27231 raft_consensus.cc:374] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.221131 27999 rpcz_store.cc:276] 0810 11:30:26.960050 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.960853 (+ 803us) service_pool.cc:227] Handling call
0810 11:30:40.201188 (+13240335us) ts_tablet_manager.cc:1145] Deleting tablet 2da86554bc51486e91f1ea5995a245b5
0810 11:30:40.213379 (+ 12191us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.213540 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13239372}
I20260810 11:30:40.221526 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:40.221746 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 136) took 13282 ms. Trace:
I20260810 11:30:40.221834 27999 rpcz_store.cc:276] 0810 11:30:26.938917 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:26.982895 (+ 43978us) service_pool.cc:227] Handling call
0810 11:30:40.221586 (+13238691us) ts_tablet_manager.cc:1145] Deleting tablet 7e78fb1bf0534deca5cc5a603fd77592
0810 11:30:40.221598 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.221721 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13157938}
W20260810 11:30:40.222016 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 2da86554bc51486e91f1ea5995a245b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2da86554bc51486e91f1ea5995a245b5 already in progress: creating tablet
I20260810 11:30:40.221912 27222 raft_consensus.cc:348] T 9e329b95fc8e41c3967079896294942a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.222187 27222 raft_consensus.cc:374] T 9e329b95fc8e41c3967079896294942a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.222254 27222 raft_consensus.cc:729] T 9e329b95fc8e41c3967079896294942a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.222270 27999 tablet_replica.cc:330] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700: stopping tablet replica
W20260810 11:30:40.222420 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7e78fb1bf0534deca5cc5a603fd77592 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e78fb1bf0534deca5cc5a603fd77592 already in progress: creating tablet
I20260810 11:30:40.222550 27999 raft_consensus.cc:2229] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:40.222502 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:40.222522 27222 consensus_queue.cc:260] T 9e329b95fc8e41c3967079896294942a P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.222738 27999 raft_consensus.cc:2258] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:40.222821 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:40.221172 27231 raft_consensus.cc:729] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.223176 27231 consensus_queue.cc:260] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.223403 27999 ts_tablet_manager.cc:1905] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:40.224541 27231 ts_tablet_manager.cc:1428] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 11:30:40.225154 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:40.230317 27222 ts_tablet_manager.cc:1428] T 9e329b95fc8e41c3967079896294942a P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260810 11:30:40.231088 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:40.231323 27222 tablet_bootstrap.cc:492] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:40.226181 28846 raft_consensus.cc:482] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6079090b1124d84aa4477974bb53700)
I20260810 11:30:40.231791 28846 raft_consensus.cc:504] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.232443 28846 leader_election.cc:288] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:40.225001 27231 tablet_bootstrap.cc:492] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:40.232993 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
W20260810 11:30:40.234169 26991 leader_election.cc:341] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 603fe104b7ab485eab6b225a58bddc1c
W20260810 11:30:40.235137 26993 leader_election.cc:341] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 603fe104b7ab485eab6b225a58bddc1c
I20260810 11:30:40.235255 26993 leader_election.cc:302] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.235334 27231 tablet_bootstrap.cc:654] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.235687 28846 raft_consensus.cc:2726] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:40.238204 27222 tablet_bootstrap.cc:654] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.238593 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:40.239102 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:40.239193 28846 raft_consensus.cc:482] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.239390 28846 raft_consensus.cc:504] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.239900 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 2 got 0
I20260810 11:30:40.240206 28846 leader_election.cc:288] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:40.240511 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:40.240852 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:40.241326 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b200bdb394d3439b86fff48494be8e3d" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:40.241609 26911 raft_consensus.cc:2454] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:40.242054 26991 leader_election.cc:302] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:40.242349 28846 raft_consensus.cc:2781] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:40.242447 28846 raft_consensus.cc:482] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:40.242538 28846 raft_consensus.cc:3037] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.242831 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:40.244766 27228 tablet_bootstrap.cc:492] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:40.244920 27228 ts_tablet_manager.cc:1397] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.004s
I20260810 11:30:40.245725 28846 raft_consensus.cc:504] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.245882 27228 raft_consensus.cc:348] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.246088 27228 raft_consensus.cc:374] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.246152 27228 raft_consensus.cc:729] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.246348 27228 consensus_queue.cc:260] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.246546 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b200bdb394d3439b86fff48494be8e3d" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:40.247031 27228 ts_tablet_manager.cc:1428] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 11:30:40.247324 27228 tablet_bootstrap.cc:492] T d24726d0214947beab0bb31b1597c1c3 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:40.247361 26580 catalog_manager.cc:5495] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
W20260810 11:30:40.248673 26993 leader_election.cc:341] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.249925 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:40.253690 27228 tablet_bootstrap.cc:654] T d24726d0214947beab0bb31b1597c1c3 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.256938 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b200bdb394d3439b86fff48494be8e3d" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:40.257159 26911 raft_consensus.cc:3037] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.259816 26911 raft_consensus.cc:2454] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:40.260007 27999 ts_tablet_manager.cc:1918] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:40.260116 27999 log.cc:1196] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/a87f6835f0dc4ad4b3a23b297726100d
I20260810 11:30:40.260520 26991 leader_election.cc:302] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:40.260931 28651 raft_consensus.cc:2781] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:40.261039 28651 raft_consensus.cc:686] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:40.261276 28651 consensus_queue.cc:237] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.261492 27999 ts_tablet_manager.cc:1939] T a87f6835f0dc4ad4b3a23b297726100d P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:40.263003 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:40.264156 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:40.269104 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:40.269750 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:40.271201 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:40.262306 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 139) took 13150 ms. Trace:
I20260810 11:30:40.271529 27231 tablet_bootstrap.cc:492] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:40.271351 27999 rpcz_store.cc:276] 0810 11:30:27.112117 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.112177 (+ 60us) service_pool.cc:227] Handling call
0810 11:30:40.222221 (+13110044us) ts_tablet_manager.cc:1145] Deleting tablet a87f6835f0dc4ad4b3a23b297726100d
0810 11:30:40.222231 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.234954 (+ 12723us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.259898 (+ 24944us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.262284 (+ 2386us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13109703}
I20260810 11:30:40.271694 27231 ts_tablet_manager.cc:1397] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.047s user 0.012s sys 0.006s
I20260810 11:30:40.271971 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet a87f6835f0dc4ad4b3a23b297726100d (table default.Table_cbf7fb0f0585465a9be24fa7e70d68d2 [id=82041e96f8de4fae85baf690bbbfc7a3]) successfully deleted
I20260810 11:30:40.272513 27999 tablet_replica.cc:330] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:40.272800 27999 raft_consensus.cc:2229] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:40.273074 27999 raft_consensus.cc:2258] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:40.272855 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:40.272836 27231 raft_consensus.cc:348] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.273341 27231 raft_consensus.cc:374] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.273433 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:40.273505 27231 raft_consensus.cc:729] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.273756 27999 ts_tablet_manager.cc:1905] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:40.274075 27231 consensus_queue.cc:260] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.275436 27222 tablet_bootstrap.cc:492] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:40.275588 27222 ts_tablet_manager.cc:1397] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.015s
I20260810 11:30:40.276373 26580 catalog_manager.cc:5495] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:40.277014 27222 raft_consensus.cc:348] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.277242 27222 raft_consensus.cc:374] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.277302 27222 raft_consensus.cc:729] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.277454 27228 tablet_bootstrap.cc:492] T d24726d0214947beab0bb31b1597c1c3 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:40.277601 27228 ts_tablet_manager.cc:1397] T d24726d0214947beab0bb31b1597c1c3 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.004s
I20260810 11:30:40.277488 27222 consensus_queue.cc:260] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.277629 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b200bdb394d3439b86fff48494be8e3d" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
W20260810 11:30:40.278399 26993 leader_election.cc:341] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.278801 27222 ts_tablet_manager.cc:1428] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 11:30:40.278680 27228 raft_consensus.cc:348] T d24726d0214947beab0bb31b1597c1c3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.278888 27228 raft_consensus.cc:374] T d24726d0214947beab0bb31b1597c1c3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.278947 27228 raft_consensus.cc:729] T d24726d0214947beab0bb31b1597c1c3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.279174 27228 consensus_queue.cc:260] T d24726d0214947beab0bb31b1597c1c3 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.279738 27222 tablet_bootstrap.cc:492] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:40.279891 27228 ts_tablet_manager.cc:1428] T d24726d0214947beab0bb31b1597c1c3 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 11:30:40.280139 27228 tablet_bootstrap.cc:492] T d1d0d55b526749059470504a27887b22 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:40.282368 27231 ts_tablet_manager.cc:1428] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
I20260810 11:30:40.282598 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_5ba00bd0ab7d4cdcb1494f9491c64291 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 2 got 0
I20260810 11:30:40.283286 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:40.283776 27222 tablet_bootstrap.cc:654] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.283983 27228 tablet_bootstrap.cc:654] T d1d0d55b526749059470504a27887b22 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.284206 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:40.285092 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:40.288515 28846 leader_election.cc:288] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:40.289168 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:40.289940 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:40.290352 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:40.290886 26580 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
I20260810 11:30:40.291342 26580 catalog_manager.cc:5495] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:40.292104 27231 tablet_bootstrap.cc:492] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
W20260810 11:30:40.292937 26575 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d4873fe8318040a2b7e021708a875f43 consensus state has no leader
I20260810 11:30:40.293227 26575 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 125) took 1371 ms. Trace:
I20260810 11:30:40.293473 26575 rpcz_store.cc:276] 0810 11:30:38.921669 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:39.812034 (+890365us) service_pool.cc:227] Handling call
0810 11:30:39.812504 (+ 470us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:39.812836 (+ 332us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:39.815565 (+ 2729us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:39.815675 (+ 110us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:39.832432 (+ 16757us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:40.293119 (+460687us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:39.821782 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:39.821902 (+ 120us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:39.821909 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:39.821912 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:39.822029 (+ 117us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:39.822042 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:39.822048 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:39.822112 (+ 64us) tablet.cc:699] Row locks acquired
0810 11:30:39.822114 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:39.822148 (+ 34us) write_op.cc:270] Start()
0810 11:30:39.822180 (+ 32us) write_op.cc:276] Timestamp: P: 1786361439822090 usec, L: 0
0810 11:30:39.822186 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:39.822361 (+ 175us) log.cc:842] Serialized 405 byte log entry
0810 11:30:39.830991 (+ 8630us) op_driver.cc:444] REPLICATION: finished
0810 11:30:39.832065 (+ 1074us) write_op.cc:301] APPLY: starting
0810 11:30:39.832077 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:39.832108 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:39.832157 (+ 49us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:39.832196 (+ 39us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:39.832222 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:39.832228 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:39.832283 (+ 55us) log.cc:842] Serialized 23 byte log entry
0810 11:30:39.832329 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.832343 (+ 14us) write_op.cc:454] Released schema lock
0810 11:30:39.832348 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:39.832405 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.832408 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1040,"apply.run_cpu_time_us":381,"apply.run_wall_time_us":381,"num_ops":1,"prepare.queue_time_us":5660,"prepare.run_cpu_time_us":9283,"prepare.run_wall_time_us":70391,"raft.queue_time_us":1983,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":8787,"thread_start_us":134469,"threads_started":2}]]}
I20260810 11:30:40.294984 27231 tablet_bootstrap.cc:654] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.295154 28846 raft_consensus.cc:482] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.295305 28846 raft_consensus.cc:504] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.296550 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "760aeada57464892ae3b9013a761c509" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:40.297119 26993 leader_election.cc:341] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.297403 28845 raft_consensus.cc:482] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.297513 28845 raft_consensus.cc:504] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.298079 28845 leader_election.cc:288] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:40.299134 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8749861874eca9b63d3db97afa2b1" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:40.299365 26911 raft_consensus.cc:2454] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:40.299854 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8749861874eca9b63d3db97afa2b1" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:40.300369 26993 leader_election.cc:341] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.300623 26991 leader_election.cc:302] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:40.300853 28845 raft_consensus.cc:2781] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:40.300910 28845 raft_consensus.cc:482] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:40.300969 28845 raft_consensus.cc:3037] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.305122 27999 ts_tablet_manager.cc:1918] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:40.305315 27999 log.cc:1196] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/fbe0a0ab82a147a3b6164904b135d1ab
I20260810 11:30:40.305754 27999 ts_tablet_manager.cc:1939] T fbe0a0ab82a147a3b6164904b135d1ab P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:40.306687 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 140) took 13193 ms. Trace:
I20260810 11:30:40.306540 28845 raft_consensus.cc:504] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.306783 27999 rpcz_store.cc:276] 0810 11:30:27.113344 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.113395 (+ 51us) service_pool.cc:227] Handling call
0810 11:30:40.272459 (+13159064us) ts_tablet_manager.cc:1145] Deleting tablet fbe0a0ab82a147a3b6164904b135d1ab
0810 11:30:40.272471 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.281940 (+ 9469us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.293386 (+ 11446us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.306664 (+ 13278us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13158837}
I20260810 11:30:40.307375 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet fbe0a0ab82a147a3b6164904b135d1ab (table default.Table_61d778388656489cb2e7fe8312b8ac6e [id=b52c11bd73cd4d1f8f9dfc32562718a2]) successfully deleted
I20260810 11:30:40.308017 26581 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 78633fbe048b4534ae3277ce6b7c4313
I20260810 11:30:40.308027 26578 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet ea66da5bc20e4718901ffc473677421c
I20260810 11:30:40.308215 28845 leader_election.cc:288] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:40.308929 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet ea66da5bc20e4718901ffc473677421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:40.309033 26572 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 23637a02b6464e17aa2a69ea5cc4ddfe
I20260810 11:30:40.309077 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 78633fbe048b4534ae3277ce6b7c4313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:39 UTC) from {username='slave'} at 127.0.0.1:58800
W20260810 11:30:40.309305 26576 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9bfed03f765f4c5aa77604ebf2e211b0 consensus state has no leader
I20260810 11:30:40.309338 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8749861874eca9b63d3db97afa2b1" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:40.309588 26576 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 97) took 1885 ms. Trace:
I20260810 11:30:40.309721 26573 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_486a807b011648dc85baba92958a368a [id=bcc0a50559544dee84b5730a48b40156] alter complete (version 1)
W20260810 11:30:40.310180 26993 leader_election.cc:341] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.309803 26576 rpcz_store.cc:276] 0810 11:30:38.424492 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:38.433211 (+ 8719us) service_pool.cc:227] Handling call
0810 11:30:38.451335 (+ 18124us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:38.454153 (+ 2818us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:38.454313 (+ 160us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:38.454411 (+ 98us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:38.820962 (+366551us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:40.309454 (+1488492us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:38.710594 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:38.710750 (+ 156us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:38.710757 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:38.710760 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:38.712052 (+ 1292us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:38.712065 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:38.712073 (+ 8us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:38.726422 (+ 14349us) tablet.cc:699] Row locks acquired
0810 11:30:38.726427 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:38.726487 (+ 60us) write_op.cc:270] Start()
0810 11:30:38.726594 (+ 107us) write_op.cc:276] Timestamp: P: 1786361438726428 usec, L: 0
0810 11:30:38.726600 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:38.768008 (+ 41408us) log.cc:842] Serialized 405 byte log entry
0810 11:30:38.768723 (+ 715us) spinlock_profiling.cc:243] Waited 41.1 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f9c62f1dd02 00007f9c642507f1 00007f9c6424f359 00007f9c642571bb 00007f9c64257038 00000000009edb7c 00007f9c57a55344 00007f9c57a5891b 00007f9c57a58798 00000000009edb7c
0810 11:30:38.816737 (+ 48014us) op_driver.cc:444] REPLICATION: finished
0810 11:30:38.818824 (+ 2087us) write_op.cc:301] APPLY: starting
0810 11:30:38.818883 (+ 59us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:38.819095 (+ 212us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:38.819098 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:38.819356 (+ 258us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:38.819429 (+ 73us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:38.819476 (+ 47us) write_op.cc:312] APPLY: finished
0810 11:30:38.820106 (+ 630us) log.cc:842] Serialized 23 byte log entry
0810 11:30:38.820774 (+ 668us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:38.820797 (+ 23us) write_op.cc:454] Released schema lock
0810 11:30:38.820830 (+ 33us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:38.821683 (+ 853us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:38.821688 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1967,"apply.run_cpu_time_us":1280,"apply.run_wall_time_us":3042,"num_ops":1,"prepare.queue_time_us":246114,"prepare.run_cpu_time_us":4162,"prepare.run_wall_time_us":78169,"raft.queue_time_us":3349,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":251,"replication_time_us":90099,"spinlock_wait_cycles":94624128,"thread_start_us":19844,"threads_started":1}]]}
W20260810 11:30:40.311260 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet ea66da5bc20e4718901ffc473677421c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea66da5bc20e4718901ffc473677421c already in progress: creating tablet
I20260810 11:30:40.311605 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8749861874eca9b63d3db97afa2b1" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:40.311620 26576 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_376e60b3deca4fd2a33be856f0457166" } modify_external_catalogs: true
W20260810 11:30:40.311749 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 78633fbe048b4534ae3277ce6b7c4313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78633fbe048b4534ae3277ce6b7c4313 already in progress: creating tablet
I20260810 11:30:40.311888 26911 raft_consensus.cc:3037] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.311955 26576 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_376e60b3deca4fd2a33be856f0457166" } modify_external_catalogs: true
I20260810 11:30:40.312590 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet ea66da5bc20e4718901ffc473677421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:40.312943 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet 78633fbe048b4534ae3277ce6b7c4313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:39 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:40.313879 27228 tablet_bootstrap.cc:492] T d1d0d55b526749059470504a27887b22 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:40.314004 27228 ts_tablet_manager.cc:1397] T d1d0d55b526749059470504a27887b22 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.003s
I20260810 11:30:40.315482 26911 raft_consensus.cc:2454] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:40.315937 26991 leader_election.cc:302] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
W20260810 11:30:40.316169 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ea66da5bc20e4718901ffc473677421c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea66da5bc20e4718901ffc473677421c already in progress: creating tablet
I20260810 11:30:40.316390 28845 raft_consensus.cc:2781] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 11:30:40.316504 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 78633fbe048b4534ae3277ce6b7c4313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78633fbe048b4534ae3277ce6b7c4313 already in progress: creating tablet
I20260810 11:30:40.316637 28845 raft_consensus.cc:686] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:40.316918 28845 consensus_queue.cc:237] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.317243 27222 tablet_bootstrap.cc:492] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:40.317391 27228 raft_consensus.cc:348] T d1d0d55b526749059470504a27887b22 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.317528 27222 ts_tablet_manager.cc:1397] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.008s
I20260810 11:30:40.317642 27228 raft_consensus.cc:374] T d1d0d55b526749059470504a27887b22 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.317718 27228 raft_consensus.cc:729] T d1d0d55b526749059470504a27887b22 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.317963 27228 consensus_queue.cc:260] T d1d0d55b526749059470504a27887b22 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.318653 27228 ts_tablet_manager.cc:1428] T d1d0d55b526749059470504a27887b22 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 11:30:40.318961 27228 tablet_bootstrap.cc:492] T 271a0607ec28441c91bac32c2f2bf44b P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:40.319370 27222 raft_consensus.cc:348] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.320184 27222 raft_consensus.cc:374] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.320693 27222 raft_consensus.cc:729] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.323499 28846 leader_election.cc:288] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:40.322173 27222 consensus_queue.cc:260] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.324221 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "760aeada57464892ae3b9013a761c509" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:40.324939 26991 leader_election.cc:341] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.325120 26991 leader_election.cc:302] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.325423 27999 tablet_replica.cc:330] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:40.326985 27222 ts_tablet_manager.cc:1428] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.009s user 0.002s sys 0.001s
I20260810 11:30:40.328809 27999 raft_consensus.cc:2229] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:40.329061 27999 raft_consensus.cc:2258] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:40.329043 27222 tablet_bootstrap.cc:492] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:40.329394 28845 raft_consensus.cc:2726] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:40.329859 27999 ts_tablet_manager.cc:1905] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:40.330652 28726 raft_consensus.cc:482] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.330786 28726 raft_consensus.cc:504] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.331449 28726 leader_election.cc:288] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.333029 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d7a07e844984b88ab81610cb95bf21e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:40.335249 28726 consensus_queue.cc:1035] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:40.336417 26700 leader_election.cc:341] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.329632 28753 raft_consensus.cc:482] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.336865 28753 raft_consensus.cc:504] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.337352 27228 tablet_bootstrap.cc:654] T 271a0607ec28441c91bac32c2f2bf44b P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.339680 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dc4fd6ca8a541f99eed57a6f51c1f0a" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:40.340314 26991 leader_election.cc:341] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.342968 28591 raft_consensus.cc:482] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.343310 28591 raft_consensus.cc:504] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.344604 27999 ts_tablet_manager.cc:1918] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:40.344740 27999 log.cc:1196] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/587c6ce242c0411b886404a0df03b1bb
I20260810 11:30:40.345182 27999 ts_tablet_manager.cc:1939] T 587c6ce242c0411b886404a0df03b1bb P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:40.346189 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 138) took 13234 ms. Trace:
I20260810 11:30:40.346307 27999 rpcz_store.cc:276] 0810 11:30:27.111977 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.113915 (+ 1938us) service_pool.cc:227] Handling call
0810 11:30:40.325340 (+13211425us) ts_tablet_manager.cc:1145] Deleting tablet 587c6ce242c0411b886404a0df03b1bb
0810 11:30:40.325369 (+ 29us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.336541 (+ 11172us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.344455 (+ 7914us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.346167 (+ 1712us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2806,"tablet-delete.queue_time_us":13205691}
I20260810 11:30:40.346766 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 141) took 13232 ms. Trace:
I20260810 11:30:40.346866 27999 rpcz_store.cc:276] 0810 11:30:27.113845 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.168723 (+ 54878us) service_pool.cc:227] Handling call
0810 11:30:40.346659 (+13177936us) ts_tablet_manager.cc:1145] Deleting tablet 6e829d4bffeb4289a54b4d3d7a53c44e
0810 11:30:40.346671 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.346749 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13177481}
I20260810 11:30:40.347295 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 146) took 12664 ms. Trace:
I20260810 11:30:40.347404 27999 rpcz_store.cc:276] 0810 11:30:27.682620 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:27.682675 (+ 55us) service_pool.cc:227] Handling call
0810 11:30:40.347181 (+12664506us) ts_tablet_manager.cc:1145] Deleting tablet 1860e56467624dcdb288e13b004f78cc
0810 11:30:40.347191 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.347278 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12575529}
I20260810 11:30:40.347703 27999 tablet_replica.cc:330] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:40.347868 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 587c6ce242c0411b886404a0df03b1bb (table default.Table_8326a5b5a7544e828699f8b41fdee4d1 [id=1ae6d36bfe0e427a9a996dff3cdccc91]) successfully deleted
I20260810 11:30:40.347975 27999 raft_consensus.cc:2229] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:40.348295 27286 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 6e829d4bffeb4289a54b4d3d7a53c44e because the tablet was not found. No further retry: Not found: Tablet not found: 6e829d4bffeb4289a54b4d3d7a53c44e
I20260810 11:30:40.348400 27999 raft_consensus.cc:2258] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:40.348915 26571 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_db0667edf5704901a7d33dad61b48608 [id=63a4145d875d40dc95b606df4380204e] alter complete (version 2)
W20260810 11:30:40.348925 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 1860e56467624dcdb288e13b004f78cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1860e56467624dcdb288e13b004f78cc already in progress: creating tablet
I20260810 11:30:40.349505 27999 ts_tablet_manager.cc:1905] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:40.351894 28591 leader_election.cc:288] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.357368 27999 ts_tablet_manager.cc:1918] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:40.357528 27999 log.cc:1196] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/55c8749861874eca9b63d3db97afa2b1
I20260810 11:30:40.357939 27999 ts_tablet_manager.cc:1939] T 55c8749861874eca9b63d3db97afa2b1 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:40.358381 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 153) took 10957 ms. Trace:
I20260810 11:30:40.358507 27999 rpcz_store.cc:276] 0810 11:30:29.400965 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.404661 (+ 3696us) service_pool.cc:227] Handling call
0810 11:30:40.347658 (+10942997us) ts_tablet_manager.cc:1145] Deleting tablet 55c8749861874eca9b63d3db97afa2b1
0810 11:30:40.347670 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.353370 (+ 5700us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.357258 (+ 3888us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.358361 (+ 1103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10786636}
I20260810 11:30:40.359105 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 154) took 10813 ms. Trace:
I20260810 11:30:40.359189 27999 rpcz_store.cc:276] 0810 11:30:29.545382 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.545872 (+ 490us) service_pool.cc:227] Handling call
0810 11:30:40.358971 (+10813099us) ts_tablet_manager.cc:1145] Deleting tablet 7c203cd90d2f472fa27cfabed5b87119
0810 11:30:40.358982 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.359087 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10796794}
I20260810 11:30:40.359742 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 155) took 10760 ms. Trace:
I20260810 11:30:40.359856 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 55c8749861874eca9b63d3db97afa2b1 (table default.Table_1c6221759f954488a1e7df4252c2a6ae [id=996f45529be941409f77e6682591b900]) successfully deleted
I20260810 11:30:40.359882 27999 rpcz_store.cc:276] 0810 11:30:29.599361 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:29.599477 (+ 116us) service_pool.cc:227] Handling call
0810 11:30:40.359583 (+10760106us) ts_tablet_manager.cc:1145] Deleting tablet 518c777e40ec40dcb3484c0374384959
0810 11:30:40.359622 (+ 39us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.359723 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10754538}
I20260810 11:30:40.360304 27999 tablet_replica.cc:330] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700: stopping tablet replica
W20260810 11:30:40.360319 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7c203cd90d2f472fa27cfabed5b87119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c203cd90d2f472fa27cfabed5b87119 already in progress: creating tablet
I20260810 11:30:40.360577 27999 raft_consensus.cc:2229] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
W20260810 11:30:40.360616 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 518c777e40ec40dcb3484c0374384959 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 518c777e40ec40dcb3484c0374384959 already in progress: creating tablet
I20260810 11:30:40.360965 27999 raft_consensus.cc:2258] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:40.361797 27999 ts_tablet_manager.cc:1905] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:40.365734 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f24c84cdd945b78f39f24015eb1e43" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:40.366668 26763 raft_consensus.cc:2454] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:40.367842 26849 leader_election.cc:302] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:40.368176 28345 raft_consensus.cc:2781] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:40.368268 28345 raft_consensus.cc:482] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:40.368340 28345 raft_consensus.cc:3037] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.332082 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d7a07e844984b88ab81610cb95bf21e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:40.369984 27059 raft_consensus.cc:2454] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:40.373917 28753 leader_election.cc:288] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:40.373657 27222 tablet_bootstrap.cc:654] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.375728 26702 leader_election.cc:302] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.344650 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f24c84cdd945b78f39f24015eb1e43" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:40.376305 27058 raft_consensus.cc:2454] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:40.377766 28727 raft_consensus.cc:2781] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:40.377856 28727 raft_consensus.cc:482] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:40.377916 28727 raft_consensus.cc:3037] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.378093 26578 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 123) took 1509 ms. Trace:
I20260810 11:30:40.378822 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 78633fbe048b4534ae3277ce6b7c4313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:39 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:40.378300 26578 rpcz_store.cc:276] 0810 11:30:38.868125 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:39.001446 (+133321us) service_pool.cc:227] Handling call
0810 11:30:39.002281 (+ 835us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:39.002455 (+ 174us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:39.002529 (+ 74us) catalog_manager.cc:2761] Locking tablets
0810 11:30:39.002684 (+ 155us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:39.081865 (+ 79181us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:39.081986 (+ 121us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:40.307898 (+1225912us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:40.377930 (+ 70032us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:39.060119 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:39.060318 (+ 199us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:39.060326 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:39.060328 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:39.060474 (+ 146us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:39.060488 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:39.060493 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:39.075624 (+ 15131us) tablet.cc:699] Row locks acquired
0810 11:30:39.075629 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:39.075691 (+ 62us) write_op.cc:270] Start()
0810 11:30:39.075742 (+ 51us) write_op.cc:276] Timestamp: P: 1786361439075644 usec, L: 0
0810 11:30:39.075749 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:39.076322 (+ 573us) log.cc:842] Serialized 734 byte log entry
0810 11:30:39.080864 (+ 4542us) op_driver.cc:444] REPLICATION: finished
0810 11:30:39.081091 (+ 227us) write_op.cc:301] APPLY: starting
0810 11:30:39.081117 (+ 26us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:39.081178 (+ 61us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:39.081239 (+ 61us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:39.081336 (+ 97us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:39.081388 (+ 52us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:39.081399 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:39.081506 (+ 107us) log.cc:842] Serialized 29 byte log entry
0810 11:30:39.081600 (+ 94us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.081630 (+ 30us) write_op.cc:454] Released schema lock
0810 11:30:39.081641 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:39.081714 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.081720 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":1408,"child_traces":[["op",{"apply.queue_time_us":154,"apply.run_cpu_time_us":697,"apply.run_wall_time_us":697,"num_ops":2,"prepare.queue_time_us":56343,"prepare.run_cpu_time_us":1328,"prepare.run_wall_time_us":38523,"raft.queue_time_us":80,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":362,"replication_time_us":5048}]]}
I20260810 11:30:40.379055 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet ea66da5bc20e4718901ffc473677421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:40.379518 26578 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_a13a99674b70411d87a2aaef8b003753"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:40.379984 26581 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 124) took 1459 ms. Trace:
W20260810 11:30:40.380612 26578 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a13a99674b70411d87a2aaef8b003753 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:40.381021 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 23637a02b6464e17aa2a69ea5cc4ddfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:40.382205 28727 raft_consensus.cc:504] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.382383 26572 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 119) took 1918 ms. Trace:
I20260810 11:30:40.382411 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet 23637a02b6464e17aa2a69ea5cc4ddfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:40.382781 27974 tablet_replica.cc:330] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:40.382889 28727 leader_election.cc:288] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.382972 27974 raft_consensus.cc:2229] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:40.383188 27974 raft_consensus.cc:2258] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:40.383801 27974 ts_tablet_manager.cc:1905] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:40.384773 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d7a07e844984b88ab81610cb95bf21e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:40.388892 26700 leader_election.cc:341] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.384488 28345 raft_consensus.cc:504] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.390643 28345 leader_election.cc:288] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.390992 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f24c84cdd945b78f39f24015eb1e43" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:40.391315 26763 raft_consensus.cc:3037] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.383885 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d7a07e844984b88ab81610cb95bf21e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:40.382565 26572 rpcz_store.cc:276] 0810 11:30:38.463374 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:38.954340 (+490966us) service_pool.cc:227] Handling call
0810 11:30:38.955228 (+ 888us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:38.955393 (+ 165us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:38.955472 (+ 79us) catalog_manager.cc:2761] Locking tablets
0810 11:30:39.378251 (+422779us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:39.388067 (+ 9816us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:39.388187 (+ 120us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:40.308953 (+920766us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:40.381817 (+ 72864us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:39.379659 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:39.379833 (+ 174us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:39.379843 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:39.379847 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:39.380011 (+ 164us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:39.380031 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:39.380038 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:39.380203 (+ 165us) tablet.cc:699] Row locks acquired
0810 11:30:39.380208 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:39.380257 (+ 49us) write_op.cc:270] Start()
0810 11:30:39.380300 (+ 43us) write_op.cc:276] Timestamp: P: 1786361439380237 usec, L: 0
0810 11:30:39.380307 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:39.380586 (+ 279us) log.cc:842] Serialized 799 byte log entry
0810 11:30:39.387045 (+ 6459us) op_driver.cc:444] REPLICATION: finished
0810 11:30:39.387271 (+ 226us) write_op.cc:301] APPLY: starting
0810 11:30:39.387297 (+ 26us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:39.387367 (+ 70us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:39.387423 (+ 56us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:39.387547 (+ 124us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:39.387632 (+ 85us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:39.387645 (+ 13us) write_op.cc:312] APPLY: finished
0810 11:30:39.387793 (+ 148us) log.cc:842] Serialized 29 byte log entry
0810 11:30:39.387895 (+ 102us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.387925 (+ 30us) write_op.cc:454] Released schema lock
0810 11:30:39.387937 (+ 12us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:39.388051 (+ 114us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.388058 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":154,"apply.run_cpu_time_us":865,"apply.run_wall_time_us":864,"num_ops":2,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":1135,"prepare.run_wall_time_us":4653,"raft.queue_time_us":79,"raft.run_cpu_time_us":413,"raft.run_wall_time_us":413,"replication_time_us":6701}]]}
I20260810 11:30:40.401846 27058 raft_consensus.cc:3037] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.403848 26572 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_bbe7d79474674b2e9278c0c784af6b38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:40.404676 26572 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbe7d79474674b2e9278c0c784af6b38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:40.406064 26578 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 127) took 1374 ms. Trace:
I20260810 11:30:40.406669 27058 raft_consensus.cc:2454] T 0d7a07e844984b88ab81610cb95bf21e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:40.407032 26763 raft_consensus.cc:2454] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:40.406399 26578 rpcz_store.cc:276] 0810 11:30:39.029268 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.379158 (+1349890us) service_pool.cc:227] Handling call
0810 11:30:40.380744 (+ 1586us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:40.381342 (+ 598us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:40.403341 (+ 21999us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:40.403545 (+ 204us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:40.403645 (+ 100us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.382074 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.388899 (+ 6825us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.388907 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:40.388910 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:40.389016 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.389043 (+ 27us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.389050 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:40.389171 (+ 121us) tablet.cc:699] Row locks acquired
0810 11:30:40.389175 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:40.389228 (+ 53us) write_op.cc:270] Start()
0810 11:30:40.389276 (+ 48us) write_op.cc:276] Timestamp: P: 1786361440389213 usec, L: 0
0810 11:30:40.389283 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.389601 (+ 318us) log.cc:842] Serialized 433 byte log entry
0810 11:30:40.395047 (+ 5446us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.395414 (+ 367us) write_op.cc:301] APPLY: starting
0810 11:30:40.395436 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.395491 (+ 55us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.400700 (+ 5209us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.400879 (+ 179us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.400938 (+ 59us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:40.400949 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:40.401064 (+ 115us) log.cc:842] Serialized 29 byte log entry
0810 11:30:40.401152 (+ 88us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.401188 (+ 36us) write_op.cc:454] Released schema lock
0810 11:30:40.401199 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.401273 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.401279 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":308,"apply.run_cpu_time_us":814,"apply.run_wall_time_us":5932,"num_ops":2,"prepare.queue_time_us":164,"prepare.run_cpu_time_us":1070,"prepare.run_wall_time_us":7678,"raft.queue_time_us":214,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":410,"replication_time_us":5734}]]}
I20260810 11:30:40.407330 26702 leader_election.cc:302] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.408454 28727 raft_consensus.cc:2781] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:40.408298 26578 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_37ba5cf5063749fbb2b8f0c05d4b73a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:40.408773 28727 raft_consensus.cc:686] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:40.409104 28727 consensus_queue.cc:237] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:40.409365 26578 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37ba5cf5063749fbb2b8f0c05d4b73a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:40.380132 26581 rpcz_store.cc:276] 0810 11:30:38.920797 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:39.007207 (+ 86410us) service_pool.cc:227] Handling call
0810 11:30:39.008184 (+ 977us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:39.008448 (+ 264us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:39.008519 (+ 71us) catalog_manager.cc:2761] Locking tablets
0810 11:30:39.380424 (+371905us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:39.400153 (+ 19729us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:39.400286 (+ 133us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:40.307898 (+907612us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:40.379724 (+ 71826us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:39.384366 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:39.384542 (+ 176us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:39.384559 (+ 17us) write_op.cc:435] Acquired schema lock
0810 11:30:39.384659 (+ 100us) tablet.cc:660] Decoding operations
0810 11:30:39.384842 (+ 183us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:39.384859 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:39.384868 (+ 9us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:39.385069 (+ 201us) tablet.cc:699] Row locks acquired
0810 11:30:39.385074 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:39.385132 (+ 58us) write_op.cc:270] Start()
0810 11:30:39.389826 (+ 4694us) write_op.cc:276] Timestamp: P: 1786361439385108 usec, L: 0
0810 11:30:39.389836 (+ 10us) op_driver.cc:331] REPLICATION: starting
0810 11:30:39.390175 (+ 339us) log.cc:842] Serialized 734 byte log entry
0810 11:30:39.399266 (+ 9091us) op_driver.cc:444] REPLICATION: finished
0810 11:30:39.399535 (+ 269us) write_op.cc:301] APPLY: starting
0810 11:30:39.399557 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:39.399616 (+ 59us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:39.399652 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:39.399741 (+ 89us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:39.399786 (+ 45us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:39.399795 (+ 9us) write_op.cc:312] APPLY: finished
0810 11:30:39.399916 (+ 121us) log.cc:842] Serialized 29 byte log entry
0810 11:30:39.399991 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.400017 (+ 26us) write_op.cc:454] Released schema lock
0810 11:30:39.400026 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:39.400122 (+ 96us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.400126 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":3072,"child_traces":[["op",{"apply.queue_time_us":203,"apply.run_cpu_time_us":659,"apply.run_wall_time_us":659,"num_ops":2,"prepare.queue_time_us":3156,"prepare.run_cpu_time_us":1457,"prepare.run_wall_time_us":9876,"raft.queue_time_us":1407,"raft.run_cpu_time_us":11,"raft.run_wall_time_us":14,"replication_time_us":9392}]]}
I20260810 11:30:40.412042 26581 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_bd5713e68e4a473a9fc231c709826f99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:40.412879 26581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd5713e68e4a473a9fc231c709826f99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:40.413856 26849 leader_election.cc:302] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:40.414556 28591 raft_consensus.cc:2781] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:40.415093 28591 raft_consensus.cc:686] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:40.415427 28591 consensus_queue.cc:237] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:40.416671 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 55462.3us
I20260810 11:30:40.417915 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dc4fd6ca8a541f99eed57a6f51c1f0a" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:40.425500 28726 consensus_queue.cc:1035] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:40.428519 27999 ts_tablet_manager.cc:1918] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:40.428730 27999 log.cc:1196] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/02ff6a9bc02441ddb7f307d6b3df31bd
I20260810 11:30:40.437585 28902 raft_consensus.cc:482] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.438005 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 23637a02b6464e17aa2a69ea5cc4ddfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:40.437932 28902 raft_consensus.cc:504] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.438318 28794 tablet_replica.cc:330] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:40.438459 28898 raft_consensus.cc:482] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.438598 28794 raft_consensus.cc:2229] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:40.438853 28902 leader_election.cc:288] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:40.438941 28794 raft_consensus.cc:2258] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:40.438689 28898 raft_consensus.cc:504] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.439569 28794 ts_tablet_manager.cc:1905] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:40.437942 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f24c84cdd945b78f39f24015eb1e43" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:40.440594 27058 raft_consensus.cc:3037] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.443632 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d0d55b526749059470504a27887b22" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:40.443931 26914 raft_consensus.cc:2454] T d1d0d55b526749059470504a27887b22 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:40.445097 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110b5acc36bd4d6bba13735e5daec75f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:40.445230 26991 leader_election.cc:302] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:40.445839 27058 raft_consensus.cc:2454] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:40.446094 28902 raft_consensus.cc:2781] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:40.446441 28902 raft_consensus.cc:482] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:40.446516 28902 raft_consensus.cc:3037] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.447062 26578 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 129) took 1397 ms. Trace:
I20260810 11:30:40.447800 28794 ts_tablet_manager.cc:1918] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:40.447928 28794 log.cc:1196] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/23637a02b6464e17aa2a69ea5cc4ddfe
I20260810 11:30:40.447311 26578 rpcz_store.cc:276] 0810 11:30:39.049726 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.407892 (+1358166us) service_pool.cc:227] Handling call
0810 11:30:40.409471 (+ 1579us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:40.410056 (+ 585us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:40.446596 (+ 36540us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:40.446822 (+ 226us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:40.446959 (+ 137us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.423453 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.423614 (+ 161us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.423623 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:40.423627 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:40.423773 (+ 146us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.423790 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.423797 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:40.423885 (+ 88us) tablet.cc:699] Row locks acquired
0810 11:30:40.423887 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:40.423929 (+ 42us) write_op.cc:270] Start()
0810 11:30:40.423963 (+ 34us) write_op.cc:276] Timestamp: P: 1786361440423914 usec, L: 0
0810 11:30:40.423967 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.424236 (+ 269us) log.cc:842] Serialized 433 byte log entry
0810 11:30:40.430828 (+ 6592us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.431232 (+ 404us) write_op.cc:301] APPLY: starting
0810 11:30:40.431260 (+ 28us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.431329 (+ 69us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.431382 (+ 53us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.431524 (+ 142us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.431565 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:40.431576 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:40.431693 (+ 117us) log.cc:842] Serialized 29 byte log entry
0810 11:30:40.431780 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.431807 (+ 27us) write_op.cc:454] Released schema lock
0810 11:30:40.431817 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.431883 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.431886 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":326,"apply.run_cpu_time_us":716,"apply.run_wall_time_us":716,"mutex_wait_us":12652,"num_ops":2,"prepare.queue_time_us":12767,"prepare.run_cpu_time_us":914,"prepare.run_wall_time_us":912,"raft.queue_time_us":1551,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":243,"replication_time_us":6822}]]}
I20260810 11:30:40.448400 28794 ts_tablet_manager.cc:1939] T 23637a02b6464e17aa2a69ea5cc4ddfe P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:40.449239 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d0d55b526749059470504a27887b22" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:40.450235 26581 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 130) took 1400 ms. Trace:
I20260810 11:30:40.450487 28902 raft_consensus.cc:504] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.450455 26581 rpcz_store.cc:276] 0810 11:30:39.049871 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.411587 (+1361716us) service_pool.cc:227] Handling call
0810 11:30:40.413047 (+ 1460us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:40.413632 (+ 585us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:40.449810 (+ 36178us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.449821 (+ 11us) write_op.cc:454] Released schema lock
0810 11:30:40.449939 (+ 118us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:40.450074 (+ 135us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:40.450166 (+ 92us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.424403 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.424491 (+ 88us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.424496 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:40.424498 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:40.424631 (+ 133us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.424640 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.424645 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:40.424775 (+ 130us) tablet.cc:699] Row locks acquired
0810 11:30:40.424777 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:40.424811 (+ 34us) write_op.cc:270] Start()
0810 11:30:40.424839 (+ 28us) write_op.cc:276] Timestamp: P: 1786361440424798 usec, L: 0
0810 11:30:40.424842 (+ 3us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.424988 (+ 146us) log.cc:842] Serialized 433 byte log entry
0810 11:30:40.430921 (+ 5933us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.432052 (+ 1131us) write_op.cc:301] APPLY: starting
0810 11:30:40.432069 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.432112 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.432154 (+ 42us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.432290 (+ 136us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.432330 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:40.432340 (+ 10us) write_op.cc:312] APPLY: finished
0810 11:30:40.432529 (+ 189us) log.cc:842] Serialized 29 byte log entry
0810 11:30:40.432613 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.432635 (+ 22us) write_op.cc:454] Released schema lock
0810 11:30:40.432644 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1082,"apply.run_cpu_time_us":688,"apply.run_wall_time_us":687,"mutex_wait_us":8936,"num_ops":2,"prepare.queue_time_us":9934,"prepare.run_cpu_time_us":673,"prepare.run_wall_time_us":1082,"raft.queue_time_us":395,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":6058,"threads_started":1}]]}
I20260810 11:30:40.451246 28902 leader_election.cc:288] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:40.446296 26991 leader_election.cc:341] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.452464 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d0d55b526749059470504a27887b22" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:40.453085 26993 leader_election.cc:341] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.453204 26993 leader_election.cc:302] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.453413 28902 raft_consensus.cc:2726] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:40.452811 26915 raft_consensus.cc:3037] T d1d0d55b526749059470504a27887b22 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:40.453920 26993 leader_election.cc:341] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.454628 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 23637a02b6464e17aa2a69ea5cc4ddfe (table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85]) successfully deleted
I20260810 11:30:40.454046 26572 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 128) took 1404 ms. Trace:
I20260810 11:30:40.455250 26572 rpcz_store.cc:276] 0810 11:30:39.049493 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.402967 (+1353474us) service_pool.cc:227] Handling call
0810 11:30:40.404819 (+ 1852us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:40.405461 (+ 642us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:40.453490 (+ 48029us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:40.453632 (+ 142us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:40.453724 (+ 92us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.414528 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.414638 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.414645 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:40.414648 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:40.414745 (+ 97us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.414761 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.414766 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:40.414850 (+ 84us) tablet.cc:699] Row locks acquired
0810 11:30:40.414853 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:40.414897 (+ 44us) write_op.cc:270] Start()
0810 11:30:40.414940 (+ 43us) write_op.cc:276] Timestamp: P: 1786361440414883 usec, L: 0
0810 11:30:40.414946 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.415147 (+ 201us) log.cc:842] Serialized 433 byte log entry
0810 11:30:40.418953 (+ 3806us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.419543 (+ 590us) write_op.cc:301] APPLY: starting
0810 11:30:40.419562 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.419611 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.419647 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.419772 (+ 125us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.419808 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:40.419815 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:40.419890 (+ 75us) log.cc:842] Serialized 29 byte log entry
0810 11:30:40.419956 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.419986 (+ 30us) write_op.cc:454] Released schema lock
0810 11:30:40.419995 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.420056 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.420061 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":532,"apply.run_cpu_time_us":576,"apply.run_wall_time_us":576,"num_ops":2,"prepare.queue_time_us":8586,"prepare.run_cpu_time_us":747,"prepare.run_wall_time_us":748,"raft.queue_time_us":180,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":307,"replication_time_us":3979}]]}
I20260810 11:30:40.458845 27231 tablet_bootstrap.cc:492] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:40.458997 27231 ts_tablet_manager.cc:1397] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.167s user 0.019s sys 0.003s
I20260810 11:30:40.459925 27231 raft_consensus.cc:348] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.460227 27231 raft_consensus.cc:374] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.460295 27231 raft_consensus.cc:729] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.439571 28898 leader_election.cc:288] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:40.462124 27999 ts_tablet_manager.cc:1939] T 02ff6a9bc02441ddb7f307d6b3df31bd P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:40.462446 27974 ts_tablet_manager.cc:1918] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:40.462671 27974 log.cc:1196] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/23637a02b6464e17aa2a69ea5cc4ddfe
I20260810 11:30:40.463378 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 159) took 9764 ms. Trace:
I20260810 11:30:40.466732 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d0d55b526749059470504a27887b22" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:40.466732 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110b5acc36bd4d6bba13735e5daec75f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:40.456610 26700 consensus_peers.cc:487] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2634beb347714fc7a2e05865adb34a22. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:40.463548 27999 rpcz_store.cc:276] 0810 11:30:30.698972 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:30.699182 (+ 210us) service_pool.cc:227] Handling call
0810 11:30:40.360222 (+9661040us) ts_tablet_manager.cc:1145] Deleting tablet 02ff6a9bc02441ddb7f307d6b3df31bd
0810 11:30:40.360233 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.400901 (+ 40668us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.428386 (+ 27485us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.463329 (+ 34943us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9653116}
I20260810 11:30:40.469357 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 02ff6a9bc02441ddb7f307d6b3df31bd (table default.Table_5f8ecc7877924d0f9871dd16aaeafdde [id=e1ca02b3f3f94632843632a15fc19245]) successfully deleted
I20260810 11:30:40.469973 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 160) took 9157 ms. Trace:
I20260810 11:30:40.470165 27999 rpcz_store.cc:276] 0810 11:30:31.312334 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:31.312446 (+ 112us) service_pool.cc:227] Handling call
0810 11:30:40.469833 (+9157387us) ts_tablet_manager.cc:1145] Deleting tablet ee803ddf27594d2b9e19fe440fc269c7
0810 11:30:40.469847 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.469951 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9156515}
W20260810 11:30:40.470302 26993 leader_election.cc:341] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:40.470602 26993 leader_election.cc:341] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.470708 26993 leader_election.cc:302] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.470769 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 161) took 9156 ms. Trace:
I20260810 11:30:40.470956 27999 rpcz_store.cc:276] 0810 11:30:31.314221 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:31.314330 (+ 109us) service_pool.cc:227] Handling call
0810 11:30:40.470593 (+9156263us) ts_tablet_manager.cc:1145] Deleting tablet e276b0fa124d42dfb3fe750d245e44d8
0810 11:30:40.470603 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.470751 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9125155}
I20260810 11:30:40.471139 26915 raft_consensus.cc:2454] T d1d0d55b526749059470504a27887b22 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
W20260810 11:30:40.471526 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ee803ddf27594d2b9e19fe440fc269c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee803ddf27594d2b9e19fe440fc269c7 already in progress: creating tablet
I20260810 11:30:40.471802 28640 consensus_queue.cc:1035] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:40.471976 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet e276b0fa124d42dfb3fe750d245e44d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e276b0fa124d42dfb3fe750d245e44d8 already in progress: creating tablet
I20260810 11:30:40.471954 26991 leader_election.cc:302] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:40.472285 28651 raft_consensus.cc:2781] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:40.472445 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 169) took 7877 ms. Trace:
I20260810 11:30:40.472460 28651 raft_consensus.cc:686] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:40.472538 27999 rpcz_store.cc:276] 0810 11:30:32.595379 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.596302 (+ 923us) service_pool.cc:227] Handling call
0810 11:30:40.472325 (+7876023us) ts_tablet_manager.cc:1145] Deleting tablet c60baf810a544a4a90dccd2337a39043
0810 11:30:40.472337 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.472428 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7875223}
W20260810 11:30:40.473733 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet c60baf810a544a4a90dccd2337a39043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c60baf810a544a4a90dccd2337a39043 already in progress: creating tablet
I20260810 11:30:40.475706 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 170) took 7874 ms. Trace:
I20260810 11:30:40.476341 27999 rpcz_store.cc:276] 0810 11:30:32.601090 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.601316 (+ 226us) service_pool.cc:227] Handling call
0810 11:30:40.475526 (+7874210us) ts_tablet_manager.cc:1145] Deleting tablet b6395bce17ee40c2822669246ce7eb42
0810 11:30:40.475542 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.475678 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7873682}
W20260810 11:30:40.477630 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet b6395bce17ee40c2822669246ce7eb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6395bce17ee40c2822669246ce7eb42 already in progress: creating tablet
I20260810 11:30:40.478444 27999 tablet_replica.cc:330] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:40.478854 27999 raft_consensus.cc:2229] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:40.479434 27999 raft_consensus.cc:2258] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:40.480785 26571 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743] alter complete (version 2)
I20260810 11:30:40.481500 27999 ts_tablet_manager.cc:1905] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:40.486749 26991 consensus_peers.cc:487] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44d5e146eeec4fe0be33c1c169d32e68. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:40.489841 27999 ts_tablet_manager.cc:1918] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:40.490031 27999 log.cc:1196] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/2801709d53614916abac370f7ae5e913
I20260810 11:30:40.490669 27999 ts_tablet_manager.cc:1939] T 2801709d53614916abac370f7ae5e913 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:40.492049 27974 ts_tablet_manager.cc:1939] T 23637a02b6464e17aa2a69ea5cc4ddfe P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:40.493081 28779 raft_consensus.cc:482] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.493248 28779 raft_consensus.cc:504] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.493920 28779 leader_election.cc:288] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.493914 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 23637a02b6464e17aa2a69ea5cc4ddfe (table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85]) successfully deleted
I20260810 11:30:40.497579 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10210204d5ff4e5e97c98fd255f674a5" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:40.498898 26572 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_48311485d3814f7db3e63b8c24b89237"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:40.500092 26572 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48311485d3814f7db3e63b8c24b89237 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:40.501993 27222 tablet_bootstrap.cc:492] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:40.502167 27222 ts_tablet_manager.cc:1397] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.174s user 0.009s sys 0.004s
I20260810 11:30:40.500844 26578 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_99d57a71681847508ff5f7ba60124d66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:40.503242 26578 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99d57a71681847508ff5f7ba60124d66 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:40.503911 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 171) took 7781 ms. Trace:
I20260810 11:30:40.504385 27999 rpcz_store.cc:276] 0810 11:30:32.722979 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.723085 (+ 106us) service_pool.cc:227] Handling call
0810 11:30:40.478368 (+7755283us) ts_tablet_manager.cc:1145] Deleting tablet 2801709d53614916abac370f7ae5e913
0810 11:30:40.478387 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.485340 (+ 6953us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.489679 (+ 4339us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.503854 (+ 14175us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7754478}
I20260810 11:30:40.505713 26581 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_37b7273d0a2a489c8ec902a8dac17bc5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:40.506910 26581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37b7273d0a2a489c8ec902a8dac17bc5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:40.513411 27231 consensus_queue.cc:260] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.514109 27231 ts_tablet_manager.cc:1428] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.055s user 0.000s sys 0.003s
I20260810 11:30:40.514780 27231 tablet_bootstrap.cc:492] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:40.514597 28753 raft_consensus.cc:2726] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:40.519570 27222 raft_consensus.cc:348] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.520004 27222 raft_consensus.cc:374] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.520082 27222 raft_consensus.cc:729] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.526218 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 2801709d53614916abac370f7ae5e913 (table default.Table_be173a149b464952b17280eb1fe40667 [id=53a6520ad3b04ffe88477fd07c159add]) successfully deleted
I20260810 11:30:40.526729 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 172) took 7798 ms. Trace:
I20260810 11:30:40.526926 27999 rpcz_store.cc:276] 0810 11:30:32.728666 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.728793 (+ 127us) service_pool.cc:227] Handling call
0810 11:30:40.505042 (+7776249us) ts_tablet_manager.cc:1145] Deleting tablet 256ad2e2d8e54a4caa1b5091bab60dd5
0810 11:30:40.505064 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.526689 (+ 21625us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7775283}
I20260810 11:30:40.517634 28345 consensus_queue.cc:1035] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:40.529435 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 256ad2e2d8e54a4caa1b5091bab60dd5 already in progress: creating tablet
I20260810 11:30:40.527616 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 174) took 7793 ms. Trace:
I20260810 11:30:40.529903 27999 rpcz_store.cc:276] 0810 11:30:32.733739 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.733896 (+ 157us) service_pool.cc:227] Handling call
0810 11:30:40.527457 (+7793561us) ts_tablet_manager.cc:1145] Deleting tablet fc558690dce44e999e55e9bf1b6ca172
0810 11:30:40.527477 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.527591 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7781044}
I20260810 11:30:40.531073 27999 tablet_replica.cc:330] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:40.531939 27999 raft_consensus.cc:2229] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:40.517686 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10210204d5ff4e5e97c98fd255f674a5" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:40.533846 27061 raft_consensus.cc:2379] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:40.537391 28898 raft_consensus.cc:482] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.537565 28898 raft_consensus.cc:504] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.538219 28898 leader_election.cc:288] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:40.538954 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d24726d0214947beab0bb31b1597c1c3" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:40.539067 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d24726d0214947beab0bb31b1597c1c3" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:40.539630 26915 raft_consensus.cc:2454] T d24726d0214947beab0bb31b1597c1c3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
W20260810 11:30:40.539740 26993 leader_election.cc:341] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.537720 27222 consensus_queue.cc:260] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.541324 26991 leader_election.cc:302] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:40.542225 27222 ts_tablet_manager.cc:1428] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.040s user 0.004s sys 0.000s
I20260810 11:30:40.542318 28898 raft_consensus.cc:2781] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:40.542425 28898 raft_consensus.cc:482] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:40.542613 28898 raft_consensus.cc:3037] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.542810 27222 tablet_bootstrap.cc:492] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:40.546469 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet fc558690dce44e999e55e9bf1b6ca172 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc558690dce44e999e55e9bf1b6ca172 already in progress: creating tablet
I20260810 11:30:40.514570 28651 consensus_queue.cc:237] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.554567 28753 raft_consensus.cc:482] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.559377 28898 raft_consensus.cc:504] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.560878 28345 consensus_queue.cc:1035] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:40.562757 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d24726d0214947beab0bb31b1597c1c3" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:40.564023 26848 leader_election.cc:302] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
W20260810 11:30:40.564242 26993 leader_election.cc:341] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.564829 28898 leader_election.cc:288] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:40.565459 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d24726d0214947beab0bb31b1597c1c3" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:40.565794 26914 raft_consensus.cc:3037] T d24726d0214947beab0bb31b1597c1c3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.570091 26914 raft_consensus.cc:2454] T d24726d0214947beab0bb31b1597c1c3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:40.570212 28591 raft_consensus.cc:3037] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.558386 28753 raft_consensus.cc:504] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.574694 28753 leader_election.cc:288] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:40.575245 27222 tablet_bootstrap.cc:654] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.575313 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "271a0607ec28441c91bac32c2f2bf44b" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:40.576102 26993 leader_election.cc:341] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.576260 26991 leader_election.cc:302] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:40.577003 28902 raft_consensus.cc:2781] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:40.577142 28902 raft_consensus.cc:686] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:40.577365 28902 consensus_queue.cc:237] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.579679 28846 consensus_queue.cc:1035] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:40.581928 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "271a0607ec28441c91bac32c2f2bf44b" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:40.586412 27228 tablet_bootstrap.cc:492] T 271a0607ec28441c91bac32c2f2bf44b P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:40.586611 27228 ts_tablet_manager.cc:1397] T 271a0607ec28441c91bac32c2f2bf44b P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.268s user 0.009s sys 0.019s
I20260810 11:30:40.587373 27228 raft_consensus.cc:348] T 271a0607ec28441c91bac32c2f2bf44b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.587620 27228 raft_consensus.cc:374] T 271a0607ec28441c91bac32c2f2bf44b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 11:30:40.587613 26991 leader_election.cc:341] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.587694 27228 raft_consensus.cc:729] T 271a0607ec28441c91bac32c2f2bf44b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.588065 26991 leader_election.cc:302] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.588385 28753 raft_consensus.cc:2726] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:40.590715 27231 tablet_bootstrap.cc:654] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.590937 26576 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet b200bdb394d3439b86fff48494be8e3d
I20260810 11:30:40.591459 28591 raft_consensus.cc:2726] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:40.591653 26576 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 126) took 1665 ms. Trace:
I20260810 11:30:40.591884 26576 rpcz_store.cc:276] 0810 11:30:38.926634 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.311228 (+1384594us) service_pool.cc:227] Handling call
0810 11:30:40.312109 (+ 881us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:40.312283 (+ 174us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:40.312366 (+ 83us) catalog_manager.cc:2761] Locking tablets
0810 11:30:40.577754 (+265388us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:40.590693 (+ 12939us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:40.590801 (+ 108us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:40.590856 (+ 55us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:40.591604 (+ 748us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.582704 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.582850 (+ 146us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.582858 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:40.582862 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:40.583012 (+ 150us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.583030 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.583035 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:40.583251 (+ 216us) tablet.cc:699] Row locks acquired
0810 11:30:40.583311 (+ 60us) write_op.cc:260] PREPARE: finished
0810 11:30:40.583357 (+ 46us) write_op.cc:270] Start()
0810 11:30:40.583426 (+ 69us) write_op.cc:276] Timestamp: P: 1786361440583327 usec, L: 0
0810 11:30:40.583432 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.583767 (+ 335us) log.cc:842] Serialized 765 byte log entry
0810 11:30:40.588059 (+ 4292us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.589944 (+ 1885us) write_op.cc:301] APPLY: starting
0810 11:30:40.589967 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.590016 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.590046 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.590124 (+ 78us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.590163 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:40.590170 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:40.590259 (+ 89us) log.cc:842] Serialized 29 byte log entry
0810 11:30:40.590559 (+ 300us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.590586 (+ 27us) write_op.cc:454] Released schema lock
0810 11:30:40.590596 (+ 10us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1815,"num_ops":2,"prepare.queue_time_us":4000,"prepare.run_cpu_time_us":1152,"prepare.run_wall_time_us":1708,"raft.queue_time_us":170,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":364,"replication_time_us":4593}]]}
I20260810 11:30:40.593305 26576 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_db828c7c4cb04bcb9fa47bbe1240e3c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:40.594173 27999 raft_consensus.cc:2258] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:40.594250 26576 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db828c7c4cb04bcb9fa47bbe1240e3c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:40.594946 27999 ts_tablet_manager.cc:1905] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:40.596334 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet b200bdb394d3439b86fff48494be8e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:40 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:40.598201 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet b200bdb394d3439b86fff48494be8e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:40 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:40.598587 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet b200bdb394d3439b86fff48494be8e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:40 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:40.598632 28794 tablet_replica.cc:330] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:40.598905 28794 raft_consensus.cc:2229] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:40.599175 28794 pending_rounds.cc:62] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215: Trying to abort 1 pending ops.
I20260810 11:30:40.599222 28794 pending_rounds.cc:68] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936459313025024 op_type: NO_OP noop_request { }
I20260810 11:30:40.599507 28794 raft_consensus.cc:2866] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:40.599684 28794 raft_consensus.cc:2258] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:40.600710 28794 ts_tablet_manager.cc:1905] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:40.605676 27231 tablet_bootstrap.cc:492] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:40.605901 27231 ts_tablet_manager.cc:1397] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.091s user 0.003s sys 0.006s
I20260810 11:30:40.607293 27231 raft_consensus.cc:348] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.614120 28345 raft_consensus.cc:482] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.614240 26576 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 134) took 1469 ms. Trace:
I20260810 11:30:40.614450 28345 raft_consensus.cc:504] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.614569 26576 rpcz_store.cc:276] 0810 11:30:39.144880 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.592777 (+1447897us) service_pool.cc:227] Handling call
0810 11:30:40.594375 (+ 1598us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:40.594985 (+ 610us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:40.613878 (+ 18893us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:40.614024 (+ 146us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:40.614143 (+ 119us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.598570 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.598707 (+ 137us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.598715 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:40.598717 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:40.598845 (+ 128us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.598866 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.598873 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:40.598956 (+ 83us) tablet.cc:699] Row locks acquired
0810 11:30:40.598959 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:40.599002 (+ 43us) write_op.cc:270] Start()
0810 11:30:40.599057 (+ 55us) write_op.cc:276] Timestamp: P: 1786361440598968 usec, L: 0
0810 11:30:40.599064 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.599338 (+ 274us) log.cc:842] Serialized 433 byte log entry
0810 11:30:40.610459 (+ 11121us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.610583 (+ 124us) write_op.cc:301] APPLY: starting
0810 11:30:40.610608 (+ 25us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.610686 (+ 78us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.610734 (+ 48us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.610915 (+ 181us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.610960 (+ 45us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:40.610967 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:40.611079 (+ 112us) log.cc:842] Serialized 29 byte log entry
0810 11:30:40.611176 (+ 97us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.611203 (+ 27us) write_op.cc:454] Released schema lock
0810 11:30:40.611212 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.611284 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.611288 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":51,"apply.run_cpu_time_us":781,"apply.run_wall_time_us":781,"num_ops":2,"prepare.queue_time_us":2900,"prepare.run_cpu_time_us":919,"prepare.run_wall_time_us":1399,"raft.queue_time_us":148,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":214,"replication_time_us":11355}]]}
I20260810 11:30:40.615293 28345 leader_election.cc:288] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.616040 27228 consensus_queue.cc:260] T 271a0607ec28441c91bac32c2f2bf44b P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.619056 27228 ts_tablet_manager.cc:1428] T 271a0607ec28441c91bac32c2f2bf44b P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.032s user 0.001s sys 0.001s
I20260810 11:30:40.620612 26576 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_c0597a7b9458401f970d2bf9a1af8e66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:40.621549 28640 raft_consensus.cc:482] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.621758 28640 raft_consensus.cc:504] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.622457 28727 raft_consensus.cc:482] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.622501 28779 raft_consensus.cc:482] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.622582 28640 leader_election.cc:288] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.622623 28779 raft_consensus.cc:504] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.622815 27228 tablet_bootstrap.cc:492] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:40.623348 28779 leader_election.cc:288] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:40.623680 26576 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0597a7b9458401f970d2bf9a1af8e66 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:40.623950 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3079a68c1c74b64bf13877bd0ee68c3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:40.624766 26849 leader_election.cc:341] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.625093 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d0d55b526749059470504a27887b22" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:40.625415 26916 raft_consensus.cc:2379] T d1d0d55b526749059470504a27887b22 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
W20260810 11:30:40.628916 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet b200bdb394d3439b86fff48494be8e3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b200bdb394d3439b86fff48494be8e3d already in progress: creating tablet
I20260810 11:30:40.622603 28727 raft_consensus.cc:504] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.633047 27228 tablet_bootstrap.cc:654] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.633416 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db59523b71224370bf5fce6b56592f71" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:40.635118 27222 tablet_bootstrap.cc:492] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:40.635274 27222 ts_tablet_manager.cc:1397] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.093s user 0.003s sys 0.003s
W20260810 11:30:40.635715 26700 leader_election.cc:341] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.635915 28727 leader_election.cc:288] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.636227 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a835d30ef9fc474ab927bb119a95d83c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:40.636279 27222 raft_consensus.cc:348] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.636510 26763 raft_consensus.cc:2454] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:40.636732 27222 raft_consensus.cc:374] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.636837 27222 raft_consensus.cc:729] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.637076 27222 consensus_queue.cc:260] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.637236 26849 leader_election.cc:302] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:40.637665 28345 raft_consensus.cc:2781] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:40.637710 27222 ts_tablet_manager.cc:1428] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:40.637755 28345 raft_consensus.cc:482] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:40.637833 28345 raft_consensus.cc:3037] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.638000 27222 tablet_bootstrap.cc:492] T 7d3406f12d9c492cbd0d86fa7a57de82 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:40.640038 27222 tablet_bootstrap.cc:654] T 7d3406f12d9c492cbd0d86fa7a57de82 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.640601 27231 raft_consensus.cc:374] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.646481 27999 ts_tablet_manager.cc:1918] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260810 11:30:40.646646 27999 log.cc:1196] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/3851d39aeb3142938a5ac558ab438c21
I20260810 11:30:40.647037 27999 ts_tablet_manager.cc:1939] T 3851d39aeb3142938a5ac558ab438c21 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:40.647608 28345 raft_consensus.cc:504] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.648093 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 173) took 7916 ms. Trace:
I20260810 11:30:40.648309 28345 leader_election.cc:288] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.649271 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a835d30ef9fc474ab927bb119a95d83c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:40.649569 26763 raft_consensus.cc:3037] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.653600 26763 raft_consensus.cc:2454] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:40.654351 26849 leader_election.cc:302] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:40.654850 28345 raft_consensus.cc:2781] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:40.655047 28345 raft_consensus.cc:686] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:40.655422 28345 consensus_queue.cc:237] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.648231 27999 rpcz_store.cc:276] 0810 11:30:32.732175 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.732259 (+ 84us) service_pool.cc:227] Handling call
0810 11:30:40.530998 (+7798739us) ts_tablet_manager.cc:1145] Deleting tablet 3851d39aeb3142938a5ac558ab438c21
0810 11:30:40.531018 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.617454 (+ 86436us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.646378 (+ 28924us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.648072 (+ 1694us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7784493}
I20260810 11:30:40.661037 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 3851d39aeb3142938a5ac558ab438c21 (table default.Table_07ad990413b541f5b90b5f0f813635d3 [id=b6d04667c02048fda37c47346472dba5]) successfully deleted
I20260810 11:30:40.662343 27999 tablet_replica.cc:330] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:40.664415 27999 raft_consensus.cc:2229] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:40.664690 27999 raft_consensus.cc:2258] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:40.665115 26700 consensus_peers.cc:487] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3851d39aeb3142938a5ac558ab438c21. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:40.665338 27999 ts_tablet_manager.cc:1905] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:40.664685 27228 tablet_bootstrap.cc:492] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:40.670526 27228 ts_tablet_manager.cc:1397] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.048s user 0.000s sys 0.005s
I20260810 11:30:40.671186 26581 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 131) took 1549 ms. Trace:
I20260810 11:30:40.672088 27228 raft_consensus.cc:348] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.672405 27228 raft_consensus.cc:374] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.672472 27228 raft_consensus.cc:729] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.672806 27228 consensus_queue.cc:260] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.673849 27228 ts_tablet_manager.cc:1428] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260810 11:30:40.671375 26581 rpcz_store.cc:276] 0810 11:30:39.114586 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.452683 (+1338097us) service_pool.cc:227] Handling call
0810 11:30:40.505450 (+ 52767us) spinlock_profiling.cc:243] Waited 50.6 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa45313 00007f9c61d37466 00007f9c61d37195 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:40.525150 (+ 19700us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:40.619663 (+ 94513us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:40.662963 (+ 43300us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:40.663150 (+ 187us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:40.663451 (+ 301us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.620674 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.620818 (+ 144us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.620826 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:40.620829 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:40.620957 (+ 128us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.620972 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.620978 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:40.621085 (+ 107us) tablet.cc:699] Row locks acquired
0810 11:30:40.621088 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:40.621134 (+ 46us) write_op.cc:270] Start()
0810 11:30:40.621175 (+ 41us) write_op.cc:276] Timestamp: P: 1786361440621099 usec, L: 0
0810 11:30:40.621179 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.621422 (+ 243us) log.cc:842] Serialized 433 byte log entry
0810 11:30:40.659367 (+ 37945us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.659525 (+ 158us) write_op.cc:301] APPLY: starting
0810 11:30:40.659547 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.659600 (+ 53us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.662141 (+ 2541us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.662257 (+ 116us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.662310 (+ 53us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:40.662317 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:40.662447 (+ 130us) log.cc:842] Serialized 29 byte log entry
0810 11:30:40.662734 (+ 287us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.662752 (+ 18us) write_op.cc:454] Released schema lock
0810 11:30:40.662759 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.662850 (+ 91us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.662856 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":116356864,"child_traces":[["op",{"apply.queue_time_us":74,"apply.run_cpu_time_us":763,"apply.run_wall_time_us":3402,"num_ops":2,"prepare.queue_time_us":227,"prepare.run_cpu_time_us":892,"prepare.run_wall_time_us":893,"raft.queue_time_us":657,"raft.run_cpu_time_us":8,"raft.run_wall_time_us":9,"replication_time_us":16725}]]}
I20260810 11:30:40.675050 26572 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 132) took 1542 ms. Trace:
I20260810 11:30:40.679155 27228 tablet_bootstrap.cc:492] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:40.675366 26572 rpcz_store.cc:276] 0810 11:30:39.131634 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.457687 (+1326053us) service_pool.cc:227] Handling call
0810 11:30:40.498642 (+ 40955us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa45313 00007f9c61d37466 00007f9c61d37195 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:40.524402 (+ 25760us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:40.525217 (+ 815us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:40.626635 (+101418us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x616000031f78. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f9c6425c4fd 00007f9c6424b41a 00007f9c641f3ef8 00007f9c641f38b9 00007f9c6aaa1f93 00007f9c6aaa347e 00007f9c6a84524d 00007f9c6aa4546a 00007f9c61d37466 00007f9c61d37195
0810 11:30:40.672718 (+ 46083us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:40.673561 (+ 843us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:40.673812 (+ 251us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.626763 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.626871 (+ 108us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.626878 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:40.626880 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:40.627035 (+ 155us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.627047 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.627053 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:40.627138 (+ 85us) tablet.cc:699] Row locks acquired
0810 11:30:40.627141 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:40.627179 (+ 38us) write_op.cc:270] Start()
0810 11:30:40.627216 (+ 37us) write_op.cc:276] Timestamp: P: 1786361440627145 usec, L: 0
0810 11:30:40.627222 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.627518 (+ 296us) log.cc:842] Serialized 433 byte log entry
0810 11:30:40.659568 (+ 32050us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.661598 (+ 2030us) write_op.cc:301] APPLY: starting
0810 11:30:40.661610 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.661645 (+ 35us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.672008 (+ 10363us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.672202 (+ 194us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.672277 (+ 75us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:40.672286 (+ 9us) write_op.cc:312] APPLY: finished
0810 11:30:40.672425 (+ 139us) log.cc:842] Serialized 29 byte log entry
0810 11:30:40.672555 (+ 130us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.672611 (+ 56us) write_op.cc:454] Released schema lock
0810 11:30:40.672623 (+ 12us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.672696 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.672699 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":324221568,"child_traces":[["op",{"apply.queue_time_us":1997,"apply.run_cpu_time_us":894,"apply.run_wall_time_us":11154,"num_ops":2,"prepare.queue_time_us":46,"prepare.run_cpu_time_us":824,"prepare.run_wall_time_us":1292,"raft.queue_time_us":437,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"replication_time_us":32331,"threads_started":1}]]}
I20260810 11:30:40.707511 26576 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 135) took 1548 ms. Trace:
I20260810 11:30:40.708292 26576 rpcz_store.cc:276] 0810 11:30:39.159215 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.620014 (+1460799us) service_pool.cc:227] Handling call
0810 11:30:40.623820 (+ 3806us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:40.624419 (+ 599us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:40.706775 (+ 82356us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:40.706930 (+ 155us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:40.707358 (+ 428us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.625190 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.625320 (+ 130us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.625328 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:40.625330 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:40.625450 (+ 120us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.625462 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.625467 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:40.625560 (+ 93us) tablet.cc:699] Row locks acquired
0810 11:30:40.625562 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:40.625607 (+ 45us) write_op.cc:270] Start()
0810 11:30:40.625647 (+ 40us) write_op.cc:276] Timestamp: P: 1786361440625571 usec, L: 0
0810 11:30:40.625651 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.625843 (+ 192us) log.cc:842] Serialized 433 byte log entry
0810 11:30:40.659475 (+ 33632us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.660899 (+ 1424us) write_op.cc:301] APPLY: starting
0810 11:30:40.660915 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.660959 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.660984 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.661159 (+ 175us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.661203 (+ 44us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:40.661209 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:40.661315 (+ 106us) log.cc:842] Serialized 29 byte log entry
0810 11:30:40.661391 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.661416 (+ 25us) write_op.cc:454] Released schema lock
0810 11:30:40.661425 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.661494 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.661500 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1343,"apply.run_cpu_time_us":663,"apply.run_wall_time_us":664,"num_ops":2,"prepare.queue_time_us":60,"prepare.run_cpu_time_us":860,"prepare.run_wall_time_us":1350,"raft.queue_time_us":1627,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":7,"replication_time_us":33806}]]}
I20260810 11:30:40.713001 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a835d30ef9fc474ab927bb119a95d83c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:40.713349 27059 raft_consensus.cc:2454] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:40.716504 28728 raft_consensus.cc:482] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.716732 28728 raft_consensus.cc:504] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.717626 28728 leader_election.cc:288] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.718374 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34ed8c9efa634fc7b091b1bb6bc6d452" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:40.720052 27231 raft_consensus.cc:729] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.720247 27228 tablet_bootstrap.cc:654] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.720639 28794 ts_tablet_manager.cc:1918] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:40.721402 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3079a68c1c74b64bf13877bd0ee68c3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:40.721554 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a835d30ef9fc474ab927bb119a95d83c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:40.721634 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db59523b71224370bf5fce6b56592f71" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:40.721787 27060 raft_consensus.cc:3037] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.721570 28753 consensus_queue.cc:1035] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260810 11:30:40.721787 27055 raft_consensus.cc:2454] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:40.723841 27054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34ed8c9efa634fc7b091b1bb6bc6d452" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:40.726742 26821 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:40.727149 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d0d55b526749059470504a27887b22" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:40.728662 26848 leader_election.cc:302] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:40.731129 27999 ts_tablet_manager.cc:1918] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:40.731392 28921 raft_consensus.cc:2781] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:40.731594 28921 raft_consensus.cc:482] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:40.731931 28921 raft_consensus.cc:3037] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.732527 26702 leader_election.cc:302] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.733134 26702 leader_election.cc:302] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.734073 28728 raft_consensus.cc:2726] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:40.734285 28728 raft_consensus.cc:3037] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.741423 28728 raft_consensus.cc:2726] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:40.743921 27999 log.cc:1196] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/8a1e2e624fff4692a22e29b293cd82d6
I20260810 11:30:40.746704 27999 ts_tablet_manager.cc:1939] T 8a1e2e624fff4692a22e29b293cd82d6 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:40.747745 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 175) took 8002 ms. Trace:
I20260810 11:30:40.747822 27057 raft_consensus.cc:2454] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:40.747898 27999 rpcz_store.cc:276] 0810 11:30:32.745255 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.745327 (+ 72us) service_pool.cc:227] Handling call
0810 11:30:40.662291 (+7916964us) ts_tablet_manager.cc:1145] Deleting tablet 8a1e2e624fff4692a22e29b293cd82d6
0810 11:30:40.662302 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.697518 (+ 35216us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.730993 (+ 33475us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.747676 (+ 16683us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7915766}
I20260810 11:30:40.748629 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 8a1e2e624fff4692a22e29b293cd82d6 (table default.Table_f974a4ceae4649bb9f17115103f554cd [id=8c06eb3e2a9245af8c8e8eb250215e0c]) successfully deleted
I20260810 11:30:40.749331 27222 tablet_bootstrap.cc:492] T 7d3406f12d9c492cbd0d86fa7a57de82 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:40.749511 27222 ts_tablet_manager.cc:1397] T 7d3406f12d9c492cbd0d86fa7a57de82 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.112s user 0.009s sys 0.008s
I20260810 11:30:40.749464 26702 leader_election.cc:302] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.750237 28728 raft_consensus.cc:2781] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:40.750411 28728 raft_consensus.cc:482] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:40.750573 28728 raft_consensus.cc:3037] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.750674 27222 raft_consensus.cc:348] T 7d3406f12d9c492cbd0d86fa7a57de82 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.751039 27222 raft_consensus.cc:374] T 7d3406f12d9c492cbd0d86fa7a57de82 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.751124 27222 raft_consensus.cc:729] T 7d3406f12d9c492cbd0d86fa7a57de82 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.755084 27231 consensus_queue.cc:260] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.756304 28753 raft_consensus.cc:482] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.757982 27999 tablet_replica.cc:330] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:40.758311 28753 raft_consensus.cc:504] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.759208 28753 leader_election.cc:288] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:40.760730 27228 tablet_bootstrap.cc:492] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:40.760730 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "add1743851c34d58afb7e4886325d659" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:40.760988 27228 ts_tablet_manager.cc:1397] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.087s user 0.002s sys 0.007s
W20260810 11:30:40.761479 26993 leader_election.cc:341] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.762055 27231 ts_tablet_manager.cc:1428] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.150s user 0.004s sys 0.000s
I20260810 11:30:40.762240 27999 raft_consensus.cc:2229] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:40.762866 28794 log.cc:1196] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/b200bdb394d3439b86fff48494be8e3d
I20260810 11:30:40.734098 26581 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_86cc59e62a374a9eb464cca153e98a75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:40.763622 28794 ts_tablet_manager.cc:1939] T b200bdb394d3439b86fff48494be8e3d P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
W20260810 11:30:40.764122 26581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86cc59e62a374a9eb464cca153e98a75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:40.737161 26572 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_a28f24b6d9034bdbb5e3e055eafbcb5c" } new_table_name: "default.Table_598f0479773f405c8fae9ad75653db34" modify_external_catalogs: true
I20260810 11:30:40.764508 26576 master_service.cc:946] ReplaceTablet: received request to replace tablet 0cc17c55109b47eeb91920c3ed8178e0 from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:40.765364 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]) successfully deleted
I20260810 11:30:40.765304 27228 raft_consensus.cc:348] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.765661 27228 raft_consensus.cc:374] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.765873 27228 raft_consensus.cc:729] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.766222 27228 consensus_queue.cc:260] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.766343 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "add1743851c34d58afb7e4886325d659" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:40.767040 27228 ts_tablet_manager.cc:1428] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260810 11:30:40.767444 27228 tablet_bootstrap.cc:492] T 7e78fb1bf0534deca5cc5a603fd77592 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:40.767457 27110 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:40.767988 27060 raft_consensus.cc:2454] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:40.770236 27231 tablet_bootstrap.cc:492] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:40.762632 27999 raft_consensus.cc:2258] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:40.770920 27999 ts_tablet_manager.cc:1905] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:40.776464 26578 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 133) took 1631 ms. Trace:
I20260810 11:30:40.776721 26578 rpcz_store.cc:276] 0810 11:30:39.144721 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.463583 (+1318862us) service_pool.cc:227] Handling call
0810 11:30:40.500655 (+ 37072us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa45313 00007f9c61d37466 00007f9c61d37195 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:40.622903 (+122248us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:40.693242 (+ 70339us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:40.758290 (+ 65048us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:40.776221 (+ 17931us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:40.776355 (+ 134us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.705034 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.705248 (+ 214us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.705258 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:40.705262 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:40.705401 (+ 139us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.705419 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.705425 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:40.705592 (+ 167us) tablet.cc:699] Row locks acquired
0810 11:30:40.705596 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:40.705651 (+ 55us) write_op.cc:270] Start()
0810 11:30:40.705698 (+ 47us) write_op.cc:276] Timestamp: P: 1786361440705605 usec, L: 0
0810 11:30:40.705704 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.733581 (+ 27877us) log.cc:842] Serialized 433 byte log entry
0810 11:30:40.733858 (+ 277us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f9c62f1dd02 00007f9c642507f1 00007f9c6424f359 00007f9c642571bb 00007f9c64257038 00000000009edb7c 00007f9c57a55344 00007f9c57a5891b 00007f9c57a58798 00000000009edb7c
0810 11:30:40.756904 (+ 23046us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.757158 (+ 254us) write_op.cc:301] APPLY: starting
0810 11:30:40.757183 (+ 25us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.757237 (+ 54us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.757239 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.757479 (+ 240us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.757519 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:40.757525 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:40.757725 (+ 200us) log.cc:842] Serialized 29 byte log entry
0810 11:30:40.758053 (+ 328us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.758077 (+ 24us) write_op.cc:454] Released schema lock
0810 11:30:40.758086 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.758152 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.758156 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":84222720,"child_traces":[["op",{"apply.queue_time_us":195,"apply.run_cpu_time_us":854,"apply.run_wall_time_us":1059,"num_ops":2,"prepare.queue_time_us":11059,"prepare.run_cpu_time_us":9124,"prepare.run_wall_time_us":40396,"raft.queue_time_us":4259,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":7,"replication_time_us":51154,"spinlock_wait_cycles":63389952,"thread_start_us":11436,"threads_started":1}]]}
I20260810 11:30:40.779062 26578 master_service.cc:946] ReplaceTablet: received request to replace tablet 7cd4f555b5d840c182a31b3c94da9619 from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:40.766664 28728 raft_consensus.cc:504] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.786281 28728 leader_election.cc:288] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.795303 26581 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 136) took 1592 ms. Trace:
I20260810 11:30:40.795624 26581 rpcz_store.cc:276] 0810 11:30:39.202420 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.674414 (+1471994us) service_pool.cc:227] Handling call
0810 11:30:40.733836 (+ 59422us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa45313 00007f9c61d37466 00007f9c61d37195 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:40.776264 (+ 42428us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:40.776842 (+ 578us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:40.794916 (+ 18074us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:40.795045 (+ 129us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:40.795192 (+ 147us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.778699 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.778838 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.778846 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:40.778848 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:40.778999 (+ 151us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.779047 (+ 48us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.779053 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:40.779148 (+ 95us) tablet.cc:699] Row locks acquired
0810 11:30:40.779151 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:40.779193 (+ 42us) write_op.cc:270] Start()
0810 11:30:40.779236 (+ 43us) write_op.cc:276] Timestamp: P: 1786361440779144 usec, L: 0
0810 11:30:40.779239 (+ 3us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.779505 (+ 266us) log.cc:842] Serialized 433 byte log entry
0810 11:30:40.783271 (+ 3766us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.786759 (+ 3488us) write_op.cc:301] APPLY: starting
0810 11:30:40.786776 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.786822 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.786847 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.786958 (+ 111us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.786994 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:40.787001 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:40.787139 (+ 138us) log.cc:842] Serialized 29 byte log entry
0810 11:30:40.787210 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.787231 (+ 21us) write_op.cc:454] Released schema lock
0810 11:30:40.787238 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.787297 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.787300 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":129915136,"child_traces":[["op",{"apply.queue_time_us":3440,"apply.run_cpu_time_us":596,"apply.run_wall_time_us":595,"num_ops":2,"prepare.queue_time_us":1149,"prepare.run_cpu_time_us":942,"prepare.run_wall_time_us":942,"raft.queue_time_us":118,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":223,"replication_time_us":3995}]]}
I20260810 11:30:40.798594 26581 master_service.cc:946] ReplaceTablet: received request to replace tablet f7ada1df82eb44ecb9a6c615b5410e6f from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:40.799266 26581 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 140) took 1138 ms. Trace:
I20260810 11:30:40.799599 26581 rpcz_store.cc:276] 0810 11:30:39.661061 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.798397 (+1137336us) service_pool.cc:227] Handling call
0810 11:30:40.799165 (+ 768us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260810 11:30:40.802560 26700 consensus_peers.cc:487] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 420ba6e9f74c4ae5bf450f369e7fbdb3. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:40.816817 27222 consensus_queue.cc:260] T 7d3406f12d9c492cbd0d86fa7a57de82 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.822330 27222 ts_tablet_manager.cc:1428] T 7d3406f12d9c492cbd0d86fa7a57de82 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.073s user 0.003s sys 0.000s
I20260810 11:30:40.822718 27222 tablet_bootstrap.cc:492] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:40.785439 27228 tablet_bootstrap.cc:654] T 7e78fb1bf0534deca5cc5a603fd77592 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.784085 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db59523b71224370bf5fce6b56592f71" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:40.837240 26700 leader_election.cc:341] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.788071 27999 ts_tablet_manager.cc:1918] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:40.838716 27999 log.cc:1196] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/10210204d5ff4e5e97c98fd255f674a5
I20260810 11:30:40.839413 27999 ts_tablet_manager.cc:1939] T 10210204d5ff4e5e97c98fd255f674a5 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:40.840363 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 176) took 8089 ms. Trace:
I20260810 11:30:40.840526 27999 rpcz_store.cc:276] 0810 11:30:32.750810 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.750927 (+ 117us) service_pool.cc:227] Handling call
0810 11:30:40.757878 (+8006951us) ts_tablet_manager.cc:1145] Deleting tablet 10210204d5ff4e5e97c98fd255f674a5
0810 11:30:40.757890 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.777664 (+ 19774us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.787898 (+ 10234us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.840262 (+ 52364us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8006449}
I20260810 11:30:40.840926 27222 tablet_bootstrap.cc:654] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.841084 27999 tablet_replica.cc:330] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:40.775218 28921 raft_consensus.cc:504] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.785147 28345 raft_consensus.cc:482] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.842244 27999 raft_consensus.cc:2229] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:40.842137 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 10210204d5ff4e5e97c98fd255f674a5 (table default.Table_4d9bc84fc41e4b87ac2f6432852e5d61 [id=9b708c86ff534253961e7c29909eb1bd]) successfully deleted
I20260810 11:30:40.842602 27999 raft_consensus.cc:2258] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:40.846302 26991 leader_election.cc:341] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.846361 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db59523b71224370bf5fce6b56592f71" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:40.846793 27057 raft_consensus.cc:3037] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.846884 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3079a68c1c74b64bf13877bd0ee68c3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:40.847512 27999 ts_tablet_manager.cc:1905] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:40.847463 28345 raft_consensus.cc:504] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.848255 28345 leader_election.cc:288] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.846588 26991 leader_election.cc:302] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.849735 28845 raft_consensus.cc:2726] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:40.851312 27291 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_feb78e30519943298329752c4fd77a59 [id=5c8a2cbef71f4c9fb038a49e1ca7f704], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet c62ae41d2dd74eedbe252c4de70fbe1e consensus state has no leader
W20260810 11:30:40.851583 26849 leader_election.cc:341] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.852051 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adecd2f0952b4f4c83919c78d563e429" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:40.854789 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adecd2f0952b4f4c83919c78d563e429" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:40.855633 27999 ts_tablet_manager.cc:1918] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:40.851006 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:40.857575 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:40.858541 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:40.859282 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:40.859819 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:40.860311 26575 catalog_manager.cc:5495] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:40.861933 26575 catalog_manager.cc:5495] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:40.862721 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:40.863327 26575 catalog_manager.cc:5495] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:40.863927 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
W20260810 11:30:40.863965 26849 leader_election.cc:341] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.864636 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:40.865885 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:40.866358 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:40.866722 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:40.867597 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:40.867980 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:40.868898 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:40.869206 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet ce73798a721b4a6d892f0c24b6b40e2c (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]). Expected version 1 got 0
I20260810 11:30:40.869581 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:40.869776 27222 tablet_bootstrap.cc:492] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:40.869920 27222 ts_tablet_manager.cc:1397] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.002s
I20260810 11:30:40.870378 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 2 got 0
I20260810 11:30:40.871075 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:40.871074 27222 raft_consensus.cc:348] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.871304 27222 raft_consensus.cc:374] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:40.871364 27222 raft_consensus.cc:729] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:40.871496 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:40.871625 27222 consensus_queue.cc:260] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.872148 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:40.873725 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:40.874234 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:40.874756 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:40.875465 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:40.875835 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:40.876163 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_5ba00bd0ab7d4cdcb1494f9491c64291 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 2 got 0
I20260810 11:30:40.876821 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:40.877156 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:40.877671 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:40.878103 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:40.878614 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:40.878965 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:40.879632 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:40.879808 27222 ts_tablet_manager.cc:1428] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260810 11:30:40.880265 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:40.880764 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:40.881162 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:40.881521 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:40.882218 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:40.883347 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d4873fe8318040a2b7e021708a875f43 (table default.Table_065fc82a2823470b89b4cff36ca03027 [id=60ce1267de814f218c27ac084a08a26a]). Expected version 1 got 0
I20260810 11:30:40.883433 28640 raft_consensus.cc:482] T 9e329b95fc8e41c3967079896294942a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.883570 28640 raft_consensus.cc:504] T 9e329b95fc8e41c3967079896294942a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.884225 28640 leader_election.cc:288] T 9e329b95fc8e41c3967079896294942a P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.892288 28898 raft_consensus.cc:482] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 443ec871f1ed4232b932ecfb0b18510d)
I20260810 11:30:40.898909 27060 raft_consensus.cc:2454] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
W20260810 11:30:40.898839 26991 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 80807.6us
W20260810 11:30:40.901866 28912 log.cc:924] Time spent T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215: Append to log took a long time: real 0.079s user 0.000s sys 0.000s
I20260810 11:30:40.904114 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e329b95fc8e41c3967079896294942a" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:40.904750 28898 raft_consensus.cc:504] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.905495 28898 leader_election.cc:288] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:40.906183 28940 tablet.cc:1722] T c62ae41d2dd74eedbe252c4de70fbe1e P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:40.910184 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3079a68c1c74b64bf13877bd0ee68c3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:40.910652 26576 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 0cc17c55109b47eeb91920c3ed8178e0
I20260810 11:30:40.910920 27055 raft_consensus.cc:3037] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.911314 26576 catalog_manager.cc:6565] ReplaceTablet: tablet 0cc17c55109b47eeb91920c3ed8178e0 deleted and replaced by tablet 6179cb2be2c442ee97161fe1f4661b64
I20260810 11:30:40.911535 26576 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 138) took 1582 ms. Trace:
I20260810 11:30:40.911644 26576 rpcz_store.cc:276] 0810 11:30:39.328748 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.764358 (+1435610us) service_pool.cc:227] Handling call
0810 11:30:40.911419 (+147061us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.902414 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.902565 (+ 151us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.902573 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:40.902576 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:40.902735 (+ 159us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.902753 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.902758 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:40.902861 (+ 103us) tablet.cc:699] Row locks acquired
0810 11:30:40.902863 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:40.902916 (+ 53us) write_op.cc:270] Start()
0810 11:30:40.902962 (+ 46us) write_op.cc:276] Timestamp: P: 1786361440902896 usec, L: 0
0810 11:30:40.902966 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.903370 (+ 404us) log.cc:842] Serialized 631 byte log entry
0810 11:30:40.908336 (+ 4966us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.908492 (+ 156us) write_op.cc:301] APPLY: starting
0810 11:30:40.908510 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.908599 (+ 89us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.908631 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.908822 (+ 191us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.908940 (+ 118us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:40.908950 (+ 10us) write_op.cc:312] APPLY: finished
0810 11:30:40.909047 (+ 97us) log.cc:842] Serialized 29 byte log entry
0810 11:30:40.909155 (+ 108us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.909177 (+ 22us) write_op.cc:454] Released schema lock
0810 11:30:40.909185 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.909243 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.909246 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":102,"apply.run_cpu_time_us":814,"apply.run_wall_time_us":814,"num_ops":2,"prepare.queue_time_us":85,"prepare.run_cpu_time_us":1134,"prepare.run_wall_time_us":1135,"raft.queue_time_us":225,"raft.run_cpu_time_us":560,"raft.run_wall_time_us":559,"replication_time_us":5341}]]}
I20260810 11:30:40.913203 27999 log.cc:1196] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/f7ada1df82eb44ecb9a6c615b5410e6f
I20260810 11:30:40.913827 26576 master_service.cc:946] ReplaceTablet: received request to replace tablet 55c8749861874eca9b63d3db97afa2b1 from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:40.915257 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e329b95fc8e41c3967079896294942a" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:40.916745 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cc17c55109b47eeb91920c3ed8178e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6179cb2be2c442ee97161fe1f4661b64) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:40.918578 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cc17c55109b47eeb91920c3ed8178e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6179cb2be2c442ee97161fe1f4661b64) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:40.919333 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 0cc17c55109b47eeb91920c3ed8178e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0cc17c55109b47eeb91920c3ed8178e0 already in progress: creating tablet
I20260810 11:30:40.920123 26848 leader_election.cc:302] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:40.925006 27057 raft_consensus.cc:2454] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:40.925681 26576 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 141) took 1226 ms. Trace:
I20260810 11:30:40.925773 26702 leader_election.cc:302] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.926092 26576 rpcz_store.cc:276] 0810 11:30:39.699455 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.913629 (+1214174us) service_pool.cc:227] Handling call
0810 11:30:40.925455 (+ 11826us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:40.926251 28728 raft_consensus.cc:2781] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:40.926368 28728 raft_consensus.cc:686] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:40.926627 28728 consensus_queue.cc:237] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.926880 28939 tablet.cc:1722] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:40.927852 26576 master_service.cc:946] ReplaceTablet: received request to replace tablet b121c13e9241468aa224e17093eb38f4 from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:40.929091 26700 leader_election.cc:302] T 9e329b95fc8e41c3967079896294942a P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.930383 28727 raft_consensus.cc:2726] T 9e329b95fc8e41c3967079896294942a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:40.935369 28727 raft_consensus.cc:482] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.935557 28727 raft_consensus.cc:504] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.936331 28727 leader_election.cc:288] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:40.936828 26564 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 77ffda3325af4096bbec689397f7a324 consensus state has no leader
I20260810 11:30:40.940196 26578 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 7cd4f555b5d840c182a31b3c94da9619
I20260810 11:30:40.940871 26578 catalog_manager.cc:6565] ReplaceTablet: tablet 7cd4f555b5d840c182a31b3c94da9619 deleted and replaced by tablet 7161d94d80b24eeaa357cc0922a874af
I20260810 11:30:40.941033 26578 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 139) took 1404 ms. Trace:
I20260810 11:30:40.941550 28345 raft_consensus.cc:2781] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:40.941799 28345 raft_consensus.cc:482] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:40.941262 26578 rpcz_store.cc:276] 0810 11:30:39.536368 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.778871 (+1242503us) service_pool.cc:227] Handling call
0810 11:30:40.782577 (+ 3706us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa51527 00007f9c61d43da7 00007f9c61d43ad5 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:40.940973 (+158396us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.932247 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.932372 (+ 125us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.932380 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:40.932382 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:40.932506 (+ 124us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.932523 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.932544 (+ 21us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:40.932715 (+ 171us) tablet.cc:699] Row locks acquired
0810 11:30:40.932718 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:40.932762 (+ 44us) write_op.cc:270] Start()
0810 11:30:40.932799 (+ 37us) write_op.cc:276] Timestamp: P: 1786361440932741 usec, L: 0
0810 11:30:40.932803 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.933028 (+ 225us) log.cc:842] Serialized 665 byte log entry
0810 11:30:40.939009 (+ 5981us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.939168 (+ 159us) write_op.cc:301] APPLY: starting
0810 11:30:40.939188 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.939238 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.939312 (+ 74us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.939430 (+ 118us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.939494 (+ 64us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:40.939503 (+ 9us) write_op.cc:312] APPLY: finished
0810 11:30:40.939610 (+ 107us) log.cc:842] Serialized 29 byte log entry
0810 11:30:40.939691 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.939714 (+ 23us) write_op.cc:454] Released schema lock
0810 11:30:40.939721 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.939783 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.939786 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":7149824,"child_traces":[["op",{"apply.queue_time_us":106,"apply.run_cpu_time_us":675,"apply.run_wall_time_us":675,"num_ops":2,"prepare.queue_time_us":173,"prepare.run_cpu_time_us":899,"prepare.run_wall_time_us":900,"raft.queue_time_us":1095,"raft.run_cpu_time_us":402,"raft.run_wall_time_us":403,"replication_time_us":6177}]]}
I20260810 11:30:40.942302 26578 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_a406a8172095498abc9c54697f00f4a0" } new_table_name: "default.Table_6ebb0ef24ef8473d8a0373a7c128de51" modify_external_catalogs: true
I20260810 11:30:40.943051 28345 raft_consensus.cc:3037] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:40.944713 26993 leader_election.cc:341] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: ff9b649e43a9456fa51cf3330290bb91
I20260810 11:30:40.947012 28345 raft_consensus.cc:504] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.947674 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cc17c55109b47eeb91920c3ed8178e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6179cb2be2c442ee97161fe1f4661b64) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:40.948832 27231 tablet_bootstrap.cc:654] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.949695 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cd4f555b5d840c182a31b3c94da9619 with delete_type TABLET_DATA_DELETED (replaced by tablet 7161d94d80b24eeaa357cc0922a874af) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:40.949957 28921 leader_election.cc:288] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.949712 27999 ts_tablet_manager.cc:1939] T f7ada1df82eb44ecb9a6c615b5410e6f P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:40.951502 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cd4f555b5d840c182a31b3c94da9619 with delete_type TABLET_DATA_DELETED (replaced by tablet 7161d94d80b24eeaa357cc0922a874af) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:40.952335 26991 leader_election.cc:341] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: ff9b649e43a9456fa51cf3330290bb91
I20260810 11:30:40.952723 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cd4f555b5d840c182a31b3c94da9619 with delete_type TABLET_DATA_DELETED (replaced by tablet 7161d94d80b24eeaa357cc0922a874af) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:40.953636 28845 raft_consensus.cc:482] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:40.953863 28845 raft_consensus.cc:504] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.954312 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "271a0607ec28441c91bac32c2f2bf44b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:40.954816 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adecd2f0952b4f4c83919c78d563e429" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:40.955179 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "271a0607ec28441c91bac32c2f2bf44b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:40.955245 28939 tablet.cc:1722] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:40.955523 26916 raft_consensus.cc:2454] T 271a0607ec28441c91bac32c2f2bf44b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:40.955873 28845 leader_election.cc:288] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:40.955256 28794 tablet_replica.cc:330] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:40.955768 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e31b380f99854eb8b63e1f9eede1fc7c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:40.956102 26700 leader_election.cc:302] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:40.958614 27222 tablet_bootstrap.cc:492] T 760aeada57464892ae3b9013a761c509 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:40.960311 28940 tablet.cc:1722] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:40.961227 27222 tablet_bootstrap.cc:654] T 760aeada57464892ae3b9013a761c509 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:40.961717 28727 raft_consensus.cc:2781] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:40.961827 28727 raft_consensus.cc:482] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:40.961920 28727 raft_consensus.cc:3037] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.963407 27974 tablet_replica.cc:330] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:40.963655 27974 raft_consensus.cc:2229] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:40.963882 27974 raft_consensus.cc:2258] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:40.965025 27974 ts_tablet_manager.cc:1905] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:40.967245 28727 raft_consensus.cc:504] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.968014 26576 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet b121c13e9241468aa224e17093eb38f4
I20260810 11:30:40.968429 28727 leader_election.cc:288] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:40.970163 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 0cc17c55109b47eeb91920c3ed8178e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0cc17c55109b47eeb91920c3ed8178e0 already in progress: creating tablet
I20260810 11:30:40.970683 26576 catalog_manager.cc:6565] ReplaceTablet: tablet b121c13e9241468aa224e17093eb38f4 deleted and replaced by tablet 3b607279006c4baeae79325926088014
I20260810 11:30:40.970763 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet b121c13e9241468aa224e17093eb38f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b607279006c4baeae79325926088014) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:40.970917 26576 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 142) took 1213 ms. Trace:
I20260810 11:30:40.971066 26576 rpcz_store.cc:276] 0810 11:30:39.757030 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.927689 (+1170659us) service_pool.cc:227] Handling call
0810 11:30:40.970790 (+ 43101us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.933631 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.933823 (+ 192us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.933831 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:40.933834 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:40.933996 (+ 162us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.934010 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.934016 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:40.934108 (+ 92us) tablet.cc:699] Row locks acquired
0810 11:30:40.934111 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:40.934157 (+ 46us) write_op.cc:270] Start()
0810 11:30:40.934196 (+ 39us) write_op.cc:276] Timestamp: P: 1786361440934132 usec, L: 0
0810 11:30:40.934200 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.934431 (+ 231us) log.cc:842] Serialized 631 byte log entry
0810 11:30:40.954162 (+ 19731us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.954340 (+ 178us) write_op.cc:301] APPLY: starting
0810 11:30:40.954360 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.954427 (+ 67us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.954466 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.954651 (+ 185us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.954746 (+ 95us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:40.954754 (+ 8us) write_op.cc:312] APPLY: finished
0810 11:30:40.954871 (+ 117us) log.cc:842] Serialized 29 byte log entry
0810 11:30:40.954949 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.954974 (+ 25us) write_op.cc:454] Released schema lock
0810 11:30:40.954985 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.955071 (+ 86us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.955076 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1608,"child_traces":[["op",{"apply.queue_time_us":123,"apply.run_cpu_time_us":800,"apply.run_wall_time_us":800,"num_ops":2,"prepare.queue_time_us":71,"prepare.run_cpu_time_us":918,"prepare.run_wall_time_us":917,"raft.queue_time_us":354,"raft.run_cpu_time_us":8,"raft.run_wall_time_us":9,"replication_time_us":19931}]]}
I20260810 11:30:40.972011 26576 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_57b6151125a144fcb6230ee986bff7ee" } new_table_name: "default.Table_a164cd4bbc4344ae905f395ab1e6cffb" modify_external_catalogs: true
I20260810 11:30:40.972546 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet b121c13e9241468aa224e17093eb38f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b607279006c4baeae79325926088014) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:40.972841 26849 leader_election.cc:341] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.972644 28345 leader_election.cc:288] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:40.973914 27974 ts_tablet_manager.cc:1918] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:40.974108 27974 log.cc:1196] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/7cd4f555b5d840c182a31b3c94da9619
I20260810 11:30:40.974500 27974 ts_tablet_manager.cc:1939] T 7cd4f555b5d840c182a31b3c94da9619 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:40.975675 28794 raft_consensus.cc:2229] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:40.975675 26993 leader_election.cc:341] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:40.976723 26991 leader_election.cc:302] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
W20260810 11:30:40.977151 26991 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 52255.9us
I20260810 11:30:40.978127 28794 raft_consensus.cc:2258] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:40.978258 28845 raft_consensus.cc:2726] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:40.979166 28794 ts_tablet_manager.cc:1905] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:40.981179 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adecd2f0952b4f4c83919c78d563e429" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:40.975700 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 7cd4f555b5d840c182a31b3c94da9619 (table default.Table_061b7dfbcc074ad6a0d99d49113a354f [id=0186ddbf3c144b4e86ae21cbdac555d2]) successfully deleted
I20260810 11:30:40.982400 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "271a0607ec28441c91bac32c2f2bf44b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:40.983304 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet b121c13e9241468aa224e17093eb38f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b607279006c4baeae79325926088014) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:40.984372 28640 consensus_queue.cc:1035] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:40.985374 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "271a0607ec28441c91bac32c2f2bf44b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:40.985656 26916 raft_consensus.cc:3037] T 271a0607ec28441c91bac32c2f2bf44b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.986222 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e31b380f99854eb8b63e1f9eede1fc7c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:40.986534 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 177) took 8193 ms. Trace:
I20260810 11:30:40.986670 27999 rpcz_store.cc:276] 0810 11:30:32.780336 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.780450 (+ 114us) service_pool.cc:227] Handling call
0810 11:30:40.840945 (+8060495us) ts_tablet_manager.cc:1145] Deleting tablet f7ada1df82eb44ecb9a6c615b5410e6f
0810 11:30:40.840957 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.851298 (+ 10341us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.855487 (+ 4189us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:40.973418 (+117931us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8058794}
I20260810 11:30:40.987219 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 178) took 8176 ms. Trace:
I20260810 11:30:40.961882 27055 raft_consensus.cc:2454] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:40.987779 27057 raft_consensus.cc:3037] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:40.987998 27999 rpcz_store.cc:276] 0810 11:30:32.811390 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.811545 (+ 155us) service_pool.cc:227] Handling call
0810 11:30:40.986961 (+8175416us) ts_tablet_manager.cc:1145] Deleting tablet 725d2e70e1d441b497d56a278e1de0ad
0810 11:30:40.986974 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:40.987040 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8174412}
I20260810 11:30:40.988603 27999 tablet_replica.cc:330] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700: stopping tablet replica
W20260810 11:30:40.988790 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet b121c13e9241468aa224e17093eb38f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b121c13e9241468aa224e17093eb38f4 already in progress: creating tablet
I20260810 11:30:40.988874 27999 raft_consensus.cc:2229] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:40.989230 27999 raft_consensus.cc:2258] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:40.990078 26848 leader_election.cc:302] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:40.992551 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet f7ada1df82eb44ecb9a6c615b5410e6f (table default.Table_635ef5268ea1426bb6578ba498e616e3 [id=fef997439a4346d2a9c6f2a4277ede5a]) successfully deleted
W20260810 11:30:40.992997 26991 leader_election.cc:341] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:40.993170 27286 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 725d2e70e1d441b497d56a278e1de0ad because the tablet was not found. No further retry: Not found: Tablet not found: 725d2e70e1d441b497d56a278e1de0ad
I20260810 11:30:40.993263 26991 leader_election.cc:302] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:40.995051 28898 raft_consensus.cc:2726] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:41.000874 28921 raft_consensus.cc:2781] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:41.001365 28921 raft_consensus.cc:686] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:41.001938 28921 consensus_queue.cc:237] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.006945 26916 raft_consensus.cc:2454] T 271a0607ec28441c91bac32c2f2bf44b P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:41.007565 26700 leader_election.cc:302] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:41.008939 28728 raft_consensus.cc:2781] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:41.009332 28728 raft_consensus.cc:686] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:41.009737 28944 tablet.cc:1722] T c62ae41d2dd74eedbe252c4de70fbe1e P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:41.009753 28728 consensus_queue.cc:237] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:40.985553 27061 raft_consensus.cc:2454] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:41.014089 27222 tablet_bootstrap.cc:492] T 760aeada57464892ae3b9013a761c509 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:41.014307 27222 ts_tablet_manager.cc:1397] T 760aeada57464892ae3b9013a761c509 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.126s user 0.005s sys 0.000s
I20260810 11:30:41.015605 27222 raft_consensus.cc:348] T 760aeada57464892ae3b9013a761c509 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.015974 27222 raft_consensus.cc:374] T 760aeada57464892ae3b9013a761c509 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.017331 27999 ts_tablet_manager.cc:1905] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:41.018064 28727 consensus_queue.cc:1035] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:41.022555 27057 raft_consensus.cc:2454] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:41.024111 26848 leader_election.cc:302] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:41.025260 28935 raft_consensus.cc:2781] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:41.025431 28935 raft_consensus.cc:686] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:41.033051 27228 tablet_bootstrap.cc:492] T 7e78fb1bf0534deca5cc5a603fd77592 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:41.042905 27228 ts_tablet_manager.cc:1397] T 7e78fb1bf0534deca5cc5a603fd77592 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.266s user 0.017s sys 0.028s
I20260810 11:30:41.044020 27228 raft_consensus.cc:348] T 7e78fb1bf0534deca5cc5a603fd77592 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.044608 27228 raft_consensus.cc:374] T 7e78fb1bf0534deca5cc5a603fd77592 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.044724 27228 raft_consensus.cc:729] T 7e78fb1bf0534deca5cc5a603fd77592 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.045027 27228 consensus_queue.cc:260] T 7e78fb1bf0534deca5cc5a603fd77592 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.045679 27228 ts_tablet_manager.cc:1428] T 7e78fb1bf0534deca5cc5a603fd77592 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:41.047091 27228 tablet_bootstrap.cc:492] T 0d7a07e844984b88ab81610cb95bf21e P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
W20260810 11:30:41.057072 26700 consensus_peers.cc:487] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7ff5b980ce4e41d7a6e1ca0e740b739c. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:41.057284 26700 consensus_peers.cc:487] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 10210204d5ff4e5e97c98fd255f674a5. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:41.057420 28794 ts_tablet_manager.cc:1918] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:41.057585 28794 log.cc:1196] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/7cd4f555b5d840c182a31b3c94da9619
I20260810 11:30:41.057670 28345 raft_consensus.cc:482] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:41.032781 28935 consensus_queue.cc:237] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.058665 28345 raft_consensus.cc:504] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } }
I20260810 11:30:41.059341 28345 leader_election.cc:288] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:41.061934 27228 tablet_bootstrap.cc:654] T 0d7a07e844984b88ab81610cb95bf21e P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:41.068190 26849 leader_election.cc:341] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 6c715bdcff8c4cdabfddf871f6fdc388
I20260810 11:30:41.070080 28942 tablet.cc:1722] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:41.074664 28794 ts_tablet_manager.cc:1939] T 7cd4f555b5d840c182a31b3c94da9619 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
W20260810 11:30:41.076496 26848 leader_election.cc:341] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 6c715bdcff8c4cdabfddf871f6fdc388
I20260810 11:30:41.076690 26848 leader_election.cc:302] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:41.077363 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 7cd4f555b5d840c182a31b3c94da9619 (table default.Table_061b7dfbcc074ad6a0d99d49113a354f [id=0186ddbf3c144b4e86ae21cbdac555d2]) successfully deleted
I20260810 11:30:41.077433 28935 raft_consensus.cc:2726] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 11:30:41.077692 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet b121c13e9241468aa224e17093eb38f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b121c13e9241468aa224e17093eb38f4 already in progress: creating tablet
I20260810 11:30:41.097291 27231 tablet_bootstrap.cc:492] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:41.113210 26894 tablet_service.cc:1467] Processing CreateTablet for tablet defabb4b90254649b5bc7927e146919a (DEFAULT_TABLE table=default.Table_bbe7d79474674b2e9278c0c784af6b38 [id=372b5f7e9bf5459d88203ec33a5bb2db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.113788 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet defabb4b90254649b5bc7927e146919a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.117311 27228 tablet_bootstrap.cc:492] T 0d7a07e844984b88ab81610cb95bf21e P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:41.117468 27228 ts_tablet_manager.cc:1397] T 0d7a07e844984b88ab81610cb95bf21e P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.072s user 0.008s sys 0.011s
I20260810 11:30:41.118249 27228 raft_consensus.cc:348] T 0d7a07e844984b88ab81610cb95bf21e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.121527 27228 raft_consensus.cc:374] T 0d7a07e844984b88ab81610cb95bf21e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.121608 27228 raft_consensus.cc:729] T 0d7a07e844984b88ab81610cb95bf21e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.121806 27228 consensus_queue.cc:260] T 0d7a07e844984b88ab81610cb95bf21e P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.122329 27228 ts_tablet_manager.cc:1428] T 0d7a07e844984b88ab81610cb95bf21e P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 11:30:41.122627 27228 tablet_bootstrap.cc:492] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:41.124236 27228 tablet_bootstrap.cc:654] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.124483 26915 raft_consensus.cc:3037] T 7e78fb1bf0534deca5cc5a603fd77592 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:41.124967 26895 tablet_service.cc:1467] Processing CreateTablet for tablet a334388a69eb45c79adc286143a557e7 (DEFAULT_TABLE table=default.Table_c0597a7b9458401f970d2bf9a1af8e66 [id=9d0f0526f1e9470686d3e1b80ba24c85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.125722 26885 tablet_service.cc:1467] Processing CreateTablet for tablet d08250001e1542f9978bc6f89ace458b (DEFAULT_TABLE table=default.Table_a13a99674b70411d87a2aaef8b003753 [id=647eb327f55c40d995f55e6918dd2e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.129164 28728 consensus_queue.cc:1035] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:41.118695 27021 tablet_service.cc:1467] Processing CreateTablet for tablet defabb4b90254649b5bc7927e146919a (DEFAULT_TABLE table=default.Table_bbe7d79474674b2e9278c0c784af6b38 [id=372b5f7e9bf5459d88203ec33a5bb2db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.129818 27231 ts_tablet_manager.cc:1397] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.367s user 0.008s sys 0.012s
I20260810 11:30:41.130160 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet defabb4b90254649b5bc7927e146919a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.130652 26741 tablet_service.cc:1467] Processing CreateTablet for tablet defabb4b90254649b5bc7927e146919a (DEFAULT_TABLE table=default.Table_bbe7d79474674b2e9278c0c784af6b38 [id=372b5f7e9bf5459d88203ec33a5bb2db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.130686 27231 raft_consensus.cc:348] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.130892 27231 raft_consensus.cc:374] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.130949 27231 raft_consensus.cc:729] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.131102 26741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet defabb4b90254649b5bc7927e146919a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.119848 27037 tablet_service.cc:1467] Processing CreateTablet for tablet a334388a69eb45c79adc286143a557e7 (DEFAULT_TABLE table=default.Table_c0597a7b9458401f970d2bf9a1af8e66 [id=9d0f0526f1e9470686d3e1b80ba24c85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.132894 26744 tablet_service.cc:1467] Processing CreateTablet for tablet a334388a69eb45c79adc286143a557e7 (DEFAULT_TABLE table=default.Table_c0597a7b9458401f970d2bf9a1af8e66 [id=9d0f0526f1e9470686d3e1b80ba24c85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.133248 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a334388a69eb45c79adc286143a557e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.134131 27231 consensus_queue.cc:260] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.120949 27028 tablet_service.cc:1467] Processing CreateTablet for tablet d08250001e1542f9978bc6f89ace458b (DEFAULT_TABLE table=default.Table_a13a99674b70411d87a2aaef8b003753 [id=647eb327f55c40d995f55e6918dd2e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.135552 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d08250001e1542f9978bc6f89ace458b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.136897 26743 tablet_service.cc:1467] Processing CreateTablet for tablet d08250001e1542f9978bc6f89ace458b (DEFAULT_TABLE table=default.Table_a13a99674b70411d87a2aaef8b003753 [id=647eb327f55c40d995f55e6918dd2e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.137331 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d08250001e1542f9978bc6f89ace458b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:41.143982 26993 consensus_peers.cc:487] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:41.145924 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a334388a69eb45c79adc286143a557e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.148727 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d08250001e1542f9978bc6f89ace458b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.152658 27231 ts_tablet_manager.cc:1428] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.023s user 0.002s sys 0.001s
I20260810 11:30:41.152864 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a334388a69eb45c79adc286143a557e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.160236 27222 raft_consensus.cc:729] T 760aeada57464892ae3b9013a761c509 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.160544 27222 consensus_queue.cc:260] T 760aeada57464892ae3b9013a761c509 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.173998 26886 tablet_service.cc:1467] Processing CreateTablet for tablet ee32c25fa9fc465dbeb0e9e99bc12b51 (DEFAULT_TABLE table=default.Table_db828c7c4cb04bcb9fa47bbe1240e3c9 [id=1009f3473ebd468cb99dfada790fd8d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.174661 26741 tablet_service.cc:1467] Processing CreateTablet for tablet ee32c25fa9fc465dbeb0e9e99bc12b51 (DEFAULT_TABLE table=default.Table_db828c7c4cb04bcb9fa47bbe1240e3c9 [id=1009f3473ebd468cb99dfada790fd8d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.175124 26741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee32c25fa9fc465dbeb0e9e99bc12b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.175922 27021 tablet_service.cc:1467] Processing CreateTablet for tablet ee32c25fa9fc465dbeb0e9e99bc12b51 (DEFAULT_TABLE table=default.Table_db828c7c4cb04bcb9fa47bbe1240e3c9 [id=1009f3473ebd468cb99dfada790fd8d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.177336 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 4827800160e64883ba7bcadafeb13ead (DEFAULT_TABLE table=default.Table_37ba5cf5063749fbb2b8f0c05d4b73a3 [id=ef80fceff09e40169c2b894a63c57afc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.178243 26744 tablet_service.cc:1467] Processing CreateTablet for tablet b6cefa1130e74a4b95a5ea35125a4a41 (DEFAULT_TABLE table=default.Table_48311485d3814f7db3e63b8c24b89237 [id=118e5d8adf9d4ddc8b4adb3e61bd0f1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.178515 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee32c25fa9fc465dbeb0e9e99bc12b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.178709 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6cefa1130e74a4b95a5ea35125a4a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.179005 27037 tablet_service.cc:1467] Processing CreateTablet for tablet b6cefa1130e74a4b95a5ea35125a4a41 (DEFAULT_TABLE table=default.Table_48311485d3814f7db3e63b8c24b89237 [id=118e5d8adf9d4ddc8b4adb3e61bd0f1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.180029 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6cefa1130e74a4b95a5ea35125a4a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.180081 26732 tablet_service.cc:1467] Processing CreateTablet for tablet d50a8bdb17fa4332b288d03658c6b9c2 (DEFAULT_TABLE table=default.Table_bd5713e68e4a473a9fc231c709826f99 [id=8346a2ee684b4a269c682ccc63b695e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.180601 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d50a8bdb17fa4332b288d03658c6b9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.181228 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4827800160e64883ba7bcadafeb13ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.182663 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:41.183405 27231 tablet_bootstrap.cc:492] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:41.184427 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee32c25fa9fc465dbeb0e9e99bc12b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.185519 27231 tablet_bootstrap.cc:654] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.187740 27039 tablet_service.cc:1467] Processing CreateTablet for tablet d50a8bdb17fa4332b288d03658c6b9c2 (DEFAULT_TABLE table=default.Table_bd5713e68e4a473a9fc231c709826f99 [id=8346a2ee684b4a269c682ccc63b695e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.188180 27039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d50a8bdb17fa4332b288d03658c6b9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.188882 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 4827800160e64883ba7bcadafeb13ead (DEFAULT_TABLE table=default.Table_37ba5cf5063749fbb2b8f0c05d4b73a3 [id=ef80fceff09e40169c2b894a63c57afc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.189280 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4827800160e64883ba7bcadafeb13ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.207378 27222 ts_tablet_manager.cc:1428] T 760aeada57464892ae3b9013a761c509 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.193s user 0.028s sys 0.000s
I20260810 11:30:41.207779 27222 tablet_bootstrap.cc:492] T d24726d0214947beab0bb31b1597c1c3 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:41.209348 26894 tablet_service.cc:1467] Processing CreateTablet for tablet b6cefa1130e74a4b95a5ea35125a4a41 (DEFAULT_TABLE table=default.Table_48311485d3814f7db3e63b8c24b89237 [id=118e5d8adf9d4ddc8b4adb3e61bd0f1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.209669 27222 tablet_bootstrap.cc:654] T d24726d0214947beab0bb31b1597c1c3 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.209981 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6cefa1130e74a4b95a5ea35125a4a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.210142 26893 tablet_service.cc:1467] Processing CreateTablet for tablet d50a8bdb17fa4332b288d03658c6b9c2 (DEFAULT_TABLE table=default.Table_bd5713e68e4a473a9fc231c709826f99 [id=8346a2ee684b4a269c682ccc63b695e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.210371 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:41.210489 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d50a8bdb17fa4332b288d03658c6b9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.210667 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:41.214658 26741 tablet_service.cc:1467] Processing CreateTablet for tablet 0daaeebbcf2e41a4a8dab1bb0f174ac4 (DEFAULT_TABLE table=default.Table_37b7273d0a2a489c8ec902a8dac17bc5 [id=9368b3fb49af46cca9fdfb492dd7afdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.211035 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:41.216048 26771 raft_consensus.cc:3037] T 9e329b95fc8e41c3967079896294942a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:41.217345 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 0daaeebbcf2e41a4a8dab1bb0f174ac4 (DEFAULT_TABLE table=default.Table_37b7273d0a2a489c8ec902a8dac17bc5 [id=9368b3fb49af46cca9fdfb492dd7afdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.217805 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0daaeebbcf2e41a4a8dab1bb0f174ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.216015 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:41.222721 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:41.226312 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:41.194767 28345 consensus_queue.cc:1035] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260810 11:30:41.229277 27039 tablet_service.cc:1467] Processing CreateTablet for tablet 0daaeebbcf2e41a4a8dab1bb0f174ac4 (DEFAULT_TABLE table=default.Table_37b7273d0a2a489c8ec902a8dac17bc5 [id=9368b3fb49af46cca9fdfb492dd7afdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.231295 27039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0daaeebbcf2e41a4a8dab1bb0f174ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.243921 27999 ts_tablet_manager.cc:1918] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:41.244109 27999 log.cc:1196] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/318d5b8453fe4c438d0fa32cb91c409e
I20260810 11:30:41.245203 26741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0daaeebbcf2e41a4a8dab1bb0f174ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.245383 26963 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
W20260810 11:30:41.250622 26991 consensus_peers.cc:487] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55c8749861874eca9b63d3db97afa2b1. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:41.253463 27231 tablet_bootstrap.cc:492] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:41.253618 27231 ts_tablet_manager.cc:1397] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.070s user 0.001s sys 0.002s
I20260810 11:30:41.254402 27222 tablet_bootstrap.cc:492] T d24726d0214947beab0bb31b1597c1c3 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:41.254462 27231 raft_consensus.cc:348] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.254688 27231 raft_consensus.cc:374] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.254745 27231 raft_consensus.cc:729] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.254976 27231 consensus_queue.cc:260] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.255656 27222 ts_tablet_manager.cc:1397] T d24726d0214947beab0bb31b1597c1c3 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.048s user 0.005s sys 0.000s
I20260810 11:30:41.256168 27231 ts_tablet_manager.cc:1428] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:41.256454 27231 tablet_bootstrap.cc:492] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:41.258689 27231 tablet_bootstrap.cc:654] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.257735 27222 raft_consensus.cc:348] T d24726d0214947beab0bb31b1597c1c3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.260095 27222 raft_consensus.cc:374] T d24726d0214947beab0bb31b1597c1c3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.260211 27222 raft_consensus.cc:729] T d24726d0214947beab0bb31b1597c1c3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.263473 27222 consensus_queue.cc:260] T d24726d0214947beab0bb31b1597c1c3 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.264297 27222 ts_tablet_manager.cc:1428] T d24726d0214947beab0bb31b1597c1c3 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260810 11:30:41.264700 27222 tablet_bootstrap.cc:492] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:41.269969 27228 tablet_bootstrap.cc:492] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:41.270174 27228 ts_tablet_manager.cc:1397] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.148s user 0.005s sys 0.004s
I20260810 11:30:41.271288 27228 raft_consensus.cc:348] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.271449 26885 tablet_service.cc:1467] Processing CreateTablet for tablet 4827800160e64883ba7bcadafeb13ead (DEFAULT_TABLE table=default.Table_37ba5cf5063749fbb2b8f0c05d4b73a3 [id=ef80fceff09e40169c2b894a63c57afc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.227430 26581 catalog_manager.cc:5495] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:41.272240 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4827800160e64883ba7bcadafeb13ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.272317 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
I20260810 11:30:41.272500 27222 tablet_bootstrap.cc:654] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.271580 27228 raft_consensus.cc:374] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.273993 27228 raft_consensus.cc:729] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.274260 27228 consensus_queue.cc:260] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.244527 27999 ts_tablet_manager.cc:1939] T 318d5b8453fe4c438d0fa32cb91c409e P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:41.274930 27228 ts_tablet_manager.cc:1428] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 11:30:41.275242 27228 tablet_bootstrap.cc:492] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:41.275246 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 179) took 8457 ms. Trace:
I20260810 11:30:41.275349 27999 rpcz_store.cc:276] 0810 11:30:32.818277 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.818430 (+ 153us) service_pool.cc:227] Handling call
0810 11:30:40.988364 (+8169934us) ts_tablet_manager.cc:1145] Deleting tablet 318d5b8453fe4c438d0fa32cb91c409e
0810 11:30:40.988376 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.240588 (+252212us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:41.243735 (+ 3147us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:41.275232 (+ 31497us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8166399}
I20260810 11:30:41.275823 27286 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 318d5b8453fe4c438d0fa32cb91c409e (table default.Table_0ca6793e2c374e8d8d93872a0b2283d6 [id=ae0e3b2d14964558848b1a00a6ddc2c6]) successfully deleted
I20260810 11:30:41.275868 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 180) took 8453 ms. Trace:
I20260810 11:30:41.275949 27999 rpcz_store.cc:276] 0810 11:30:32.822414 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.822825 (+ 411us) service_pool.cc:227] Handling call
0810 11:30:41.275767 (+8452942us) ts_tablet_manager.cc:1145] Deleting tablet 9311943eebaa4824bde96b4cb09f1e2c
0810 11:30:41.275777 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.275852 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8452087}
W20260810 11:30:41.276365 27286 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 9311943eebaa4824bde96b4cb09f1e2c because the tablet was not found. No further retry: Not found: Tablet not found: 9311943eebaa4824bde96b4cb09f1e2c
I20260810 11:30:41.276383 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 181) took 8453 ms. Trace:
I20260810 11:30:41.276460 27999 rpcz_store.cc:276] 0810 11:30:32.822734 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.823767 (+ 1033us) service_pool.cc:227] Handling call
0810 11:30:41.276282 (+8452515us) ts_tablet_manager.cc:1145] Deleting tablet 49db12565dbc4187b78a98ed35c40fed
0810 11:30:41.276291 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.276368 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8451816}
W20260810 11:30:41.277029 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 49db12565dbc4187b78a98ed35c40fed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49db12565dbc4187b78a98ed35c40fed already in progress: creating tablet
I20260810 11:30:41.276923 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 182) took 8441 ms. Trace:
I20260810 11:30:41.277319 27999 rpcz_store.cc:276] 0810 11:30:32.835518 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.835574 (+ 56us) service_pool.cc:227] Handling call
0810 11:30:41.276846 (+8441272us) ts_tablet_manager.cc:1145] Deleting tablet 7aa16654b7f34f9baf856bf724cece8f
0810 11:30:41.276855 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.276907 (+ 52us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8440957}
I20260810 11:30:41.277789 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 184) took 8387 ms. Trace:
I20260810 11:30:41.277860 27999 rpcz_store.cc:276] 0810 11:30:32.890458 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.890797 (+ 339us) service_pool.cc:227] Handling call
0810 11:30:41.277676 (+8386879us) ts_tablet_manager.cc:1145] Deleting tablet d000f0ebaf0049a7bdaad93e307e16e2
0810 11:30:41.277696 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.277774 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8373913}
I20260810 11:30:41.278729 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 183) took 8441 ms. Trace:
I20260810 11:30:41.278815 27999 rpcz_store.cc:276] 0810 11:30:32.839162 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.839212 (+ 50us) service_pool.cc:227] Handling call
0810 11:30:41.278641 (+8439429us) ts_tablet_manager.cc:1145] Deleting tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e
0810 11:30:41.278651 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.278713 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8371008}
I20260810 11:30:41.279127 28845 raft_consensus.cc:482] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:41.279218 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 189) took 8361 ms. Trace:
W20260810 11:30:41.279242 27286 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7aa16654b7f34f9baf856bf724cece8f because the tablet was not found. No further retry: Not found: Tablet not found: 7aa16654b7f34f9baf856bf724cece8f
I20260810 11:30:41.279284 27999 rpcz_store.cc:276] 0810 11:30:32.917884 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.918485 (+ 601us) service_pool.cc:227] Handling call
0810 11:30:41.279133 (+8360648us) ts_tablet_manager.cc:1145] Deleting tablet 5adcec593b8c4d40997c8911e9f77c85
0810 11:30:41.279144 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.279203 (+ 59us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8360106}
I20260810 11:30:41.279280 28845 raft_consensus.cc:504] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:41.279491 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet d000f0ebaf0049a7bdaad93e307e16e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d000f0ebaf0049a7bdaad93e307e16e2 already in progress: creating tablet
I20260810 11:30:41.279680 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 188) took 8371 ms. Trace:
W20260810 11:30:41.279701 27286 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7dc4000f1dde46a3b881a9fa8e9a6e3e because the tablet was not found. No further retry: Not found: Tablet not found: 7dc4000f1dde46a3b881a9fa8e9a6e3e
I20260810 11:30:41.279752 27999 rpcz_store.cc:276] 0810 11:30:32.908452 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.909557 (+ 1105us) service_pool.cc:227] Handling call
0810 11:30:41.279607 (+8370050us) ts_tablet_manager.cc:1145] Deleting tablet b7a3b877457c4a2489d397f3f864d6b2
0810 11:30:41.279617 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.279666 (+ 49us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8357478}
I20260810 11:30:41.279964 28845 leader_election.cc:288] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:41.280081 27286 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 5adcec593b8c4d40997c8911e9f77c85 because the tablet was not found. No further retry: Not found: Tablet not found: 5adcec593b8c4d40997c8911e9f77c85
I20260810 11:30:41.280164 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 185) took 8372 ms. Trace:
I20260810 11:30:41.280239 27999 rpcz_store.cc:276] 0810 11:30:32.907840 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.909808 (+ 1968us) service_pool.cc:227] Handling call
0810 11:30:41.280056 (+8370248us) ts_tablet_manager.cc:1145] Deleting tablet 3ae27bf110114b70a3e3f6cf64f31b98
0810 11:30:41.280067 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.280145 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8357385}
W20260810 11:30:41.280431 27286 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet b7a3b877457c4a2489d397f3f864d6b2 because the tablet was not found. No further retry: Not found: Tablet not found: b7a3b877457c4a2489d397f3f864d6b2
I20260810 11:30:41.280682 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 187) took 8372 ms. Trace:
W20260810 11:30:41.280699 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 3ae27bf110114b70a3e3f6cf64f31b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae27bf110114b70a3e3f6cf64f31b98 already in progress: creating tablet
I20260810 11:30:41.280755 27999 rpcz_store.cc:276] 0810 11:30:32.908282 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.908964 (+ 682us) service_pool.cc:227] Handling call
0810 11:30:41.280606 (+8371642us) ts_tablet_manager.cc:1145] Deleting tablet 3ff4e19071fc435fbae4490799325e37
0810 11:30:41.280617 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.280667 (+ 50us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8357594}
I20260810 11:30:41.281131 27228 tablet_bootstrap.cc:654] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.281160 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 186) took 8373 ms. Trace:
I20260810 11:30:41.281221 27999 rpcz_store.cc:276] 0810 11:30:32.908104 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.910016 (+ 1912us) service_pool.cc:227] Handling call
0810 11:30:41.281082 (+8371066us) ts_tablet_manager.cc:1145] Deleting tablet 23d8ce485cb84495a6e964b6d5977f0d
0810 11:30:41.281094 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.281146 (+ 52us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8356919}
I20260810 11:30:41.281613 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 190) took 8346 ms. Trace:
I20260810 11:30:41.281682 27999 rpcz_store.cc:276] 0810 11:30:32.935257 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.936337 (+ 1080us) service_pool.cc:227] Handling call
0810 11:30:41.281529 (+8345192us) ts_tablet_manager.cc:1145] Deleting tablet 60d56e162b4b41e2867ac845e524aca4
0810 11:30:41.281539 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.281598 (+ 59us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8344011}
I20260810 11:30:41.281903 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9de57b6d03e34ee783b822b30090c077" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:41.282053 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 191) took 8346 ms. Trace:
I20260810 11:30:41.282136 27999 rpcz_store.cc:276] 0810 11:30:32.935928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.936048 (+ 120us) service_pool.cc:227] Handling call
0810 11:30:41.281978 (+8345930us) ts_tablet_manager.cc:1145] Deleting tablet 0938a2f3688246a2b46978eeb7d5d521
0810 11:30:41.281989 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.282038 (+ 49us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8343203}
I20260810 11:30:41.283013 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 192) took 8346 ms. Trace:
W20260810 11:30:41.283023 26993 leader_election.cc:341] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:41.283491 27999 rpcz_store.cc:276] 0810 11:30:32.936244 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.936806 (+ 562us) service_pool.cc:227] Handling call
0810 11:30:41.282887 (+8346081us) ts_tablet_manager.cc:1145] Deleting tablet 110b5acc36bd4d6bba13735e5daec75f
0810 11:30:41.282898 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.282994 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":104,"tablet-delete.queue_time_us":8343154}
W20260810 11:30:41.284045 27286 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 3ff4e19071fc435fbae4490799325e37 because the tablet was not found. No further retry: Not found: Tablet not found: 3ff4e19071fc435fbae4490799325e37
I20260810 11:30:41.284246 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50850 (request call id 193) took 8288 ms. Trace:
W20260810 11:30:41.284356 27286 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 23d8ce485cb84495a6e964b6d5977f0d because the tablet was not found. No further retry: Not found: Tablet not found: 23d8ce485cb84495a6e964b6d5977f0d
I20260810 11:30:41.284323 27999 rpcz_store.cc:276] 0810 11:30:32.995971 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:32.996234 (+ 263us) service_pool.cc:227] Handling call
0810 11:30:41.284107 (+8287873us) ts_tablet_manager.cc:1145] Deleting tablet 43fee1a9a6f9482fbbe6ab6599c27fb9
0810 11:30:41.284116 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.284228 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8286946}
W20260810 11:30:41.284660 27286 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 60d56e162b4b41e2867ac845e524aca4 because the tablet was not found. No further retry: Not found: Tablet not found: 60d56e162b4b41e2867ac845e524aca4
W20260810 11:30:41.284900 27286 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 0938a2f3688246a2b46978eeb7d5d521 because the tablet was not found. No further retry: Not found: Tablet not found: 0938a2f3688246a2b46978eeb7d5d521
W20260810 11:30:41.285169 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 110b5acc36bd4d6bba13735e5daec75f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 110b5acc36bd4d6bba13735e5daec75f already in progress: creating tablet
I20260810 11:30:41.285247 27999 tablet_replica.cc:330] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
W20260810 11:30:41.285425 27286 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 already in progress: creating tablet
I20260810 11:30:41.285523 27999 raft_consensus.cc:2229] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:41.285732 27999 raft_consensus.cc:2258] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:41.285908 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9de57b6d03e34ee783b822b30090c077" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:41.286320 27999 ts_tablet_manager.cc:1905] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:41.286463 26991 leader_election.cc:341] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:41.286588 26991 leader_election.cc:302] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:41.286903 28845 raft_consensus.cc:2726] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:41.297080 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:41.297504 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:41.297832 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:41.298357 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
W20260810 11:30:41.298789 26564 consensus_peers.cc:487] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 -> Peer c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547): Couldn't send request to peer c40c76e125b44de181b88b7f63a566f7. Status: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260810 11:30:41.298985 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_5ba00bd0ab7d4cdcb1494f9491c64291 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 2 got 0
I20260810 11:30:41.299937 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet ce73798a721b4a6d892f0c24b6b40e2c (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]). Expected version 1 got 0
I20260810 11:30:41.300366 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:41.313570 27231 tablet_bootstrap.cc:492] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:41.314028 27231 ts_tablet_manager.cc:1397] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.058s user 0.003s sys 0.000s
I20260810 11:30:41.314697 28921 consensus_queue.cc:1035] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:41.314872 27231 raft_consensus.cc:348] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.315129 27231 raft_consensus.cc:374] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.315202 27231 raft_consensus.cc:729] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.315397 27231 consensus_queue.cc:260] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.319527 27228 tablet_bootstrap.cc:492] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:41.319707 27228 ts_tablet_manager.cc:1397] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.045s user 0.000s sys 0.003s
I20260810 11:30:41.320442 27228 raft_consensus.cc:348] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.320750 27228 raft_consensus.cc:374] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.320820 27228 raft_consensus.cc:729] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.321514 27231 ts_tablet_manager.cc:1428] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260810 11:30:41.321080 27228 consensus_queue.cc:260] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.323171 27228 ts_tablet_manager.cc:1428] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 11:30:41.323505 27228 tablet_bootstrap.cc:492] T add1743851c34d58afb7e4886325d659 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:41.323647 27231 tablet_bootstrap.cc:492] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:41.325435 27231 tablet_bootstrap.cc:654] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.328320 27228 tablet_bootstrap.cc:654] T add1743851c34d58afb7e4886325d659 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.332934 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:41.333902 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:41.335242 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 2 got 0
I20260810 11:30:41.350062 27222 tablet_bootstrap.cc:492] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:41.350293 27222 ts_tablet_manager.cc:1397] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.086s user 0.007s sys 0.003s
I20260810 11:30:41.351313 27222 raft_consensus.cc:348] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.351629 27222 raft_consensus.cc:374] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.351724 27222 raft_consensus.cc:729] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.351998 27222 consensus_queue.cc:260] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.353255 27222 ts_tablet_manager.cc:1428] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 11:30:41.353657 27222 tablet_bootstrap.cc:492] T adecd2f0952b4f4c83919c78d563e429 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:41.355345 27231 tablet_bootstrap.cc:492] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:41.355542 27231 ts_tablet_manager.cc:1397] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.034s user 0.000s sys 0.007s
I20260810 11:30:41.356184 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:41.356329 27231 raft_consensus.cc:348] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.356472 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:41.357282 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:41.357761 27228 tablet_bootstrap.cc:492] T add1743851c34d58afb7e4886325d659 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:41.357914 27228 ts_tablet_manager.cc:1397] T add1743851c34d58afb7e4886325d659 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.001s
I20260810 11:30:41.358585 27228 raft_consensus.cc:348] T add1743851c34d58afb7e4886325d659 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.358809 27228 raft_consensus.cc:374] T add1743851c34d58afb7e4886325d659 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.358876 27228 raft_consensus.cc:729] T add1743851c34d58afb7e4886325d659 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.359170 27222 tablet_bootstrap.cc:654] T adecd2f0952b4f4c83919c78d563e429 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.359164 27228 consensus_queue.cc:260] T add1743851c34d58afb7e4886325d659 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.359855 27228 ts_tablet_manager.cc:1428] T add1743851c34d58afb7e4886325d659 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 11:30:41.360008 27231 raft_consensus.cc:374] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.360100 27231 raft_consensus.cc:729] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.360337 27231 consensus_queue.cc:260] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.360813 27228 tablet_bootstrap.cc:492] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:41.367247 27231 ts_tablet_manager.cc:1428] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260810 11:30:41.367807 27231 tablet_bootstrap.cc:492] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:41.369827 27228 tablet_bootstrap.cc:654] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.378414 27231 tablet_bootstrap.cc:654] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.385743 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:41.387368 27999 ts_tablet_manager.cc:1918] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:41.388917 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:41.392143 26771 raft_consensus.cc:3037] T d24726d0214947beab0bb31b1597c1c3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:41.392695 27999 log.cc:1196] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/6c715bdcff8c4cdabfddf871f6fdc388
I20260810 11:30:41.393141 27999 ts_tablet_manager.cc:1939] T 6c715bdcff8c4cdabfddf871f6fdc388 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:41.393934 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 0) took 2508 ms. Trace:
I20260810 11:30:41.394026 27999 rpcz_store.cc:276] 0810 11:30:38.885669 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:38.886540 (+ 871us) service_pool.cc:227] Handling call
0810 11:30:41.285192 (+2398652us) ts_tablet_manager.cc:1145] Deleting tablet 6c715bdcff8c4cdabfddf871f6fdc388
0810 11:30:41.285205 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.293853 (+ 8648us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:41.387248 (+ 93395us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:41.393911 (+ 6663us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2398430}
I20260810 11:30:41.394420 27999 tablet_replica.cc:330] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:41.394627 27999 raft_consensus.cc:2229] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:41.394968 27999 raft_consensus.cc:2258] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:41.394830 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 6c715bdcff8c4cdabfddf871f6fdc388 (table default.Table_c82a1b2b7cba46adb8ba9c9c6ead9935 [id=ac09591d93074ce49c66162021f26b05]) successfully deleted
I20260810 11:30:41.395916 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:41.396076 27231 tablet_bootstrap.cc:492] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:41.396723 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:41.397595 26762 raft_consensus.cc:3037] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:41.397557 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:41.401646 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:41.402442 27999 ts_tablet_manager.cc:1905] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:41.404343 27222 tablet_bootstrap.cc:492] T adecd2f0952b4f4c83919c78d563e429 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:41.404667 27222 ts_tablet_manager.cc:1397] T adecd2f0952b4f4c83919c78d563e429 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.051s user 0.004s sys 0.001s
I20260810 11:30:41.405979 27222 raft_consensus.cc:348] T adecd2f0952b4f4c83919c78d563e429 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.406044 28845 consensus_queue.cc:1035] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:41.406359 27222 raft_consensus.cc:374] T adecd2f0952b4f4c83919c78d563e429 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.406481 27222 raft_consensus.cc:729] T adecd2f0952b4f4c83919c78d563e429 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.406817 27222 consensus_queue.cc:260] T adecd2f0952b4f4c83919c78d563e429 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.407380 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:41.410040 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:41.404345 26916 raft_consensus.cc:3037] T 0d7a07e844984b88ab81610cb95bf21e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:41.416299 28727 consensus_queue.cc:1035] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:41.425257 27228 tablet_bootstrap.cc:492] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:41.425537 27228 ts_tablet_manager.cc:1397] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.065s user 0.006s sys 0.002s
I20260810 11:30:41.426205 27231 ts_tablet_manager.cc:1397] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.003s
I20260810 11:30:41.427771 27222 ts_tablet_manager.cc:1428] T adecd2f0952b4f4c83919c78d563e429 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260810 11:30:41.430316 27222 tablet_bootstrap.cc:492] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:41.430974 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:41.434114 27231 raft_consensus.cc:348] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.434366 27231 raft_consensus.cc:374] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.434425 27231 raft_consensus.cc:729] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.438534 28728 consensus_queue.cc:1035] T 0d7a07e844984b88ab81610cb95bf21e P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:41.441392 27231 consensus_queue.cc:260] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.443708 27228 raft_consensus.cc:348] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.444074 27228 raft_consensus.cc:374] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.444135 27228 raft_consensus.cc:729] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.444419 27228 consensus_queue.cc:260] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.445363 27231 ts_tablet_manager.cc:1428] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260810 11:30:41.446404 27231 tablet_bootstrap.cc:492] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:41.452997 27231 tablet_bootstrap.cc:654] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.450628 27228 ts_tablet_manager.cc:1428] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.025s user 0.002s sys 0.002s
I20260810 11:30:41.453778 28345 raft_consensus.cc:482] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:41.455417 28345 raft_consensus.cc:504] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.455847 27228 tablet_bootstrap.cc:492] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:41.456092 28345 leader_election.cc:288] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:41.458261 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "760aeada57464892ae3b9013a761c509" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:41.458711 27055 raft_consensus.cc:2454] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:41.459442 26848 leader_election.cc:302] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:41.460422 28345 raft_consensus.cc:2781] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:41.460577 28345 raft_consensus.cc:482] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:41.460668 28345 raft_consensus.cc:3037] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:41.452955 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:41.461169 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:41.461688 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:41.462061 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:41.464093 28345 raft_consensus.cc:504] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.465857 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "760aeada57464892ae3b9013a761c509" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:41.436733 27222 tablet_bootstrap.cc:654] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.466168 26762 raft_consensus.cc:2454] T 760aeada57464892ae3b9013a761c509 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:41.466331 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "760aeada57464892ae3b9013a761c509" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:41.466496 26763 raft_consensus.cc:3037] T 760aeada57464892ae3b9013a761c509 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:41.472182 26848 consensus_peers.cc:487] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7cd4f555b5d840c182a31b3c94da9619. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:41.473913 28845 consensus_queue.cc:1035] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:41.474853 26763 raft_consensus.cc:2454] T 760aeada57464892ae3b9013a761c509 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:41.476815 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:41.480542 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:41.488186 26849 leader_election.cc:302] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:41.489519 28921 raft_consensus.cc:2781] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:41.489704 28921 raft_consensus.cc:686] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:41.489967 28921 consensus_queue.cc:237] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.493721 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "760aeada57464892ae3b9013a761c509" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:41.493974 27055 raft_consensus.cc:3037] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:41.494067 28345 leader_election.cc:288] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:41.497607 26824 tablet.cc:2369] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 11:30:41.497817 27055 raft_consensus.cc:2454] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:41.504447 27231 tablet_bootstrap.cc:492] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:41.505337 27228 tablet_bootstrap.cc:654] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.507148 27231 ts_tablet_manager.cc:1397] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.061s user 0.004s sys 0.000s
I20260810 11:30:41.508154 27231 raft_consensus.cc:348] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.508489 27231 raft_consensus.cc:374] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.508628 27231 raft_consensus.cc:729] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.511438 27231 consensus_queue.cc:260] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.513123 27231 ts_tablet_manager.cc:1428] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260810 11:30:41.513422 27231 tablet_bootstrap.cc:492] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:41.514618 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:41.515288 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:41.515619 26581 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d4873fe8318040a2b7e021708a875f43 (table default.Table_065fc82a2823470b89b4cff36ca03027 [id=60ce1267de814f218c27ac084a08a26a]). Expected version 1 got 0
I20260810 11:30:41.516342 26577 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae] alter complete (version 1)
W20260810 11:30:41.516521 26578 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3c31d08ddd74ee28948427c726ed130 consensus state has no leader
I20260810 11:30:41.516887 26578 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 143) took 1504 ms. Trace:
I20260810 11:30:41.517011 26578 rpcz_store.cc:276] 0810 11:30:40.011877 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.942007 (+930130us) service_pool.cc:227] Handling call
0810 11:30:40.942584 (+ 577us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:40.942814 (+ 230us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:40.943082 (+ 268us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:40.943172 (+ 90us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:40.965590 (+ 22418us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:41.516743 (+551153us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.945509 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.945668 (+ 159us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.945675 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:40.945678 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:40.945798 (+ 120us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.945811 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.945816 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:40.945892 (+ 76us) tablet.cc:699] Row locks acquired
0810 11:30:40.945896 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:40.945955 (+ 59us) write_op.cc:270] Start()
0810 11:30:40.945998 (+ 43us) write_op.cc:276] Timestamp: P: 1786361440945933 usec, L: 0
0810 11:30:40.946014 (+ 16us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.946251 (+ 237us) log.cc:842] Serialized 405 byte log entry
0810 11:30:40.962468 (+ 16217us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.963273 (+ 805us) write_op.cc:301] APPLY: starting
0810 11:30:40.963291 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.963337 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.963368 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.963441 (+ 73us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.963479 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:40.963485 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:40.963579 (+ 94us) log.cc:842] Serialized 23 byte log entry
0810 11:30:40.963655 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.963676 (+ 21us) write_op.cc:454] Released schema lock
0810 11:30:40.963685 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.963746 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.963750 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":732,"apply.run_cpu_time_us":537,"apply.run_wall_time_us":537,"num_ops":1,"prepare.queue_time_us":1614,"prepare.run_cpu_time_us":884,"prepare.run_wall_time_us":2575,"raft.queue_time_us":1673,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":8,"replication_time_us":16416}]]}
W20260810 11:30:41.520779 26576 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1d0d55b526749059470504a27887b22 consensus state has no leader
I20260810 11:30:41.521099 26576 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 144) took 1508 ms. Trace:
I20260810 11:30:41.521246 26576 rpcz_store.cc:276] 0810 11:30:40.012149 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.971734 (+959585us) service_pool.cc:227] Handling call
0810 11:30:40.972284 (+ 550us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:40.972547 (+ 263us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:40.972882 (+ 335us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:40.973023 (+ 141us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:40.998166 (+ 25143us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:41.521000 (+522834us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.973700 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.973848 (+ 148us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.973856 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:40.973859 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:40.974002 (+ 143us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.974015 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.974020 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:40.974091 (+ 71us) tablet.cc:699] Row locks acquired
0810 11:30:40.974095 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:40.974153 (+ 58us) write_op.cc:270] Start()
0810 11:30:40.974192 (+ 39us) write_op.cc:276] Timestamp: P: 1786361440974127 usec, L: 0
0810 11:30:40.974196 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.974512 (+ 316us) log.cc:842] Serialized 405 byte log entry
0810 11:30:40.990566 (+ 16054us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.990737 (+ 171us) write_op.cc:301] APPLY: starting
0810 11:30:40.990757 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.990830 (+ 73us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.990872 (+ 42us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.990935 (+ 63us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.990988 (+ 53us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:40.990994 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:40.991095 (+ 101us) log.cc:842] Serialized 23 byte log entry
0810 11:30:40.991167 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.991191 (+ 24us) write_op.cc:454] Released schema lock
0810 11:30:40.991198 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.991259 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.991262 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":112,"apply.run_cpu_time_us":584,"apply.run_wall_time_us":584,"num_ops":1,"prepare.queue_time_us":57,"prepare.run_cpu_time_us":1014,"prepare.run_wall_time_us":2688,"raft.queue_time_us":1284,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":235,"replication_time_us":16328}]]}
I20260810 11:30:41.524024 28345 consensus_queue.cc:1035] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:41.525065 27999 ts_tablet_manager.cc:1918] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 11:30:41.525221 27999 log.cc:1196] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/3ccef06fa06c4c519d8760fa948d6c8b
I20260810 11:30:41.525616 27999 ts_tablet_manager.cc:1939] T 3ccef06fa06c4c519d8760fa948d6c8b P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:41.533891 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 1) took 2648 ms. Trace:
I20260810 11:30:41.534078 27999 rpcz_store.cc:276] 0810 11:30:38.885787 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:38.886793 (+ 1006us) service_pool.cc:227] Handling call
0810 11:30:41.394373 (+2507580us) ts_tablet_manager.cc:1145] Deleting tablet 3ccef06fa06c4c519d8760fa948d6c8b
0810 11:30:41.394384 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.458440 (+ 64056us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:41.524951 (+ 66511us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:41.533846 (+ 8895us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2507397}
I20260810 11:30:41.534777 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 3ccef06fa06c4c519d8760fa948d6c8b (table default.Table_abbbb80ecbe4491d98912dcdcaab5dd3 [id=ba999b4084c84b2f8e0313b96849b169]) successfully deleted
W20260810 11:30:41.536805 26572 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 41e7ace2693b4b8c8a978e7853e42472 consensus state has no leader
I20260810 11:30:41.538595 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 2) took 2652 ms. Trace:
I20260810 11:30:41.538720 27999 rpcz_store.cc:276] 0810 11:30:38.885887 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:38.887008 (+ 1121us) service_pool.cc:227] Handling call
0810 11:30:41.538399 (+2651391us) ts_tablet_manager.cc:1145] Deleting tablet 713663be70014b17b17056a865e7db63
0810 11:30:41.538416 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.538552 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2651071}
I20260810 11:30:41.539541 27231 tablet_bootstrap.cc:654] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.541755 26572 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 137) took 2325 ms. Trace:
W20260810 11:30:41.542268 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 713663be70014b17b17056a865e7db63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 713663be70014b17b17056a865e7db63 already in progress: creating tablet
I20260810 11:30:41.543260 27222 tablet_bootstrap.cc:492] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:41.543567 27222 ts_tablet_manager.cc:1397] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.113s user 0.004s sys 0.002s
I20260810 11:30:41.545322 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 11) took 2598 ms. Trace:
I20260810 11:30:41.545253 27222 raft_consensus.cc:348] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.545468 27999 rpcz_store.cc:276] 0810 11:30:38.946358 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:38.946510 (+ 152us) service_pool.cc:227] Handling call
0810 11:30:41.545158 (+2598648us) ts_tablet_manager.cc:1145] Deleting tablet 44d5e146eeec4fe0be33c1c169d32e68
0810 11:30:41.545190 (+ 32us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.545292 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2598212}
I20260810 11:30:41.545750 27222 raft_consensus.cc:374] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.545882 27222 raft_consensus.cc:729] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.546223 27222 consensus_queue.cc:260] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:41.546983 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 44d5e146eeec4fe0be33c1c169d32e68 because the tablet was not found. No further retry: Not found: Tablet not found: 44d5e146eeec4fe0be33c1c169d32e68
I20260810 11:30:41.547109 27222 ts_tablet_manager.cc:1428] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 11:30:41.547402 27222 tablet_bootstrap.cc:492] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:41.541901 26572 rpcz_store.cc:276] 0810 11:30:39.211779 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.682480 (+1470701us) service_pool.cc:227] Handling call
0810 11:30:40.737049 (+ 54569us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa47586 00007f9c61d3ade6 00007f9c61d3ab15 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:40.780163 (+ 43114us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:40.780388 (+ 225us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:40.780653 (+ 265us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:40.780738 (+ 85us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:40.802847 (+ 22109us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:41.537036 (+734189us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.781340 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.781417 (+ 77us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.781422 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:40.781424 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:40.781515 (+ 91us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.781525 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.781530 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:40.781590 (+ 60us) tablet.cc:699] Row locks acquired
0810 11:30:40.781593 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:40.781628 (+ 35us) write_op.cc:270] Start()
0810 11:30:40.781657 (+ 29us) write_op.cc:276] Timestamp: P: 1786361440781579 usec, L: 0
0810 11:30:40.781662 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.781816 (+ 154us) log.cc:842] Serialized 405 byte log entry
0810 11:30:40.786625 (+ 4809us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.787384 (+ 759us) write_op.cc:301] APPLY: starting
0810 11:30:40.787393 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.787421 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.787442 (+ 21us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.787479 (+ 37us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.787503 (+ 24us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:40.787509 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:40.787607 (+ 98us) log.cc:842] Serialized 23 byte log entry
0810 11:30:40.787697 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.787711 (+ 14us) write_op.cc:454] Released schema lock
0810 11:30:40.787717 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.787765 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.787769 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":116106112,"child_traces":[["op",{"apply.queue_time_us":722,"apply.run_cpu_time_us":424,"apply.run_wall_time_us":423,"num_ops":1,"prepare.queue_time_us":73,"prepare.run_cpu_time_us":605,"prepare.run_wall_time_us":605,"raft.queue_time_us":40,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":6,"replication_time_us":4936}]]}
I20260810 11:30:41.548535 26572 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_fee5e058d63849c189e798c232542ad2" } modify_external_catalogs: true
I20260810 11:30:41.548858 26572 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_fee5e058d63849c189e798c232542ad2" } modify_external_catalogs: true
I20260810 11:30:41.549489 28902 consensus_queue.cc:1035] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:41.549750 27222 tablet_bootstrap.cc:654] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.549777 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 9) took 2603 ms. Trace:
I20260810 11:30:41.550526 27999 rpcz_store.cc:276] 0810 11:30:38.946095 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:38.947168 (+ 1073us) service_pool.cc:227] Handling call
0810 11:30:41.549653 (+2602485us) ts_tablet_manager.cc:1145] Deleting tablet 10e6c41db71a4146840f06c5b7412d9c
0810 11:30:41.549668 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.549751 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2602237}
W20260810 11:30:41.551003 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 10e6c41db71a4146840f06c5b7412d9c because the tablet was not found. No further retry: Not found: Tablet not found: 10e6c41db71a4146840f06c5b7412d9c
I20260810 11:30:41.551697 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 10) took 2605 ms. Trace:
I20260810 11:30:41.551786 27999 rpcz_store.cc:276] 0810 11:30:38.946231 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:38.947473 (+ 1242us) service_pool.cc:227] Handling call
0810 11:30:41.551587 (+2604114us) ts_tablet_manager.cc:1145] Deleting tablet 834c9c99ec424bb39e8a003e9204b2bc
0810 11:30:41.551603 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.551677 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2603844}
W20260810 11:30:41.552340 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 834c9c99ec424bb39e8a003e9204b2bc because the tablet was not found. No further retry: Not found: Tablet not found: 834c9c99ec424bb39e8a003e9204b2bc
I20260810 11:30:41.553751 27999 tablet_replica.cc:330] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:41.554440 27999 raft_consensus.cc:2229] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:41.555307 27999 pending_rounds.cc:62] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700: Trying to abort 1 pending ops.
I20260810 11:30:41.556949 27999 pending_rounds.cc:68] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936460934393856 op_type: NO_OP noop_request { }
I20260810 11:30:41.557787 27999 raft_consensus.cc:2866] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:41.558288 27999 raft_consensus.cc:2258] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:41.559660 27999 ts_tablet_manager.cc:1905] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:41.567102 27222 tablet_bootstrap.cc:492] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:41.568636 28845 consensus_queue.cc:1035] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:41.567425 27222 ts_tablet_manager.cc:1397] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.001s
I20260810 11:30:41.570178 27222 raft_consensus.cc:348] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.570494 27222 raft_consensus.cc:374] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.570606 27222 raft_consensus.cc:729] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.570909 27222 consensus_queue.cc:260] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.571707 27222 ts_tablet_manager.cc:1428] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:41.572770 27222 tablet_bootstrap.cc:492] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:41.575103 27222 tablet_bootstrap.cc:654] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:41.579602 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 8083fa130cd04dae9d61aeed977c1c63 consensus state has no leader
I20260810 11:30:41.581559 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet 2801709d53614916abac370f7ae5e913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:41.581610 26849 consensus_peers.cc:487] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7cd4f555b5d840c182a31b3c94da9619. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:41.583115 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.583591 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 3851d39aeb3142938a5ac558ab438c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:41.584133 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 65756c37fe514194bebe76921419653c consensus state has no leader
W20260810 11:30:41.585781 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 52a9367b7a8345739b5b9acf9ea1e6d8 consensus state has no leader
I20260810 11:30:41.588761 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:41.589568 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 372b49dc083d46538442fcbfdfeb3545 consensus state has no leader
W20260810 11:30:41.590184 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a22cdf7d273d427cb32b811aa5caa3a3 consensus state has no leader
I20260810 11:30:41.592922 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet fc558690dce44e999e55e9bf1b6ca172 with delete_type TABLET_DATA_DELETED (replaced by tablet 0bb01711769f457aa0696bb59582166d) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.595211 27999 ts_tablet_manager.cc:1918] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:41.595386 27999 log.cc:1196] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/a835d30ef9fc474ab927bb119a95d83c
I20260810 11:30:41.595950 27999 ts_tablet_manager.cc:1939] T a835d30ef9fc474ab927bb119a95d83c P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:41.597148 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 12) took 2587 ms. Trace:
I20260810 11:30:41.597295 27999 rpcz_store.cc:276] 0810 11:30:39.010123 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:39.010395 (+ 272us) service_pool.cc:227] Handling call
0810 11:30:41.553697 (+2543302us) ts_tablet_manager.cc:1145] Deleting tablet a835d30ef9fc474ab927bb119a95d83c
0810 11:30:41.553709 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.588878 (+ 35169us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:41.595051 (+ 6173us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:41.597114 (+ 2063us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2543012}
I20260810 11:30:41.597755 27999 tablet_replica.cc:330] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:41.605541 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet a835d30ef9fc474ab927bb119a95d83c (table default.Table_eecd0244ecc849339f452f38db67c973 [id=41d3dec833b54d1e855194862cb1726b]) successfully deleted
W20260810 11:30:41.607502 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet b200bdb394d3439b86fff48494be8e3d consensus state has no leader
I20260810 11:30:41.608752 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3406f12d9c492cbd0d86fa7a57de82 with delete_type TABLET_DATA_DELETED (replaced by tablet 72e0b69e7c7e4343b309d16c030d4306) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.609229 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.613406 27999 raft_consensus.cc:2229] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:41.613837 27999 raft_consensus.cc:2258] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:41.614588 27999 ts_tablet_manager.cc:1905] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:41.614773 27228 tablet_bootstrap.cc:492] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:41.614931 27228 ts_tablet_manager.cc:1397] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.159s user 0.004s sys 0.004s
I20260810 11:30:41.615713 27228 raft_consensus.cc:348] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.615983 27228 raft_consensus.cc:374] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.616045 27228 raft_consensus.cc:729] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.616247 28987 tablet_replica.cc:330] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:41.616581 28987 raft_consensus.cc:2229] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:41.616966 28987 raft_consensus.cc:2258] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:41.619580 27228 consensus_queue.cc:260] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.624091 28987 ts_tablet_manager.cc:1905] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:41.624323 28921 consensus_queue.cc:1035] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:41.637735 27228 ts_tablet_manager.cc:1428] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260810 11:30:41.638173 27228 tablet_bootstrap.cc:492] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:41.638638 27222 tablet_bootstrap.cc:492] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:41.638828 27222 ts_tablet_manager.cc:1397] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.066s user 0.005s sys 0.002s
I20260810 11:30:41.641628 27222 raft_consensus.cc:348] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.641916 27222 raft_consensus.cc:374] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.642006 27222 raft_consensus.cc:729] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.642225 27222 consensus_queue.cc:260] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.643041 27222 ts_tablet_manager.cc:1428] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 11:30:41.643427 27222 tablet_bootstrap.cc:492] T e31b380f99854eb8b63e1f9eede1fc7c P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:41.646175 27222 tablet_bootstrap.cc:654] T e31b380f99854eb8b63e1f9eede1fc7c P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:41.649605 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 consensus state has no leader
W20260810 11:30:41.652859 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 997cff3351724953bd9c792085a38364 consensus state has no leader
I20260810 11:30:41.653921 27231 tablet_bootstrap.cc:492] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:41.654066 27231 ts_tablet_manager.cc:1397] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.141s user 0.003s sys 0.002s
I20260810 11:30:41.650620 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.650949 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f24c84cdd945b78f39f24015eb1e43 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b95f3ec8ff34c89a68cd1edf8391f9b) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.651202 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.651508 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.652587 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet ee803ddf27594d2b9e19fe440fc269c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 82de53efa73447fe84e70dbb11a16a5f) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.663014 28987 ts_tablet_manager.cc:1918] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:41.663318 28987 log.cc:1196] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/2801709d53614916abac370f7ae5e913
I20260810 11:30:41.663796 28987 ts_tablet_manager.cc:1939] T 2801709d53614916abac370f7ae5e913 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:41.664866 28345 raft_consensus.cc:482] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:41.666368 28987 tablet_replica.cc:330] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:41.667853 28987 raft_consensus.cc:2229] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [term 2 LEADER]: Raft consensus shutting down.
I20260810 11:30:41.668548 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 2801709d53614916abac370f7ae5e913 (table default.Table_be173a149b464952b17280eb1fe40667 [id=53a6520ad3b04ffe88477fd07c159add]) successfully deleted
I20260810 11:30:41.669025 27231 raft_consensus.cc:348] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.669281 28987 raft_consensus.cc:2258] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:41.669312 27231 raft_consensus.cc:374] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.669441 27231 raft_consensus.cc:729] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
W20260810 11:30:41.669462 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 256ad2e2d8e54a4caa1b5091bab60dd5 already in progress: creating tablet
I20260810 11:30:41.669726 27231 consensus_queue.cc:260] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.670240 28987 ts_tablet_manager.cc:1905] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:41.670485 27231 ts_tablet_manager.cc:1428] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.016s user 0.003s sys 0.000s
I20260810 11:30:41.670958 27231 tablet_bootstrap.cc:492] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:41.673450 27222 tablet_bootstrap.cc:492] T e31b380f99854eb8b63e1f9eede1fc7c P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:41.673621 27222 ts_tablet_manager.cc:1397] T e31b380f99854eb8b63e1f9eede1fc7c P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.003s
I20260810 11:30:41.674573 27222 raft_consensus.cc:348] T e31b380f99854eb8b63e1f9eede1fc7c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.674830 27222 raft_consensus.cc:374] T e31b380f99854eb8b63e1f9eede1fc7c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.674897 27222 raft_consensus.cc:729] T e31b380f99854eb8b63e1f9eede1fc7c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.675143 27222 consensus_queue.cc:260] T e31b380f99854eb8b63e1f9eede1fc7c P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.675856 27222 ts_tablet_manager.cc:1428] T e31b380f99854eb8b63e1f9eede1fc7c P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:41.676153 27222 tablet_bootstrap.cc:492] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:41.683626 27222 tablet_bootstrap.cc:654] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.691434 28987 ts_tablet_manager.cc:1918] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260810 11:30:41.693147 28987 log.cc:1196] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/3851d39aeb3142938a5ac558ab438c21
I20260810 11:30:41.694566 28987 ts_tablet_manager.cc:1939] T 3851d39aeb3142938a5ac558ab438c21 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:41.696137 28987 tablet_replica.cc:330] T 7d3406f12d9c492cbd0d86fa7a57de82 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:41.697961 28987 raft_consensus.cc:2229] T 7d3406f12d9c492cbd0d86fa7a57de82 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:41.698943 28987 raft_consensus.cc:2258] T 7d3406f12d9c492cbd0d86fa7a57de82 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:41.700898 28987 ts_tablet_manager.cc:1905] T 7d3406f12d9c492cbd0d86fa7a57de82 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:41.701284 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 3851d39aeb3142938a5ac558ab438c21 (table default.Table_07ad990413b541f5b90b5f0f813635d3 [id=b6d04667c02048fda37c47346472dba5]) successfully deleted
W20260810 11:30:41.701795 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 34bd3c0edf6b49d1891c0ee9af344872 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34bd3c0edf6b49d1891c0ee9af344872 already in progress: creating tablet
W20260810 11:30:41.702217 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet fc558690dce44e999e55e9bf1b6ca172 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc558690dce44e999e55e9bf1b6ca172 already in progress: creating tablet
I20260810 11:30:41.702597 27231 tablet_bootstrap.cc:654] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.706554 28753 raft_consensus.cc:482] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:41.706714 28753 raft_consensus.cc:504] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.707439 28753 leader_election.cc:288] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:41.709367 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1801d3af4a4548dba8b0d8ea2fecf5ba" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:41.715233 28987 ts_tablet_manager.cc:1918] T 7d3406f12d9c492cbd0d86fa7a57de82 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 11:30:41.715665 26993 leader_election.cc:341] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:41.716917 28987 log.cc:1196] T 7d3406f12d9c492cbd0d86fa7a57de82 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/7d3406f12d9c492cbd0d86fa7a57de82
I20260810 11:30:41.717679 28987 ts_tablet_manager.cc:1939] T 7d3406f12d9c492cbd0d86fa7a57de82 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:41.722381 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 7d3406f12d9c492cbd0d86fa7a57de82 (table default.Table_c32d1cb0b9e744fbacbd00c8736fad21 [id=f54b49f28880453aa7bc67b9c36a219b]) successfully deleted
I20260810 11:30:41.723762 28987 tablet_replica.cc:330] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:41.724874 28987 raft_consensus.cc:2229] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:41.725670 28987 raft_consensus.cc:2258] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:41.726402 27231 tablet_bootstrap.cc:492] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:41.726838 27231 ts_tablet_manager.cc:1397] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.056s user 0.008s sys 0.000s
I20260810 11:30:41.727849 28987 ts_tablet_manager.cc:1905] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:41.728075 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 1aa4562a2247405187d9dbd1baa48f39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1aa4562a2247405187d9dbd1baa48f39 already in progress: creating tablet
I20260810 11:30:41.728161 28753 raft_consensus.cc:482] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:41.728308 28753 raft_consensus.cc:504] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.728384 27231 raft_consensus.cc:348] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.728895 27231 raft_consensus.cc:374] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.728997 27231 raft_consensus.cc:729] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.729113 28753 leader_election.cc:288] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:41.729184 27231 consensus_queue.cc:260] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.729751 27231 ts_tablet_manager.cc:1428] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
W20260810 11:30:41.729779 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet d000f0ebaf0049a7bdaad93e307e16e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d000f0ebaf0049a7bdaad93e307e16e2 already in progress: creating tablet
I20260810 11:30:41.730046 27231 tablet_bootstrap.cc:492] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:41.730019 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49db12565dbc4187b78a98ed35c40fed" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:41.730294 26763 raft_consensus.cc:2454] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:41.732012 26993 leader_election.cc:302] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:41.732542 27231 tablet_bootstrap.cc:654] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.732510 28898 raft_consensus.cc:2781] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:41.732726 28898 raft_consensus.cc:482] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:41.732807 28898 raft_consensus.cc:3037] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:41.735844 28898 raft_consensus.cc:504] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:41.737541 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 5deec04c1be64473accf8b9df14bd22e consensus state has no leader
I20260810 11:30:41.737907 28987 ts_tablet_manager.cc:1918] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:41.738054 28898 leader_election.cc:288] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:41.738260 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet afbe6ce99f7c4f7cb939bea086cd90be consensus state has no leader
I20260810 11:30:41.739133 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49db12565dbc4187b78a98ed35c40fed" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:41.740088 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet b6395bce17ee40c2822669246ce7eb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.743652 26763 raft_consensus.cc:3037] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:41.745389 28753 raft_consensus.cc:482] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:41.745735 28753 raft_consensus.cc:504] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.747045 28753 leader_election.cc:288] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:41.747110 26763 raft_consensus.cc:2454] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:41.747478 28987 log.cc:1196] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/81f24c84cdd945b78f39f24015eb1e43
I20260810 11:30:41.748117 28987 ts_tablet_manager.cc:1939] T 81f24c84cdd945b78f39f24015eb1e43 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:41.748396 26993 leader_election.cc:302] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:41.749171 28753 raft_consensus.cc:2781] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:41.749356 28753 raft_consensus.cc:686] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:41.749643 28753 consensus_queue.cc:237] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.750357 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 81f24c84cdd945b78f39f24015eb1e43 (table default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e]) successfully deleted
W20260810 11:30:41.751132 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 8228600e3f6b4f9993dd25e4ceb57e4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8228600e3f6b4f9993dd25e4ceb57e4d already in progress: creating tablet
I20260810 11:30:41.751462 27999 ts_tablet_manager.cc:1918] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:41.751662 27999 log.cc:1196] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/d14091e1c111438bac8bcf3d36123d80
I20260810 11:30:41.752142 27999 ts_tablet_manager.cc:1939] T d14091e1c111438bac8bcf3d36123d80 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:41.753254 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 13) took 2742 ms. Trace:
I20260810 11:30:41.753393 27999 rpcz_store.cc:276] 0810 11:30:39.010331 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:39.010412 (+ 81us) service_pool.cc:227] Handling call
0810 11:30:41.597692 (+2587280us) ts_tablet_manager.cc:1145] Deleting tablet d14091e1c111438bac8bcf3d36123d80
0810 11:30:41.597705 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.630398 (+ 32693us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:41.751292 (+120894us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:41.753222 (+ 1930us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15305,"tablet-delete.queue_time_us":2586684}
I20260810 11:30:41.754287 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet d14091e1c111438bac8bcf3d36123d80 (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]) successfully deleted
I20260810 11:30:41.754506 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 14) took 2335 ms. Trace:
W20260810 11:30:41.754616 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 3ae27bf110114b70a3e3f6cf64f31b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae27bf110114b70a3e3f6cf64f31b98 already in progress: creating tablet
I20260810 11:30:41.754639 27999 rpcz_store.cc:276] 0810 11:30:39.418823 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:39.418917 (+ 94us) service_pool.cc:227] Handling call
0810 11:30:41.753845 (+2334928us) ts_tablet_manager.cc:1145] Deleting tablet a63227e69df14a4ea935087fd31ece63
0810 11:30:41.754332 (+ 487us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.754469 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2334621}
W20260810 11:30:41.755551 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet a63227e69df14a4ea935087fd31ece63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a63227e69df14a4ea935087fd31ece63 already in progress: creating tablet
I20260810 11:30:41.755543 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 19) took 1941 ms. Trace:
W20260810 11:30:41.756846 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ee803ddf27594d2b9e19fe440fc269c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee803ddf27594d2b9e19fe440fc269c7 already in progress: creating tablet
W20260810 11:30:41.758081 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet b6395bce17ee40c2822669246ce7eb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6395bce17ee40c2822669246ce7eb42 already in progress: creating tablet
I20260810 11:30:41.758973 27231 tablet_bootstrap.cc:492] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:41.759176 27231 ts_tablet_manager.cc:1397] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.002s
I20260810 11:30:41.761484 27231 raft_consensus.cc:348] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.761840 27231 raft_consensus.cc:374] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.761940 27231 raft_consensus.cc:729] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.762507 27231 consensus_queue.cc:260] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.763579 27231 ts_tablet_manager.cc:1428] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 11:30:41.764012 27231 tablet_bootstrap.cc:492] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:41.764613 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet f6e264e8507446809f3c386fdb3c34ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.764940 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet db59523b71224370bf5fce6b56592f71 with delete_type TABLET_DATA_DELETED (replaced by tablet bd34a4de1b93402c8a4bce1215660e77) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.765515 28987 tablet_replica.cc:330] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:41.765741 28987 raft_consensus.cc:2229] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:41.766012 28987 pending_rounds.cc:62] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d: Trying to abort 1 pending ops.
I20260810 11:30:41.766149 27231 tablet_bootstrap.cc:654] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.766067 28987 pending_rounds.cc:68] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936462038474752 op_type: NO_OP noop_request { }
I20260810 11:30:41.766243 28987 raft_consensus.cc:2866] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:41.766345 28987 raft_consensus.cc:2258] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:41.767381 28987 ts_tablet_manager.cc:1905] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:41.767474 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 271a0607ec28441c91bac32c2f2bf44b consensus state has no leader
W20260810 11:30:41.768141 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet f756689d4c99489885a0cd59f84a6e8a consensus state has no leader
W20260810 11:30:41.768507 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 7d3e78dcaa55491393f529ea33007786 consensus state has no leader
W20260810 11:30:41.769304 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 00d52e5c77d94854b8ba0b38c63ad015 consensus state has no leader
W20260810 11:30:41.771350 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet f6e264e8507446809f3c386fdb3c34ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6e264e8507446809f3c386fdb3c34ae already in progress: creating tablet
I20260810 11:30:41.772316 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet c60baf810a544a4a90dccd2337a39043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.772605 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da86554bc51486e91f1ea5995a245b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.773420 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.773693 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c203cd90d2f472fa27cfabed5b87119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.773936 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 49db12565dbc4187b78a98ed35c40fed with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1e46f80f7f4e3a84638421892e6236) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.777514 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1aa4562a2247405187d9dbd1baa48f39" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:41.778230 26993 leader_election.cc:341] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:41.784940 28726 raft_consensus.cc:482] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:41.785166 28726 raft_consensus.cc:504] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.786000 28726 leader_election.cc:288] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:41.786790 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3079a68c1c74b64bf13877bd0ee68c3" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:41.792979 27055 raft_consensus.cc:2379] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate b6079090b1124d84aa4477974bb53700 in this term.
W20260810 11:30:41.799772 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet bd34a4de1b93402c8a4bce1215660e77 consensus state has no leader
I20260810 11:30:41.743602 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1801d3af4a4548dba8b0d8ea2fecf5ba" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:41.755762 27999 rpcz_store.cc:276] 0810 11:30:39.813707 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:39.814075 (+ 368us) service_pool.cc:227] Handling call
0810 11:30:41.755160 (+1941085us) ts_tablet_manager.cc:1145] Deleting tablet cc76d30f37094391b75076c92ccc277f
0810 11:30:41.755392 (+ 232us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.755517 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1940875}
I20260810 11:30:41.665184 28345 raft_consensus.cc:504] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.801431 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 29) took 1423 ms. Trace:
I20260810 11:30:41.801544 27999 rpcz_store.cc:276] 0810 11:30:40.378499 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.378746 (+ 247us) service_pool.cc:227] Handling call
0810 11:30:41.801266 (+1422520us) ts_tablet_manager.cc:1145] Deleting tablet 78633fbe048b4534ae3277ce6b7c4313
0810 11:30:41.801286 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.801409 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1422289}
I20260810 11:30:41.801934 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 30) took 1423 ms. Trace:
I20260810 11:30:41.802017 27999 rpcz_store.cc:276] 0810 11:30:40.378686 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.379006 (+ 320us) service_pool.cc:227] Handling call
0810 11:30:41.801804 (+1422798us) ts_tablet_manager.cc:1145] Deleting tablet ea66da5bc20e4718901ffc473677421c
0810 11:30:41.801816 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.801917 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1422648}
I20260810 11:30:41.802287 27999 tablet_replica.cc:330] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:41.802542 27999 raft_consensus.cc:2229] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:41.802757 27999 raft_consensus.cc:2258] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:41.803001 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3079a68c1c74b64bf13877bd0ee68c3" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:41.803498 27999 ts_tablet_manager.cc:1905] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:41.803728 26700 leader_election.cc:302] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
W20260810 11:30:41.802234 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet cc76d30f37094391b75076c92ccc277f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc76d30f37094391b75076c92ccc277f already in progress: creating tablet
I20260810 11:30:41.804764 28726 raft_consensus.cc:3037] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:41.804857 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 78633fbe048b4534ae3277ce6b7c4313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78633fbe048b4534ae3277ce6b7c4313 already in progress: creating tablet
W20260810 11:30:41.805131 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ea66da5bc20e4718901ffc473677421c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea66da5bc20e4718901ffc473677421c already in progress: creating tablet
I20260810 11:30:41.805774 26821 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:41.807698 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet ea66da5bc20e4718901ffc473677421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.808652 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e78fb1bf0534deca5cc5a603fd77592 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.809768 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7acf847a1fd74ccc89b5bffe1bbb76f3) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.811380 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b5a7f67ec5b48c2b5a510add0282a76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:41.812430 26991 leader_election.cc:341] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:41.812685 26991 leader_election.cc:302] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:41.813997 28753 raft_consensus.cc:2726] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:41.816416 28345 leader_election.cc:288] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:41.816948 26914 raft_consensus.cc:3037] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:41.817559 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1aa4562a2247405187d9dbd1baa48f39" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:41.820135 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet e31b380f99854eb8b63e1f9eede1fc7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.820447 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 0713f4f14a284050a7774a70ab974f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.820703 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet 110b5acc36bd4d6bba13735e5daec75f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:41.822503 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 1801d3af4a4548dba8b0d8ea2fecf5ba consensus state has no leader
I20260810 11:30:41.822458 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49db12565dbc4187b78a98ed35c40fed" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:41.822726 26912 raft_consensus.cc:3037] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:41.824533 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 760aeada57464892ae3b9013a761c509 consensus state has no leader
W20260810 11:30:41.825078 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 0bb01711769f457aa0696bb59582166d consensus state has no leader
W20260810 11:30:41.825719 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 72209a805e3e4b4ea1bf99508e0f75db consensus state has no leader
I20260810 11:30:41.826241 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110b5acc36bd4d6bba13735e5daec75f" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:41.827077 26849 leader_election.cc:341] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:41.834190 28640 raft_consensus.cc:482] T adecd2f0952b4f4c83919c78d563e429 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:41.834235 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet 23637a02b6464e17aa2a69ea5cc4ddfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.834389 28640 raft_consensus.cc:504] T adecd2f0952b4f4c83919c78d563e429 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.834544 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ccef06fa06c4c519d8760fa948d6c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.834712 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 518c777e40ec40dcb3484c0374384959 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.834980 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c715bdcff8c4cdabfddf871f6fdc388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.835268 28640 leader_election.cc:288] T adecd2f0952b4f4c83919c78d563e429 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:41.835295 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet d14091e1c111438bac8bcf3d36123d80 with delete_type TABLET_DATA_DELETED (replaced by tablet ce73798a721b4a6d892f0c24b6b40e2c) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.835667 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet cb6805a5dd264939850ea2cd9a850a1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.836108 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adecd2f0952b4f4c83919c78d563e429" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:41.836401 27055 raft_consensus.cc:2379] T adecd2f0952b4f4c83919c78d563e429 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate b6079090b1124d84aa4477974bb53700 in this term.
I20260810 11:30:41.836910 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet ff9b649e43a9456fa51cf3330290bb91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.837203 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet 78633fbe048b4534ae3277ce6b7c4313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:39 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.837394 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.837625 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 91b6078efadf496fb252f725bdf56b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.838814 28987 ts_tablet_manager.cc:1918] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:41.839035 28987 log.cc:1196] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/db59523b71224370bf5fce6b56592f71
I20260810 11:30:41.839710 28987 ts_tablet_manager.cc:1939] T db59523b71224370bf5fce6b56592f71 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:41.841261 28987 tablet_replica.cc:330] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:41.841677 28987 raft_consensus.cc:2229] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:41.842491 28987 raft_consensus.cc:2258] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:41.844581 26991 leader_election.cc:341] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:41.844862 26991 leader_election.cc:302] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:41.845597 28753 raft_consensus.cc:2726] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:41.855654 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet db59523b71224370bf5fce6b56592f71 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]) successfully deleted
I20260810 11:30:41.875638 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adecd2f0952b4f4c83919c78d563e429" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:41.855997 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 10e6c41db71a4146840f06c5b7412d9c with delete_type TABLET_DATA_DELETED (replaced by tablet 72209a805e3e4b4ea1bf99508e0f75db) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.856524 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet a8a65a0e8b1f4e4b8d9a82059b766cda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.820250 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49db12565dbc4187b78a98ed35c40fed" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:41.879173 28987 ts_tablet_manager.cc:1905] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:41.887881 26885 tablet_service.cc:1467] Processing CreateTablet for tablet 27c49b8012bd4343a995b871e81ae136 (DEFAULT_TABLE table=default.Table_86cc59e62a374a9eb464cca153e98a75 [id=54e15442ece74885b4e77eb545d60a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.888388 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27c49b8012bd4343a995b871e81ae136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.888856 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 7dccb93f3de942aabf5f534357b16282 (DEFAULT_TABLE table=default.Table_99d57a71681847508ff5f7ba60124d66 [id=23f2343f74354dae8c85e737bc48bab7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.889631 27231 tablet_bootstrap.cc:492] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:41.889783 27231 ts_tablet_manager.cc:1397] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.126s user 0.003s sys 0.000s
I20260810 11:30:41.890802 27231 raft_consensus.cc:348] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.891031 27231 raft_consensus.cc:374] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.891093 27231 raft_consensus.cc:729] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.891273 27231 consensus_queue.cc:260] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:41.891579 27291 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 256ad2e2d8e54a4caa1b5091bab60dd5 consensus state has no leader
W20260810 11:30:41.892122 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a45422addab84e9083df8665a0cf9322 consensus state has no leader
I20260810 11:30:41.892836 28345 raft_consensus.cc:482] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:41.893025 28345 raft_consensus.cc:504] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.893239 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dccb93f3de942aabf5f534357b16282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.892817 26886 tablet_service.cc:1467] Processing CreateTablet for tablet 3b607279006c4baeae79325926088014 (DEFAULT_TABLE table=default.Table_2c7697ec19204b3d823f5684c30978e2 [id=9d480f65788b486db55bbbe48a0ad5eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.894838 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b607279006c4baeae79325926088014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.900949 27231 ts_tablet_manager.cc:1428] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.011s user 0.002s sys 0.001s
W20260810 11:30:41.900952 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet c60baf810a544a4a90dccd2337a39043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c60baf810a544a4a90dccd2337a39043 already in progress: creating tablet
I20260810 11:30:41.901297 27231 tablet_bootstrap.cc:492] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
W20260810 11:30:41.901656 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2da86554bc51486e91f1ea5995a245b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2da86554bc51486e91f1ea5995a245b5 already in progress: creating tablet
I20260810 11:30:41.904249 28727 raft_consensus.cc:482] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:41.904502 28727 raft_consensus.cc:504] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:41.904858 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 809b5b6b65d244cd9186517e39494839 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 809b5b6b65d244cd9186517e39494839 already in progress: creating tablet
I20260810 11:30:41.905545 28727 leader_election.cc:288] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:41.906071 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7c203cd90d2f472fa27cfabed5b87119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c203cd90d2f472fa27cfabed5b87119 already in progress: creating tablet
I20260810 11:30:41.907213 28845 raft_consensus.cc:482] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6079090b1124d84aa4477974bb53700)
I20260810 11:30:41.907403 28845 raft_consensus.cc:504] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.908133 28845 leader_election.cc:288] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:41.909322 26700 leader_election.cc:302] T adecd2f0952b4f4c83919c78d563e429 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:41.910436 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 27c49b8012bd4343a995b871e81ae136 (DEFAULT_TABLE table=default.Table_86cc59e62a374a9eb464cca153e98a75 [id=54e15442ece74885b4e77eb545d60a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.910593 28640 raft_consensus.cc:3037] T adecd2f0952b4f4c83919c78d563e429 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:41.910661 26732 tablet_service.cc:1467] Processing CreateTablet for tablet 7dccb93f3de942aabf5f534357b16282 (DEFAULT_TABLE table=default.Table_99d57a71681847508ff5f7ba60124d66 [id=23f2343f74354dae8c85e737bc48bab7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.910989 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27c49b8012bd4343a995b871e81ae136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.911140 26730 tablet_service.cc:1467] Processing CreateTablet for tablet 7161d94d80b24eeaa357cc0922a874af (DEFAULT_TABLE table=default.Table_061b7dfbcc074ad6a0d99d49113a354f [id=0186ddbf3c144b4e86ae21cbdac555d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.911489 26730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7161d94d80b24eeaa357cc0922a874af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.911980 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 318d5b8453fe4c438d0fa32cb91c409e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.912667 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet a835d30ef9fc474ab927bb119a95d83c with delete_type TABLET_DATA_DELETED (replaced by tablet 2a1fbf3890ee4a829b4c8c61fe1e978f) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.912935 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet a63227e69df14a4ea935087fd31ece63 with delete_type TABLET_DATA_DELETED (replaced by tablet aa71cedba3d34c288a3e3be99d474ce4) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.913304 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dccb93f3de942aabf5f534357b16282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.875614 27222 tablet_bootstrap.cc:492] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:41.912840 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 3b607279006c4baeae79325926088014 (DEFAULT_TABLE table=default.Table_2c7697ec19204b3d823f5684c30978e2 [id=9d480f65788b486db55bbbe48a0ad5eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.926918 27222 ts_tablet_manager.cc:1397] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.251s user 0.023s sys 0.046s
I20260810 11:30:41.927312 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b607279006c4baeae79325926088014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.927963 27222 raft_consensus.cc:348] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.928169 27222 raft_consensus.cc:374] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.928102 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 7161d94d80b24eeaa357cc0922a874af (DEFAULT_TABLE table=default.Table_061b7dfbcc074ad6a0d99d49113a354f [id=0186ddbf3c144b4e86ae21cbdac555d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:41.928220 27222 raft_consensus.cc:729] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.928607 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7161d94d80b24eeaa357cc0922a874af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:41.928392 27222 consensus_queue.cc:260] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.929201 27222 ts_tablet_manager.cc:1428] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:41.929471 27222 tablet_bootstrap.cc:492] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:41.931015 27228 tablet_bootstrap.cc:654] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.931571 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b200bdb394d3439b86fff48494be8e3d" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:41.931815 26915 raft_consensus.cc:2379] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
I20260810 11:30:41.935751 27222 tablet_bootstrap.cc:654] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:41.936079 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a consensus state has no leader
I20260810 11:30:41.936451 28345 leader_election.cc:288] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:41.936898 29027 tablet.cc:1722] T e8dc3dece9d84d47a638707d10de6fd4 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 11:30:41.941636 26849 leader_election.cc:341] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: db59523b71224370bf5fce6b56592f71
I20260810 11:30:41.944787 27231 tablet_bootstrap.cc:654] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.926620 28640 raft_consensus.cc:2726] T adecd2f0952b4f4c83919c78d563e429 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:41.938282 29026 tablet.cc:1722] T e8dc3dece9d84d47a638707d10de6fd4 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:41.952276 26912 raft_consensus.cc:2454] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:41.957003 28640 raft_consensus.cc:482] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6079090b1124d84aa4477974bb53700)
I20260810 11:30:41.940774 29034 tablet.cc:1722] T 592be61b7e524941931264125b33d92c P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:41.941324 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ada1df82eb44ecb9a6c615b5410e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.942142 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet cc76d30f37094391b75076c92ccc277f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.942345 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet 64818ca5827e41d99428903ddb8688d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.942572 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 2634beb347714fc7a2e05865adb34a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.942806 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.942827 26738 tablet_service.cc:1514] Processing DeleteTablet for tablet 10210204d5ff4e5e97c98fd255f674a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.943596 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 713663be70014b17b17056a865e7db63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.943763 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.965214 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:41.965651 27231 tablet_bootstrap.cc:492] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:41.965853 27231 ts_tablet_manager.cc:1397] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.065s user 0.003s sys 0.002s
W20260810 11:30:41.965701 26564 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1801d3af4a4548dba8b0d8ea2fecf5ba consensus state has no leader
I20260810 11:30:41.968706 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:41.973567 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:41.973750 27222 tablet_bootstrap.cc:492] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:41.946046 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet 834c9c99ec424bb39e8a003e9204b2bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.947331 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 55c8749861874eca9b63d3db97afa2b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.977173 27222 ts_tablet_manager.cc:1397] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.004s
I20260810 11:30:41.948390 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d5e146eeec4fe0be33c1c169d32e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.949730 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 1860e56467624dcdb288e13b004f78cc with delete_type TABLET_DATA_DELETED (replaced by tablet 214be3356fda4c8484596196c0985721) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:41.957340 28640 raft_consensus.cc:504] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.978191 28640 leader_election.cc:288] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:41.944154 28987 ts_tablet_manager.cc:1918] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:41.978518 28987 log.cc:1196] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/49db12565dbc4187b78a98ed35c40fed
I20260810 11:30:41.978552 27222 raft_consensus.cc:348] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.979516 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:41.979797 28987 ts_tablet_manager.cc:1939] T 49db12565dbc4187b78a98ed35c40fed P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:41.981411 27222 raft_consensus.cc:374] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:41.981760 27222 raft_consensus.cc:729] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
W20260810 11:30:41.966051 26577 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.193:48791 (request call id 300) took 3280 ms (client timeout 1000 ms). Trace:
I20260810 11:30:41.982527 27222 consensus_queue.cc:260] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:41.982575 26577 rpcz_store.cc:269] 0810 11:30:38.658458 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:38.713153 (+ 54695us) service_pool.cc:227] Handling call
0810 11:30:38.776066 (+ 62913us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa3fd8f 00007f9c61d34946 00007f9c61d34675 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:41.938520 (+3162454us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.526523 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.526682 (+ 159us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.526689 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:40.526692 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:40.526808 (+ 116us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.526821 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.526827 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:40.527001 (+ 174us) tablet.cc:699] Row locks acquired
0810 11:30:40.527003 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:40.527062 (+ 59us) write_op.cc:270] Start()
0810 11:30:40.527106 (+ 44us) write_op.cc:276] Timestamp: P: 1786361440527033 usec, L: 0
0810 11:30:40.527122 (+ 16us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.527351 (+ 229us) log.cc:842] Serialized 356 byte log entry
0810 11:30:40.534140 (+ 6789us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.535051 (+ 911us) write_op.cc:301] APPLY: starting
0810 11:30:40.535062 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.535089 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.535116 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.535154 (+ 38us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.535187 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:40.535196 (+ 9us) write_op.cc:312] APPLY: finished
0810 11:30:40.535271 (+ 75us) log.cc:842] Serialized 23 byte log entry
0810 11:30:40.535310 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.535324 (+ 14us) write_op.cc:454] Released schema lock
0810 11:30:40.535330 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.535375 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.535379 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6170,"reported_tablets":184,"spinlock_wait_cycles":98931072,"child_traces":[["op",{"apply.queue_time_us":883,"apply.run_cpu_time_us":367,"apply.run_wall_time_us":366,"num_ops":1,"prepare.queue_time_us":74,"prepare.run_cpu_time_us":1001,"prepare.run_wall_time_us":1439,"raft.queue_time_us":121,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":7002}]]}
I20260810 11:30:41.984509 27222 ts_tablet_manager.cc:1428] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260810 11:30:41.985971 27222 tablet_bootstrap.cc:492] T 110b5acc36bd4d6bba13735e5daec75f P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:41.986903 26577 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_fb8c5684b00a41eebe3f5b088bcbee33" } new_table_name: "default.Table_65da57b4be754a5b9cbc73361a4f1b93" modify_external_catalogs: true
I20260810 11:30:41.987959 27055 raft_consensus.cc:3037] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:41.988807 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8a65a0e8b1f4e4b8d9a82059b766cda" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:41.989109 27060 raft_consensus.cc:2454] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:41.989230 27222 tablet_bootstrap.cc:654] T 110b5acc36bd4d6bba13735e5daec75f P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:41.990191 26702 leader_election.cc:302] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:41.990489 28640 raft_consensus.cc:2781] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 11:30:41.990598 28640 raft_consensus.cc:482] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6079090b1124d84aa4477974bb53700)
I20260810 11:30:41.990705 28640 raft_consensus.cc:3037] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:41.991878 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 49db12565dbc4187b78a98ed35c40fed (table default.Table_49be430f1e8f475482b54850772c0430 [id=82e113439bc04ce9955f59612ba480dc]) successfully deleted
I20260810 11:30:41.993054 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:41.993919 28987 tablet_replica.cc:330] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:41.997388 28987 raft_consensus.cc:2229] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:41.997871 28987 raft_consensus.cc:2258] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:41.997843 26991 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 53009.3us
W20260810 11:30:41.998108 26991 leader_election.cc:341] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: a8a65a0e8b1f4e4b8d9a82059b766cda
I20260810 11:30:41.998215 27231 raft_consensus.cc:348] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.998745 28753 raft_consensus.cc:482] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:41.998952 28987 ts_tablet_manager.cc:1905] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:41.998956 28753 raft_consensus.cc:504] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.994268 28640 raft_consensus.cc:504] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:41.999677 28753 leader_election.cc:288] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:42.000001 28640 leader_election.cc:288] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:42.000257 27231 raft_consensus.cc:374] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:42.000416 27231 raft_consensus.cc:729] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:41.871182 28726 raft_consensus.cc:2726] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:42.000816 27231 consensus_queue.cc:260] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.002674 27231 ts_tablet_manager.cc:1428] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.037s user 0.003s sys 0.000s
I20260810 11:30:42.002996 27231 tablet_bootstrap.cc:492] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:42.004583 28726 raft_consensus.cc:482] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:42.004854 28726 raft_consensus.cc:504] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.005733 28726 leader_election.cc:288] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:42.007437 27231 tablet_bootstrap.cc:654] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:42.012391 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ea66da5bc20e4718901ffc473677421c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea66da5bc20e4718901ffc473677421c already in progress: creating tablet
I20260810 11:30:42.012914 26578 catalog_manager.cc:5495] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:42.014248 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d1d0d55b526749059470504a27887b22 (table default.Table_a164cd4bbc4344ae905f395ab1e6cffb [id=62f404c62e4040fc801f70cafddf9d95]). Expected version 1 got 0
I20260810 11:30:42.014876 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
I20260810 11:30:42.015528 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:42.015810 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:42.016060 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:42.017381 27231 tablet_bootstrap.cc:492] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:42.017545 27231 ts_tablet_manager.cc:1397] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.000s
I20260810 11:30:42.018165 27039 tablet_service.cc:1467] Processing CreateTablet for tablet 27c49b8012bd4343a995b871e81ae136 (DEFAULT_TABLE table=default.Table_86cc59e62a374a9eb464cca153e98a75 [id=54e15442ece74885b4e77eb545d60a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:42.018622 27039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27c49b8012bd4343a995b871e81ae136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:42.023010 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db59523b71224370bf5fce6b56592f71" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:42.023391 27060 raft_consensus.cc:2454] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:42.025023 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:42.025354 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8a65a0e8b1f4e4b8d9a82059b766cda" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:42.025835 26762 raft_consensus.cc:2379] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 482e605580be48cbbacce05a3e61c215 in current term 2: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:42.027661 26762 raft_consensus.cc:3037] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:42.027972 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:42.031159 27222 tablet_bootstrap.cc:492] T 110b5acc36bd4d6bba13735e5daec75f P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:42.031306 27222 ts_tablet_manager.cc:1397] T 110b5acc36bd4d6bba13735e5daec75f P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.045s user 0.005s sys 0.000s
I20260810 11:30:42.030172 26578 catalog_manager.cc:5495] T d24726d0214947beab0bb31b1597c1c3 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:42.033094 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a45422addab84e9083df8665a0cf9322" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:42.033730 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110b5acc36bd4d6bba13735e5daec75f" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:42.034238 27061 raft_consensus.cc:2454] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:42.032100 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:42.035984 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:42.037663 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet ce73798a721b4a6d892f0c24b6b40e2c (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]). Expected version 1 got 0
I20260810 11:30:42.038305 27231 raft_consensus.cc:348] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.038683 27231 raft_consensus.cc:374] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:42.038771 27231 raft_consensus.cc:729] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:42.039384 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:42.039844 28640 consensus_queue.cc:1035] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:42.041925 27222 raft_consensus.cc:348] T 110b5acc36bd4d6bba13735e5daec75f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.042172 27222 raft_consensus.cc:374] T 110b5acc36bd4d6bba13735e5daec75f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:42.042245 27222 raft_consensus.cc:729] T 110b5acc36bd4d6bba13735e5daec75f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:42.042479 27222 consensus_queue.cc:260] T 110b5acc36bd4d6bba13735e5daec75f P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.044454 27231 consensus_queue.cc:260] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.045528 28987 ts_tablet_manager.cc:1918] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:42.044637 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 2 got 0
I20260810 11:30:42.047889 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:42.049264 28987 log.cc:1196] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/7e78fb1bf0534deca5cc5a603fd77592
I20260810 11:30:42.049685 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:42.050858 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:42.053555 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:42.054387 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:42.055047 28987 ts_tablet_manager.cc:1939] T 7e78fb1bf0534deca5cc5a603fd77592 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:42.055219 27231 ts_tablet_manager.cc:1428] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.038s user 0.004s sys 0.000s
I20260810 11:30:42.045625 27222 ts_tablet_manager.cc:1428] T 110b5acc36bd4d6bba13735e5daec75f P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260810 11:30:42.058097 27222 tablet_bootstrap.cc:492] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:42.059062 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 7e78fb1bf0534deca5cc5a603fd77592 (table default.Table_3d15fcde44db49a7ba17fd166381299f [id=e88ac45e937f49b2a8be4256d1a7279e]) successfully deleted
I20260810 11:30:42.060011 28987 tablet_replica.cc:330] T 4b5a7f67ec5b48c2b5a510add0282a76 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
W20260810 11:30:42.060228 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet e276b0fa124d42dfb3fe750d245e44d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e276b0fa124d42dfb3fe750d245e44d8 already in progress: creating tablet
I20260810 11:30:42.061182 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:42.061524 28987 raft_consensus.cc:2229] T 4b5a7f67ec5b48c2b5a510add0282a76 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:42.061923 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:42.062590 28987 raft_consensus.cc:2258] T 4b5a7f67ec5b48c2b5a510add0282a76 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:42.063342 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:42.063946 28753 raft_consensus.cc:482] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:42.064196 28753 raft_consensus.cc:504] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:42.064843 28466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
I20260810 11:30:42.065374 28753 leader_election.cc:288] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:42.065369 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:42.065747 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:42.062772 27222 tablet_bootstrap.cc:654] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:42.067225 28987 ts_tablet_manager.cc:1905] T 4b5a7f67ec5b48c2b5a510add0282a76 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:42.067451 26993 leader_election.cc:302] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:42.067811 28753 raft_consensus.cc:3037] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:42.069409 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:42.072526 28753 raft_consensus.cc:2726] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:42.073848 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:42.075623 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:42.077123 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
W20260810 11:30:42.078612 28466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20260810 11:30:42.079101 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
W20260810 11:30:42.079869 28466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 11:30:42.080888 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:42.082037 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:42.082152 27222 tablet_bootstrap.cc:492] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:42.083226 27222 ts_tablet_manager.cc:1397] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.025s user 0.008s sys 0.000s
I20260810 11:30:42.084820 27222 raft_consensus.cc:348] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.085120 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:42.086771 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:42.087050 27222 raft_consensus.cc:374] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:42.087388 27222 raft_consensus.cc:729] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:42.087889 27222 consensus_queue.cc:260] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.088333 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:42.089617 27222 ts_tablet_manager.cc:1428] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260810 11:30:42.089941 28640 raft_consensus.cc:482] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:42.090443 28640 raft_consensus.cc:504] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.091058 28640 leader_election.cc:288] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:42.091549 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:42.092157 27222 tablet_bootstrap.cc:492] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:42.095434 27222 tablet_bootstrap.cc:654] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:42.096167 28921 consensus_queue.cc:1035] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:42.096779 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:42.096992 26848 leader_election.cc:302] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:42.097259 28921 raft_consensus.cc:2781] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 11:30:42.097348 28921 raft_consensus.cc:482] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:42.097426 28921 raft_consensus.cc:3037] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:42.098876 27054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "add1743851c34d58afb7e4886325d659" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:42.099124 27054 raft_consensus.cc:2454] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:42.099522 26702 leader_election.cc:302] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:42.102181 28640 raft_consensus.cc:2781] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:42.102366 28640 raft_consensus.cc:482] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:42.102458 28640 raft_consensus.cc:3037] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:42.102406 27048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9de57b6d03e34ee783b822b30090c077" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:42.102828 27048 raft_consensus.cc:2454] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:42.103892 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8a65a0e8b1f4e4b8d9a82059b766cda" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:42.101071 26578 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:42.106259 28640 raft_consensus.cc:504] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.107493 28640 leader_election.cc:288] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:42.107486 27060 raft_consensus.cc:2454] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 2.
I20260810 11:30:42.108206 26702 leader_election.cc:302] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:42.108639 28640 raft_consensus.cc:2781] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:42.108786 28640 raft_consensus.cc:482] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:42.108923 28640 raft_consensus.cc:3037] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:42.111747 28640 raft_consensus.cc:504] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.113584 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "add1743851c34d58afb7e4886325d659" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:42.113981 27060 raft_consensus.cc:3037] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:42.117009 29027 tablet.cc:1722] T 592be61b7e524941931264125b33d92c P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:42.112648 26702 leader_election.cc:302] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:42.118934 28727 raft_consensus.cc:2781] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 2 FOLLOWER]: Leader election won for term 2
I20260810 11:30:42.119395 28727 raft_consensus.cc:686] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 2 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:42.119886 28727 consensus_queue.cc:237] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.120781 26900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77ffda3325af4096bbec689397f7a324" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:42.120119 28987 ts_tablet_manager.cc:1918] T 4b5a7f67ec5b48c2b5a510add0282a76 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:42.123636 28987 log.cc:1196] T 4b5a7f67ec5b48c2b5a510add0282a76 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/4b5a7f67ec5b48c2b5a510add0282a76
I20260810 11:30:42.123884 28640 leader_election.cc:288] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:42.124210 28987 ts_tablet_manager.cc:1939] T 4b5a7f67ec5b48c2b5a510add0282a76 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:42.124758 28987 tablet_replica.cc:330] T e31b380f99854eb8b63e1f9eede1fc7c P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:42.124830 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9de57b6d03e34ee783b822b30090c077" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:42.125038 28987 raft_consensus.cc:2229] T e31b380f99854eb8b63e1f9eede1fc7c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:42.125216 27061 raft_consensus.cc:3037] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:42.125264 28987 raft_consensus.cc:2258] T e31b380f99854eb8b63e1f9eede1fc7c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:42.125830 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 4b5a7f67ec5b48c2b5a510add0282a76 (table default.Table_393d03f5197d43b6977bf48bd7818a0e [id=bc7f10791af946e5957625fb1f912c4e]) successfully deleted
I20260810 11:30:42.126403 28987 ts_tablet_manager.cc:1905] T e31b380f99854eb8b63e1f9eede1fc7c P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:42.103638 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a45422addab84e9083df8665a0cf9322" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:42.129313 27061 raft_consensus.cc:2454] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:42.133199 26905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "add1743851c34d58afb7e4886325d659" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:42.133507 26905 raft_consensus.cc:3037] T add1743851c34d58afb7e4886325d659 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:42.133836 26702 leader_election.cc:302] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:42.134135 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9de57b6d03e34ee783b822b30090c077" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:42.134364 28640 raft_consensus.cc:2781] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:42.134493 28640 raft_consensus.cc:686] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
W20260810 11:30:42.134567 26700 leader_election.cc:341] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: a8a65a0e8b1f4e4b8d9a82059b766cda
W20260810 11:30:42.134948 26700 leader_election.cc:341] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: a8a65a0e8b1f4e4b8d9a82059b766cda
I20260810 11:30:42.134888 28640 consensus_queue.cc:237] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.136852 29034 tablet.cc:1722] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:42.131126 27060 raft_consensus.cc:2454] T add1743851c34d58afb7e4886325d659 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:42.137609 26702 leader_election.cc:302] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:42.138092 28726 raft_consensus.cc:2781] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:42.138296 28726 raft_consensus.cc:686] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:42.138631 28726 consensus_queue.cc:237] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.138835 28935 consensus_queue.cc:1035] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:42.143029 27110 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:42.144706 28987 ts_tablet_manager.cc:1918] T e31b380f99854eb8b63e1f9eede1fc7c P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:42.144842 28987 log.cc:1196] T e31b380f99854eb8b63e1f9eede1fc7c P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/e31b380f99854eb8b63e1f9eede1fc7c
W20260810 11:30:42.144850 26700 leader_election.cc:341] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:42.145287 28987 ts_tablet_manager.cc:1939] T e31b380f99854eb8b63e1f9eede1fc7c P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:42.145768 28987 tablet_replica.cc:330] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:42.146004 28987 raft_consensus.cc:2229] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:42.146193 28987 raft_consensus.cc:2258] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:42.146783 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet e31b380f99854eb8b63e1f9eede1fc7c (table default.Table_5ffe87ce66134f859f413c9a6ec537b5 [id=98340b81af5d4da9b563a14d7470e1ae]) successfully deleted
W20260810 11:30:42.156455 28466 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
I20260810 11:30:42.157339 28987 ts_tablet_manager.cc:1905] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:42.158622 28466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 11:30:42.159139 28466 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
I20260810 11:30:42.162384 27231 tablet_bootstrap.cc:492] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:42.165683 27231 tablet_bootstrap.cc:654] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:42.166739 28728 consensus_queue.cc:1035] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:42.072930 26993 leader_election.cc:341] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:42.171733 26991 leader_election.cc:341] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:42.172008 26991 leader_election.cc:302] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
W20260810 11:30:42.173781 26991 leader_election.cc:341] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:42.174151 28753 raft_consensus.cc:2726] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:42.177942 28466 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 11:30:42.190161 26916 thread.cc:636] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.531s user 0.001s sys 0.009s
W20260810 11:30:42.199709 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 126776us
I20260810 11:30:42.200717 27231 tablet_bootstrap.cc:492] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:42.200872 27231 ts_tablet_manager.cc:1397] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.008s
I20260810 11:30:42.206087 27231 raft_consensus.cc:348] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.207028 27231 raft_consensus.cc:374] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:42.207149 27231 raft_consensus.cc:729] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:42.207427 27231 consensus_queue.cc:260] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.184214 26901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9de57b6d03e34ee783b822b30090c077" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:42.191411 26904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "add1743851c34d58afb7e4886325d659" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:42.190498 26916 thread.cc:602] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.532s user 0.001s sys 0.009s
I20260810 11:30:42.217378 27231 ts_tablet_manager.cc:1428] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.016s user 0.004s sys 0.000s
I20260810 11:30:42.219940 27231 tablet_bootstrap.cc:492] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:42.227384 28987 ts_tablet_manager.cc:1918] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:42.227723 28987 log.cc:1196] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/0713f4f14a284050a7774a70ab974f30
I20260810 11:30:42.228530 28987 ts_tablet_manager.cc:1939] T 0713f4f14a284050a7774a70ab974f30 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:42.229815 28921 raft_consensus.cc:504] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.230695 28921 leader_election.cc:288] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:42.235803 26702 leader_election.cc:341] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: b200bdb394d3439b86fff48494be8e3d
I20260810 11:30:42.235996 26702 leader_election.cc:302] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:42.239094 28640 raft_consensus.cc:3037] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:42.244792 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 7dccb93f3de942aabf5f534357b16282 (DEFAULT_TABLE table=default.Table_99d57a71681847508ff5f7ba60124d66 [id=23f2343f74354dae8c85e737bc48bab7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:42.245271 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 0713f4f14a284050a7774a70ab974f30 (table default.Table_a87ac76268094e76aafcb7a2766c0f1e [id=730b858701d54c73a1456c3821d069e2]) successfully deleted
I20260810 11:30:42.245373 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dccb93f3de942aabf5f534357b16282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:42.248908 27037 tablet_service.cc:1467] Processing CreateTablet for tablet 7161d94d80b24eeaa357cc0922a874af (DEFAULT_TABLE table=default.Table_061b7dfbcc074ad6a0d99d49113a354f [id=0186ddbf3c144b4e86ae21cbdac555d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:42.249476 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7161d94d80b24eeaa357cc0922a874af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:42.249547 27231 tablet_bootstrap.cc:654] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:42.249434 27039 tablet_service.cc:1467] Processing CreateTablet for tablet 3b607279006c4baeae79325926088014 (DEFAULT_TABLE table=default.Table_2c7697ec19204b3d823f5684c30978e2 [id=9d480f65788b486db55bbbe48a0ad5eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:42.262454 27039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b607279006c4baeae79325926088014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:42.263343 28640 raft_consensus.cc:2726] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:42.269200 28987 tablet_replica.cc:330] T 110b5acc36bd4d6bba13735e5daec75f P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:42.270085 28987 raft_consensus.cc:2229] T 110b5acc36bd4d6bba13735e5daec75f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:42.275966 28987 raft_consensus.cc:2258] T 110b5acc36bd4d6bba13735e5daec75f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:42.277609 28987 ts_tablet_manager.cc:1905] T 110b5acc36bd4d6bba13735e5daec75f P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:42.277984 27999 ts_tablet_manager.cc:1918] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:42.278409 27999 log.cc:1196] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/23637a02b6464e17aa2a69ea5cc4ddfe
I20260810 11:30:42.279215 27999 ts_tablet_manager.cc:1939] T 23637a02b6464e17aa2a69ea5cc4ddfe P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:42.287120 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:42.287525 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
W20260810 11:30:42.289384 26849 leader_election.cc:341] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: db59523b71224370bf5fce6b56592f71
I20260810 11:30:42.289920 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:42.290426 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:42.292419 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:42.292834 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d1d0d55b526749059470504a27887b22 (table default.Table_a164cd4bbc4344ae905f395ab1e6cffb [id=62f404c62e4040fc801f70cafddf9d95]). Expected version 1 got 0
I20260810 11:30:42.295753 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:42.301268 26576 catalog_manager.cc:5495] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:42.304514 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:42.305742 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:42.307372 27231 tablet_bootstrap.cc:492] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:42.307554 27231 ts_tablet_manager.cc:1397] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.088s user 0.002s sys 0.011s
I20260810 11:30:42.308202 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:42.309268 27228 tablet_bootstrap.cc:492] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:42.309381 26905 raft_consensus.cc:2454] T add1743851c34d58afb7e4886325d659 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:42.311004 27231 raft_consensus.cc:348] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.311266 27231 raft_consensus.cc:374] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:42.311316 27231 raft_consensus.cc:729] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:42.311589 27231 consensus_queue.cc:260] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.311831 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:42.314865 27231 ts_tablet_manager.cc:1428] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.007s user 0.002s sys 0.002s
I20260810 11:30:42.316694 27231 tablet_bootstrap.cc:492] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:42.317668 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:42.318288 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:42.318804 27228 ts_tablet_manager.cc:1397] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.681s user 0.003s sys 0.008s
I20260810 11:30:42.325390 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:42.325547 29027 tablet.cc:1722] T b4a37afa17d04e3181e7513ac8d23c24 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:42.325822 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet ce73798a721b4a6d892f0c24b6b40e2c (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]). Expected version 1 got 0
I20260810 11:30:42.326016 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:42.326646 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:42.330250 27231 tablet_bootstrap.cc:654] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:42.330824 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:42.331548 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 592be61b7e524941931264125b33d92c (table default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a]). Expected version 2 got 0
W20260810 11:30:42.283384 26700 leader_election.cc:341] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:42.314159 28640 raft_consensus.cc:482] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:42.332721 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:42.316129 29034 tablet.cc:1722] T 1f64d4b9320c4cb39f57573d781a47d3 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 11:30:42.324231 29026 tablet.cc:1722] T b4a37afa17d04e3181e7513ac8d23c24 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 11:30:42.336908 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 53543.9us
I20260810 11:30:42.339828 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:42.340755 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:42.341446 29078 tablet.cc:1722] T 83992214ba314d3fa674e00d8eaddec6 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:42.346028 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:42.350919 29052 tablet.cc:1722] T 592be61b7e524941931264125b33d92c P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:42.352312 26848 leader_election.cc:302] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:42.353194 29069 raft_consensus.cc:2781] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:42.356524 29027 tablet.cc:1722] T 83992214ba314d3fa674e00d8eaddec6 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:42.351816 29057 tablet.cc:1722] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:42.353320 29069 raft_consensus.cc:482] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:42.358057 29069 raft_consensus.cc:3037] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:42.359583 28845 raft_consensus.cc:482] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:42.359747 28845 raft_consensus.cc:504] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.360411 28845 leader_election.cc:288] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:42.362224 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:42.362950 28779 consensus_queue.cc:1035] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:42.366365 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:42.368479 28345 consensus_queue.cc:1035] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:42.368499 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:42.369213 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:42.384840 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:42.390799 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
I20260810 11:30:42.391883 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:42.392951 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:42.396073 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:42.398871 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:42.371510 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "809b5b6b65d244cd9186517e39494839" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:42.400766 26991 leader_election.cc:341] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:42.412132 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77ffda3325af4096bbec689397f7a324" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:42.414628 26963 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
W20260810 11:30:42.420686 29042 log.cc:924] Time spent T 83992214ba314d3fa674e00d8eaddec6 P b6079090b1124d84aa4477974bb53700: Append to log took a long time: real 0.056s user 0.000s sys 0.001s
I20260810 11:30:42.378135 29069 raft_consensus.cc:504] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.385871 27228 raft_consensus.cc:348] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.424136 27228 raft_consensus.cc:374] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:42.424386 27228 raft_consensus.cc:729] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:42.424763 27228 consensus_queue.cc:260] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.425350 27228 ts_tablet_manager.cc:1428] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.106s user 0.000s sys 0.003s
I20260810 11:30:42.426112 27228 tablet_bootstrap.cc:492] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:42.427628 29057 tablet.cc:1722] T b4a37afa17d04e3181e7513ac8d23c24 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 11:30:42.429062 29062 log.cc:924] Time spent T bd6b328baa2346afbbe9f513ae4db3df P 443ec871f1ed4232b932ecfb0b18510d: Append to log took a long time: real 0.100s user 0.000s sys 0.000s
I20260810 11:30:42.433976 29069 leader_election.cc:288] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:42.434206 27228 tablet_bootstrap.cc:654] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:42.429946 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110b5acc36bd4d6bba13735e5daec75f" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
W20260810 11:30:42.435496 26849 leader_election.cc:341] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: Tablet not RUNNING: STOPPED
I20260810 11:30:42.436414 28345 raft_consensus.cc:482] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 11:30:42.436717 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 49141.6us
I20260810 11:30:42.430773 26576 catalog_manager.cc:5495] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
W20260810 11:30:42.439749 27113 tablet.cc:2369] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 11:30:42.441123 28845 raft_consensus.cc:482] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:42.441234 28902 raft_consensus.cc:482] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:42.441264 28845 raft_consensus.cc:504] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.441344 28902 raft_consensus.cc:504] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.441867 28902 leader_election.cc:288] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:42.441977 28845 leader_election.cc:288] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:42.439424 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:42.444427 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc558690dce44e999e55e9bf1b6ca172" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:42.446611 29077 tablet.cc:1722] T 1f64d4b9320c4cb39f57573d781a47d3 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 11:30:42.447348 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:42.449086 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:42.449368 27222 tablet_bootstrap.cc:492] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:42.449586 27222 ts_tablet_manager.cc:1397] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.358s user 0.009s sys 0.014s
I20260810 11:30:42.449429 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 31) took 2068 ms. Trace:
I20260810 11:30:42.449795 27999 rpcz_store.cc:276] 0810 11:30:40.380906 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.380972 (+ 66us) service_pool.cc:227] Handling call
0810 11:30:41.802240 (+1421268us) ts_tablet_manager.cc:1145] Deleting tablet 23637a02b6464e17aa2a69ea5cc4ddfe
0810 11:30:41.802252 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:41.881335 (+ 79083us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:42.237703 (+356368us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:42.449401 (+211698us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1421090}
I20260810 11:30:42.450654 27999 tablet_replica.cc:330] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:42.450910 27999 raft_consensus.cc:2229] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:42.451087 27999 raft_consensus.cc:2258] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:42.450455 27222 raft_consensus.cc:348] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.451359 27222 raft_consensus.cc:374] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:42.451431 27222 raft_consensus.cc:729] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:42.451695 27999 ts_tablet_manager.cc:1905] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:42.451683 27222 consensus_queue.cc:260] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.450397 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 23637a02b6464e17aa2a69ea5cc4ddfe (table default.Table_15f8b33002864cd2872dc2a70e613456 [id=bb3435760ed6476fbec4aee7d609cd85]) successfully deleted
I20260810 11:30:42.453166 27222 ts_tablet_manager.cc:1428] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 11:30:42.453459 27222 tablet_bootstrap.cc:492] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:42.455050 27222 tablet_bootstrap.cc:654] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:42.453150 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:42.461382 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:42.462378 29052 tablet.cc:1722] T bd6b328baa2346afbbe9f513ae4db3df P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:42.464126 28987 ts_tablet_manager.cc:1918] T 110b5acc36bd4d6bba13735e5daec75f P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 11:30:42.465610 26991 leader_election.cc:341] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:42.466106 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:42.466555 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1860e56467624dcdb288e13b004f78cc" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:42.468538 26576 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:42.472419 26572 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 6179cb2be2c442ee97161fe1f4661b64
I20260810 11:30:42.472699 26572 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 145) took 2456 ms. Trace:
I20260810 11:30:42.472883 26572 rpcz_store.cc:276] 0810 11:30:40.016456 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.548266 (+1531810us) service_pool.cc:227] Handling call
0810 11:30:41.549017 (+ 751us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:41.549211 (+ 194us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:41.549294 (+ 83us) catalog_manager.cc:2761] Locking tablets
0810 11:30:41.549445 (+ 151us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:41.725343 (+175898us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:41.741338 (+ 15995us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:42.472221 (+730883us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:42.472550 (+ 329us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:41.645681 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:41.645812 (+ 131us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:41.645820 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:41.645823 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:41.645963 (+ 140us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:41.645976 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:41.645982 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:41.646087 (+ 105us) tablet.cc:699] Row locks acquired
0810 11:30:41.646090 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:41.646133 (+ 43us) write_op.cc:270] Start()
0810 11:30:41.646174 (+ 41us) write_op.cc:276] Timestamp: P: 1786361441646091 usec, L: 0
0810 11:30:41.646179 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:41.715168 (+ 68989us) log.cc:842] Serialized 533 byte log entry
0810 11:30:41.715896 (+ 728us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f9c62f1dd02 00007f9c642507f1 00007f9c6424f359 00007f9c642571bb 00007f9c64257038 00000000009edb7c 00007f9c57a55344 00007f9c57a5891b 00007f9c57a58798 00000000009edb7c
0810 11:30:41.724313 (+ 8417us) op_driver.cc:444] REPLICATION: finished
0810 11:30:41.724660 (+ 347us) write_op.cc:301] APPLY: starting
0810 11:30:41.724680 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:41.724729 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:41.724731 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:41.724801 (+ 70us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:41.724838 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:41.724845 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:41.724935 (+ 90us) log.cc:842] Serialized 29 byte log entry
0810 11:30:41.725228 (+ 293us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:41.725249 (+ 21us) write_op.cc:454] Released schema lock
0810 11:30:41.725257 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:41.725397 (+ 140us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:41.725426 (+ 29us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":279,"apply.run_cpu_time_us":535,"apply.run_wall_time_us":826,"num_ops":2,"prepare.queue_time_us":95552,"prepare.run_cpu_time_us":1542,"prepare.run_wall_time_us":70301,"raft.queue_time_us":2694,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":902,"replication_time_us":78105,"spinlock_wait_cycles":157992320}]]}
I20260810 11:30:42.474296 26572 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_f3f00d1fa4db4cd4bbaaeefeef68897d" } new_table_name: "default.Table_078ba3396f414043a14962c817c6ad28" modify_external_catalogs: true
I20260810 11:30:42.477463 29069 raft_consensus.cc:482] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:42.477607 29069 raft_consensus.cc:504] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:42.495592 26572 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 67364e1082184aad82a85c3fda850a26 consensus state has no leader
I20260810 11:30:42.495887 26572 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 147) took 1980 ms. Trace:
I20260810 11:30:42.496120 26572 rpcz_store.cc:276] 0810 11:30:40.515179 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.473863 (+1958684us) service_pool.cc:227] Handling call
0810 11:30:42.474594 (+ 731us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:42.474850 (+ 256us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:42.475227 (+ 377us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:42.475320 (+ 93us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:42.494185 (+ 18865us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:42.495810 (+ 1625us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.479815 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.480001 (+ 186us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.480009 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:42.480011 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:42.480130 (+ 119us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.480144 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.480149 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:42.480217 (+ 68us) tablet.cc:699] Row locks acquired
0810 11:30:42.480219 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:42.480263 (+ 44us) write_op.cc:270] Start()
0810 11:30:42.480301 (+ 38us) write_op.cc:276] Timestamp: P: 1786361442480255 usec, L: 0
0810 11:30:42.480305 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.480539 (+ 234us) log.cc:842] Serialized 405 byte log entry
0810 11:30:42.486122 (+ 5583us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.486295 (+ 173us) write_op.cc:301] APPLY: starting
0810 11:30:42.486317 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.486373 (+ 56us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.486420 (+ 47us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.486491 (+ 71us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.486540 (+ 49us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:42.486550 (+ 10us) write_op.cc:312] APPLY: finished
0810 11:30:42.486653 (+ 103us) log.cc:842] Serialized 23 byte log entry
0810 11:30:42.486730 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.486758 (+ 28us) write_op.cc:454] Released schema lock
0810 11:30:42.486767 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:42.486853 (+ 86us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.486870 (+ 17us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":112,"apply.run_cpu_time_us":724,"apply.run_wall_time_us":723,"num_ops":1,"prepare.queue_time_us":3740,"prepare.run_cpu_time_us":893,"prepare.run_wall_time_us":903,"raft.queue_time_us":1118,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":266,"replication_time_us":5782}]]}
W20260810 11:30:42.500458 26991 leader_election.cc:341] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:42.503970 26578 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_065fc82a2823470b89b4cff36ca03027 [id=60ce1267de814f218c27ac084a08a26a] alter complete (version 1)
I20260810 11:30:42.452999 28345 raft_consensus.cc:504] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.506503 28345 leader_election.cc:288] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:42.507287 28987 log.cc:1196] T 110b5acc36bd4d6bba13735e5daec75f P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/110b5acc36bd4d6bba13735e5daec75f
I20260810 11:30:42.507896 28987 ts_tablet_manager.cc:1939] T 110b5acc36bd4d6bba13735e5daec75f P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:42.508793 26574 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_7cbd744a71da44b28fef2d5b57df58d4 [id=855a2f7a37c84ade8be77e7c0ba17a14] alter complete (version 1)
I20260810 11:30:42.509523 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 110b5acc36bd4d6bba13735e5daec75f (table default.Table_24bdc44050024c23aa90a182bdcecb50 [id=4ea7ee58aac74fba84dbbcc009017421]) successfully deleted
W20260810 11:30:42.523561 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 23637a02b6464e17aa2a69ea5cc4ddfe because the tablet was not found. No further retry: Not found: Tablet not found: 23637a02b6464e17aa2a69ea5cc4ddfe
I20260810 11:30:42.528067 28466 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.195.212:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.25.195.254:41125,127.25.195.253:34547,127.25.195.252:34489
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.195.253:34547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.195.253
--webserver_port=42129
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 10:32:47 UTC on ccycloud.quasar-nosthy.root.comops.site
build id 4577509
ASAN enabled
I20260810 11:30:42.529127 28898 raft_consensus.cc:482] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:42.532337 28466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
W20260810 11:30:42.534158 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 3ccef06fa06c4c519d8760fa948d6c8b because the tablet was not found. No further retry: Not found: Tablet not found: 3ccef06fa06c4c519d8760fa948d6c8b
I20260810 11:30:42.534701 26577 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 146) took 2032 ms. Trace:
I20260810 11:30:42.535005 26577 rpcz_store.cc:276] 0810 11:30:40.502111 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.986378 (+1484267us) service_pool.cc:227] Handling call
0810 11:30:41.987228 (+ 850us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:41.987491 (+ 263us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:41.987723 (+ 232us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:41.987821 (+ 98us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:42.004859 (+ 17038us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.004867 (+ 8us) write_op.cc:454] Released schema lock
0810 11:30:42.004969 (+ 102us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:42.534579 (+529610us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:41.993461 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:41.993623 (+ 162us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:41.993634 (+ 11us) write_op.cc:435] Acquired schema lock
0810 11:30:41.993639 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:41.993836 (+ 197us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:41.993855 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:41.993860 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:41.993942 (+ 82us) tablet.cc:699] Row locks acquired
0810 11:30:41.993946 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:41.993992 (+ 46us) write_op.cc:270] Start()
0810 11:30:41.994037 (+ 45us) write_op.cc:276] Timestamp: P: 1786361441993965 usec, L: 0
0810 11:30:41.994044 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:41.994308 (+ 264us) log.cc:842] Serialized 405 byte log entry
0810 11:30:41.999121 (+ 4813us) op_driver.cc:444] REPLICATION: finished
0810 11:30:41.999267 (+ 146us) write_op.cc:301] APPLY: starting
0810 11:30:41.999286 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:41.999346 (+ 60us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:41.999433 (+ 87us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:41.999508 (+ 75us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:41.999548 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:41.999555 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:41.999659 (+ 104us) log.cc:842] Serialized 23 byte log entry
0810 11:30:41.999731 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:41.999755 (+ 24us) write_op.cc:454] Released schema lock
0810 11:30:41.999763 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":92,"apply.run_cpu_time_us":560,"apply.run_wall_time_us":559,"num_ops":1,"prepare.queue_time_us":2380,"prepare.run_cpu_time_us":997,"prepare.run_wall_time_us":2286,"raft.queue_time_us":139,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":253,"replication_time_us":5044}]]}
I20260810 11:30:42.536953 26577 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_065fc82a2823470b89b4cff36ca03027" } modify_external_catalogs: true
W20260810 11:30:42.537469 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 518c777e40ec40dcb3484c0374384959 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 518c777e40ec40dcb3484c0374384959 already in progress: creating tablet
I20260810 11:30:42.538146 29069 leader_election.cc:288] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:42.486552 28640 raft_consensus.cc:504] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.499127 27222 tablet_bootstrap.cc:492] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:42.540055 27222 ts_tablet_manager.cc:1397] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.087s user 0.002s sys 0.002s
I20260810 11:30:42.540987 28640 leader_election.cc:288] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:42.540838 27222 raft_consensus.cc:348] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.541081 27222 raft_consensus.cc:374] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:42.541147 27222 raft_consensus.cc:729] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:42.541388 27222 consensus_queue.cc:260] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.542207 27222 ts_tablet_manager.cc:1428] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 11:30:42.542330 26574 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_ea330e3236fb4089b9b4f17ae165fa3c [id=933ce361d9e941d0ae10caa20a0d96ea] alter complete (version 2)
I20260810 11:30:42.542495 27222 tablet_bootstrap.cc:492] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:42.542726 28987 tablet_replica.cc:330] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:42.542941 28987 raft_consensus.cc:2229] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:42.543143 28987 raft_consensus.cc:2258] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:42.543737 28987 ts_tablet_manager.cc:1905] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:42.544085 27222 tablet_bootstrap.cc:654] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:42.545583 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 6c715bdcff8c4cdabfddf871f6fdc388 because the tablet was not found. No further retry: Not found: Tablet not found: 6c715bdcff8c4cdabfddf871f6fdc388
W20260810 11:30:42.546348 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet d14091e1c111438bac8bcf3d36123d80 because the tablet was not found. No further retry: Not found: Tablet not found: d14091e1c111438bac8bcf3d36123d80
I20260810 11:30:42.553999 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 2801709d53614916abac370f7ae5e913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.554483 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.559888 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet fc558690dce44e999e55e9bf1b6ca172 with delete_type TABLET_DATA_DELETED (replaced by tablet 0bb01711769f457aa0696bb59582166d) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.561220 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a1e2e624fff4692a22e29b293cd82d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.562115 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 1860e56467624dcdb288e13b004f78cc with delete_type TABLET_DATA_DELETED (replaced by tablet 214be3356fda4c8484596196c0985721) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.562189 27222 tablet_bootstrap.cc:492] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:42.562381 27222 ts_tablet_manager.cc:1397] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.007s
I20260810 11:30:42.563024 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d5e146eeec4fe0be33c1c169d32e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.564311 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 10210204d5ff4e5e97c98fd255f674a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.565138 27222 raft_consensus.cc:348] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.565853 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 55c8749861874eca9b63d3db97afa2b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.566802 27222 raft_consensus.cc:374] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:42.567394 27222 raft_consensus.cc:729] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:42.568631 27222 consensus_queue.cc:260] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.571487 27222 ts_tablet_manager.cc:1428] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
W20260810 11:30:42.572888 26575 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet ce73798a721b4a6d892f0c24b6b40e2c (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet ce73798a721b4a6d892f0c24b6b40e2c consensus state has no leader
I20260810 11:30:42.575562 28466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 11:30:42.578815 27222 tablet_bootstrap.cc:492] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:42.583279 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 2801709d53614916abac370f7ae5e913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.584106 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.584757 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 3851d39aeb3142938a5ac558ab438c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:42.587472 26573 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.195:32877 (request call id 341) took 3959 ms (client timeout 1000 ms). Trace:
I20260810 11:30:42.590663 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.591533 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet fc558690dce44e999e55e9bf1b6ca172 with delete_type TABLET_DATA_DELETED (replaced by tablet 0bb01711769f457aa0696bb59582166d) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.599027 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 3851d39aeb3142938a5ac558ab438c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.600226 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet b200bdb394d3439b86fff48494be8e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:40 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.529299 28898 raft_consensus.cc:504] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.602699 27231 tablet_bootstrap.cc:492] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:42.602881 27231 ts_tablet_manager.cc:1397] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.286s user 0.005s sys 0.005s
I20260810 11:30:42.604534 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3406f12d9c492cbd0d86fa7a57de82 with delete_type TABLET_DATA_DELETED (replaced by tablet 72e0b69e7c7e4343b309d16c030d4306) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.606365 28898 leader_election.cc:288] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:42.606362 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "490ada0a918d48c3a07e12eed58bda19" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:42.607932 26991 leader_election.cc:341] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:42.610128 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.610620 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.613369 29057 tablet.cc:1722] T 9e329b95fc8e41c3967079896294942a P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:42.613498 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10e6c41db71a4146840f06c5b7412d9c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:42.615649 27061 raft_consensus.cc:2454] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
W20260810 11:30:42.616077 26574 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.193:48791 (request call id 301) took 2891 ms (client timeout 1000 ms). Trace:
I20260810 11:30:42.616381 26702 leader_election.cc:302] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:42.617441 28640 raft_consensus.cc:2781] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 11:30:42.617555 28640 raft_consensus.cc:482] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:42.617636 28640 raft_consensus.cc:3037] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:42.621812 27231 raft_consensus.cc:348] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.622177 27231 raft_consensus.cc:374] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:42.622243 27231 raft_consensus.cc:729] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:42.622282 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f24c84cdd945b78f39f24015eb1e43 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b95f3ec8ff34c89a68cd1edf8391f9b) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.622494 27231 consensus_queue.cc:260] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.625608 27231 ts_tablet_manager.cc:1428] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.023s user 0.004s sys 0.000s
I20260810 11:30:42.627089 28987 ts_tablet_manager.cc:1918] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:42.627224 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.627388 27231 tablet_bootstrap.cc:492] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:42.627553 28987 log.cc:1196] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/cb6805a5dd264939850ea2cd9a850a1f
I20260810 11:30:42.628136 28987 ts_tablet_manager.cc:1939] T cb6805a5dd264939850ea2cd9a850a1f P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:42.629070 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.629323 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet ea66da5bc20e4718901ffc473677421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.629304 28640 raft_consensus.cc:504] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.630690 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 02ff6a9bc02441ddb7f307d6b3df31bd with delete_type TABLET_DATA_DELETED (replaced by tablet aaef5a4d651e4bc2b0b76cf6f51b0751) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.630767 28640 leader_election.cc:288] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:42.631994 26574 rpcz_store.cc:269] 0810 11:30:39.724627 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:39.806287 (+ 81660us) service_pool.cc:227] Handling call
0810 11:30:42.615914 (+2809627us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.113945 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.114108 (+ 163us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.114115 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:40.114117 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:40.114236 (+ 119us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.114252 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.114256 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:40.114333 (+ 77us) tablet.cc:699] Row locks acquired
0810 11:30:40.114335 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:40.114372 (+ 37us) write_op.cc:270] Start()
0810 11:30:40.114409 (+ 37us) write_op.cc:276] Timestamp: P: 1786361440114333 usec, L: 0
0810 11:30:40.114412 (+ 3us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.114628 (+ 216us) log.cc:842] Serialized 536 byte log entry
0810 11:30:40.122940 (+ 8312us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.123140 (+ 200us) write_op.cc:301] APPLY: starting
0810 11:30:40.123164 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.123215 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.123250 (+ 35us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.123337 (+ 87us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.123389 (+ 52us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:40.123396 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:40.123531 (+ 135us) log.cc:842] Serialized 23 byte log entry
0810 11:30:40.123626 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.123673 (+ 47us) write_op.cc:454] Released schema lock
0810 11:30:40.123689 (+ 16us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.123807 (+ 118us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.123812 (+ 5us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:41.716017 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:41.716180 (+ 163us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:41.716188 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:41.716190 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:41.716313 (+ 123us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:41.716327 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:41.716332 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:41.716409 (+ 77us) tablet.cc:699] Row locks acquired
0810 11:30:41.716411 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:41.716451 (+ 40us) write_op.cc:270] Start()
0810 11:30:41.716490 (+ 39us) write_op.cc:276] Timestamp: P: 1786361441716404 usec, L: 0
0810 11:30:41.716494 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:41.716710 (+ 216us) log.cc:842] Serialized 356 byte log entry
0810 11:30:41.724388 (+ 7678us) op_driver.cc:444] REPLICATION: finished
0810 11:30:41.725559 (+ 1171us) write_op.cc:301] APPLY: starting
0810 11:30:41.725572 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:41.725628 (+ 56us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:41.725655 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:41.725719 (+ 64us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:41.725769 (+ 50us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:41.725776 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:41.725887 (+ 111us) log.cc:842] Serialized 23 byte log entry
0810 11:30:41.726173 (+ 286us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:41.726212 (+ 39us) write_op.cc:454] Released schema lock
0810 11:30:41.726218 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:41.726363 (+ 145us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:41.726367 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:42.517836 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.517936 (+ 100us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.517941 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:42.517943 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:42.518023 (+ 80us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.518044 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.518048 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:42.518123 (+ 75us) tablet.cc:699] Row locks acquired
0810 11:30:42.518125 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:42.518154 (+ 29us) write_op.cc:270] Start()
0810 11:30:42.518182 (+ 28us) write_op.cc:276] Timestamp: P: 1786361442518146 usec, L: 0
0810 11:30:42.518186 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.518336 (+ 150us) log.cc:842] Serialized 356 byte log entry
0810 11:30:42.540138 (+ 21802us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.541134 (+ 996us) write_op.cc:301] APPLY: starting
0810 11:30:42.541152 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.541192 (+ 40us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.541273 (+ 81us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.541324 (+ 51us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.541363 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:42.541373 (+ 10us) write_op.cc:312] APPLY: finished
0810 11:30:42.541447 (+ 74us) log.cc:842] Serialized 23 byte log entry
0810 11:30:42.541500 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.541519 (+ 19us) write_op.cc:454] Released schema lock
0810 11:30:42.541525 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:42.541588 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.541594 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":42191,"reported_tablets":187,"child_traces":[["op",{"apply.queue_time_us":132,"apply.run_cpu_time_us":769,"apply.run_wall_time_us":769,"num_ops":1,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":814,"prepare.run_wall_time_us":815,"raft.queue_time_us":1865,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":364,"replication_time_us":8490}],["op",{"apply.queue_time_us":1118,"apply.run_cpu_time_us":468,"apply.run_wall_time_us":890,"num_ops":1,"prepare.queue_time_us":163845,"prepare.run_cpu_time_us":10061,"prepare.run_wall_time_us":130637,"raft.queue_time_us":2298,"raft.run_cpu_time_us":8,"raft.run_wall_time_us":8,"replication_time_us":7880,"thread_start_us":181742,"threads_started":2}],["op",{"apply.queue_time_us":957,"apply.run_cpu_time_us":514,"apply.run_wall_time_us":513,"num_ops":1,"prepare.queue_time_us":7201,"prepare.run_cpu_time_us":918,"prepare.run_wall_time_us":11070,"raft.queue_time_us":1690,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":7,"replication_time_us":21937,"thread_start_us":29133,"threads_started":2}]]}
I20260810 11:30:42.634938 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10e6c41db71a4146840f06c5b7412d9c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
W20260810 11:30:42.587836 26573 rpcz_store.cc:269] 0810 11:30:38.627911 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:38.661517 (+ 33606us) service_pool.cc:227] Handling call
0810 11:30:38.774491 (+112974us) spinlock_profiling.cc:243] Waited 73.9 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa3fd8f 00007f9c61d34946 00007f9c61d34675 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:42.587357 (+3812866us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:39.360013 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:39.360217 (+ 204us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:39.360225 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:39.360228 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:39.362188 (+ 1960us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:39.362213 (+ 25us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:39.362224 (+ 11us) tablet.cc:683] Acquiring locks for 18 operations
0810 11:30:39.362751 (+ 527us) tablet.cc:699] Row locks acquired
0810 11:30:39.362756 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:39.362827 (+ 71us) write_op.cc:270] Start()
0810 11:30:39.362875 (+ 48us) write_op.cc:276] Timestamp: P: 1786361439362804 usec, L: 0
0810 11:30:39.362880 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:39.363276 (+ 396us) log.cc:842] Serialized 7048 byte log entry
0810 11:30:39.374192 (+ 10916us) op_driver.cc:444] REPLICATION: finished
0810 11:30:39.374368 (+ 176us) write_op.cc:301] APPLY: starting
0810 11:30:39.374387 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:39.374555 (+ 168us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:39.374623 (+ 68us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:39.374855 (+ 232us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:39.374913 (+ 58us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0810 11:30:39.374920 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:39.375099 (+ 179us) log.cc:842] Serialized 125 byte log entry
0810 11:30:39.375176 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.375213 (+ 37us) write_op.cc:454] Released schema lock
0810 11:30:39.375227 (+ 14us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:39.375298 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.375301 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:39.425795 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:39.425975 (+ 180us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:39.425986 (+ 11us) write_op.cc:435] Acquired schema lock
0810 11:30:39.425992 (+ 6us) tablet.cc:660] Decoding operations
0810 11:30:39.426136 (+ 144us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:39.426156 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:39.426164 (+ 8us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:39.426250 (+ 86us) tablet.cc:699] Row locks acquired
0810 11:30:39.426252 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:39.426305 (+ 53us) write_op.cc:270] Start()
0810 11:30:39.426348 (+ 43us) write_op.cc:276] Timestamp: P: 1786361439426281 usec, L: 0
0810 11:30:39.426352 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:39.426908 (+ 556us) log.cc:842] Serialized 356 byte log entry
0810 11:30:39.433667 (+ 6759us) op_driver.cc:444] REPLICATION: finished
0810 11:30:39.434088 (+ 421us) write_op.cc:301] APPLY: starting
0810 11:30:39.434115 (+ 27us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:39.434166 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:39.434198 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:39.434283 (+ 85us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:39.434324 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:39.434331 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:39.434477 (+ 146us) log.cc:842] Serialized 23 byte log entry
0810 11:30:39.434578 (+ 101us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.434604 (+ 26us) write_op.cc:454] Released schema lock
0810 11:30:39.434613 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:39.434702 (+ 89us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.434706 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:39.808421 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:39.808660 (+ 239us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:39.808671 (+ 11us) write_op.cc:435] Acquired schema lock
0810 11:30:39.808675 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:39.808853 (+ 178us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:39.808874 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:39.808881 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:39.808979 (+ 98us) tablet.cc:699] Row locks acquired
0810 11:30:39.808982 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:39.809035 (+ 53us) write_op.cc:270] Start()
0810 11:30:39.809084 (+ 49us) write_op.cc:276] Timestamp: P: 1786361439808971 usec, L: 0
0810 11:30:39.809090 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:39.809338 (+ 248us) log.cc:842] Serialized 356 byte log entry
0810 11:30:39.814214 (+ 4876us) op_driver.cc:444] REPLICATION: finished
0810 11:30:39.814444 (+ 230us) write_op.cc:301] APPLY: starting
0810 11:30:39.814476 (+ 32us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:39.814525 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:39.814576 (+ 51us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:39.814645 (+ 69us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:39.814688 (+ 43us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:39.814700 (+ 12us) write_op.cc:312] APPLY: finished
0810 11:30:39.814791 (+ 91us) log.cc:842] Serialized 23 byte log entry
0810 11:30:39.814863 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.814886 (+ 23us) write_op.cc:454] Released schema lock
0810 11:30:39.814894 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:39.814965 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.814969 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":75138,"reported_tablets":181,"spinlock_wait_cycles":170010880,"child_traces":[["op",{"apply.queue_time_us":116,"apply.run_cpu_time_us":1007,"apply.run_wall_time_us":1006,"num_ops":18,"prepare.queue_time_us":201,"prepare.run_cpu_time_us":2712,"prepare.run_wall_time_us":5219,"raft.queue_time_us":1520,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":344,"replication_time_us":11273}],["op",{"apply.queue_time_us":322,"apply.run_cpu_time_us":701,"apply.run_wall_time_us":700,"num_ops":1,"prepare.queue_time_us":39637,"prepare.run_cpu_time_us":1154,"prepare.run_wall_time_us":5170,"raft.queue_time_us":167,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":395,"replication_time_us":7272}],["op",{"apply.queue_time_us":101,"apply.run_cpu_time_us":589,"apply.run_wall_time_us":588,"num_ops":1,"prepare.queue_time_us":1239,"prepare.run_cpu_time_us":1083,"prepare.run_wall_time_us":1085,"raft.queue_time_us":1113,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":264,"replication_time_us":5096}]]}
I20260810 11:30:42.635170 27061 raft_consensus.cc:3037] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:42.635574 26573 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_c40dd8e327db40b59167de093a5c616d" } modify_external_catalogs: true
I20260810 11:30:42.635937 26573 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_c40dd8e327db40b59167de093a5c616d" } modify_external_catalogs: true
I20260810 11:30:42.638896 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet b6395bce17ee40c2822669246ce7eb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:42.627010 26581 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.193:48791 (request call id 302) took 1827 ms (client timeout 1000 ms). Trace:
I20260810 11:30:42.639921 27049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db59523b71224370bf5fce6b56592f71" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:42.640193 27049 raft_consensus.cc:3037] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:42.642125 29079 tablet.cc:1722] T bd6b328baa2346afbbe9f513ae4db3df P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:42.643060 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:42.631621 26580 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.195:32877 (request call id 342) took 2897 ms (client timeout 1000 ms). Trace:
W20260810 11:30:42.646876 26580 rpcz_store.cc:269] 0810 11:30:39.734096 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:39.806345 (+ 72249us) service_pool.cc:227] Handling call
0810 11:30:39.896361 (+ 90016us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa3fd8f 00007f9c61d34946 00007f9c61d34675 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:42.631500 (+2735139us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.473334 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.473483 (+ 149us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.473492 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:40.473494 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:40.473746 (+ 252us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.473763 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.473767 (+ 4us) tablet.cc:683] Acquiring locks for 3 operations
0810 11:30:40.473873 (+ 106us) tablet.cc:699] Row locks acquired
0810 11:30:40.473875 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:40.473918 (+ 43us) write_op.cc:270] Start()
0810 11:30:40.473958 (+ 40us) write_op.cc:276] Timestamp: P: 1786361440473897 usec, L: 0
0810 11:30:40.473965 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.503899 (+ 29934us) log.cc:842] Serialized 1302 byte log entry
0810 11:30:40.504144 (+ 245us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f9c62f1dd02 00007f9c642507f1 00007f9c6424f359 00007f9c642571bb 00007f9c64257038 00000000009edb7c 00007f9c57a55344 00007f9c57a5891b 00007f9c57a58798 00000000009edb7c
0810 11:30:40.534058 (+ 29914us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.534441 (+ 383us) write_op.cc:301] APPLY: starting
0810 11:30:40.534460 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.534511 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.534513 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.534600 (+ 87us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.534638 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0810 11:30:40.534645 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:40.534741 (+ 96us) log.cc:842] Serialized 35 byte log entry
0810 11:30:40.534829 (+ 88us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.534850 (+ 21us) write_op.cc:454] Released schema lock
0810 11:30:40.534857 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.534947 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.534951 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8538,"reported_tablets":184,"spinlock_wait_cycles":119049984,"child_traces":[["op",{"apply.queue_time_us":322,"apply.run_cpu_time_us":571,"apply.run_wall_time_us":571,"num_ops":3,"prepare.queue_time_us":4251,"prepare.run_cpu_time_us":1915,"prepare.run_wall_time_us":30905,"raft.queue_time_us":11066,"raft.run_cpu_time_us":10,"raft.run_wall_time_us":11,"replication_time_us":60036,"spinlock_wait_cycles":68018432}]]}
I20260810 11:30:42.648224 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.584908 27222 tablet_bootstrap.cc:654] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:42.651980 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f24c84cdd945b78f39f24015eb1e43 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b95f3ec8ff34c89a68cd1edf8391f9b) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.652799 26580 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_a775fdecca7946e8b9eef11d83007e28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:42.653261 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.653931 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:42.654105 26580 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a775fdecca7946e8b9eef11d83007e28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:42.655661 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet ee803ddf27594d2b9e19fe440fc269c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 82de53efa73447fe84e70dbb11a16a5f) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.656416 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet b6395bce17ee40c2822669246ce7eb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.657498 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7acf847a1fd74ccc89b5bffe1bbb76f3) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.657893 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet db59523b71224370bf5fce6b56592f71 with delete_type TABLET_DATA_DELETED (replaced by tablet bd34a4de1b93402c8a4bce1215660e77) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.658973 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b5a7f67ec5b48c2b5a510add0282a76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.659304 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet ee803ddf27594d2b9e19fe440fc269c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 82de53efa73447fe84e70dbb11a16a5f) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.661055 27222 tablet_bootstrap.cc:492] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:42.661556 27999 ts_tablet_manager.cc:1918] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:42.661710 27999 log.cc:1196] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/b200bdb394d3439b86fff48494be8e3d
I20260810 11:30:42.662091 27999 ts_tablet_manager.cc:1939] T b200bdb394d3439b86fff48494be8e3d P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:42.662495 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 32) took 2066 ms. Trace:
I20260810 11:30:42.662981 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet f6e264e8507446809f3c386fdb3c34ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:42.663933 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 228106us
I20260810 11:30:42.661310 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da86554bc51486e91f1ea5995a245b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.662521 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet c60baf810a544a4a90dccd2337a39043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.663647 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 49db12565dbc4187b78a98ed35c40fed with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1e46f80f7f4e3a84638421892e6236) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.664755 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet f6e264e8507446809f3c386fdb3c34ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.665727 27222 ts_tablet_manager.cc:1397] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.087s user 0.004s sys 0.000s
I20260810 11:30:42.662601 27999 rpcz_store.cc:276] 0810 11:30:40.596182 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.596250 (+ 68us) service_pool.cc:227] Handling call
0810 11:30:42.450593 (+1854343us) ts_tablet_manager.cc:1145] Deleting tablet b200bdb394d3439b86fff48494be8e3d
0810 11:30:42.450608 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:42.617556 (+166948us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:42.661420 (+ 43864us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:42.662475 (+ 1055us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1854096}
I20260810 11:30:42.666335 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 33) took 1752 ms. Trace:
I20260810 11:30:42.666523 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet db59523b71224370bf5fce6b56592f71 with delete_type TABLET_DATA_DELETED (replaced by tablet bd34a4de1b93402c8a4bce1215660e77) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.666937 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dc4fd6ca8a541f99eed57a6f51c1f0a" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:42.667198 26762 raft_consensus.cc:2454] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:42.668147 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.670549 29078 tablet.cc:1722] T 9e329b95fc8e41c3967079896294942a P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:42.671391 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 0713f4f14a284050a7774a70ab974f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.671815 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c203cd90d2f472fa27cfabed5b87119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.673115 27222 raft_consensus.cc:348] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.673322 27222 raft_consensus.cc:374] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:42.673369 27222 raft_consensus.cc:729] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:42.673627 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet ea66da5bc20e4718901ffc473677421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.673722 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7acf847a1fd74ccc89b5bffe1bbb76f3) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.674269 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e78fb1bf0534deca5cc5a603fd77592 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.675354 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet 0713f4f14a284050a7774a70ab974f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.677795 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet e31b380f99854eb8b63e1f9eede1fc7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.666436 27999 rpcz_store.cc:276] 0810 11:30:40.913410 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.913476 (+ 66us) service_pool.cc:227] Handling call
0810 11:30:42.666139 (+1752663us) ts_tablet_manager.cc:1145] Deleting tablet 0cc17c55109b47eeb91920c3ed8178e0
0810 11:30:42.666157 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:42.666296 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1718253}
I20260810 11:30:42.678905 27999 tablet_replica.cc:330] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:42.678884 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet 0713f4f14a284050a7774a70ab974f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.679214 27999 raft_consensus.cc:2229] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:42.679339 27222 consensus_queue.cc:260] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.681036 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet c60baf810a544a4a90dccd2337a39043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.682709 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da86554bc51486e91f1ea5995a245b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.680325 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet b121c13e9241468aa224e17093eb38f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b607279006c4baeae79325926088014) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.682531 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 23637a02b6464e17aa2a69ea5cc4ddfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.683758 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet cc76d30f37094391b75076c92ccc277f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.683874 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 110b5acc36bd4d6bba13735e5daec75f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.683913 27231 tablet_bootstrap.cc:654] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:42.684180 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.684595 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet ac4b1821ac30452cbe7a8f844d9b37e5 with delete_type TABLET_DATA_DELETED (replaced by tablet a45422addab84e9083df8665a0cf9322) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.684670 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 518c777e40ec40dcb3484c0374384959 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:42.684798 26966 tablet.cc:2369] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 11:30:42.640234 26581 rpcz_store.cc:269] 0810 11:30:40.799997 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.800285 (+ 288us) service_pool.cc:227] Handling call
0810 11:30:42.626910 (+1826625us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:41.524177 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:41.524337 (+ 160us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:41.524346 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:41.524349 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:41.538460 (+ 14111us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:41.538478 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:41.538485 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:41.542563 (+ 4078us) tablet.cc:699] Row locks acquired
0810 11:30:41.542567 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:41.542624 (+ 57us) write_op.cc:270] Start()
0810 11:30:41.542671 (+ 47us) write_op.cc:276] Timestamp: P: 1786361441542592 usec, L: 0
0810 11:30:41.542676 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:41.543447 (+ 771us) log.cc:842] Serialized 536 byte log entry
0810 11:30:41.614639 (+ 71192us) op_driver.cc:444] REPLICATION: finished
0810 11:30:41.670977 (+ 56338us) write_op.cc:301] APPLY: starting
0810 11:30:41.671007 (+ 30us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:41.671145 (+ 138us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:41.671200 (+ 55us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:41.671276 (+ 76us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:41.671316 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:41.671322 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:41.671442 (+ 120us) log.cc:842] Serialized 23 byte log entry
0810 11:30:41.671818 (+ 376us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:41.671843 (+ 25us) write_op.cc:454] Released schema lock
0810 11:30:41.671853 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:41.703131 (+ 31278us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:41.703150 (+ 19us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":44032,"reported_tablets":198,"child_traces":[["op",{"apply.queue_time_us":56249,"apply.run_cpu_time_us":791,"apply.run_wall_time_us":32283,"num_ops":1,"prepare.queue_time_us":6912,"prepare.run_cpu_time_us":11268,"prepare.run_wall_time_us":121470,"raft.queue_time_us":1232,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":257,"replication_time_us":71924,"thread_start_us":184131,"threads_started":2}]]}
I20260810 11:30:42.684917 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 49db12565dbc4187b78a98ed35c40fed with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1e46f80f7f4e3a84638421892e6236) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.685251 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.685410 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cc17c55109b47eeb91920c3ed8178e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6179cb2be2c442ee97161fe1f4661b64) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:42.685596 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e78fb1bf0534deca5cc5a603fd77592 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.685856 27222 ts_tablet_manager.cc:1428] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260810 11:30:42.685928 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c203cd90d2f472fa27cfabed5b87119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.687042 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet cb6805a5dd264939850ea2cd9a850a1f (table default.Table_057f1bf3995143138dd2954a212a480b [id=2db59831074f4dd2b4603d6f8215b1d0]) successfully deleted
I20260810 11:30:42.686004 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cd4f555b5d840c182a31b3c94da9619 with delete_type TABLET_DATA_DELETED (replaced by tablet 7161d94d80b24eeaa357cc0922a874af) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:42.687448 26571 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.194:35117 (request call id 266) took 3531 ms (client timeout 1000 ms). Trace:
I20260810 11:30:42.687654 26577 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_065fc82a2823470b89b4cff36ca03027" } modify_external_catalogs: true
I20260810 11:30:42.688043 26581 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_52cf39e2586743a595ebe5b3172bd921"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:42.658218 26574 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_a13a99674b70411d87a2aaef8b003753" } modify_external_catalogs: true
W20260810 11:30:42.655334 26575 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.194:35117 (request call id 267) took 2415 ms (client timeout 1000 ms). Trace:
I20260810 11:30:42.688853 29052 tablet.cc:1722] T 83992214ba314d3fa674e00d8eaddec6 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:42.688867 26574 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_a13a99674b70411d87a2aaef8b003753" } modify_external_catalogs: true
I20260810 11:30:42.689958 27999 raft_consensus.cc:2258] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:42.690662 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ff9b649e43a9456fa51cf3330290bb91 because the tablet was not found. No further retry: Not found: Tablet not found: ff9b649e43a9456fa51cf3330290bb91
W20260810 11:30:42.691032 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 78633fbe048b4534ae3277ce6b7c4313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78633fbe048b4534ae3277ce6b7c4313 already in progress: creating tablet
W20260810 11:30:42.691422 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 already in progress: creating tablet
I20260810 11:30:42.649708 27052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110b5acc36bd4d6bba13735e5daec75f" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:42.695055 27052 raft_consensus.cc:3037] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:42.693483 27999 ts_tablet_manager.cc:1905] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:42.698367 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1860e56467624dcdb288e13b004f78cc" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:42.699625 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "490ada0a918d48c3a07e12eed58bda19" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:42.692214 26571 rpcz_store.cc:269] 0810 11:30:39.156524 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:39.412058 (+255534us) service_pool.cc:227] Handling call
0810 11:30:40.464067 (+1052009us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.464086 (+ 19us) write_op.cc:454] Released schema lock
0810 11:30:42.687405 (+2223319us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:39.820963 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:39.821073 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:39.821079 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:39.821081 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:39.821206 (+ 125us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:39.821220 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:39.821224 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:39.821324 (+ 100us) tablet.cc:699] Row locks acquired
0810 11:30:39.821328 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:39.821373 (+ 45us) write_op.cc:270] Start()
0810 11:30:39.821412 (+ 39us) write_op.cc:276] Timestamp: P: 1786361439821312 usec, L: 0
0810 11:30:39.821416 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:39.821631 (+ 215us) log.cc:842] Serialized 536 byte log entry
0810 11:30:39.830912 (+ 9281us) op_driver.cc:444] REPLICATION: finished
0810 11:30:39.831258 (+ 346us) write_op.cc:301] APPLY: starting
0810 11:30:39.831280 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:39.831540 (+ 260us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:39.831579 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:39.831646 (+ 67us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:39.831687 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:39.831695 (+ 8us) write_op.cc:312] APPLY: finished
0810 11:30:39.831795 (+ 100us) log.cc:842] Serialized 23 byte log entry
0810 11:30:39.831871 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.831892 (+ 21us) write_op.cc:454] Released schema lock
0810 11:30:39.831901 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:39.831970 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:39.831974 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:40.337694 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.337833 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.337841 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:40.337846 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:40.337994 (+ 148us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.338013 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.338020 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:40.338103 (+ 83us) tablet.cc:699] Row locks acquired
0810 11:30:40.338107 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:40.338155 (+ 48us) write_op.cc:270] Start()
0810 11:30:40.338196 (+ 41us) write_op.cc:276] Timestamp: P: 1786361440338092 usec, L: 0
0810 11:30:40.338201 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.338499 (+ 298us) log.cc:842] Serialized 356 byte log entry
0810 11:30:40.342943 (+ 4444us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.343100 (+ 157us) write_op.cc:301] APPLY: starting
0810 11:30:40.343120 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.343166 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.343204 (+ 38us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.343267 (+ 63us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.343305 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:40.343313 (+ 8us) write_op.cc:312] APPLY: finished
0810 11:30:40.343454 (+ 141us) log.cc:842] Serialized 23 byte log entry
0810 11:30:40.343533 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.343561 (+ 28us) write_op.cc:454] Released schema lock
0810 11:30:40.343572 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:40.343652 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.343656 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:40.369218 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.369360 (+ 142us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.369369 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:40.369373 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:40.369497 (+ 124us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.369514 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.369523 (+ 9us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:40.369618 (+ 95us) tablet.cc:699] Row locks acquired
0810 11:30:40.369620 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:40.369664 (+ 44us) write_op.cc:270] Start()
0810 11:30:40.369702 (+ 38us) write_op.cc:276] Timestamp: P: 1786361440369597 usec, L: 0
0810 11:30:40.369706 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.369930 (+ 224us) log.cc:842] Serialized 356 byte log entry
0810 11:30:40.374022 (+ 4092us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.374214 (+ 192us) write_op.cc:301] APPLY: starting
0810 11:30:40.374236 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.374286 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.374314 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.374373 (+ 59us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.374423 (+ 50us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:40.374433 (+ 10us) write_op.cc:312] APPLY: finished
0810 11:30:40.374522 (+ 89us) log.cc:842] Serialized 23 byte log entry
0810 11:30:40.374589 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.374617 (+ 28us) write_op.cc:454] Released schema lock
0810 11:30:40.374627 (+ 10us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":8993,"reported_tablets":190,"child_traces":[["op",{"apply.queue_time_us":280,"apply.run_cpu_time_us":775,"apply.run_wall_time_us":775,"num_ops":1,"prepare.queue_time_us":5740,"prepare.run_cpu_time_us":778,"prepare.run_wall_time_us":778,"raft.queue_time_us":2901,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":225,"replication_time_us":9460}],["op",{"apply.queue_time_us":102,"apply.run_cpu_time_us":619,"apply.run_wall_time_us":618,"num_ops":1,"prepare.queue_time_us":62,"prepare.run_cpu_time_us":938,"prepare.run_wall_time_us":938,"raft.queue_time_us":1132,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":324,"replication_time_us":4711}],["op",{"apply.queue_time_us":122,"apply.run_cpu_time_us":487,"apply.run_wall_time_us":487,"num_ops":1,"prepare.queue_time_us":183,"prepare.run_cpu_time_us":847,"prepare.run_wall_time_us":848,"raft.queue_time_us":188,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":330,"replication_time_us":4282}]]}
I20260810 11:30:42.700624 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc558690dce44e999e55e9bf1b6ca172" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:42.702881 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "809b5b6b65d244cd9186517e39494839" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:42.703176 26762 raft_consensus.cc:2454] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:42.703313 26571 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_8190307d727041fbac21da6cbb2f1bcc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:42.706660 26571 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8190307d727041fbac21da6cbb2f1bcc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:42.709236 28779 consensus_queue.cc:1035] T adecd2f0952b4f4c83919c78d563e429 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:42.710788 27228 tablet_bootstrap.cc:492] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:42.710964 27228 ts_tablet_manager.cc:1397] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.285s user 0.002s sys 0.013s
W20260810 11:30:42.711079 26575 rpcz_store.cc:269] 0810 11:30:40.240168 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.294432 (+ 54264us) service_pool.cc:227] Handling call
0810 11:30:40.900003 (+605571us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.900015 (+ 12us) write_op.cc:454] Released schema lock
0810 11:30:42.655287 (+1755272us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:40.884716 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:40.884855 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:40.884863 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:40.884865 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:40.885025 (+ 160us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:40.885040 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:40.885045 (+ 5us) tablet.cc:683] Acquiring locks for 3 operations
0810 11:30:40.885153 (+ 108us) tablet.cc:699] Row locks acquired
0810 11:30:40.885155 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:40.885200 (+ 45us) write_op.cc:270] Start()
0810 11:30:40.885245 (+ 45us) write_op.cc:276] Timestamp: P: 1786361440885139 usec, L: 0
0810 11:30:40.885249 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:40.885528 (+ 279us) log.cc:842] Serialized 1302 byte log entry
0810 11:30:40.893951 (+ 8423us) op_driver.cc:444] REPLICATION: finished
0810 11:30:40.894100 (+ 149us) write_op.cc:301] APPLY: starting
0810 11:30:40.894120 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:40.894357 (+ 237us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:40.894495 (+ 138us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:40.894600 (+ 105us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:40.894655 (+ 55us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0810 11:30:40.894662 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:40.894868 (+ 206us) log.cc:842] Serialized 35 byte log entry
0810 11:30:40.894958 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:40.894987 (+ 29us) write_op.cc:454] Released schema lock
0810 11:30:40.894996 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":119014,"reported_tablets":197,"child_traces":[["op",{"apply.queue_time_us":96,"apply.run_cpu_time_us":964,"apply.run_wall_time_us":963,"num_ops":3,"prepare.queue_time_us":49,"prepare.run_cpu_time_us":941,"prepare.run_wall_time_us":941,"raft.queue_time_us":1196,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":335,"replication_time_us":8671}]]}
I20260810 11:30:42.712307 26575 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_47155e2716ed4136a4fed4c9e0b45a22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:42.713212 26575 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47155e2716ed4136a4fed4c9e0b45a22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:42.715188 26581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52cf39e2586743a595ebe5b3172bd921 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:42.715346 29027 tablet.cc:1722] T 460a679219cb4a7f9aecfec58a98238b P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:42.642318 27050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dc4fd6ca8a541f99eed57a6f51c1f0a" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:42.721045 27050 raft_consensus.cc:2454] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:42.722976 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 23637a02b6464e17aa2a69ea5cc4ddfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.630789 28987 tablet_replica.cc:330] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:42.689028 27056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e31b380f99854eb8b63e1f9eede1fc7c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:42.725598 27056 raft_consensus.cc:2454] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:42.726733 28987 raft_consensus.cc:2229] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:42.732717 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet a87f6835f0dc4ad4b3a23b297726100d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.736011 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet e31b380f99854eb8b63e1f9eede1fc7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.741827 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b5a7f67ec5b48c2b5a510add0282a76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.744257 27228 raft_consensus.cc:348] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.744504 27228 raft_consensus.cc:374] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:42.744588 27228 raft_consensus.cc:729] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:42.744638 26571 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 153) took 2081 ms. Trace:
I20260810 11:30:42.744784 27228 consensus_queue.cc:260] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.745385 27228 ts_tablet_manager.cc:1428] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20260810 11:30:42.744868 26571 rpcz_store.cc:276] 0810 11:30:40.663350 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.702975 (+2039625us) service_pool.cc:227] Handling call
0810 11:30:42.706927 (+ 3952us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:42.710515 (+ 3588us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:42.744248 (+ 33733us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:42.744419 (+ 171us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:42.744576 (+ 157us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.728502 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.728688 (+ 186us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.728696 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:42.728700 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:42.728834 (+ 134us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.728850 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.728858 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.728995 (+ 137us) tablet.cc:699] Row locks acquired
0810 11:30:42.728999 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:42.729046 (+ 47us) write_op.cc:270] Start()
0810 11:30:42.729107 (+ 61us) write_op.cc:276] Timestamp: P: 1786361442729011 usec, L: 0
0810 11:30:42.729114 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.729373 (+ 259us) log.cc:842] Serialized 433 byte log entry
0810 11:30:42.742486 (+ 13113us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.742723 (+ 237us) write_op.cc:301] APPLY: starting
0810 11:30:42.742746 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.742812 (+ 66us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.742851 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.743029 (+ 178us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.743098 (+ 69us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:42.743109 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:42.743218 (+ 109us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.743313 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.743338 (+ 25us) write_op.cc:454] Released schema lock
0810 11:30:42.743349 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:42.743421 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.743427 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":174,"apply.run_cpu_time_us":769,"apply.run_wall_time_us":768,"mutex_wait_us":16583,"num_ops":2,"prepare.queue_time_us":17221,"prepare.run_cpu_time_us":1016,"prepare.run_wall_time_us":1492,"raft.queue_time_us":72,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":13335}]]}
I20260810 11:30:42.745664 27228 tablet_bootstrap.cc:492] T 9de57b6d03e34ee783b822b30090c077 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:42.746169 26571 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_9744be92699b40d1bae23bbb564db585" } modify_external_catalogs: true
I20260810 11:30:42.746460 26571 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_9744be92699b40d1bae23bbb564db585" } modify_external_catalogs: true
I20260810 11:30:42.730265 27222 tablet_bootstrap.cc:492] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:42.749081 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet fc558690dce44e999e55e9bf1b6ca172 with delete_type TABLET_DATA_DELETED (replaced by tablet 0bb01711769f457aa0696bb59582166d) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.749877 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet fbe0a0ab82a147a3b6164904b135d1ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.750805 27222 tablet_bootstrap.cc:654] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:42.751015 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ccef06fa06c4c519d8760fa948d6c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.751364 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3406f12d9c492cbd0d86fa7a57de82 with delete_type TABLET_DATA_DELETED (replaced by tablet 72e0b69e7c7e4343b309d16c030d4306) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.751722 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 518c777e40ec40dcb3484c0374384959 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.752279 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet d14091e1c111438bac8bcf3d36123d80 with delete_type TABLET_DATA_DELETED (replaced by tablet ce73798a721b4a6d892f0c24b6b40e2c) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.752645 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 110b5acc36bd4d6bba13735e5daec75f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.754107 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.754552 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c715bdcff8c4cdabfddf871f6fdc388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.755815 28987 raft_consensus.cc:2258] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:42.756489 28987 ts_tablet_manager.cc:1905] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:42.756995 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet ff9b649e43a9456fa51cf3330290bb91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.757438 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet a835d30ef9fc474ab927bb119a95d83c with delete_type TABLET_DATA_DELETED (replaced by tablet 2a1fbf3890ee4a829b4c8c61fe1e978f) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.757848 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet a63227e69df14a4ea935087fd31ece63 with delete_type TABLET_DATA_DELETED (replaced by tablet aa71cedba3d34c288a3e3be99d474ce4) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.758275 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 318d5b8453fe4c438d0fa32cb91c409e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.758447 26575 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 154) took 2094 ms. Trace:
I20260810 11:30:42.758649 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 78633fbe048b4534ae3277ce6b7c4313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:39 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.758606 26575 rpcz_store.cc:276] 0810 11:30:40.663559 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.712059 (+2048500us) service_pool.cc:227] Handling call
0810 11:30:42.713402 (+ 1343us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:42.714642 (+ 1240us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:42.758146 (+ 43504us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:42.758276 (+ 130us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:42.758392 (+ 116us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.730606 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.730709 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.730714 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:42.730717 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:42.730805 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.730818 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.730825 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.730927 (+ 102us) tablet.cc:699] Row locks acquired
0810 11:30:42.730929 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:42.730962 (+ 33us) write_op.cc:270] Start()
0810 11:30:42.730996 (+ 34us) write_op.cc:276] Timestamp: P: 1786361442730932 usec, L: 0
0810 11:30:42.731001 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.731213 (+ 212us) log.cc:842] Serialized 433 byte log entry
0810 11:30:42.742564 (+ 11351us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.743535 (+ 971us) write_op.cc:301] APPLY: starting
0810 11:30:42.743549 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.743590 (+ 41us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.743636 (+ 46us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.743781 (+ 145us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.743820 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:42.743831 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:42.743901 (+ 70us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.743950 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.743998 (+ 48us) write_op.cc:454] Released schema lock
0810 11:30:42.744007 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:42.744076 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.744082 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":931,"apply.run_cpu_time_us":601,"apply.run_wall_time_us":600,"mutex_wait_us":15377,"num_ops":2,"prepare.queue_time_us":15433,"prepare.run_cpu_time_us":728,"prepare.run_wall_time_us":1094,"raft.queue_time_us":79,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":11544}]]}
I20260810 11:30:42.759073 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 587c6ce242c0411b886404a0df03b1bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.759370 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ada1df82eb44ecb9a6c615b5410e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.760244 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 713663be70014b17b17056a865e7db63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.760656 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 91b6078efadf496fb252f725bdf56b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.761019 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet d91a02b22044429fb3e25840c7947a02 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ba5191082814a4f8cf821354416e1d3) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.761427 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 64818ca5827e41d99428903ddb8688d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.761873 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet f2b555f18c1e485d9af7b08f98543c80 with delete_type TABLET_DATA_DELETED (replaced by tablet 1801d3af4a4548dba8b0d8ea2fecf5ba) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.762276 26575 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_0bf07015df0d4fc4ae4119eecdd6dac4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:42.762603 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.762916 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 834c9c99ec424bb39e8a003e9204b2bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.763033 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 96cae4eb16c84410926a317af70e44f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.763476 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 2634beb347714fc7a2e05865adb34a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.763758 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.764330 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]) successfully deleted
I20260810 11:30:42.766037 27228 tablet_bootstrap.cc:654] T 9de57b6d03e34ee783b822b30090c077 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:42.770881 26575 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0bf07015df0d4fc4ae4119eecdd6dac4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:42.772083 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 1860e56467624dcdb288e13b004f78cc with delete_type TABLET_DATA_DELETED (replaced by tablet 214be3356fda4c8484596196c0985721) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.772962 28898 raft_consensus.cc:482] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:42.773124 28898 raft_consensus.cc:504] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.773738 28898 leader_election.cc:288] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:42.775085 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a63227e69df14a4ea935087fd31ece63" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:42.775866 26991 leader_election.cc:341] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:42.777642 29077 tablet.cc:1722] T e8dc3dece9d84d47a638707d10de6fd4 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:42.778553 29092 raft_consensus.cc:482] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:42.778800 29092 raft_consensus.cc:504] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.779707 29092 leader_election.cc:288] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:42.782500 29057 tablet.cc:1722] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:42.789834 27228 tablet_bootstrap.cc:492] T 9de57b6d03e34ee783b822b30090c077 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:42.790119 27228 ts_tablet_manager.cc:1397] T 9de57b6d03e34ee783b822b30090c077 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.002s
I20260810 11:30:42.791158 27228 raft_consensus.cc:348] T 9de57b6d03e34ee783b822b30090c077 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.791495 27228 raft_consensus.cc:374] T 9de57b6d03e34ee783b822b30090c077 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:42.791617 27228 raft_consensus.cc:729] T 9de57b6d03e34ee783b822b30090c077 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:42.792011 27228 consensus_queue.cc:260] T 9de57b6d03e34ee783b822b30090c077 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.792281 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d5e146eeec4fe0be33c1c169d32e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.793648 29052 tablet.cc:1722] T 460a679219cb4a7f9aecfec58a98238b P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:42.794052 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 55c8749861874eca9b63d3db97afa2b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.796044 29082 tablet.cc:1722] T f85c0767ad164075b87ba672cafafb47 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 11:30:42.799556 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3406f12d9c492cbd0d86fa7a57de82 with delete_type TABLET_DATA_DELETED (replaced by tablet 72e0b69e7c7e4343b309d16c030d4306) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.800436 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.800510 26575 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 156) took 1983 ms. Trace:
I20260810 11:30:42.801167 26849 leader_election.cc:302] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:42.801285 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.801643 29086 raft_consensus.cc:2781] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:42.801746 29086 raft_consensus.cc:482] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:42.801834 29086 raft_consensus.cc:3037] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:42.801914 28726 raft_consensus.cc:482] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:42.802059 28726 raft_consensus.cc:504] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.802781 28726 leader_election.cc:288] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:42.800777 26575 rpcz_store.cc:276] 0810 11:30:40.817323 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.761935 (+1944612us) service_pool.cc:227] Handling call
0810 11:30:42.788933 (+ 26998us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:42.789659 (+ 726us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:42.800037 (+ 10378us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.800043 (+ 6us) write_op.cc:454] Released schema lock
0810 11:30:42.800124 (+ 81us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:42.800295 (+ 171us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:42.800413 (+ 118us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.790476 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.790648 (+ 172us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.790658 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:42.790663 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:42.790798 (+ 135us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.790819 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.790827 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.790947 (+ 120us) tablet.cc:699] Row locks acquired
0810 11:30:42.790952 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:42.790999 (+ 47us) write_op.cc:270] Start()
0810 11:30:42.791046 (+ 47us) write_op.cc:276] Timestamp: P: 1786361442790959 usec, L: 0
0810 11:30:42.791054 (+ 8us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.791491 (+ 437us) log.cc:842] Serialized 433 byte log entry
0810 11:30:42.798490 (+ 6999us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.798652 (+ 162us) write_op.cc:301] APPLY: starting
0810 11:30:42.798670 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.798718 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.798798 (+ 80us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.798934 (+ 136us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.798981 (+ 47us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:42.798993 (+ 12us) write_op.cc:312] APPLY: finished
0810 11:30:42.799097 (+ 104us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.799165 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.799184 (+ 19us) write_op.cc:454] Released schema lock
0810 11:30:42.799192 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":100,"apply.run_cpu_time_us":602,"apply.run_wall_time_us":601,"mutex_wait_us":76,"num_ops":2,"prepare.queue_time_us":75,"prepare.run_cpu_time_us":1038,"prepare.run_wall_time_us":1709,"raft.queue_time_us":164,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":316,"replication_time_us":7401}]]}
I20260810 11:30:42.803483 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f24c84cdd945b78f39f24015eb1e43 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b95f3ec8ff34c89a68cd1edf8391f9b) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.804149 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.804711 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.805256 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da86554bc51486e91f1ea5995a245b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.805999 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.805717 29086 raft_consensus.cc:504] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.806664 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7acf847a1fd74ccc89b5bffe1bbb76f3) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.807072 29086 leader_election.cc:288] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:42.807323 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b5a7f67ec5b48c2b5a510add0282a76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:58800
W20260810 11:30:42.807432 26849 leader_election.cc:341] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: e31b380f99854eb8b63e1f9eede1fc7c
I20260810 11:30:42.807533 26580 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 150) took 2197 ms. Trace:
I20260810 11:30:42.808027 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet ee803ddf27594d2b9e19fe440fc269c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 82de53efa73447fe84e70dbb11a16a5f) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.807746 26580 rpcz_store.cc:276] 0810 11:30:40.609845 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.652435 (+2042590us) service_pool.cc:227] Handling call
0810 11:30:42.664066 (+ 11631us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:42.691876 (+ 27810us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:42.806938 (+115062us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:42.807080 (+ 142us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:42.807474 (+ 394us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.792602 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.792741 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.792747 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:42.792750 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:42.792850 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.792863 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.792870 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.793030 (+ 160us) tablet.cc:699] Row locks acquired
0810 11:30:42.793034 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:42.793089 (+ 55us) write_op.cc:270] Start()
0810 11:30:42.793127 (+ 38us) write_op.cc:276] Timestamp: P: 1786361442793048 usec, L: 0
0810 11:30:42.793131 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.793299 (+ 168us) log.cc:842] Serialized 433 byte log entry
0810 11:30:42.804370 (+ 11071us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.804614 (+ 244us) write_op.cc:301] APPLY: starting
0810 11:30:42.804633 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.804690 (+ 57us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.804763 (+ 73us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.804928 (+ 165us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.804967 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:42.804974 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:42.805077 (+ 103us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.805165 (+ 88us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.805184 (+ 19us) write_op.cc:454] Released schema lock
0810 11:30:42.805193 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:42.805263 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.805269 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":190,"apply.run_cpu_time_us":719,"apply.run_wall_time_us":719,"num_ops":2,"prepare.queue_time_us":258,"prepare.run_cpu_time_us":757,"prepare.run_wall_time_us":825,"raft.queue_time_us":87,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":7,"replication_time_us":11212}]]}
I20260810 11:30:42.807245 26581 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 152) took 2146 ms. Trace:
I20260810 11:30:42.810038 29079 tablet.cc:1722] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:42.809546 26581 rpcz_store.cc:276] 0810 11:30:40.660836 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.687735 (+2026899us) service_pool.cc:227] Handling call
0810 11:30:42.715398 (+ 27663us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:42.716031 (+ 633us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:42.806338 (+ 90307us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:42.806480 (+ 142us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:42.806584 (+ 104us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.794150 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.794306 (+ 156us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.794313 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:42.794315 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:42.794401 (+ 86us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.794411 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.794416 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.794497 (+ 81us) tablet.cc:699] Row locks acquired
0810 11:30:42.794500 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:42.794554 (+ 54us) write_op.cc:270] Start()
0810 11:30:42.794590 (+ 36us) write_op.cc:276] Timestamp: P: 1786361442794514 usec, L: 0
0810 11:30:42.794594 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.794821 (+ 227us) log.cc:842] Serialized 433 byte log entry
0810 11:30:42.804452 (+ 9631us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.805380 (+ 928us) write_op.cc:301] APPLY: starting
0810 11:30:42.805395 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.805438 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.805466 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.805631 (+ 165us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.805668 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:42.805676 (+ 8us) write_op.cc:312] APPLY: finished
0810 11:30:42.805751 (+ 75us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.805800 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.805820 (+ 20us) write_op.cc:454] Released schema lock
0810 11:30:42.805828 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:42.805886 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.805890 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":893,"apply.run_cpu_time_us":561,"apply.run_wall_time_us":560,"mutex_wait_us":77382,"num_ops":2,"prepare.queue_time_us":77588,"prepare.run_cpu_time_us":782,"prepare.run_wall_time_us":782,"raft.queue_time_us":66,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":9784}]]}
I20260810 11:30:42.813061 28845 raft_consensus.cc:482] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:42.813244 28845 raft_consensus.cc:504] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.813616 26580 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_8936d38c9e8e4ba9a4be8cc491e080dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:42.814013 28845 leader_election.cc:288] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:42.814810 29078 tablet.cc:1722] T bd6b328baa2346afbbe9f513ae4db3df P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 11:30:42.815135 26580 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8936d38c9e8e4ba9a4be8cc491e080dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:42.815306 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b755744059b04967857c1b00e951b8ee" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:42.815873 26991 leader_election.cc:341] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:42.816277 26700 leader_election.cc:341] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 10e6c41db71a4146840f06c5b7412d9c
I20260810 11:30:42.814291 26581 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_7bf69372e4b04dfba17cfcb786af5763"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:42.817836 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1860e56467624dcdb288e13b004f78cc" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:42.818950 29034 tablet.cc:1722] T f85c0767ad164075b87ba672cafafb47 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 11:30:42.819576 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dc4fd6ca8a541f99eed57a6f51c1f0a" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:42.819765 26762 raft_consensus.cc:3037] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:42.822084 26581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7bf69372e4b04dfba17cfcb786af5763 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:42.822736 26762 raft_consensus.cc:2454] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:42.825060 27228 ts_tablet_manager.cc:1428] T 9de57b6d03e34ee783b822b30090c077 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.035s user 0.001s sys 0.001s
I20260810 11:30:42.825922 27228 tablet_bootstrap.cc:492] T 1aa4562a2247405187d9dbd1baa48f39 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:42.828045 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1801d3af4a4548dba8b0d8ea2fecf5ba" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:42.828622 27057 raft_consensus.cc:2454] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:42.829293 26702 leader_election.cc:302] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:42.829941 28726 raft_consensus.cc:2781] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:42.830066 28726 raft_consensus.cc:482] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:42.830149 28726 raft_consensus.cc:3037] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:42.830798 27049 raft_consensus.cc:2454] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 2.
I20260810 11:30:42.830919 27228 tablet_bootstrap.cc:654] T 1aa4562a2247405187d9dbd1baa48f39 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:42.832621 26700 leader_election.cc:341] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 10e6c41db71a4146840f06c5b7412d9c
I20260810 11:30:42.834192 27052 raft_consensus.cc:2454] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:42.834726 28726 raft_consensus.cc:504] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.836297 27052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1801d3af4a4548dba8b0d8ea2fecf5ba" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:42.836957 27061 raft_consensus.cc:2454] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 2.
I20260810 11:30:42.837172 27052 raft_consensus.cc:3037] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:42.837832 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1801d3af4a4548dba8b0d8ea2fecf5ba" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:42.842634 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1801d3af4a4548dba8b0d8ea2fecf5ba" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:42.844808 28726 leader_election.cc:288] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:42.848076 26581 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 158) took 1964 ms. Trace:
I20260810 11:30:42.848084 27052 raft_consensus.cc:2454] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:42.848937 26580 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 157) took 1972 ms. Trace:
I20260810 11:30:42.849884 26702 leader_election.cc:302] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:42.848896 26581 rpcz_store.cc:276] 0810 11:30:40.883732 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.812841 (+1929109us) service_pool.cc:227] Handling call
0810 11:30:42.822306 (+ 9465us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:42.822970 (+ 664us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:42.842065 (+ 19095us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.842072 (+ 7us) write_op.cc:454] Released schema lock
0810 11:30:42.847748 (+ 5676us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:42.847909 (+ 161us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:42.848026 (+ 117us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.833191 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.833325 (+ 134us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.833333 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:42.833336 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:42.833440 (+ 104us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.833455 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.833460 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.833552 (+ 92us) tablet.cc:699] Row locks acquired
0810 11:30:42.833554 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:42.833610 (+ 56us) write_op.cc:270] Start()
0810 11:30:42.833648 (+ 38us) write_op.cc:276] Timestamp: P: 1786361442833568 usec, L: 0
0810 11:30:42.833652 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.833979 (+ 327us) log.cc:842] Serialized 433 byte log entry
0810 11:30:42.838792 (+ 4813us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.838884 (+ 92us) write_op.cc:301] APPLY: starting
0810 11:30:42.838904 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.839018 (+ 114us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.839091 (+ 73us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.839213 (+ 122us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.839254 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:42.839260 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:42.839341 (+ 81us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.839418 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.839440 (+ 22us) write_op.cc:454] Released schema lock
0810 11:30:42.839463 (+ 23us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":859008,"child_traces":[["op",{"apply.queue_time_us":33,"apply.run_cpu_time_us":651,"apply.run_wall_time_us":650,"num_ops":2,"prepare.queue_time_us":9237,"prepare.run_cpu_time_us":953,"prepare.run_wall_time_us":954,"raft.queue_time_us":229,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":272,"replication_time_us":5114}]]}
I20260810 11:30:42.850320 26702 leader_election.cc:302] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:42.850586 28727 raft_consensus.cc:2781] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 2 FOLLOWER]: Leader election won for term 2
I20260810 11:30:42.850713 28727 raft_consensus.cc:686] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 2 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:42.850787 28728 raft_consensus.cc:2781] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:42.850912 28728 raft_consensus.cc:686] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:42.850935 28727 consensus_queue.cc:237] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.851168 28728 consensus_queue.cc:237] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.849118 26580 rpcz_store.cc:276] 0810 11:30:40.876541 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.810825 (+1934284us) service_pool.cc:227] Handling call
0810 11:30:42.815234 (+ 4409us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:42.818657 (+ 3423us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:42.848646 (+ 29989us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:42.848756 (+ 110us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:42.848871 (+ 115us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.836934 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.837197 (+ 263us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.837205 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:42.837208 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:42.837367 (+ 159us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.837381 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.837385 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.837502 (+ 117us) tablet.cc:699] Row locks acquired
0810 11:30:42.837506 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:42.837554 (+ 48us) write_op.cc:270] Start()
0810 11:30:42.837608 (+ 54us) write_op.cc:276] Timestamp: P: 1786361442837509 usec, L: 0
0810 11:30:42.837612 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.837815 (+ 203us) log.cc:842] Serialized 433 byte log entry
0810 11:30:42.843404 (+ 5589us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.843502 (+ 98us) write_op.cc:301] APPLY: starting
0810 11:30:42.843522 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.843581 (+ 59us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.843610 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.843807 (+ 197us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.843846 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:42.843852 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:42.843937 (+ 85us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.844020 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.844045 (+ 25us) write_op.cc:454] Released schema lock
0810 11:30:42.844055 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:42.844236 (+ 181us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.844241 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":36,"apply.run_cpu_time_us":801,"apply.run_wall_time_us":801,"mutex_wait_us":8524,"num_ops":2,"prepare.queue_time_us":8585,"prepare.run_cpu_time_us":1009,"prepare.run_wall_time_us":1009,"raft.queue_time_us":109,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":5764}]]}
I20260810 11:30:42.860924 29082 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:51686 (request call id 46) took 1037 ms. Trace:
I20260810 11:30:42.861053 29082 rpcz_store.cc:276] 0810 11:30:41.823844 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.823904 (+ 60us) service_pool.cc:227] Handling call
0810 11:30:42.860893 (+1036989us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:41.945464 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0810 11:30:41.945624 (+ 160us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 11:30:41.945643 (+ 19us) alter_schema_op.cc:65] Acquired schema lock
0810 11:30:41.945660 (+ 17us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0810 11:30:41.945731 (+ 71us) alter_schema_op.cc:126] START. Timestamp: 1786361441945689
0810 11:30:41.945736 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:41.945959 (+ 223us) log.cc:842] Serialized 173 byte log entry
0810 11:30:42.795864 (+849905us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.795973 (+ 109us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0810 11:30:42.796809 (+ 836us) log.cc:842] Serialized 5 byte log entry
0810 11:30:42.851694 (+ 54885us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:42.860503 (+ 8809us) log.cc:842] Serialized 14 byte log entry
0810 11:30:42.860839 (+ 336us) alter_schema_op.cc:71] Released schema lock
0810 11:30:42.860844 (+ 5us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":43,"mutex_wait_us":8390,"prepare.queue_time_us":112201,"prepare.run_cpu_time_us":11380,"prepare.run_wall_time_us":367452,"raft.queue_time_us":361,"raft.run_cpu_time_us":967,"raft.run_wall_time_us":7649,"replication_time_us":850093,"thread_start_us":366354,"threads_started":1,"wal-append.queue_time_us":341443}]]}
I20260810 11:30:42.862552 26580 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_75533618dd694f43bd62eb7502414575"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:42.863463 26581 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_403112b5aa7a4fa082949d46b04c64e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:42.870369 26581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_403112b5aa7a4fa082949d46b04c64e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:42.870690 26580 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75533618dd694f43bd62eb7502414575 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:42.872067 26849 consensus_peers.cc:487] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 81f24c84cdd945b78f39f24015eb1e43. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:42.872989 26849 leader_election.cc:341] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:42.873008 28898 consensus_queue.cc:1035] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:42.873721 26849 leader_election.cc:302] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:42.874094 28921 raft_consensus.cc:2781] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:42.874305 28921 raft_consensus.cc:686] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:42.875335 28921 consensus_queue.cc:237] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.882746 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet f6e264e8507446809f3c386fdb3c34ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.884240 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet b6395bce17ee40c2822669246ce7eb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.884908 28898 raft_consensus.cc:482] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:42.885061 28898 raft_consensus.cc:504] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.885737 28898 leader_election.cc:288] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:42.886968 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:42.887621 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:42.888130 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:42.888646 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:42.888514 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4efa31ad2ce8436b9638e6759d9b5421" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:42.889065 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
W20260810 11:30:42.889142 26991 leader_election.cc:341] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:42.889716 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:42.890156 26572 catalog_manager.cc:5495] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:42.890795 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:42.891086 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d1d0d55b526749059470504a27887b22 (table default.Table_a164cd4bbc4344ae905f395ab1e6cffb [id=62f404c62e4040fc801f70cafddf9d95]). Expected version 1 got 0
I20260810 11:30:42.891537 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
I20260810 11:30:42.892699 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:42.893092 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:42.893430 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:42.894119 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
W20260810 11:30:42.895077 26700 leader_election.cc:341] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:42.895675 26581 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 160) took 1914 ms. Trace:
W20260810 11:30:42.895867 26700 leader_election.cc:341] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:42.894696 26572 catalog_manager.cc:5495] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:42.899421 26581 rpcz_store.cc:276] 0810 11:30:40.981039 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.863200 (+1882161us) service_pool.cc:227] Handling call
0810 11:30:42.878757 (+ 15557us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:42.879321 (+ 564us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:42.895328 (+ 16007us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.895336 (+ 8us) write_op.cc:454] Released schema lock
0810 11:30:42.895417 (+ 81us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:42.895530 (+ 113us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:42.895632 (+ 102us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.881423 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.881562 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.881570 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:42.881574 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:42.881705 (+ 131us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.881725 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.881732 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.881848 (+ 116us) tablet.cc:699] Row locks acquired
0810 11:30:42.881852 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:42.881901 (+ 49us) write_op.cc:270] Start()
0810 11:30:42.881948 (+ 47us) write_op.cc:276] Timestamp: P: 1786361442881853 usec, L: 0
0810 11:30:42.881953 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.882244 (+ 291us) log.cc:842] Serialized 433 byte log entry
0810 11:30:42.886782 (+ 4538us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.886938 (+ 156us) write_op.cc:301] APPLY: starting
0810 11:30:42.886964 (+ 26us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.887014 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.887051 (+ 37us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.887186 (+ 135us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.887225 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:42.887232 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:42.887316 (+ 84us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.887413 (+ 97us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.887436 (+ 23us) write_op.cc:454] Released schema lock
0810 11:30:42.887443 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":99,"apply.run_cpu_time_us":569,"apply.run_wall_time_us":568,"num_ops":2,"prepare.queue_time_us":58,"prepare.run_cpu_time_us":963,"prepare.run_wall_time_us":964,"raft.queue_time_us":1327,"raft.run_cpu_time_us":449,"raft.run_wall_time_us":449,"replication_time_us":4801}]]}
I20260810 11:30:42.900362 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet ce73798a721b4a6d892f0c24b6b40e2c (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]). Expected version 1 got 0
I20260810 11:30:42.900651 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:42.900974 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:42.901157 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:42.902181 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:42.902609 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:42.902828 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:42.903779 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:42.904399 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:42.904652 26580 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 159) took 1933 ms. Trace:
I20260810 11:30:42.904796 26580 rpcz_store.cc:276] 0810 11:30:40.965829 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.862119 (+1896290us) service_pool.cc:227] Handling call
0810 11:30:42.885225 (+ 23106us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:42.890001 (+ 4776us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:42.898987 (+ 8986us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:42.899177 (+ 190us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:42.899256 (+ 79us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.890625 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.890746 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.890754 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:42.890757 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:42.890868 (+ 111us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.890884 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.890890 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.890975 (+ 85us) tablet.cc:699] Row locks acquired
0810 11:30:42.890978 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:42.891017 (+ 39us) write_op.cc:270] Start()
0810 11:30:42.891072 (+ 55us) write_op.cc:276] Timestamp: P: 1786361442890970 usec, L: 0
0810 11:30:42.891078 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.891266 (+ 188us) log.cc:842] Serialized 433 byte log entry
0810 11:30:42.896479 (+ 5213us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.896705 (+ 226us) write_op.cc:301] APPLY: starting
0810 11:30:42.896728 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.896788 (+ 60us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.897189 (+ 401us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.897343 (+ 154us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.897389 (+ 46us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:42.897395 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:42.897484 (+ 89us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.897551 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.897586 (+ 35us) write_op.cc:454] Released schema lock
0810 11:30:42.897594 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:42.897658 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.897662 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":167,"apply.run_cpu_time_us":661,"apply.run_wall_time_us":1011,"num_ops":2,"prepare.queue_time_us":46,"prepare.run_cpu_time_us":750,"prepare.run_wall_time_us":750,"raft.queue_time_us":218,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":287,"replication_time_us":5374}]]}
I20260810 11:30:42.907650 26581 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_39b5e6c9fae14b689a454fbe35bc3891"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:42.908443 26580 master_service.cc:946] ReplaceTablet: received request to replace tablet ce73798a721b4a6d892f0c24b6b40e2c from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:42.909374 29027 tablet.cc:1722] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 11:30:42.910449 26581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39b5e6c9fae14b689a454fbe35bc3891 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:42.909317 27999 ts_tablet_manager.cc:1918] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:42.912056 27999 log.cc:1196] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/7cd4f555b5d840c182a31b3c94da9619
I20260810 11:30:42.912916 27999 ts_tablet_manager.cc:1939] T 7cd4f555b5d840c182a31b3c94da9619 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:42.917079 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 10210204d5ff4e5e97c98fd255f674a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.917690 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet c60baf810a544a4a90dccd2337a39043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.917939 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 34) took 1977 ms. Trace:
I20260810 11:30:42.920485 27999 rpcz_store.cc:276] 0810 11:30:40.940982 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.941050 (+ 68us) service_pool.cc:227] Handling call
0810 11:30:42.678826 (+1737776us) ts_tablet_manager.cc:1145] Deleting tablet 7cd4f555b5d840c182a31b3c94da9619
0810 11:30:42.678856 (+ 30us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:42.856699 (+177843us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:42.909198 (+ 52499us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:42.917902 (+ 8704us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10482,"tablet-delete.queue_time_us":1728927}
I20260810 11:30:42.922669 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 7cd4f555b5d840c182a31b3c94da9619 (table default.Table_061b7dfbcc074ad6a0d99d49113a354f [id=0186ddbf3c144b4e86ae21cbdac555d2]) successfully deleted
I20260810 11:30:42.923914 27999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 35) took 1954 ms. Trace:
I20260810 11:30:42.924110 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:42.924479 27999 rpcz_store.cc:276] 0810 11:30:40.969390 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:40.969457 (+ 67us) service_pool.cc:227] Handling call
0810 11:30:42.923479 (+1954022us) ts_tablet_manager.cc:1145] Deleting tablet b121c13e9241468aa224e17093eb38f4
0810 11:30:42.923492 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:42.923881 (+ 389us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1950706}
I20260810 11:30:42.924528 26581 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 161) took 1925 ms. Trace:
I20260810 11:30:42.925467 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:42.925968 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
W20260810 11:30:42.926043 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet b121c13e9241468aa224e17093eb38f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b121c13e9241468aa224e17093eb38f4 already in progress: creating tablet
I20260810 11:30:42.925168 26581 rpcz_store.cc:276] 0810 11:30:40.998995 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.907346 (+1908351us) service_pool.cc:227] Handling call
0810 11:30:42.910592 (+ 3246us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:42.911194 (+ 602us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:42.924043 (+ 12849us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:42.924195 (+ 152us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:42.924465 (+ 270us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.916123 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.916317 (+ 194us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.916327 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:42.916332 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:42.916479 (+ 147us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.916499 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.916508 (+ 9us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.916664 (+ 156us) tablet.cc:699] Row locks acquired
0810 11:30:42.916669 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:42.916721 (+ 52us) write_op.cc:270] Start()
0810 11:30:42.916785 (+ 64us) write_op.cc:276] Timestamp: P: 1786361442916668 usec, L: 0
0810 11:30:42.916792 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.917078 (+ 286us) log.cc:842] Serialized 433 byte log entry
0810 11:30:42.921623 (+ 4545us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.921742 (+ 119us) write_op.cc:301] APPLY: starting
0810 11:30:42.921762 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.921810 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.921840 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.921993 (+ 153us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.922033 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:42.922040 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:42.922145 (+ 105us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.922218 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.922242 (+ 24us) write_op.cc:454] Released schema lock
0810 11:30:42.922250 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:42.922310 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.922313 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":48,"apply.run_cpu_time_us":631,"apply.run_wall_time_us":631,"num_ops":2,"prepare.queue_time_us":4201,"prepare.run_cpu_time_us":1112,"prepare.run_wall_time_us":1112,"raft.queue_time_us":814,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":291,"replication_time_us":4793}]]}
W20260810 11:30:42.928040 26700 consensus_peers.cc:487] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8a65a0e8b1f4e4b8d9a82059b766cda. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:42.928704 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:42.928859 27231 tablet_bootstrap.cc:492] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:42.929013 27231 ts_tablet_manager.cc:1397] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.303s user 0.012s sys 0.017s
I20260810 11:30:42.929056 29052 tablet.cc:1722] T fccc21cfc1ce4eb586f03276ec6e987f P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:42.929512 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:42.929899 27231 raft_consensus.cc:348] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.930145 27231 raft_consensus.cc:374] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:42.930207 27231 raft_consensus.cc:729] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:42.930347 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:42.930598 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:42.930466 27231 consensus_queue.cc:260] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.930778 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:42.931021 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:42.931056 27231 ts_tablet_manager.cc:1428] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 11:30:42.931263 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:42.931349 27231 tablet_bootstrap.cc:492] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:42.932054 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet db59523b71224370bf5fce6b56592f71 with delete_type TABLET_DATA_DELETED (replaced by tablet bd34a4de1b93402c8a4bce1215660e77) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.932431 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 49db12565dbc4187b78a98ed35c40fed with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1e46f80f7f4e3a84638421892e6236) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.934267 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet ea66da5bc20e4718901ffc473677421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.934655 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.934893 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:42.936334 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet fccc21cfc1ce4eb586f03276ec6e987f (table default.Table_65da57b4be754a5b9cbc73361a4f1b93 [id=e22f19a993564e53b1cc76633f25f505]). Expected version 1 got 0
I20260810 11:30:42.936897 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:42.937880 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:42.938861 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:42.939762 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:42.940392 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
W20260810 11:30:42.940696 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 2801709d53614916abac370f7ae5e913 because the tablet was not found. No further retry: Not found: Tablet not found: 2801709d53614916abac370f7ae5e913
I20260810 11:30:42.942361 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
W20260810 11:30:42.945689 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 256ad2e2d8e54a4caa1b5091bab60dd5 already in progress: creating tablet
W20260810 11:30:42.946950 26565 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 271a0607ec28441c91bac32c2f2bf44b consensus state has no leader
I20260810 11:30:42.947023 29110 tablet_replica.cc:330] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:42.947258 29110 raft_consensus.cc:2229] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:42.947564 29110 raft_consensus.cc:2258] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:42.948194 29110 ts_tablet_manager.cc:1905] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:42.949066 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e78fb1bf0534deca5cc5a603fd77592 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.949223 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c203cd90d2f472fa27cfabed5b87119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.950160 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 23637a02b6464e17aa2a69ea5cc4ddfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
W20260810 11:30:42.950537 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet fc558690dce44e999e55e9bf1b6ca172 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc558690dce44e999e55e9bf1b6ca172 already in progress: creating tablet
I20260810 11:30:42.952241 27222 tablet_bootstrap.cc:492] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:42.952455 27222 ts_tablet_manager.cc:1397] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.222s user 0.012s sys 0.000s
W20260810 11:30:42.953294 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 8a1e2e624fff4692a22e29b293cd82d6 because the tablet was not found. No further retry: Not found: Tablet not found: 8a1e2e624fff4692a22e29b293cd82d6
I20260810 11:30:42.953369 27222 raft_consensus.cc:348] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.953639 27222 raft_consensus.cc:374] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:42.953714 27222 raft_consensus.cc:729] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:42.953938 27999 tablet_replica.cc:330] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:42.953995 27222 consensus_queue.cc:260] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.954845 27222 ts_tablet_manager.cc:1428] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:42.955331 27222 tablet_bootstrap.cc:492] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:42.956043 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 110b5acc36bd4d6bba13735e5daec75f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.957178 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 518c777e40ec40dcb3484c0374384959 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.961122 27999 raft_consensus.cc:2229] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:42.962173 27999 raft_consensus.cc:2258] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:42.965178 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 603fe104b7ab485eab6b225a58bddc1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.966689 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 10e6c41db71a4146840f06c5b7412d9c with delete_type TABLET_DATA_DELETED (replaced by tablet 72209a805e3e4b4ea1bf99508e0f75db) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.971864 27999 ts_tablet_manager.cc:1905] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:42.974751 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 91b6078efadf496fb252f725bdf56b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.977087 27231 tablet_bootstrap.cc:654] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:42.977468 26580 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet ce73798a721b4a6d892f0c24b6b40e2c
I20260810 11:30:42.978335 26580 catalog_manager.cc:6565] ReplaceTablet: tablet ce73798a721b4a6d892f0c24b6b40e2c deleted and replaced by tablet 81b800247b4e4171b82dcde68e39fb00
I20260810 11:30:42.978487 26580 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 162) took 1709 ms. Trace:
I20260810 11:30:42.979053 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.978718 26580 rpcz_store.cc:276] 0810 11:30:41.268595 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.908339 (+1639744us) service_pool.cc:227] Handling call
0810 11:30:42.978427 (+ 70088us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.968428 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.968541 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.968548 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:42.968551 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:42.968717 (+ 166us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.968732 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.968737 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.968820 (+ 83us) tablet.cc:699] Row locks acquired
0810 11:30:42.968822 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:42.968862 (+ 40us) write_op.cc:270] Start()
0810 11:30:42.968900 (+ 38us) write_op.cc:276] Timestamp: P: 1786361442968841 usec, L: 0
0810 11:30:42.968904 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.969112 (+ 208us) log.cc:842] Serialized 631 byte log entry
0810 11:30:42.973471 (+ 4359us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.973612 (+ 141us) write_op.cc:301] APPLY: starting
0810 11:30:42.973630 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.973676 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.973704 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.973818 (+ 114us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.973903 (+ 85us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:42.973910 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:42.973998 (+ 88us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.974073 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.974097 (+ 24us) write_op.cc:454] Released schema lock
0810 11:30:42.974104 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:42.974163 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.974166 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":92,"apply.run_cpu_time_us":610,"apply.run_wall_time_us":608,"num_ops":2,"prepare.queue_time_us":63,"prepare.run_cpu_time_us":823,"prepare.run_wall_time_us":822,"raft.queue_time_us":950,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":252,"replication_time_us":4539}]]}
I20260810 11:30:42.979430 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 3851d39aeb3142938a5ac558ab438c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.979619 26580 master_service.cc:946] ReplaceTablet: received request to replace tablet 8b303be24f4e46d0b966e8191d76297b from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:42.979849 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.980266 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 78633fbe048b4534ae3277ce6b7c4313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:39 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.980690 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet ff9b649e43a9456fa51cf3330290bb91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.980651 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet ce73798a721b4a6d892f0c24b6b40e2c with delete_type TABLET_DATA_DELETED (replaced by tablet 81b800247b4e4171b82dcde68e39fb00) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:42.981003 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet a8a65a0e8b1f4e4b8d9a82059b766cda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.981307 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet a835d30ef9fc474ab927bb119a95d83c with delete_type TABLET_DATA_DELETED (replaced by tablet 2a1fbf3890ee4a829b4c8c61fe1e978f) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.981552 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet a63227e69df14a4ea935087fd31ece63 with delete_type TABLET_DATA_DELETED (replaced by tablet aa71cedba3d34c288a3e3be99d474ce4) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.981853 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ccef06fa06c4c519d8760fa948d6c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.982170 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet cc76d30f37094391b75076c92ccc277f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.987058 27228 tablet_bootstrap.cc:492] T 1aa4562a2247405187d9dbd1baa48f39 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:42.987231 27228 ts_tablet_manager.cc:1397] T 1aa4562a2247405187d9dbd1baa48f39 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.161s user 0.008s sys 0.016s
I20260810 11:30:42.988157 27228 raft_consensus.cc:348] T 1aa4562a2247405187d9dbd1baa48f39 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.988387 27228 raft_consensus.cc:374] T 1aa4562a2247405187d9dbd1baa48f39 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:42.988446 27228 raft_consensus.cc:729] T 1aa4562a2247405187d9dbd1baa48f39 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:42.988721 27228 consensus_queue.cc:260] T 1aa4562a2247405187d9dbd1baa48f39 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.989329 27228 ts_tablet_manager.cc:1428] T 1aa4562a2247405187d9dbd1baa48f39 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 11:30:42.965566 28726 raft_consensus.cc:482] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:42.989547 28726 raft_consensus.cc:504] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:42.990310 28726 leader_election.cc:288] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:42.992007 27222 tablet_bootstrap.cc:654] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:42.998093 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c715bdcff8c4cdabfddf871f6fdc388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.999079 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a45422addab84e9083df8665a0cf9322" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:42.999287 27228 tablet_bootstrap.cc:492] T 1801d3af4a4548dba8b0d8ea2fecf5ba P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
W20260810 11:30:43.000360 26700 leader_election.cc:341] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.000954 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet d14091e1c111438bac8bcf3d36123d80 with delete_type TABLET_DATA_DELETED (replaced by tablet ce73798a721b4a6d892f0c24b6b40e2c) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:42.971091 28987 ts_tablet_manager.cc:1918] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:42.985294 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet ce73798a721b4a6d892f0c24b6b40e2c with delete_type TABLET_DATA_DELETED (replaced by tablet 81b800247b4e4171b82dcde68e39fb00) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:43.002944 28987 log.cc:1196] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/91b6078efadf496fb252f725bdf56b02
I20260810 11:30:43.003764 28987 ts_tablet_manager.cc:1939] T 91b6078efadf496fb252f725bdf56b02 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:43.010334 27228 tablet_bootstrap.cc:654] T 1801d3af4a4548dba8b0d8ea2fecf5ba P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:43.011803 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 81) took 1175 ms. Trace:
I20260810 11:30:43.015209 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a45422addab84e9083df8665a0cf9322" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:43.015605 27060 raft_consensus.cc:2454] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:42.935032 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet e31b380f99854eb8b63e1f9eede1fc7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:43.014735 27999 ts_tablet_manager.cc:1918] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:43.036477 27999 log.cc:1196] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/1860e56467624dcdb288e13b004f78cc
I20260810 11:30:43.016294 26702 leader_election.cc:302] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.037262 27999 ts_tablet_manager.cc:1939] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:43.018476 28640 consensus_queue.cc:1035] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:43.038115 28640 raft_consensus.cc:2781] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:43.038218 28640 raft_consensus.cc:482] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:43.038285 28640 raft_consensus.cc:3037] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.039047 27999 tablet_replica.cc:330] T 1aa4562a2247405187d9dbd1baa48f39 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:43.039433 27999 raft_consensus.cc:2229] T 1aa4562a2247405187d9dbd1baa48f39 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:43.039731 27999 raft_consensus.cc:2258] T 1aa4562a2247405187d9dbd1baa48f39 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:43.018935 28728 raft_consensus.cc:482] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:43.040745 28728 raft_consensus.cc:504] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.040922 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 1860e56467624dcdb288e13b004f78cc (table default.Table_5a4c04e087c3490fae87a17247850531 [id=323f239c11f84a69beaf74e68c0cf50a]) successfully deleted
W20260810 11:30:43.041461 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 44d5e146eeec4fe0be33c1c169d32e68 because the tablet was not found. No further retry: Not found: Tablet not found: 44d5e146eeec4fe0be33c1c169d32e68
I20260810 11:30:43.041520 28728 leader_election.cc:288] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:43.041785 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 10210204d5ff4e5e97c98fd255f674a5 because the tablet was not found. No further retry: Not found: Tablet not found: 10210204d5ff4e5e97c98fd255f674a5
W20260810 11:30:43.042133 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 55c8749861874eca9b63d3db97afa2b1 because the tablet was not found. No further retry: Not found: Tablet not found: 55c8749861874eca9b63d3db97afa2b1
W20260810 11:30:43.042393 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 3851d39aeb3142938a5ac558ab438c21 because the tablet was not found. No further retry: Not found: Tablet not found: 3851d39aeb3142938a5ac558ab438c21
W20260810 11:30:43.042836 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 8228600e3f6b4f9993dd25e4ceb57e4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8228600e3f6b4f9993dd25e4ceb57e4d already in progress: creating tablet
I20260810 11:30:43.019090 27222 tablet_bootstrap.cc:492] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:43.043169 27222 ts_tablet_manager.cc:1397] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.088s user 0.004s sys 0.000s
W20260810 11:30:43.043926 26700 leader_election.cc:341] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 1860e56467624dcdb288e13b004f78cc
I20260810 11:30:43.044162 27222 raft_consensus.cc:348] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.044471 27222 raft_consensus.cc:374] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.044544 27222 raft_consensus.cc:729] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.044847 27222 consensus_queue.cc:260] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.045679 27222 ts_tablet_manager.cc:1428] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:43.046062 27222 tablet_bootstrap.cc:492] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:43.048204 27222 tablet_bootstrap.cc:654] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:43.049959 28640 raft_consensus.cc:504] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.051038 27999 ts_tablet_manager.cc:1905] T 1aa4562a2247405187d9dbd1baa48f39 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:43.053009 28640 leader_election.cc:288] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:43.053050 26849 consensus_peers.cc:487] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0713f4f14a284050a7774a70ab974f30. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:43.054971 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a45422addab84e9083df8665a0cf9322" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:43.056056 26700 leader_election.cc:341] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.064263 28987 rpcz_store.cc:276] 0810 11:30:41.835977 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.837521 (+ 1544us) service_pool.cc:227] Handling call
0810 11:30:42.630748 (+793227us) ts_tablet_manager.cc:1145] Deleting tablet 91b6078efadf496fb252f725bdf56b02
0810 11:30:42.630756 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:42.967605 (+336849us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:42.970970 (+ 3365us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:43.011770 (+ 40800us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":793015}
I20260810 11:30:43.065078 28987 tablet_replica.cc:330] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:43.065433 28987 raft_consensus.cc:2229] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 2 LEADER]: Raft consensus shutting down.
I20260810 11:30:43.065409 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 91b6078efadf496fb252f725bdf56b02 (table default.Table_f5acadd3f7ff49d4883a695e2348164f [id=02cec75d98d0411ba2eb17ae8f083f00]) successfully deleted
I20260810 11:30:43.065775 28987 pending_rounds.cc:62] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d: Trying to abort 1 pending ops.
I20260810 11:30:43.065840 28987 pending_rounds.cc:68] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d: Aborting op as it isn't in flight: id { term: 2 index: 1 } timestamp: 7316936469920559104 op_type: NO_OP noop_request { }
I20260810 11:30:43.066175 28987 raft_consensus.cc:2866] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:43.066404 28987 raft_consensus.cc:2258] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:43.065579 27999 ts_tablet_manager.cc:1918] T 1aa4562a2247405187d9dbd1baa48f39 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:43.067516 27999 log.cc:1196] T 1aa4562a2247405187d9dbd1baa48f39 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/1aa4562a2247405187d9dbd1baa48f39
I20260810 11:30:43.067610 26580 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 8b303be24f4e46d0b966e8191d76297b
I20260810 11:30:43.068058 27999 ts_tablet_manager.cc:1939] T 1aa4562a2247405187d9dbd1baa48f39 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:43.068230 26580 catalog_manager.cc:6565] ReplaceTablet: tablet 8b303be24f4e46d0b966e8191d76297b deleted and replaced by tablet ccdf2bb9f3b347ceb970a0d3115816df
I20260810 11:30:43.068423 26580 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 163) took 1731 ms. Trace:
I20260810 11:30:43.068730 26909 raft_consensus.cc:3037] T 9de57b6d03e34ee783b822b30090c077 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.068608 26580 rpcz_store.cc:276] 0810 11:30:41.336788 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.979484 (+1642696us) service_pool.cc:227] Handling call
0810 11:30:43.068326 (+ 88842us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:43.057641 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:43.057809 (+ 168us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:43.057819 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:43.057823 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:43.058082 (+ 259us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:43.058105 (+ 23us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:43.058113 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:43.058238 (+ 125us) tablet.cc:699] Row locks acquired
0810 11:30:43.058242 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:43.058296 (+ 54us) write_op.cc:270] Start()
0810 11:30:43.058345 (+ 49us) write_op.cc:276] Timestamp: P: 1786361443058262 usec, L: 0
0810 11:30:43.058352 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:43.058621 (+ 269us) log.cc:842] Serialized 631 byte log entry
0810 11:30:43.063666 (+ 5045us) op_driver.cc:444] REPLICATION: finished
0810 11:30:43.063841 (+ 175us) write_op.cc:301] APPLY: starting
0810 11:30:43.063863 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:43.063942 (+ 79us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:43.063978 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:43.064108 (+ 130us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:43.064186 (+ 78us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:43.064192 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:43.064303 (+ 111us) log.cc:842] Serialized 29 byte log entry
0810 11:30:43.064378 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:43.064404 (+ 26us) write_op.cc:454] Released schema lock
0810 11:30:43.064412 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:43.064476 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:43.064479 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":110,"apply.run_cpu_time_us":700,"apply.run_wall_time_us":699,"num_ops":2,"prepare.queue_time_us":79,"prepare.run_cpu_time_us":1143,"prepare.run_wall_time_us":1144,"raft.queue_time_us":1289,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":295,"replication_time_us":5278}]]}
I20260810 11:30:43.069576 26580 master_service.cc:946] ReplaceTablet: received request to replace tablet b945cb22353f4d99a3836e3c0b8e26e3 from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:43.071277 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 1aa4562a2247405187d9dbd1baa48f39 (table default.Table_5318e36611c342278e64da2f02be8a08 [id=3b8a0c6cf3fa45c18cedc4967f725ba3]) successfully deleted
I20260810 11:30:43.071906 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b303be24f4e46d0b966e8191d76297b with delete_type TABLET_DATA_DELETED (replaced by tablet ccdf2bb9f3b347ceb970a0d3115816df) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:43.080839 27999 tablet_replica.cc:330] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:43.081322 27999 raft_consensus.cc:2229] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:43.081868 27999 raft_consensus.cc:2258] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:43.082715 27228 tablet_bootstrap.cc:492] T 1801d3af4a4548dba8b0d8ea2fecf5ba P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:43.071734 27222 tablet_bootstrap.cc:492] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:43.073469 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b303be24f4e46d0b966e8191d76297b with delete_type TABLET_DATA_DELETED (replaced by tablet ccdf2bb9f3b347ceb970a0d3115816df) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:43.074734 28640 consensus_queue.cc:1035] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:43.083880 27222 ts_tablet_manager.cc:1397] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.006s
I20260810 11:30:43.084267 27228 ts_tablet_manager.cc:1397] T 1801d3af4a4548dba8b0d8ea2fecf5ba P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.085s user 0.003s sys 0.001s
I20260810 11:30:43.084798 27222 raft_consensus.cc:348] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.085027 27222 raft_consensus.cc:374] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.085086 27222 raft_consensus.cc:729] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.085285 27222 consensus_queue.cc:260] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.085988 27222 ts_tablet_manager.cc:1428] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:43.086138 28987 ts_tablet_manager.cc:1905] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:43.086495 27222 tablet_bootstrap.cc:492] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:43.025274 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 64818ca5827e41d99428903ddb8688d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:43.025635 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 318d5b8453fe4c438d0fa32cb91c409e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:43.026492 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ada1df82eb44ecb9a6c615b5410e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:43.026926 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 713663be70014b17b17056a865e7db63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:43.027129 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet 2634beb347714fc7a2e05865adb34a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:43.027280 27033 tablet_service.cc:1514] Processing DeleteTablet for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:43.027338 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:43.029981 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet ce73798a721b4a6d892f0c24b6b40e2c with delete_type TABLET_DATA_DELETED (replaced by tablet 81b800247b4e4171b82dcde68e39fb00) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:43.083196 27999 ts_tablet_manager.cc:1905] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:43.035835 26993 leader_election.cc:341] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.090117 26993 leader_election.cc:302] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.090512 28845 raft_consensus.cc:2726] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:43.090937 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 55112.6us
W20260810 11:30:43.094463 26993 leader_election.cc:341] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.045639 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1860e56467624dcdb288e13b004f78cc" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:43.094853 27059 raft_consensus.cc:2454] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:43.046742 29123 raft_consensus.cc:482] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:43.095126 26580 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet b945cb22353f4d99a3836e3c0b8e26e3
I20260810 11:30:43.095257 29123 raft_consensus.cc:504] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.095937 29123 leader_election.cc:288] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:43.052978 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a45422addab84e9083df8665a0cf9322" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:43.096263 27058 raft_consensus.cc:3037] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.096644 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet b945cb22353f4d99a3836e3c0b8e26e3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ee50a7da224437baed913995e6587dd) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:43.096974 26702 leader_election.cc:302] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.097033 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet b945cb22353f4d99a3836e3c0b8e26e3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ee50a7da224437baed913995e6587dd) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:43.073447 28753 raft_consensus.cc:482] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:43.097442 26580 catalog_manager.cc:6565] ReplaceTablet: tablet b945cb22353f4d99a3836e3c0b8e26e3 deleted and replaced by tablet 5ee50a7da224437baed913995e6587dd
I20260810 11:30:43.097709 26580 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 164) took 1722 ms. Trace:
I20260810 11:30:43.098212 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8e6fc49f5e54f6c8fb710220a6cbf0f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:43.097908 26580 rpcz_store.cc:276] 0810 11:30:41.375057 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.069345 (+1694288us) service_pool.cc:227] Handling call
0810 11:30:43.097555 (+ 28210us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:43.082333 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:43.082483 (+ 150us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:43.082491 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:43.082493 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:43.082619 (+ 126us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:43.082634 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:43.082640 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:43.082733 (+ 93us) tablet.cc:699] Row locks acquired
0810 11:30:43.082737 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:43.082785 (+ 48us) write_op.cc:270] Start()
0810 11:30:43.082829 (+ 44us) write_op.cc:276] Timestamp: P: 1786361443082750 usec, L: 0
0810 11:30:43.082833 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:43.083215 (+ 382us) log.cc:842] Serialized 631 byte log entry
0810 11:30:43.089553 (+ 6338us) op_driver.cc:444] REPLICATION: finished
0810 11:30:43.090190 (+ 637us) write_op.cc:301] APPLY: starting
0810 11:30:43.090211 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:43.090267 (+ 56us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:43.090359 (+ 92us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:43.090497 (+ 138us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:43.090567 (+ 70us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:43.090574 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:43.090676 (+ 102us) log.cc:842] Serialized 29 byte log entry
0810 11:30:43.090757 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:43.090783 (+ 26us) write_op.cc:454] Released schema lock
0810 11:30:43.090791 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:43.090854 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:43.090858 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":558,"apply.run_cpu_time_us":751,"apply.run_wall_time_us":751,"num_ops":2,"prepare.queue_time_us":73,"prepare.run_cpu_time_us":1084,"prepare.run_wall_time_us":1085,"raft.queue_time_us":239,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":325,"replication_time_us":6684}]]}
I20260810 11:30:43.099028 26580 master_service.cc:946] ReplaceTablet: received request to replace tablet d512c335e340437fa32f2dc16dca6812 from {username='slave'} at 127.0.0.1:51252
W20260810 11:30:43.099498 26991 leader_election.cc:341] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.100194 28640 raft_consensus.cc:2781] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:43.100301 28640 raft_consensus.cc:482] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:43.100419 28640 raft_consensus.cc:3037] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:43.103283 27291 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9e329b95fc8e41c3967079896294942a consensus state has no leader
I20260810 11:30:43.104368 28640 raft_consensus.cc:504] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.106141 28640 leader_election.cc:288] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:43.107266 26700 leader_election.cc:341] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 1860e56467624dcdb288e13b004f78cc
I20260810 11:30:43.104765 27222 tablet_bootstrap.cc:654] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:43.109787 28726 consensus_queue.cc:1035] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:43.041769 27231 tablet_bootstrap.cc:492] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:43.110209 27231 ts_tablet_manager.cc:1397] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.179s user 0.003s sys 0.000s
I20260810 11:30:43.113981 26993 leader_election.cc:302] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.114339 29123 raft_consensus.cc:2726] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:43.115257 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 791737cdc46949d88fa46c7f7c660593 (DEFAULT_TABLE table=default.Table_7bf69372e4b04dfba17cfcb786af5763 [id=b599ee40ccaa4800b503976d61f0178d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:43.115351 26993 consensus_peers.cc:487] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 49db12565dbc4187b78a98ed35c40fed. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:43.115762 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 791737cdc46949d88fa46c7f7c660593. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:43.115978 26993 leader_election.cc:341] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.116087 26993 leader_election.cc:302] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.116302 29123 raft_consensus.cc:2726] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:43.117383 27999 ts_tablet_manager.cc:1918] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:43.117549 27999 log.cc:1196] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/81f24c84cdd945b78f39f24015eb1e43
I20260810 11:30:43.119657 27228 raft_consensus.cc:348] T 1801d3af4a4548dba8b0d8ea2fecf5ba P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.120023 27228 raft_consensus.cc:374] T 1801d3af4a4548dba8b0d8ea2fecf5ba P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.120102 27228 raft_consensus.cc:729] T 1801d3af4a4548dba8b0d8ea2fecf5ba P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.120348 27228 consensus_queue.cc:260] T 1801d3af4a4548dba8b0d8ea2fecf5ba P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.120580 27222 tablet_bootstrap.cc:492] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:43.120756 27222 ts_tablet_manager.cc:1397] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.034s user 0.006s sys 0.003s
I20260810 11:30:43.121065 27228 ts_tablet_manager.cc:1428] T 1801d3af4a4548dba8b0d8ea2fecf5ba P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.037s user 0.002s sys 0.000s
I20260810 11:30:43.121371 27228 tablet_bootstrap.cc:492] T 77ffda3325af4096bbec689397f7a324 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:43.123775 27222 raft_consensus.cc:348] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.124116 27222 raft_consensus.cc:374] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.124199 27222 raft_consensus.cc:729] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.124683 27999 ts_tablet_manager.cc:1939] T 81f24c84cdd945b78f39f24015eb1e43 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:43.127460 27228 tablet_bootstrap.cc:654] T 77ffda3325af4096bbec689397f7a324 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:43.131008 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 81f24c84cdd945b78f39f24015eb1e43 (table default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e]) successfully deleted
I20260810 11:30:43.131420 27999 tablet_replica.cc:330] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:43.131801 27999 raft_consensus.cc:2229] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:43.132019 27999 raft_consensus.cc:2258] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:43.132390 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 3ae27bf110114b70a3e3f6cf64f31b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae27bf110114b70a3e3f6cf64f31b98 already in progress: creating tablet
I20260810 11:30:43.132679 27222 consensus_queue.cc:260] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:43.133122 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet d000f0ebaf0049a7bdaad93e307e16e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d000f0ebaf0049a7bdaad93e307e16e2 already in progress: creating tablet
W20260810 11:30:43.133389 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ea66da5bc20e4718901ffc473677421c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea66da5bc20e4718901ffc473677421c already in progress: creating tablet
W20260810 11:30:43.133615 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 02ff6a9bc02441ddb7f307d6b3df31bd because the tablet was not found. No further retry: Not found: Tablet not found: 02ff6a9bc02441ddb7f307d6b3df31bd
W20260810 11:30:43.133912 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet b6395bce17ee40c2822669246ce7eb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6395bce17ee40c2822669246ce7eb42 already in progress: creating tablet
I20260810 11:30:43.135143 26580 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet d512c335e340437fa32f2dc16dca6812
I20260810 11:30:43.136008 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet d512c335e340437fa32f2dc16dca6812 with delete_type TABLET_DATA_DELETED (replaced by tablet 7abf8e1e7f2c4519902cf31c6e0e86e2) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:43.137671 28987 ts_tablet_manager.cc:1918] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260810 11:30:43.137934 29110 ts_tablet_manager.cc:1918] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:43.138094 29110 log.cc:1196] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/fc558690dce44e999e55e9bf1b6ca172
I20260810 11:30:43.138906 29110 ts_tablet_manager.cc:1939] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
W20260810 11:30:43.142827 29128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 11:30:43.144704 28987 log.cc:1196] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/10e6c41db71a4146840f06c5b7412d9c
I20260810 11:30:43.145802 28987 ts_tablet_manager.cc:1939] T 10e6c41db71a4146840f06c5b7412d9c P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:43.146347 27999 ts_tablet_manager.cc:1905] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:43.145874 27222 ts_tablet_manager.cc:1428] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.025s user 0.003s sys 0.000s
I20260810 11:30:43.147433 27222 tablet_bootstrap.cc:492] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:43.150264 27222 tablet_bootstrap.cc:654] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:43.155122 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 84) took 1318 ms. Trace:
I20260810 11:30:43.160100 28987 rpcz_store.cc:276] 0810 11:30:41.854764 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.855917 (+ 1153us) service_pool.cc:227] Handling call
0810 11:30:43.065012 (+1209095us) ts_tablet_manager.cc:1145] Deleting tablet 10e6c41db71a4146840f06c5b7412d9c
0810 11:30:43.065027 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:43.124386 (+ 59359us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:43.137527 (+ 13141us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:43.155092 (+ 17565us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1187170}
I20260810 11:30:43.161899 28987 tablet_replica.cc:330] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:43.162200 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 10e6c41db71a4146840f06c5b7412d9c (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]) successfully deleted
I20260810 11:30:43.164105 28987 raft_consensus.cc:2229] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 2 LEADER]: Raft consensus shutting down.
I20260810 11:30:43.165436 27999 ts_tablet_manager.cc:1918] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:43.165598 27999 log.cc:1196] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/db59523b71224370bf5fce6b56592f71
I20260810 11:30:43.165920 27999 ts_tablet_manager.cc:1939] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:43.166993 27999 tablet_replica.cc:330] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:43.167315 27999 raft_consensus.cc:2229] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:43.167444 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet db59523b71224370bf5fce6b56592f71 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]) successfully deleted
I20260810 11:30:43.167663 27999 raft_consensus.cc:2258] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:43.167989 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ee803ddf27594d2b9e19fe440fc269c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee803ddf27594d2b9e19fe440fc269c7 already in progress: creating tablet
I20260810 11:30:43.168071 28987 pending_rounds.cc:62] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d: Trying to abort 1 pending ops.
W20260810 11:30:43.168658 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet f6e264e8507446809f3c386fdb3c34ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6e264e8507446809f3c386fdb3c34ae already in progress: creating tablet
I20260810 11:30:43.169471 28987 pending_rounds.cc:68] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7316936466935111680 op_type: NO_OP noop_request { }
I20260810 11:30:43.168308 27999 ts_tablet_manager.cc:1905] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:43.170228 26746 tablet_service.cc:1467] Processing CreateTablet for tablet 791737cdc46949d88fa46c7f7c660593 (DEFAULT_TABLE table=default.Table_7bf69372e4b04dfba17cfcb786af5763 [id=b599ee40ccaa4800b503976d61f0178d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.171196 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 791737cdc46949d88fa46c7f7c660593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.171343 26895 tablet_service.cc:1467] Processing CreateTablet for tablet a9ad92f2c782407aaf74f607d34e780b (DEFAULT_TABLE table=default.Table_0bf07015df0d4fc4ae4119eecdd6dac4 [id=78034ee094e641419617f27946ee29de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.171707 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9ad92f2c782407aaf74f607d34e780b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.177030 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet d512c335e340437fa32f2dc16dca6812 with delete_type TABLET_DATA_DELETED (replaced by tablet 7abf8e1e7f2c4519902cf31c6e0e86e2) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:43.177351 27999 ts_tablet_manager.cc:1918] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:43.177495 27999 log.cc:1196] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/0713f4f14a284050a7774a70ab974f30
I20260810 11:30:43.177431 29123 raft_consensus.cc:482] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6079090b1124d84aa4477974bb53700)
I20260810 11:30:43.177614 29123 raft_consensus.cc:504] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.177937 27999 ts_tablet_manager.cc:1939] T 0713f4f14a284050a7774a70ab974f30 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:43.178076 26580 catalog_manager.cc:6565] ReplaceTablet: tablet d512c335e340437fa32f2dc16dca6812 deleted and replaced by tablet 7abf8e1e7f2c4519902cf31c6e0e86e2
I20260810 11:30:43.178357 29123 leader_election.cc:288] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:43.178371 26580 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 165) took 1755 ms. Trace:
I20260810 11:30:43.178539 26580 rpcz_store.cc:276] 0810 11:30:41.422591 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.098791 (+1676200us) service_pool.cc:227] Handling call
0810 11:30:43.134647 (+ 35856us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:43.134658 (+ 11us) write_op.cc:454] Released schema lock
0810 11:30:43.178206 (+ 43548us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:43.100513 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:43.100669 (+ 156us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:43.100676 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:43.100678 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:43.100832 (+ 154us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:43.100852 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:43.100860 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:43.100980 (+ 120us) tablet.cc:699] Row locks acquired
0810 11:30:43.100984 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:43.101033 (+ 49us) write_op.cc:270] Start()
0810 11:30:43.101076 (+ 43us) write_op.cc:276] Timestamp: P: 1786361443100996 usec, L: 0
0810 11:30:43.101081 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:43.101313 (+ 232us) log.cc:842] Serialized 665 byte log entry
0810 11:30:43.107333 (+ 6020us) op_driver.cc:444] REPLICATION: finished
0810 11:30:43.107554 (+ 221us) write_op.cc:301] APPLY: starting
0810 11:30:43.107576 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:43.107649 (+ 73us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:43.107720 (+ 71us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:43.107852 (+ 132us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:43.107934 (+ 82us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:43.107941 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:43.108044 (+ 103us) log.cc:842] Serialized 29 byte log entry
0810 11:30:43.108125 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:43.108155 (+ 30us) write_op.cc:454] Released schema lock
0810 11:30:43.108165 (+ 10us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":157,"apply.run_cpu_time_us":693,"apply.run_wall_time_us":693,"num_ops":2,"prepare.queue_time_us":59,"prepare.run_cpu_time_us":940,"prepare.run_wall_time_us":940,"raft.queue_time_us":1929,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":274,"replication_time_us":6204}]]}
I20260810 11:30:43.179299 28987 raft_consensus.cc:2866] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260810 11:30:43.179625 26991 leader_election.cc:341] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: f7ada1df82eb44ecb9a6c615b5410e6f
I20260810 11:30:43.179885 26580 master_service.cc:946] ReplaceTablet: received request to replace tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:43.179955 28987 raft_consensus.cc:2258] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:43.181959 26746 tablet_service.cc:1467] Processing CreateTablet for tablet a9ad92f2c782407aaf74f607d34e780b (DEFAULT_TABLE table=default.Table_0bf07015df0d4fc4ae4119eecdd6dac4 [id=78034ee094e641419617f27946ee29de]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:43.183012 29127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 11:30:43.183113 26894 tablet_service.cc:1467] Processing CreateTablet for tablet dfa0b4bf31324782b97973b1cdfb02e2 (DEFAULT_TABLE table=default.Table_47155e2716ed4136a4fed4c9e0b45a22 [id=7a7c1360dc6345969c0776e3e084cc48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.183609 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfa0b4bf31324782b97973b1cdfb02e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.190200 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 0713f4f14a284050a7774a70ab974f30 (table default.Table_a87ac76268094e76aafcb7a2766c0f1e [id=730b858701d54c73a1456c3821d069e2]) successfully deleted
W20260810 11:30:43.191862 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet e276b0fa124d42dfb3fe750d245e44d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e276b0fa124d42dfb3fe750d245e44d8 already in progress: creating tablet
W20260810 11:30:43.192588 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet c60baf810a544a4a90dccd2337a39043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c60baf810a544a4a90dccd2337a39043 already in progress: creating tablet
W20260810 11:30:43.193244 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 2da86554bc51486e91f1ea5995a245b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2da86554bc51486e91f1ea5995a245b5 already in progress: creating tablet
W20260810 11:30:43.193775 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet cc76d30f37094391b75076c92ccc277f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc76d30f37094391b75076c92ccc277f already in progress: creating tablet
I20260810 11:30:43.198966 27999 tablet_replica.cc:330] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:43.199307 27999 raft_consensus.cc:2229] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:43.199685 27999 raft_consensus.cc:2258] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:43.199527 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 34bd3c0edf6b49d1891c0ee9af344872 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34bd3c0edf6b49d1891c0ee9af344872 already in progress: creating tablet
I20260810 11:30:43.201159 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9ad92f2c782407aaf74f607d34e780b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.200537 27999 ts_tablet_manager.cc:1905] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:43.203105 28987 ts_tablet_manager.cc:1905] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:43.117168 26993 leader_election.cc:341] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.206760 26993 leader_election.cc:302] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
W20260810 11:30:43.206961 26993 raft_consensus.cc:2670] T fc558690dce44e999e55e9bf1b6ca172 P 482e605580be48cbbacce05a3e61c215: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 11:30:43.207289 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1860e56467624dcdb288e13b004f78cc" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:43.207486 27059 raft_consensus.cc:3037] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.207837 27061 raft_consensus.cc:1261] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Refusing update from remote peer 443ec871f1ed4232b932ecfb0b18510d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 11:30:43.097488 28753 raft_consensus.cc:504] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:43.210723 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 93551.1us
I20260810 11:30:43.211253 26993 leader_election.cc:302] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.212257 28753 leader_election.cc:288] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:43.212899 28753 raft_consensus.cc:2781] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:43.212985 28753 raft_consensus.cc:482] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:43.213052 28753 raft_consensus.cc:3037] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.213886 27231 raft_consensus.cc:348] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.214080 27231 raft_consensus.cc:374] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.214128 27231 raft_consensus.cc:729] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.214076 26848 leader_election.cc:302] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:43.214314 27231 consensus_queue.cc:260] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.214843 27231 ts_tablet_manager.cc:1428] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.105s user 0.001s sys 0.001s
I20260810 11:30:43.214884 29059 consensus_queue.cc:1035] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:43.215298 29059 raft_consensus.cc:2781] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:43.215435 29059 raft_consensus.cc:482] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:43.215504 29059 raft_consensus.cc:3037] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.215833 28753 raft_consensus.cc:504] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.216357 28753 leader_election.cc:288] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:43.217257 27059 raft_consensus.cc:2454] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:43.219290 27058 raft_consensus.cc:2454] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:43.221791 27999 ts_tablet_manager.cc:1918] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:43.221937 27999 log.cc:1196] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/ac4b1821ac30452cbe7a8f844d9b37e5
I20260810 11:30:43.222321 27999 ts_tablet_manager.cc:1939] T ac4b1821ac30452cbe7a8f844d9b37e5 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:43.223150 29059 raft_consensus.cc:504] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:43.224843 26849 leader_election.cc:341] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: e31b380f99854eb8b63e1f9eede1fc7c
I20260810 11:30:43.225782 29059 leader_election.cc:288] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:43.228776 27999 tablet_replica.cc:330] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:43.228852 26848 leader_election.cc:302] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:43.229001 27999 raft_consensus.cc:2229] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:43.229043 26848 raft_consensus.cc:2670] T db59523b71224370bf5fce6b56592f71 P b6079090b1124d84aa4477974bb53700: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 11:30:43.229498 27999 raft_consensus.cc:2258] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:43.230177 26848 leader_election.cc:302] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:43.230145 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "809b5b6b65d244cd9186517e39494839" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:43.230648 26991 leader_election.cc:341] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 7d3406f12d9c492cbd0d86fa7a57de82
I20260810 11:30:43.231302 29059 raft_consensus.cc:2781] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:43.231489 29059 raft_consensus.cc:686] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:43.231784 29059 consensus_queue.cc:237] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:43.232681 26991 leader_election.cc:341] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.233743 27231 tablet_bootstrap.cc:492] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:43.235536 27231 tablet_bootstrap.cc:654] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:43.238737 27999 ts_tablet_manager.cc:1905] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:43.242596 28845 raft_consensus.cc:482] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:43.242782 28845 raft_consensus.cc:504] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.243546 28845 leader_election.cc:288] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:43.244834 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5409c96c1949416e85cfcaa8f2f61227" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:43.245608 26991 leader_election.cc:341] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.246345 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1860e56467624dcdb288e13b004f78cc" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:43.246639 27061 raft_consensus.cc:2379] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:43.247619 29115 tablet.cc:1722] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:43.248636 27049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dc4fd6ca8a541f99eed57a6f51c1f0a" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:43.248850 27049 raft_consensus.cc:3037] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.255008 27049 raft_consensus.cc:2454] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:43.262959 27047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e31b380f99854eb8b63e1f9eede1fc7c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:43.263293 27047 raft_consensus.cc:3037] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.265231 27999 ts_tablet_manager.cc:1918] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:43.265377 27999 log.cc:1196] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/49db12565dbc4187b78a98ed35c40fed
I20260810 11:30:43.265794 27999 ts_tablet_manager.cc:1939] T 49db12565dbc4187b78a98ed35c40fed P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:43.266878 27047 raft_consensus.cc:2454] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:43.269379 29115 tablet.cc:1722] T 1f64d4b9320c4cb39f57573d781a47d3 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 11:30:43.274282 27999 tablet_replica.cc:330] T 7e78fb1bf0534deca5cc5a603fd77592 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:43.274583 27999 raft_consensus.cc:2229] T 7e78fb1bf0534deca5cc5a603fd77592 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:43.274811 27999 raft_consensus.cc:2258] T 7e78fb1bf0534deca5cc5a603fd77592 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:43.275678 27999 ts_tablet_manager.cc:1905] T 7e78fb1bf0534deca5cc5a603fd77592 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:43.284386 28753 raft_consensus.cc:482] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6079090b1124d84aa4477974bb53700)
I20260810 11:30:43.284641 28753 raft_consensus.cc:504] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.285462 28753 leader_election.cc:288] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:43.286448 26991 leader_election.cc:341] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 318d5b8453fe4c438d0fa32cb91c409e
I20260810 11:30:43.290885 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b303be24f4e46d0b966e8191d76297b with delete_type TABLET_DATA_DELETED (replaced by tablet ccdf2bb9f3b347ceb970a0d3115816df) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:43.291256 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet b945cb22353f4d99a3836e3c0b8e26e3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ee50a7da224437baed913995e6587dd) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:43.291779 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 791737cdc46949d88fa46c7f7c660593 (DEFAULT_TABLE table=default.Table_7bf69372e4b04dfba17cfcb786af5763 [id=b599ee40ccaa4800b503976d61f0178d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.292229 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 791737cdc46949d88fa46c7f7c660593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.299697 27999 ts_tablet_manager.cc:1918] T 7e78fb1bf0534deca5cc5a603fd77592 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:43.303733 27038 tablet_service.cc:1467] Processing CreateTablet for tablet a9ad92f2c782407aaf74f607d34e780b (DEFAULT_TABLE table=default.Table_0bf07015df0d4fc4ae4119eecdd6dac4 [id=78034ee094e641419617f27946ee29de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.304283 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9ad92f2c782407aaf74f607d34e780b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.305934 27999 log.cc:1196] T 7e78fb1bf0534deca5cc5a603fd77592 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/7e78fb1bf0534deca5cc5a603fd77592
I20260810 11:30:43.306649 27999 ts_tablet_manager.cc:1939] T 7e78fb1bf0534deca5cc5a603fd77592 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:43.315538 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet d512c335e340437fa32f2dc16dca6812 with delete_type TABLET_DATA_DELETED (replaced by tablet 7abf8e1e7f2c4519902cf31c6e0e86e2) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:43.316937 27999 tablet_replica.cc:330] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:43.317728 27999 raft_consensus.cc:2229] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:43.318353 27999 raft_consensus.cc:2258] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:43.318346 29115 tablet.cc:1722] T f85c0767ad164075b87ba672cafafb47 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 11:30:43.320070 27999 ts_tablet_manager.cc:1905] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:43.323745 29154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 11:30:43.213433 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a63227e69df14a4ea935087fd31ece63" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:43.224155 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b755744059b04967857c1b00e951b8ee" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:43.324465 26771 raft_consensus.cc:2454] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:43.220042 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4efa31ad2ce8436b9638e6759d9b5421" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:43.226997 29034 tablet.cc:1722] T 460a679219cb4a7f9aecfec58a98238b P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:43.228803 28726 consensus_queue.cc:1035] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:43.229806 26760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8e6fc49f5e54f6c8fb710220a6cbf0f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:43.326174 26760 raft_consensus.cc:2454] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:43.231405 26764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ada1df82eb44ecb9a6c615b5410e6f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:43.284660 26737 tablet_service.cc:1467] Processing CreateTablet for tablet dfa0b4bf31324782b97973b1cdfb02e2 (DEFAULT_TABLE table=default.Table_47155e2716ed4136a4fed4c9e0b45a22 [id=7a7c1360dc6345969c0776e3e084cc48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.327064 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfa0b4bf31324782b97973b1cdfb02e2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:43.329777 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 101240us
I20260810 11:30:43.331492 26702 leader_election.cc:302] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.332084 28727 raft_consensus.cc:2781] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:43.332304 28727 raft_consensus.cc:686] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:43.286547 26734 tablet_service.cc:1467] Processing CreateTablet for tablet e700aa4c0c45496db8a2b4f4d6d746a4 (DEFAULT_TABLE table=default.Table_8936d38c9e8e4ba9a4be8cc491e080dd [id=da71b19216b54d50b0793300e4ecaed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.332638 28727 consensus_queue.cc:237] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.333182 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e700aa4c0c45496db8a2b4f4d6d746a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.293880 26745 tablet_service.cc:1467] Processing CreateTablet for tablet 23a372c577fa4a6f87611dc2bcceceeb (DEFAULT_TABLE table=default.Table_a775fdecca7946e8b9eef11d83007e28 [id=42de94edec7b45368c06f826aca2c25d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.334992 26745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23a372c577fa4a6f87611dc2bcceceeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.335166 27999 ts_tablet_manager.cc:1918] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:43.335304 27999 log.cc:1196] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/e31b380f99854eb8b63e1f9eede1fc7c
I20260810 11:30:43.335687 27999 ts_tablet_manager.cc:1939] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:43.295605 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 25efcc18e8444b09ae2556345c36a710 (DEFAULT_TABLE table=default.Table_52cf39e2586743a595ebe5b3172bd921 [id=fccc6199006b4c56ad4423862733a078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.336951 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25efcc18e8444b09ae2556345c36a710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.336840 29079 tablet.cc:1722] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:43.337296 29052 tablet.cc:1722] T d1d0d55b526749059470504a27887b22 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:43.296700 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 0bc474da4c6446f79fb0756b9edacf65 (DEFAULT_TABLE table=default.Table_8190307d727041fbac21da6cbb2f1bcc [id=f90b0fcb23c14d838673967050085777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.341041 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bc474da4c6446f79fb0756b9edacf65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.314144 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "809b5b6b65d244cd9186517e39494839" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:43.348713 26765 raft_consensus.cc:3037] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.349213 27999 tablet_replica.cc:330] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:43.349439 27999 raft_consensus.cc:2229] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:43.349743 27999 pending_rounds.cc:62] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700: Trying to abort 1 pending ops.
I20260810 11:30:43.349805 27999 pending_rounds.cc:68] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936471483359232 op_type: NO_OP noop_request { }
I20260810 11:30:43.349951 27999 raft_consensus.cc:2866] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:43.350059 27999 raft_consensus.cc:2258] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:43.351229 27999 ts_tablet_manager.cc:1905] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:43.356138 29110 tablet_replica.cc:330] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:43.356518 29110 raft_consensus.cc:2229] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:43.358079 26765 raft_consensus.cc:2454] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:43.360889 27222 tablet_bootstrap.cc:492] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:43.361073 27222 ts_tablet_manager.cc:1397] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.214s user 0.003s sys 0.007s
I20260810 11:30:43.362805 28466 server_base.cc:1034] running on GCE node
I20260810 11:30:43.363713 26702 leader_election.cc:302] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.364528 28466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 11:30:43.365913 27222 raft_consensus.cc:348] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.369818 27222 raft_consensus.cc:374] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.369912 27222 raft_consensus.cc:729] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.370186 27222 consensus_queue.cc:260] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.222980 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet ac4b1821ac30452cbe7a8f844d9b37e5 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]) successfully deleted
I20260810 11:30:43.373184 27222 ts_tablet_manager.cc:1428] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
W20260810 11:30:43.373309 26564 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 150312us
I20260810 11:30:43.373575 27222 tablet_bootstrap.cc:492] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:43.231432 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet fc558690dce44e999e55e9bf1b6ca172 (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]) successfully deleted
W20260810 11:30:43.374240 26565 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 142803us
I20260810 11:30:43.375480 27999 ts_tablet_manager.cc:1918] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:43.375625 27999 log.cc:1196] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/110b5acc36bd4d6bba13735e5daec75f
I20260810 11:30:43.376437 27222 tablet_bootstrap.cc:654] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:43.377826 26894 tablet_service.cc:1467] Processing CreateTablet for tablet e700aa4c0c45496db8a2b4f4d6d746a4 (DEFAULT_TABLE table=default.Table_8936d38c9e8e4ba9a4be8cc491e080dd [id=da71b19216b54d50b0793300e4ecaed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.379043 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e700aa4c0c45496db8a2b4f4d6d746a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.381546 27999 ts_tablet_manager.cc:1939] T 110b5acc36bd4d6bba13735e5daec75f P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:43.386153 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5409c96c1949416e85cfcaa8f2f61227" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:43.388036 26848 leader_election.cc:302] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
W20260810 11:30:43.388348 26848 raft_consensus.cc:2670] T 1860e56467624dcdb288e13b004f78cc P b6079090b1124d84aa4477974bb53700: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 11:30:43.390913 29059 raft_consensus.cc:482] T 1801d3af4a4548dba8b0d8ea2fecf5ba P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:43.391121 29059 raft_consensus.cc:504] T 1801d3af4a4548dba8b0d8ea2fecf5ba P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.391937 29059 leader_election.cc:288] T 1801d3af4a4548dba8b0d8ea2fecf5ba P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:43.392021 26848 leader_election.cc:302] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
W20260810 11:30:43.392256 26848 raft_consensus.cc:2670] T e31b380f99854eb8b63e1f9eede1fc7c P b6079090b1124d84aa4477974bb53700: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 11:30:43.393530 29142 raft_consensus.cc:2781] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:43.393394 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1801d3af4a4548dba8b0d8ea2fecf5ba" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:43.393662 29142 raft_consensus.cc:686] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:43.394066 29142 consensus_queue.cc:237] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.403949 27999 tablet_replica.cc:330] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:43.404249 27999 raft_consensus.cc:2229] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:43.405579 27999 raft_consensus.cc:2258] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:43.406147 28726 raft_consensus.cc:482] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6079090b1124d84aa4477974bb53700)
I20260810 11:30:43.406320 28726 raft_consensus.cc:504] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.407130 28726 leader_election.cc:288] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:43.407562 27999 ts_tablet_manager.cc:1905] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:43.407673 27222 tablet_bootstrap.cc:492] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:43.407809 27222 ts_tablet_manager.cc:1397] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.034s user 0.007s sys 0.003s
W20260810 11:30:43.408922 26700 leader_election.cc:341] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 318d5b8453fe4c438d0fa32cb91c409e
I20260810 11:30:43.409888 27222 raft_consensus.cc:348] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.356812 29110 raft_consensus.cc:2258] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:43.410141 27222 raft_consensus.cc:374] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.410296 27222 raft_consensus.cc:729] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.400332 28845 raft_consensus.cc:482] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:43.410640 28845 raft_consensus.cc:504] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.410605 27222 consensus_queue.cc:260] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.410881 29110 ts_tablet_manager.cc:1905] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:43.411334 28845 leader_election.cc:288] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:43.411965 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65756c37fe514194bebe76921419653c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:43.412581 26991 leader_election.cc:341] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.413945 27222 ts_tablet_manager.cc:1428] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.006s user 0.000s sys 0.004s
I20260810 11:30:43.414362 27222 tablet_bootstrap.cc:492] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:43.416800 27228 tablet_bootstrap.cc:492] T 77ffda3325af4096bbec689397f7a324 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:43.416975 27228 ts_tablet_manager.cc:1397] T 77ffda3325af4096bbec689397f7a324 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.296s user 0.012s sys 0.001s
W20260810 11:30:43.417699 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 53991us
I20260810 11:30:43.205102 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:43.417871 27228 raft_consensus.cc:348] T 77ffda3325af4096bbec689397f7a324 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.418217 27228 raft_consensus.cc:374] T 77ffda3325af4096bbec689397f7a324 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.418283 27228 raft_consensus.cc:729] T 77ffda3325af4096bbec689397f7a324 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.418568 27228 consensus_queue.cc:260] T 77ffda3325af4096bbec689397f7a324 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.426872 29079 tablet.cc:1722] T 9e329b95fc8e41c3967079896294942a P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:43.420107 27222 tablet_bootstrap.cc:654] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:43.430784 28726 raft_consensus.cc:482] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:43.424475 27999 ts_tablet_manager.cc:1918] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:43.431062 28726 raft_consensus.cc:504] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.431250 27999 log.cc:1196] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/d512c335e340437fa32f2dc16dca6812
I20260810 11:30:43.431806 28726 leader_election.cc:288] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:43.431875 27999 ts_tablet_manager.cc:1939] T d512c335e340437fa32f2dc16dca6812 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
W20260810 11:30:43.433314 26700 leader_election.cc:341] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 1aa4562a2247405187d9dbd1baa48f39
I20260810 11:30:43.436517 28726 raft_consensus.cc:482] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6079090b1124d84aa4477974bb53700)
I20260810 11:30:43.436724 28726 raft_consensus.cc:504] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.437350 28726 leader_election.cc:288] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:43.438983 26700 leader_election.cc:341] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: f7ada1df82eb44ecb9a6c615b5410e6f
I20260810 11:30:43.440068 27047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1aa4562a2247405187d9dbd1baa48f39" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:43.440891 27047 raft_consensus.cc:2454] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:43.444633 29034 tablet.cc:1722] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:43.447580 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318d5b8453fe4c438d0fa32cb91c409e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:43.447924 27060 raft_consensus.cc:2454] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:43.448431 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318d5b8453fe4c438d0fa32cb91c409e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:43.448729 26765 raft_consensus.cc:2454] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:43.451279 27222 tablet_bootstrap.cc:492] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:43.451494 27222 ts_tablet_manager.cc:1397] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.037s user 0.009s sys 0.009s
I20260810 11:30:43.452505 27222 raft_consensus.cc:348] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.452805 27222 raft_consensus.cc:374] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.452893 27222 raft_consensus.cc:729] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.418604 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:43.453334 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:43.453368 27222 consensus_queue.cc:260] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.454139 27222 ts_tablet_manager.cc:1428] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 11:30:43.454793 27222 tablet_bootstrap.cc:492] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:43.459194 26993 consensus_peers.cc:487] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b5a7f67ec5b48c2b5a510add0282a76. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:43.460098 26993 leader_election.cc:341] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 7d3406f12d9c492cbd0d86fa7a57de82
I20260810 11:30:43.460228 26993 leader_election.cc:302] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.460417 28898 raft_consensus.cc:2726] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:43.463722 27228 ts_tablet_manager.cc:1428] T 77ffda3325af4096bbec689397f7a324 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.047s user 0.002s sys 0.000s
I20260810 11:30:43.465553 26885 tablet_service.cc:1467] Processing CreateTablet for tablet 25efcc18e8444b09ae2556345c36a710 (DEFAULT_TABLE table=default.Table_52cf39e2586743a595ebe5b3172bd921 [id=fccc6199006b4c56ad4423862733a078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.465730 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 49db12565dbc4187b78a98ed35c40fed (table default.Table_49be430f1e8f475482b54850772c0430 [id=82e113439bc04ce9955f59612ba480dc]) successfully deleted
I20260810 11:30:43.465780 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 0bc474da4c6446f79fb0756b9edacf65 (DEFAULT_TABLE table=default.Table_8190307d727041fbac21da6cbb2f1bcc [id=f90b0fcb23c14d838673967050085777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.466133 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25efcc18e8444b09ae2556345c36a710. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:43.466188 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 809b5b6b65d244cd9186517e39494839 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 809b5b6b65d244cd9186517e39494839 already in progress: creating tablet
I20260810 11:30:43.466316 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bc474da4c6446f79fb0756b9edacf65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.466524 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 7e78fb1bf0534deca5cc5a603fd77592 (table default.Table_3d15fcde44db49a7ba17fd166381299f [id=e88ac45e937f49b2a8be4256d1a7279e]) successfully deleted
W20260810 11:30:43.466869 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7c203cd90d2f472fa27cfabed5b87119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c203cd90d2f472fa27cfabed5b87119 already in progress: creating tablet
W20260810 11:30:43.467139 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 23637a02b6464e17aa2a69ea5cc4ddfe because the tablet was not found. No further retry: Not found: Tablet not found: 23637a02b6464e17aa2a69ea5cc4ddfe
W20260810 11:30:43.467377 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet a87f6835f0dc4ad4b3a23b297726100d because the tablet was not found. No further retry: Not found: Tablet not found: a87f6835f0dc4ad4b3a23b297726100d
I20260810 11:30:43.467558 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet e31b380f99854eb8b63e1f9eede1fc7c (table default.Table_5ffe87ce66134f859f413c9a6ec537b5 [id=98340b81af5d4da9b563a14d7470e1ae]) successfully deleted
W20260810 11:30:43.467806 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 4b5a7f67ec5b48c2b5a510add0282a76 because the tablet was not found. No further retry: Not found: Tablet not found: 4b5a7f67ec5b48c2b5a510add0282a76
W20260810 11:30:43.468017 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet fbe0a0ab82a147a3b6164904b135d1ab because the tablet was not found. No further retry: Not found: Tablet not found: fbe0a0ab82a147a3b6164904b135d1ab
W20260810 11:30:43.468261 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 3ccef06fa06c4c519d8760fa948d6c8b because the tablet was not found. No further retry: Not found: Tablet not found: 3ccef06fa06c4c519d8760fa948d6c8b
I20260810 11:30:43.468937 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 23a372c577fa4a6f87611dc2bcceceeb (DEFAULT_TABLE table=default.Table_a775fdecca7946e8b9eef11d83007e28 [id=42de94edec7b45368c06f826aca2c25d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.469341 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23a372c577fa4a6f87611dc2bcceceeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.480163 26821 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:43.480768 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:43.481386 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:43.481755 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d1d0d55b526749059470504a27887b22 (table default.Table_a164cd4bbc4344ae905f395ab1e6cffb [id=62f404c62e4040fc801f70cafddf9d95]). Expected version 1 got 0
I20260810 11:30:43.482141 27228 tablet_bootstrap.cc:492] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:43.483667 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:43.484400 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:43.484472 28466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 11:30:43.485167 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:43.485914 27231 tablet_bootstrap.cc:492] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:43.486090 27231 ts_tablet_manager.cc:1397] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.252s user 0.001s sys 0.009s
I20260810 11:30:43.486940 28466 hybrid_clock.cc:648] HybridClock initialized: now 1786361443486716 us; error 123 us; skew 500 ppm
I20260810 11:30:43.487465 28466 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260810 11:30:43.493352 26993 leader_election.cc:341] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.493516 26993 leader_election.cc:302] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.493839 28902 raft_consensus.cc:2726] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:43.494580 26993 leader_election.cc:302] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.494911 28898 raft_consensus.cc:2781] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:43.494998 28898 raft_consensus.cc:482] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:43.495065 28898 raft_consensus.cc:3037] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.498732 28898 raft_consensus.cc:504] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.500051 28898 leader_election.cc:288] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:43.500164 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a63227e69df14a4ea935087fd31ece63" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:43.500674 27231 raft_consensus.cc:348] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.500869 27231 raft_consensus.cc:374] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.500910 27231 raft_consensus.cc:729] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.501094 27231 consensus_queue.cc:260] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:43.501991 26991 leader_election.cc:341] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.504436 29142 raft_consensus.cc:482] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:43.504653 29142 raft_consensus.cc:504] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.505317 29142 leader_election.cc:288] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:43.501982 27231 ts_tablet_manager.cc:1428] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.016s user 0.000s sys 0.002s
I20260810 11:30:43.509023 27231 tablet_bootstrap.cc:492] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:43.509379 26702 leader_election.cc:302] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.509737 26702 leader_election.cc:302] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.510200 28726 raft_consensus.cc:2781] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:43.510278 28726 raft_consensus.cc:482] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:43.510336 28726 raft_consensus.cc:3037] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.510937 27222 tablet_bootstrap.cc:654] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:43.511664 28640 raft_consensus.cc:2781] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 11:30:43.511740 28640 raft_consensus.cc:482] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6079090b1124d84aa4477974bb53700)
I20260810 11:30:43.511798 28640 raft_consensus.cc:3037] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:43.513132 27231 tablet_bootstrap.cc:654] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:43.513677 27047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "490ada0a918d48c3a07e12eed58bda19" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:43.513890 27047 raft_consensus.cc:2454] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:43.514779 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "490ada0a918d48c3a07e12eed58bda19" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:43.515276 26700 leader_election.cc:341] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.516219 27228 tablet_bootstrap.cc:654] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:43.517621 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:43.518136 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:43.519258 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:43.519541 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
W20260810 11:30:43.468519 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7d3406f12d9c492cbd0d86fa7a57de82 because the tablet was not found. No further retry: Not found: Tablet not found: 7d3406f12d9c492cbd0d86fa7a57de82
I20260810 11:30:43.519824 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ada1df82eb44ecb9a6c615b5410e6f" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:43.520090 27058 raft_consensus.cc:2454] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
W20260810 11:30:43.520117 26564 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 51549.2us
W20260810 11:30:43.520409 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 518c777e40ec40dcb3484c0374384959 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 518c777e40ec40dcb3484c0374384959 already in progress: creating tablet
W20260810 11:30:43.520747 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet d14091e1c111438bac8bcf3d36123d80 because the tablet was not found. No further retry: Not found: Tablet not found: d14091e1c111438bac8bcf3d36123d80
W20260810 11:30:43.520841 26993 leader_election.cc:341] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.520968 26993 leader_election.cc:302] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.521207 28898 raft_consensus.cc:2726] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:43.521340 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 110b5acc36bd4d6bba13735e5daec75f (table default.Table_24bdc44050024c23aa90a182bdcecb50 [id=4ea7ee58aac74fba84dbbcc009017421]) successfully deleted
I20260810 11:30:43.521646 26993 leader_election.cc:302] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
W20260810 11:30:43.521735 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 already in progress: creating tablet
I20260810 11:30:43.521895 28898 raft_consensus.cc:2781] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:43.522086 28898 raft_consensus.cc:482] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260810 11:30:43.522200 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 6c715bdcff8c4cdabfddf871f6fdc388 because the tablet was not found. No further retry: Not found: Tablet not found: 6c715bdcff8c4cdabfddf871f6fdc388
I20260810 11:30:43.522235 28898 raft_consensus.cc:3037] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:43.522675 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ff9b649e43a9456fa51cf3330290bb91 because the tablet was not found. No further retry: Not found: Tablet not found: ff9b649e43a9456fa51cf3330290bb91
W20260810 11:30:43.523058 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet a835d30ef9fc474ab927bb119a95d83c because the tablet was not found. No further retry: Not found: Tablet not found: a835d30ef9fc474ab927bb119a95d83c
W20260810 11:30:43.523537 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet a63227e69df14a4ea935087fd31ece63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a63227e69df14a4ea935087fd31ece63 already in progress: creating tablet
W20260810 11:30:43.523922 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 318d5b8453fe4c438d0fa32cb91c409e because the tablet was not found. No further retry: Not found: Tablet not found: 318d5b8453fe4c438d0fa32cb91c409e
I20260810 11:30:43.525671 28898 raft_consensus.cc:504] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.527891 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8e6fc49f5e54f6c8fb710220a6cbf0f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:43.528085 29142 raft_consensus.cc:482] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:43.528224 29142 raft_consensus.cc:504] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:43.528514 26991 leader_election.cc:341] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.528936 28898 leader_election.cc:288] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:43.529356 26993 leader_election.cc:302] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.529933 28902 raft_consensus.cc:2726] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:43.530606 26993 leader_election.cc:302] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.530882 28902 raft_consensus.cc:2781] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:43.530988 28902 raft_consensus.cc:686] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:43.531085 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc558690dce44e999e55e9bf1b6ca172" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:43.531224 28902 consensus_queue.cc:237] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:43.531684 26700 leader_election.cc:341] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.534036 26702 leader_election.cc:302] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.535058 28728 raft_consensus.cc:2781] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:43.535152 28728 raft_consensus.cc:482] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:43.535215 28728 raft_consensus.cc:3037] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.537652 28987 ts_tablet_manager.cc:1918] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260810 11:30:43.530551 28726 raft_consensus.cc:504] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.542575 28726 leader_election.cc:288] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:43.538417 29142 leader_election.cc:288] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:43.543586 28987 log.cc:1196] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/a8a65a0e8b1f4e4b8d9a82059b766cda
I20260810 11:30:43.543531 28640 raft_consensus.cc:504] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.544183 28640 leader_election.cc:288] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:43.545593 26700 leader_election.cc:341] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 318d5b8453fe4c438d0fa32cb91c409e
W20260810 11:30:43.546276 26700 leader_election.cc:341] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 1aa4562a2247405187d9dbd1baa48f39
I20260810 11:30:43.547225 28987 ts_tablet_manager.cc:1939] T a8a65a0e8b1f4e4b8d9a82059b766cda P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:43.547684 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 85) took 1692 ms. Trace:
I20260810 11:30:43.547834 28987 rpcz_store.cc:276] 0810 11:30:41.855063 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.856478 (+ 1415us) service_pool.cc:227] Handling call
0810 11:30:43.161836 (+1305358us) ts_tablet_manager.cc:1145] Deleting tablet a8a65a0e8b1f4e4b8d9a82059b766cda
0810 11:30:43.161851 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:43.525490 (+363639us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:43.537545 (+ 12055us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:43.547666 (+ 10121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1283653}
I20260810 11:30:43.549005 28987 tablet_replica.cc:330] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:43.548623 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet a8a65a0e8b1f4e4b8d9a82059b766cda (table default.Table_ad62ebe50ede4d7d96922bac3e954f9e [id=a9ff451e18b54994abfa288ecac98560]) successfully deleted
I20260810 11:30:43.549857 28987 raft_consensus.cc:2229] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:43.550053 28987 raft_consensus.cc:2258] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:43.549934 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 78633fbe048b4534ae3277ce6b7c4313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78633fbe048b4534ae3277ce6b7c4313 already in progress: creating tablet
W20260810 11:30:43.550460 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 587c6ce242c0411b886404a0df03b1bb because the tablet was not found. No further retry: Not found: Tablet not found: 587c6ce242c0411b886404a0df03b1bb
W20260810 11:30:43.550838 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet f7ada1df82eb44ecb9a6c615b5410e6f because the tablet was not found. No further retry: Not found: Tablet not found: f7ada1df82eb44ecb9a6c615b5410e6f
W20260810 11:30:43.551167 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 713663be70014b17b17056a865e7db63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 713663be70014b17b17056a865e7db63 already in progress: creating tablet
I20260810 11:30:43.551316 28728 raft_consensus.cc:504] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:43.551573 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 91b6078efadf496fb252f725bdf56b02 because the tablet was not found. No further retry: Not found: Tablet not found: 91b6078efadf496fb252f725bdf56b02
W20260810 11:30:43.552023 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet d91a02b22044429fb3e25840c7947a02 because the tablet was not found. No further retry: Not found: Tablet not found: d91a02b22044429fb3e25840c7947a02
W20260810 11:30:43.552343 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 64818ca5827e41d99428903ddb8688d9 because the tablet was not found. No further retry: Not found: Tablet not found: 64818ca5827e41d99428903ddb8688d9
I20260810 11:30:43.549036 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:43.552641 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "490ada0a918d48c3a07e12eed58bda19" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:43.552938 28987 ts_tablet_manager.cc:1905] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:43.553092 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
W20260810 11:30:43.553368 26700 leader_election.cc:341] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.553692 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:43.554795 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:43.555730 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:43.556072 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:43.556639 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:43.557479 28728 leader_election.cc:288] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:43.562983 26993 leader_election.cc:341] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.563151 26993 leader_election.cc:302] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.563390 28902 raft_consensus.cc:2726] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:43.563604 26993 leader_election.cc:302] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.563941 28902 raft_consensus.cc:2781] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 11:30:43.564148 28902 raft_consensus.cc:482] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6079090b1124d84aa4477974bb53700)
I20260810 11:30:43.564296 28902 raft_consensus.cc:3037] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:43.566601 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65756c37fe514194bebe76921419653c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:43.568861 26760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a63227e69df14a4ea935087fd31ece63" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:43.569065 26760 raft_consensus.cc:3037] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.569255 28898 raft_consensus.cc:482] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 443ec871f1ed4232b932ecfb0b18510d)
I20260810 11:30:43.569372 28898 raft_consensus.cc:504] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.570317 27228 tablet_bootstrap.cc:492] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:43.570492 27228 ts_tablet_manager.cc:1397] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.089s user 0.003s sys 0.001s
I20260810 11:30:43.571092 28466 webserver.cc:460] Webserver started at http://127.25.195.253:42129/ using document root <none> and password file <none>
I20260810 11:30:43.575170 27228 raft_consensus.cc:348] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.575387 27228 raft_consensus.cc:374] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.575431 27228 raft_consensus.cc:729] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.575623 27228 consensus_queue.cc:260] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.576323 29110 ts_tablet_manager.cc:1918] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:43.576453 29110 log.cc:1196] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/1860e56467624dcdb288e13b004f78cc
I20260810 11:30:43.581079 28466 fs_manager.cc:359] Metadata directory not provided
I20260810 11:30:43.576594 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8e6fc49f5e54f6c8fb710220a6cbf0f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:43.587931 26768 raft_consensus.cc:3037] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:43.588946 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 50901.4us
I20260810 11:30:43.589708 26702 leader_election.cc:302] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.589974 28726 raft_consensus.cc:2781] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 11:30:43.590045 28726 raft_consensus.cc:482] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6079090b1124d84aa4477974bb53700)
I20260810 11:30:43.590119 28726 raft_consensus.cc:3037] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:43.590893 27228 ts_tablet_manager.cc:1428] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260810 11:30:43.591244 28466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 11:30:43.591466 26768 raft_consensus.cc:2454] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:43.577594 29034 tablet.cc:1722] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:43.592973 27038 tablet_service.cc:1467] Processing CreateTablet for tablet dfa0b4bf31324782b97973b1cdfb02e2 (DEFAULT_TABLE table=default.Table_47155e2716ed4136a4fed4c9e0b45a22 [id=7a7c1360dc6345969c0776e3e084cc48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.592947 28726 raft_consensus.cc:504] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.593672 28726 leader_election.cc:288] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:43.581259 27222 tablet_bootstrap.cc:492] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:43.593962 27222 ts_tablet_manager.cc:1397] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.139s user 0.008s sys 0.005s
W20260810 11:30:43.594401 26700 leader_election.cc:341] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: f7ada1df82eb44ecb9a6c615b5410e6f
I20260810 11:30:43.594872 27228 tablet_bootstrap.cc:492] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:43.594811 27222 raft_consensus.cc:348] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.595019 27222 raft_consensus.cc:374] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.595073 27222 raft_consensus.cc:729] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.595383 27222 consensus_queue.cc:260] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.596688 27028 tablet_service.cc:1467] Processing CreateTablet for tablet e700aa4c0c45496db8a2b4f4d6d746a4 (DEFAULT_TABLE table=default.Table_8936d38c9e8e4ba9a4be8cc491e080dd [id=da71b19216b54d50b0793300e4ecaed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.597398 27031 tablet_service.cc:1467] Processing CreateTablet for tablet 0bc474da4c6446f79fb0756b9edacf65 (DEFAULT_TABLE table=default.Table_8190307d727041fbac21da6cbb2f1bcc [id=f90b0fcb23c14d838673967050085777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.598842 27222 ts_tablet_manager.cc:1428] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
W20260810 11:30:43.599519 26993 leader_election.cc:341] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.599645 26993 leader_election.cc:302] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.572535 26760 raft_consensus.cc:2454] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:43.600394 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1801d3af4a4548dba8b0d8ea2fecf5ba" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:43.601094 27059 raft_consensus.cc:2379] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:43.600442 29123 raft_consensus.cc:2726] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:43.603338 27222 tablet_bootstrap.cc:492] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:43.607178 27228 tablet_bootstrap.cc:654] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:43.608610 26993 leader_election.cc:302] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.609357 28753 raft_consensus.cc:2781] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:43.609473 28753 raft_consensus.cc:686] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:43.609696 28753 consensus_queue.cc:237] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.611270 26993 leader_election.cc:302] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.611449 27222 tablet_bootstrap.cc:654] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:43.613386 28987 ts_tablet_manager.cc:1918] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:43.613524 28987 log.cc:1196] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/318d5b8453fe4c438d0fa32cb91c409e
I20260810 11:30:43.626139 27228 tablet_bootstrap.cc:492] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:43.626358 27228 ts_tablet_manager.cc:1397] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.004s
I20260810 11:30:43.627568 27228 raft_consensus.cc:348] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.627892 27228 raft_consensus.cc:374] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.627978 27228 raft_consensus.cc:729] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.632866 27228 consensus_queue.cc:260] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.633956 27228 ts_tablet_manager.cc:1428] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.007s user 0.001s sys 0.002s
I20260810 11:30:43.634306 27228 tablet_bootstrap.cc:492] T f8e6fc49f5e54f6c8fb710220a6cbf0f P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:43.636626 27228 tablet_bootstrap.cc:654] T f8e6fc49f5e54f6c8fb710220a6cbf0f P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:43.630417 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet f2b555f18c1e485d9af7b08f98543c80 because the tablet was not found. No further retry: Not found: Tablet not found: f2b555f18c1e485d9af7b08f98543c80
I20260810 11:30:43.568159 28902 raft_consensus.cc:504] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.645145 28902 leader_election.cc:288] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:43.645713 29110 ts_tablet_manager.cc:1939] T 1860e56467624dcdb288e13b004f78cc P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:43.648494 29123 raft_consensus.cc:2781] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:43.648656 29123 raft_consensus.cc:686] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:43.648860 29123 consensus_queue.cc:237] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:43.645228 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 because the tablet was not found. No further retry: Not found: Tablet not found: 420ba6e9f74c4ae5bf450f369e7fbdb3
I20260810 11:30:43.650596 26848 leader_election.cc:302] T 1801d3af4a4548dba8b0d8ea2fecf5ba P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:43.651829 29092 raft_consensus.cc:3037] T 1801d3af4a4548dba8b0d8ea2fecf5ba P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.655534 29092 raft_consensus.cc:2726] T 1801d3af4a4548dba8b0d8ea2fecf5ba P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:43.656427 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfa0b4bf31324782b97973b1cdfb02e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.657179 27033 tablet_service.cc:1467] Processing CreateTablet for tablet 25efcc18e8444b09ae2556345c36a710 (DEFAULT_TABLE table=default.Table_52cf39e2586743a595ebe5b3172bd921 [id=fccc6199006b4c56ad4423862733a078]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:43.658283 26991 leader_election.cc:341] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 318d5b8453fe4c438d0fa32cb91c409e
I20260810 11:30:43.660903 29110 tablet_replica.cc:330] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:43.661357 29110 raft_consensus.cc:2229] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:43.661751 29110 raft_consensus.cc:2258] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:43.662485 29110 ts_tablet_manager.cc:1905] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:43.664436 27033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25efcc18e8444b09ae2556345c36a710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.665995 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 1860e56467624dcdb288e13b004f78cc (table default.Table_5a4c04e087c3490fae87a17247850531 [id=323f239c11f84a69beaf74e68c0cf50a]) successfully deleted
I20260810 11:30:43.668324 27222 tablet_bootstrap.cc:492] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:43.668627 27222 ts_tablet_manager.cc:1397] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.065s user 0.011s sys 0.023s
I20260810 11:30:43.668748 27031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bc474da4c6446f79fb0756b9edacf65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.669450 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e700aa4c0c45496db8a2b4f4d6d746a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.669565 27222 raft_consensus.cc:348] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.669781 27222 raft_consensus.cc:374] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.669849 27222 raft_consensus.cc:729] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.670252 27222 consensus_queue.cc:260] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.672698 27222 ts_tablet_manager.cc:1428] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 11:30:43.675210 28898 leader_election.cc:288] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:43.674837 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318d5b8453fe4c438d0fa32cb91c409e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:43.677990 28921 consensus_queue.cc:1035] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:43.678272 27222 tablet_bootstrap.cc:492] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:43.679636 29034 tablet.cc:1722] T fccc21cfc1ce4eb586f03276ec6e987f P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 11:30:43.680289 26993 leader_election.cc:341] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: Tablet not RUNNING: STOPPED
I20260810 11:30:43.680459 26993 leader_election.cc:302] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.681298 28898 raft_consensus.cc:2726] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 11:30:43.656850 27025 tablet_service.cc:1467] Processing CreateTablet for tablet 23a372c577fa4a6f87611dc2bcceceeb (DEFAULT_TABLE table=default.Table_a775fdecca7946e8b9eef11d83007e28 [id=42de94edec7b45368c06f826aca2c25d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:43.687201 26993 leader_election.cc:341] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 3851d39aeb3142938a5ac558ab438c21
I20260810 11:30:43.688508 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:43.690033 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:43.690634 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:43.691576 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:43.691951 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:43.694511 29167 raft_consensus.cc:482] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:43.694761 29167 raft_consensus.cc:504] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.695570 29167 leader_election.cc:288] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:43.696815 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a22cdf7d273d427cb32b811aa5caa3a3" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:43.697495 26700 leader_election.cc:341] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.698788 27222 tablet_bootstrap.cc:654] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:43.700703 28987 ts_tablet_manager.cc:1939] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:43.701381 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 93) took 1789 ms. Trace:
I20260810 11:30:43.701555 28987 rpcz_store.cc:276] 0810 11:30:41.911728 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.911785 (+ 57us) service_pool.cc:227] Handling call
0810 11:30:43.548959 (+1637174us) ts_tablet_manager.cc:1145] Deleting tablet 318d5b8453fe4c438d0fa32cb91c409e
0810 11:30:43.548971 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:43.577731 (+ 28760us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:43.613278 (+ 35547us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:43.701352 (+ 88074us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1636828}
I20260810 11:30:43.702625 28987 tablet_replica.cc:330] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:43.702996 28987 raft_consensus.cc:2229] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:43.703299 28987 raft_consensus.cc:2258] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:43.704234 28987 ts_tablet_manager.cc:1905] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:43.704690 28466 fs_manager.cc:709] Time spent opening directory manager: real 0.102s user 0.001s sys 0.008s
I20260810 11:30:43.711686 29086 consensus_queue.cc:1035] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:43.718217 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23a372c577fa4a6f87611dc2bcceceeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.724435 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 318d5b8453fe4c438d0fa32cb91c409e (table default.Table_0ca6793e2c374e8d8d93872a0b2283d6 [id=ae0e3b2d14964558848b1a00a6ddc2c6]) successfully deleted
W20260810 11:30:43.724973 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 834c9c99ec424bb39e8a003e9204b2bc because the tablet was not found. No further retry: Not found: Tablet not found: 834c9c99ec424bb39e8a003e9204b2bc
I20260810 11:30:43.726342 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318d5b8453fe4c438d0fa32cb91c409e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:43.726971 27059 raft_consensus.cc:2379] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 2: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
W20260810 11:30:43.728436 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 96cae4eb16c84410926a317af70e44f7 because the tablet was not found. No further retry: Not found: Tablet not found: 96cae4eb16c84410926a317af70e44f7
W20260810 11:30:43.728859 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 2634beb347714fc7a2e05865adb34a22 because the tablet was not found. No further retry: Not found: Tablet not found: 2634beb347714fc7a2e05865adb34a22
W20260810 11:30:43.729238 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c because the tablet was not found. No further retry: Not found: Tablet not found: 7ff5b980ce4e41d7a6e1ca0e740b739c
W20260810 11:30:43.734443 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ce73798a721b4a6d892f0c24b6b40e2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce73798a721b4a6d892f0c24b6b40e2c already in progress: creating tablet
I20260810 11:30:43.734609 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a22cdf7d273d427cb32b811aa5caa3a3" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:43.735316 26702 leader_election.cc:341] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: fc558690dce44e999e55e9bf1b6ca172
W20260810 11:30:43.735502 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 8b303be24f4e46d0b966e8191d76297b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b303be24f4e46d0b966e8191d76297b already in progress: creating tablet
I20260810 11:30:43.735703 26702 leader_election.cc:302] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
W20260810 11:30:43.736147 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet b945cb22353f4d99a3836e3c0b8e26e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b945cb22353f4d99a3836e3c0b8e26e3 already in progress: creating tablet
I20260810 11:30:43.736215 26702 leader_election.cc:302] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
W20260810 11:30:43.736380 26702 raft_consensus.cc:2670] T 318d5b8453fe4c438d0fa32cb91c409e P 443ec871f1ed4232b932ecfb0b18510d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 11:30:43.736521 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]) successfully deleted
I20260810 11:30:43.737310 28727 raft_consensus.cc:2726] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:43.737334 26541 master_runner.cc:186] Error getting master registration for 127.25.195.253:34547: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111),
I20260810 11:30:43.737565 26541 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 11:30:43.737478 28727 consensus_queue.cc:1035] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:43.726058 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1aa4562a2247405187d9dbd1baa48f39" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:43.738381 27057 raft_consensus.cc:3037] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.741223 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "490ada0a918d48c3a07e12eed58bda19" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:43.743932 27060 raft_consensus.cc:3037] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.743031 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ada1df82eb44ecb9a6c615b5410e6f" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:43.745172 27059 raft_consensus.cc:3037] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:43.745306 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
W20260810 11:30:43.745517 26702 leader_election.cc:341] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.745651 26702 leader_election.cc:302] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.745762 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:43.746009 28640 raft_consensus.cc:2726] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:43.749202 26564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111) [suppressed 9 similar messages]
I20260810 11:30:43.740376 27231 tablet_bootstrap.cc:492] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:43.750595 27231 ts_tablet_manager.cc:1397] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.242s user 0.007s sys 0.012s
I20260810 11:30:43.748889 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet fccc21cfc1ce4eb586f03276ec6e987f (table default.Table_65da57b4be754a5b9cbc73361a4f1b93 [id=e22f19a993564e53b1cc76633f25f505]). Expected version 1 got 0
I20260810 11:30:43.753058 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:43.754952 29110 ts_tablet_manager.cc:1918] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:43.755833 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:43.761729 27222 tablet_bootstrap.cc:492] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:43.762230 27222 ts_tablet_manager.cc:1397] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.084s user 0.006s sys 0.002s
I20260810 11:30:43.763060 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:43.768098 26963 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:43.764314 27059 raft_consensus.cc:2454] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 2.
I20260810 11:30:43.765861 27057 raft_consensus.cc:2454] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:43.765939 27231 raft_consensus.cc:348] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.768805 27231 raft_consensus.cc:374] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.768994 27231 raft_consensus.cc:729] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.775362 26702 leader_election.cc:302] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.775914 26702 leader_election.cc:302] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.776572 28727 raft_consensus.cc:2781] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:43.777063 28727 raft_consensus.cc:686] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:43.777633 28727 consensus_queue.cc:237] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.769573 27231 consensus_queue.cc:260] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.776278 28726 raft_consensus.cc:2781] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 2 FOLLOWER]: Leader election won for term 2
I20260810 11:30:43.782876 28726 raft_consensus.cc:686] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 2 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:43.783216 28726 consensus_queue.cc:237] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.786312 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:43.787106 27060 raft_consensus.cc:2454] T 490ada0a918d48c3a07e12eed58bda19 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:43.788160 26702 leader_election.cc:302] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.792387 29167 raft_consensus.cc:2781] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:43.792637 29167 raft_consensus.cc:686] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:43.792953 29167 consensus_queue.cc:237] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.797761 27231 ts_tablet_manager.cc:1428] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.047s user 0.001s sys 0.001s
I20260810 11:30:43.800834 28728 consensus_queue.cc:1035] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:43.802225 27222 raft_consensus.cc:348] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.804934 27222 raft_consensus.cc:374] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.805446 27222 raft_consensus.cc:729] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.806716 27222 consensus_queue.cc:260] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.791508 26575 catalog_manager.cc:5495] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:43.812852 27222 ts_tablet_manager.cc:1428] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.050s user 0.001s sys 0.002s
I20260810 11:30:43.813416 27222 tablet_bootstrap.cc:492] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:43.816720 27222 tablet_bootstrap.cc:654] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:43.817863 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:43.829494 29092 raft_consensus.cc:482] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:43.829809 29092 raft_consensus.cc:504] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.835937 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e8dc3dece9d84d47a638707d10de6fd4 (table default.Table_d0408c25651147ccac283681b9c88a6d [id=61c880dd2c6447129e05d2a39f25678a]). Expected version 1 got 0
I20260810 11:30:43.836434 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:43.837005 26575 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:43.838411 27231 tablet_bootstrap.cc:492] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:43.840754 27231 tablet_bootstrap.cc:654] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:43.836762 26991 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 165938us
W20260810 11:30:43.845362 26991 leader_election.cc:341] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 3851d39aeb3142938a5ac558ab438c21
I20260810 11:30:43.845855 26991 leader_election.cc:302] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.845727 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a45422addab84e9083df8665a0cf9322" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:43.846570 27059 raft_consensus.cc:2379] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:43.829315 28726 raft_consensus.cc:482] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:43.847663 28726 raft_consensus.cc:504] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.832154 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a45422addab84e9083df8665a0cf9322" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:43.849284 28726 leader_election.cc:288] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:43.850256 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77ffda3325af4096bbec689397f7a324" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:43.850631 27059 raft_consensus.cc:2454] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:43.850909 26849 leader_election.cc:302] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:43.851214 29086 raft_consensus.cc:3037] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.851199 26702 leader_election.cc:302] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:43.851799 28726 raft_consensus.cc:2781] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:43.852006 28726 raft_consensus.cc:482] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:43.852164 28726 raft_consensus.cc:3037] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.854980 29086 raft_consensus.cc:2726] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:43.855159 29092 leader_election.cc:288] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:43.812779 26564 consensus_peers.cc:487] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 -> Peer c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547): Couldn't send request to peer c40c76e125b44de181b88b7f63a566f7. Status: Network error: Client connection negotiation failed: client connection to 127.25.195.253:34547: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260810 11:30:43.856029 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77ffda3325af4096bbec689397f7a324" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:43.856365 28845 raft_consensus.cc:2726] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260810 11:30:43.856446 26909 raft_consensus.cc:2454] T 77ffda3325af4096bbec689397f7a324 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:43.838078 29110 log.cc:1196] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/44d5e146eeec4fe0be33c1c169d32e68
I20260810 11:30:43.859088 29110 ts_tablet_manager.cc:1939] T 44d5e146eeec4fe0be33c1c169d32e68 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
W20260810 11:30:43.875501 26993 consensus_peers.cc:487] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91b6078efadf496fb252f725bdf56b02. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:43.877022 28726 raft_consensus.cc:504] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.880074 27228 tablet_bootstrap.cc:492] T f8e6fc49f5e54f6c8fb710220a6cbf0f P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:43.880775 27228 ts_tablet_manager.cc:1397] T f8e6fc49f5e54f6c8fb710220a6cbf0f P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.247s user 0.033s sys 0.059s
I20260810 11:30:43.883839 27228 raft_consensus.cc:348] T f8e6fc49f5e54f6c8fb710220a6cbf0f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.883622 28987 ts_tablet_manager.cc:1918] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:43.884327 28987 log.cc:1196] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/a835d30ef9fc474ab927bb119a95d83c
I20260810 11:30:43.887127 29195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 11:30:43.887781 28987 ts_tablet_manager.cc:1939] T a835d30ef9fc474ab927bb119a95d83c P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:43.887993 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 58) took 1111 ms. Trace:
I20260810 11:30:43.890615 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 90) took 1979 ms. Trace:
I20260810 11:30:43.891535 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77ffda3325af4096bbec689397f7a324" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:43.892123 27057 raft_consensus.cc:3037] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.893049 28987 rpcz_store.cc:276] 0810 11:30:41.910682 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.912619 (+ 1937us) service_pool.cc:227] Handling call
0810 11:30:43.702558 (+1789939us) ts_tablet_manager.cc:1145] Deleting tablet a835d30ef9fc474ab927bb119a95d83c
0810 11:30:43.702576 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:43.813038 (+110462us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:43.883477 (+ 70439us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:43.890549 (+ 7072us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1789760}
I20260810 11:30:43.893802 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet a835d30ef9fc474ab927bb119a95d83c (table default.Table_eecd0244ecc849339f452f38db67c973 [id=41d3dec833b54d1e855194862cb1726b]) successfully deleted
I20260810 11:30:43.891850 29110 rpcz_store.cc:276] 0810 11:30:42.776471 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.776534 (+ 63us) service_pool.cc:227] Handling call
0810 11:30:43.660849 (+884315us) ts_tablet_manager.cc:1145] Deleting tablet 44d5e146eeec4fe0be33c1c169d32e68
0810 11:30:43.660860 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:43.731574 (+ 70714us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:43.754830 (+ 23256us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:43.887968 (+133138us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":868411}
I20260810 11:30:43.888260 28726 leader_election.cc:288] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:43.895650 28987 tablet_replica.cc:330] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:43.889375 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77ffda3325af4096bbec689397f7a324" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:43.896132 26909 raft_consensus.cc:3037] T 77ffda3325af4096bbec689397f7a324 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.896358 28987 raft_consensus.cc:2229] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:43.899554 26909 raft_consensus.cc:2454] T 77ffda3325af4096bbec689397f7a324 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:43.895952 27228 raft_consensus.cc:374] T f8e6fc49f5e54f6c8fb710220a6cbf0f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.900754 27228 raft_consensus.cc:729] T f8e6fc49f5e54f6c8fb710220a6cbf0f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.901165 27228 consensus_queue.cc:260] T f8e6fc49f5e54f6c8fb710220a6cbf0f P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.904479 27228 ts_tablet_manager.cc:1428] T f8e6fc49f5e54f6c8fb710220a6cbf0f P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260810 11:30:43.905319 27228 tablet_bootstrap.cc:492] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:43.896451 27222 tablet_bootstrap.cc:492] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:43.908667 28987 raft_consensus.cc:2258] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:43.908982 27222 ts_tablet_manager.cc:1397] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.096s user 0.010s sys 0.006s
I20260810 11:30:43.909482 28987 ts_tablet_manager.cc:1905] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:43.910075 27222 raft_consensus.cc:348] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.910377 27222 raft_consensus.cc:374] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.910494 27222 raft_consensus.cc:729] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.910784 27222 consensus_queue.cc:260] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.911289 29110 tablet_replica.cc:330] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:43.911505 29110 raft_consensus.cc:2229] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:43.911458 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 44d5e146eeec4fe0be33c1c169d32e68 (table default.Table_733cd3d375dd4cf9b1297c9395073c3c [id=9b6492211433453495bdb14155a56a85]) successfully deleted
I20260810 11:30:43.911813 29110 raft_consensus.cc:2258] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:43.912389 29110 ts_tablet_manager.cc:1905] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:43.918212 27057 raft_consensus.cc:2454] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:43.919414 27228 tablet_bootstrap.cc:654] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:43.920209 28466 fs_manager.cc:725] Time spent opening block manager: real 0.163s user 0.003s sys 0.000s
I20260810 11:30:43.920463 28466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data,/tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/wal
uuid: "c40c76e125b44de181b88b7f63a566f7"
format_stamp: "Formatted at 2026-08-10 11:30:05 on dist-test-slave-rgb1"
I20260810 11:30:43.922335 28466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 11:30:43.928771 26580 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a
I20260810 11:30:43.930205 29110 ts_tablet_manager.cc:1918] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:43.930341 29110 log.cc:1196] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/55c8749861874eca9b63d3db97afa2b1
I20260810 11:30:43.930858 29110 ts_tablet_manager.cc:1939] T 55c8749861874eca9b63d3db97afa2b1 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:43.931388 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a with delete_type TABLET_DATA_DELETED (replaced by tablet c8c9267e2da64738b5f7550c83b7c4a3) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:43.931665 27999 tablet_replica.cc:330] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:43.931890 27999 raft_consensus.cc:2229] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:43.932152 26580 catalog_manager.cc:6565] ReplaceTablet: tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a deleted and replaced by tablet c8c9267e2da64738b5f7550c83b7c4a3
I20260810 11:30:43.932274 27999 raft_consensus.cc:2258] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:43.932355 26580 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 166) took 2473 ms. Trace:
I20260810 11:30:43.900283 26700 leader_election.cc:302] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:43.932549 26580 rpcz_store.cc:276] 0810 11:30:41.458715 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.179768 (+1721053us) service_pool.cc:227] Handling call
0810 11:30:43.932259 (+752491us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:43.922136 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:43.922258 (+ 122us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:43.922265 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:43.922267 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:43.922453 (+ 186us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:43.922469 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:43.922473 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:43.922572 (+ 99us) tablet.cc:699] Row locks acquired
0810 11:30:43.922574 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:43.922615 (+ 41us) write_op.cc:270] Start()
0810 11:30:43.922652 (+ 37us) write_op.cc:276] Timestamp: P: 1786361443922553 usec, L: 0
0810 11:30:43.922656 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:43.922844 (+ 188us) log.cc:842] Serialized 631 byte log entry
0810 11:30:43.927396 (+ 4552us) op_driver.cc:444] REPLICATION: finished
0810 11:30:43.927531 (+ 135us) write_op.cc:301] APPLY: starting
0810 11:30:43.927550 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:43.927597 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:43.927676 (+ 79us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:43.927799 (+ 123us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:43.927871 (+ 72us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:43.927878 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:43.927972 (+ 94us) log.cc:842] Serialized 29 byte log entry
0810 11:30:43.928041 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:43.928068 (+ 27us) write_op.cc:454] Released schema lock
0810 11:30:43.928075 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:43.928134 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:43.928138 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2672,"child_traces":[["op",{"apply.queue_time_us":41,"apply.run_cpu_time_us":675,"apply.run_wall_time_us":676,"num_ops":2,"prepare.queue_time_us":63,"prepare.run_cpu_time_us":829,"prepare.run_wall_time_us":830,"raft.queue_time_us":160,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":317,"replication_time_us":4712}]]}
I20260810 11:30:43.933358 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a with delete_type TABLET_DATA_DELETED (replaced by tablet c8c9267e2da64738b5f7550c83b7c4a3) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:43.933488 27999 ts_tablet_manager.cc:1905] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:43.933672 28727 raft_consensus.cc:2781] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:43.933820 28727 raft_consensus.cc:686] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:43.933979 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a with delete_type TABLET_DATA_DELETED (replaced by tablet c8c9267e2da64738b5f7550c83b7c4a3) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:43.934057 28727 consensus_queue.cc:237] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.935452 28640 raft_consensus.cc:482] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:43.935595 28640 raft_consensus.cc:504] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.936205 28640 leader_election.cc:288] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:43.937939 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b755744059b04967857c1b00e951b8ee" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:43.938185 27060 raft_consensus.cc:2454] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:43.941462 27110 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:43.944880 26702 leader_election.cc:302] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:43.945156 28640 raft_consensus.cc:2781] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:43.945251 28640 raft_consensus.cc:482] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:43.945319 28640 raft_consensus.cc:3037] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:43.945494 28753 raft_consensus.cc:482] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:43.945647 28753 raft_consensus.cc:504] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.946203 28753 leader_election.cc:288] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:43.946659 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b755744059b04967857c1b00e951b8ee" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:43.946782 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43fee1a9a6f9482fbbe6ab6599c27fb9" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:43.947304 26991 leader_election.cc:341] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.948254 28640 raft_consensus.cc:504] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.949560 26760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43fee1a9a6f9482fbbe6ab6599c27fb9" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:43.950320 26993 leader_election.cc:341] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.950435 26993 leader_election.cc:302] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.951390 28640 leader_election.cc:288] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:43.951557 28753 raft_consensus.cc:2726] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:43.951960 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b755744059b04967857c1b00e951b8ee" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:43.952268 27057 raft_consensus.cc:3037] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:43.952687 26700 leader_election.cc:341] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.952670 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b755744059b04967857c1b00e951b8ee" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:43.953280 26700 leader_election.cc:341] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:43.955605 28987 ts_tablet_manager.cc:1918] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:43.955714 28987 log.cc:1196] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/a63227e69df14a4ea935087fd31ece63
I20260810 11:30:43.956035 28987 ts_tablet_manager.cc:1939] T a63227e69df14a4ea935087fd31ece63 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
W20260810 11:30:43.956610 26565 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet afbe6ce99f7c4f7cb939bea086cd90be consensus state has no leader
I20260810 11:30:43.957028 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 91) took 2046 ms. Trace:
I20260810 11:30:43.957139 28987 rpcz_store.cc:276] 0810 11:30:41.910950 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.912847 (+ 1897us) service_pool.cc:227] Handling call
0810 11:30:43.895523 (+1982676us) ts_tablet_manager.cc:1145] Deleting tablet a63227e69df14a4ea935087fd31ece63
0810 11:30:43.895538 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:43.925946 (+ 30408us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:43.955488 (+ 29542us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:43.956991 (+ 1503us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1982438}
I20260810 11:30:43.960399 27057 raft_consensus.cc:2454] T b755744059b04967857c1b00e951b8ee P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:43.961025 27999 ts_tablet_manager.cc:1918] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:43.961288 27999 log.cc:1196] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/6dc4fd6ca8a541f99eed57a6f51c1f0a
I20260810 11:30:43.961759 27999 ts_tablet_manager.cc:1939] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:43.961779 28987 tablet_replica.cc:330] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:43.957623 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet a63227e69df14a4ea935087fd31ece63 (table default.Table_d863b14a3a96454e8ee5a85fb2ab30c8 [id=a40ab01e5be24248b3af7ef1dc456da6]) successfully deleted
I20260810 11:30:43.974752 28987 raft_consensus.cc:2229] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 2 LEADER]: Raft consensus shutting down.
I20260810 11:30:43.975474 28987 pending_rounds.cc:62] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d: Trying to abort 1 pending ops.
I20260810 11:30:43.977121 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 59) took 1177 ms. Trace:
I20260810 11:30:43.963397 27231 tablet_bootstrap.cc:492] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
W20260810 11:30:43.966290 26991 consensus_peers.cc:487] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d512c335e340437fa32f2dc16dca6812. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:43.977250 29110 rpcz_store.cc:276] 0810 11:30:42.793774 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.793989 (+ 215us) service_pool.cc:227] Handling call
0810 11:30:43.911232 (+1117243us) ts_tablet_manager.cc:1145] Deleting tablet 55c8749861874eca9b63d3db97afa2b1
0810 11:30:43.911246 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:43.916779 (+ 5533us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:43.930093 (+ 13314us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:43.971503 (+ 41410us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1116984}
I20260810 11:30:43.977818 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 55c8749861874eca9b63d3db97afa2b1 (table default.Table_1c6221759f954488a1e7df4252c2a6ae [id=996f45529be941409f77e6682591b900]) successfully deleted
I20260810 11:30:43.978109 27231 ts_tablet_manager.cc:1397] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.140s user 0.001s sys 0.004s
I20260810 11:30:43.979126 27231 raft_consensus.cc:348] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.979485 27231 raft_consensus.cc:374] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:43.979580 27231 raft_consensus.cc:729] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:43.980314 27231 consensus_queue.cc:260] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.981030 29110 tablet_replica.cc:330] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:43.977195 26702 leader_election.cc:302] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:43.982496 27231 ts_tablet_manager.cc:1428] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 11:30:43.982950 29110 raft_consensus.cc:2229] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:43.983088 28727 raft_consensus.cc:2781] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:43.983352 29110 raft_consensus.cc:2258] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:43.984766 29110 ts_tablet_manager.cc:1905] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:43.983475 28727 raft_consensus.cc:686] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:43.985808 28727 consensus_queue.cc:237] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:43.987615 28987 pending_rounds.cc:68] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7316936473739689984 op_type: NO_OP noop_request { }
I20260810 11:30:43.987865 28987 raft_consensus.cc:2866] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:43.988268 28987 raft_consensus.cc:2258] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:43.986009 27231 tablet_bootstrap.cc:492] T a22cdf7d273d427cb32b811aa5caa3a3 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:43.989603 27228 tablet_bootstrap.cc:492] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:43.990583 27231 tablet_bootstrap.cc:654] T a22cdf7d273d427cb32b811aa5caa3a3 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:43.990533 26895 tablet_service.cc:1467] Processing CreateTablet for tablet e89a5c5b46624e2293907a037017ed02 (DEFAULT_TABLE table=default.Table_39b5e6c9fae14b689a454fbe35bc3891 [id=141c06b42bcd474884e9a40193a7e043]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.990963 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89a5c5b46624e2293907a037017ed02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.990960 26746 tablet_service.cc:1467] Processing CreateTablet for tablet e89a5c5b46624e2293907a037017ed02 (DEFAULT_TABLE table=default.Table_39b5e6c9fae14b689a454fbe35bc3891 [id=141c06b42bcd474884e9a40193a7e043]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.991427 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89a5c5b46624e2293907a037017ed02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.993642 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 307cabadffed423d8c8bb2d8a1011199 (DEFAULT_TABLE table=default.Table_75533618dd694f43bd62eb7502414575 [id=2ab09df4982a424ca7f3d3d9a0eac538]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.994078 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 307cabadffed423d8c8bb2d8a1011199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:43.996949 27031 tablet_service.cc:1467] Processing CreateTablet for tablet e89a5c5b46624e2293907a037017ed02 (DEFAULT_TABLE table=default.Table_39b5e6c9fae14b689a454fbe35bc3891 [id=141c06b42bcd474884e9a40193a7e043]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:43.997795 27031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89a5c5b46624e2293907a037017ed02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.000042 28726 raft_consensus.cc:482] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.000196 28726 raft_consensus.cc:504] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.000497 27228 ts_tablet_manager.cc:1397] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.095s user 0.005s sys 0.004s
I20260810 11:30:44.001044 28726 leader_election.cc:288] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:44.001264 27228 raft_consensus.cc:348] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.001588 27228 raft_consensus.cc:374] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.001694 27228 raft_consensus.cc:729] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.001835 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afbe6ce99f7c4f7cb939bea086cd90be" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:44.001844 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afbe6ce99f7c4f7cb939bea086cd90be" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:44.002079 27228 consensus_queue.cc:260] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:44.002575 26702 leader_election.cc:341] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:44.002877 26700 leader_election.cc:341] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.003017 26700 leader_election.cc:302] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:44.004218 28726 raft_consensus.cc:2726] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:44.005650 27228 ts_tablet_manager.cc:1428] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 11:30:44.006246 27228 tablet_bootstrap.cc:492] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:44.006798 27025 tablet_service.cc:1467] Processing CreateTablet for tablet 307cabadffed423d8c8bb2d8a1011199 (DEFAULT_TABLE table=default.Table_75533618dd694f43bd62eb7502414575 [id=2ab09df4982a424ca7f3d3d9a0eac538]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.009466 27228 tablet_bootstrap.cc:654] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.009665 28987 ts_tablet_manager.cc:1905] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:44.011864 26746 tablet_service.cc:1467] Processing CreateTablet for tablet 307cabadffed423d8c8bb2d8a1011199 (DEFAULT_TABLE table=default.Table_75533618dd694f43bd62eb7502414575 [id=2ab09df4982a424ca7f3d3d9a0eac538]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.012292 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 307cabadffed423d8c8bb2d8a1011199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.014027 28726 raft_consensus.cc:482] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.014201 28726 raft_consensus.cc:504] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.014816 28726 leader_election.cc:288] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:44.017819 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 307cabadffed423d8c8bb2d8a1011199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.018800 27222 ts_tablet_manager.cc:1428] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.110s user 0.014s sys 0.002s
I20260810 11:30:44.017261 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5409c96c1949416e85cfcaa8f2f61227" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:44.020952 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5409c96c1949416e85cfcaa8f2f61227" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:44.021014 26734 tablet_service.cc:1467] Processing CreateTablet for tablet ccdf2bb9f3b347ceb970a0d3115816df (DEFAULT_TABLE table=default.Table_7df687282e5d42448878a624cddcac77 [id=1db29e28c564433e892b958e027b5f72]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:44.021128 26700 leader_election.cc:341] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.021195 27057 raft_consensus.cc:2454] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:44.021441 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccdf2bb9f3b347ceb970a0d3115816df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.026087 27222 tablet_bootstrap.cc:492] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:44.029091 26702 leader_election.cc:302] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:44.029604 28726 raft_consensus.cc:2781] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:44.029682 28726 raft_consensus.cc:482] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:44.029737 28726 raft_consensus.cc:3037] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:44.031987 26895 tablet_service.cc:1467] Processing CreateTablet for tablet bf03e6a7c8334e79be79bb0869f59ade (DEFAULT_TABLE table=default.Table_403112b5aa7a4fa082949d46b04c64e9 [id=86d58cce00294d6787cbc9b3796e2c38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.032450 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf03e6a7c8334e79be79bb0869f59ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.033985 29110 ts_tablet_manager.cc:1918] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:44.034142 29110 log.cc:1196] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/7d3406f12d9c492cbd0d86fa7a57de82
I20260810 11:30:44.034449 29110 ts_tablet_manager.cc:1939] T 7d3406f12d9c492cbd0d86fa7a57de82 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:44.032560 28726 raft_consensus.cc:504] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.035497 27025 tablet_service.cc:1467] Processing CreateTablet for tablet ccdf2bb9f3b347ceb970a0d3115816df (DEFAULT_TABLE table=default.Table_7df687282e5d42448878a624cddcac77 [id=1db29e28c564433e892b958e027b5f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.037678 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccdf2bb9f3b347ceb970a0d3115816df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.039170 27031 tablet_service.cc:1467] Processing CreateTablet for tablet bf03e6a7c8334e79be79bb0869f59ade (DEFAULT_TABLE table=default.Table_403112b5aa7a4fa082949d46b04c64e9 [id=86d58cce00294d6787cbc9b3796e2c38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.039594 27031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf03e6a7c8334e79be79bb0869f59ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.040654 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 81b800247b4e4171b82dcde68e39fb00 (DEFAULT_TABLE table=default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.041036 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81b800247b4e4171b82dcde68e39fb00. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:44.045696 26991 consensus_peers.cc:487] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 49db12565dbc4187b78a98ed35c40fed. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:44.037806 26737 tablet_service.cc:1467] Processing CreateTablet for tablet bf03e6a7c8334e79be79bb0869f59ade (DEFAULT_TABLE table=default.Table_403112b5aa7a4fa082949d46b04c64e9 [id=86d58cce00294d6787cbc9b3796e2c38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.038983 27222 tablet_bootstrap.cc:654] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.048334 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf03e6a7c8334e79be79bb0869f59ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.039950 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 81b800247b4e4171b82dcde68e39fb00 (DEFAULT_TABLE table=default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.050987 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81b800247b4e4171b82dcde68e39fb00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.045727 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 60) took 1246 ms. Trace:
I20260810 11:30:44.053421 29110 rpcz_store.cc:276] 0810 11:30:42.799238 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.799481 (+ 243us) service_pool.cc:227] Handling call
0810 11:30:43.980974 (+1181493us) ts_tablet_manager.cc:1145] Deleting tablet 7d3406f12d9c492cbd0d86fa7a57de82
0810 11:30:43.980987 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.030419 (+ 49432us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.033879 (+ 3460us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.045709 (+ 11830us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1181132}
I20260810 11:30:44.061812 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 7d3406f12d9c492cbd0d86fa7a57de82 (table default.Table_c32d1cb0b9e744fbacbd00c8736fad21 [id=f54b49f28880453aa7bc67b9c36a219b]) successfully deleted
I20260810 11:30:44.062286 29110 tablet_replica.cc:330] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:44.063133 29110 raft_consensus.cc:2229] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:44.063536 28726 leader_election.cc:288] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:44.064888 29110 raft_consensus.cc:2258] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:44.065603 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5409c96c1949416e85cfcaa8f2f61227" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:44.067426 26700 leader_election.cc:341] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.067929 28640 raft_consensus.cc:482] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.068063 28640 raft_consensus.cc:504] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.068717 28640 leader_election.cc:288] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:44.069659 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4efa31ad2ce8436b9638e6759d9b5421" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:44.069941 26914 raft_consensus.cc:2454] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:44.070235 26894 tablet_service.cc:1467] Processing CreateTablet for tablet ccdf2bb9f3b347ceb970a0d3115816df (DEFAULT_TABLE table=default.Table_7df687282e5d42448878a624cddcac77 [id=1db29e28c564433e892b958e027b5f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.071388 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccdf2bb9f3b347ceb970a0d3115816df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.072548 26885 tablet_service.cc:1467] Processing CreateTablet for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (DEFAULT_TABLE table=default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.071482 29217 tablet.cc:1722] T 760aeada57464892ae3b9013a761c509 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:44.072896 26700 leader_election.cc:302] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:44.072996 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.073922 28640 raft_consensus.cc:2781] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:44.074008 28640 raft_consensus.cc:482] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:44.074070 28640 raft_consensus.cc:3037] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:44.075564 26734 tablet_service.cc:1467] Processing CreateTablet for tablet 5ee50a7da224437baed913995e6587dd (DEFAULT_TABLE table=default.Table_307bbf62894b4edc922e0fd4afa1a91f [id=a700655211944205a74b75b8449abc29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.076004 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ee50a7da224437baed913995e6587dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.077571 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (DEFAULT_TABLE table=default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.077702 28640 raft_consensus.cc:504] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.078568 28640 leader_election.cc:288] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:44.079303 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4efa31ad2ce8436b9638e6759d9b5421" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:44.079510 26914 raft_consensus.cc:3037] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:44.080168 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 5ee50a7da224437baed913995e6587dd (DEFAULT_TABLE table=default.Table_307bbf62894b4edc922e0fd4afa1a91f [id=a700655211944205a74b75b8449abc29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.080536 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ee50a7da224437baed913995e6587dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.082574 26914 raft_consensus.cc:2454] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:44.083314 26700 leader_election.cc:302] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:44.083611 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:44.083673 28640 raft_consensus.cc:2781] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:44.083802 28640 raft_consensus.cc:686] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:44.084100 28640 consensus_queue.cc:237] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.078003 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.091233 29034 tablet.cc:1722] T 271a0607ec28441c91bac32c2f2bf44b P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:44.093595 29221 tablet.cc:1722] T 271a0607ec28441c91bac32c2f2bf44b P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:44.094966 27228 tablet_bootstrap.cc:492] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:44.095119 27228 ts_tablet_manager.cc:1397] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.089s user 0.004s sys 0.006s
I20260810 11:30:44.095717 27228 raft_consensus.cc:348] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.095952 27228 raft_consensus.cc:374] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.096026 27228 raft_consensus.cc:729] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.096400 27228 consensus_queue.cc:260] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.097326 27228 ts_tablet_manager.cc:1428] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:44.097689 27228 tablet_bootstrap.cc:492] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:44.100193 29110 ts_tablet_manager.cc:1905] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:44.105327 27033 tablet_service.cc:1467] Processing CreateTablet for tablet 81b800247b4e4171b82dcde68e39fb00 (DEFAULT_TABLE table=default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.105512 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (DEFAULT_TABLE table=default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.105808 27033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81b800247b4e4171b82dcde68e39fb00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.105960 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5409c96c1949416e85cfcaa8f2f61227" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:44.106030 27038 tablet_service.cc:1467] Processing CreateTablet for tablet 5ee50a7da224437baed913995e6587dd (DEFAULT_TABLE table=default.Table_307bbf62894b4edc922e0fd4afa1a91f [id=a700655211944205a74b75b8449abc29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.106179 27059 raft_consensus.cc:3037] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:44.106333 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ee50a7da224437baed913995e6587dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.108739 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4efa31ad2ce8436b9638e6759d9b5421" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:44.109023 27058 raft_consensus.cc:2454] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:44.109432 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4efa31ad2ce8436b9638e6759d9b5421" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:44.109594 27055 raft_consensus.cc:3037] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:44.109869 27059 raft_consensus.cc:2454] T 5409c96c1949416e85cfcaa8f2f61227 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:44.113587 29123 raft_consensus.cc:482] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6079090b1124d84aa4477974bb53700)
I20260810 11:30:44.113731 29123 raft_consensus.cc:504] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.114401 29123 leader_election.cc:288] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:44.108739 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.117355 27228 tablet_bootstrap.cc:654] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:44.122476 26993 leader_election.cc:341] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 603fe104b7ab485eab6b225a58bddc1c
I20260810 11:30:44.124898 27055 raft_consensus.cc:2454] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:44.125675 26702 leader_election.cc:302] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:44.126276 28728 raft_consensus.cc:2781] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:44.126405 28728 raft_consensus.cc:686] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:44.126636 28728 consensus_queue.cc:237] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.129702 29223 tablet.cc:1722] T 760aeada57464892ae3b9013a761c509 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:44.132809 29034 tablet.cc:1722] T 760aeada57464892ae3b9013a761c509 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:44.145304 29059 raft_consensus.cc:482] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.145537 29059 raft_consensus.cc:504] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.146214 29059 leader_election.cc:288] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:44.147946 26849 leader_election.cc:341] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: a63227e69df14a4ea935087fd31ece63
I20260810 11:30:44.147912 27048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a63227e69df14a4ea935087fd31ece63" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:44.148874 26848 leader_election.cc:302] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:44.149257 29086 raft_consensus.cc:2726] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:44.156498 27231 tablet_bootstrap.cc:492] T a22cdf7d273d427cb32b811aa5caa3a3 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:44.156734 27231 ts_tablet_manager.cc:1397] T a22cdf7d273d427cb32b811aa5caa3a3 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.171s user 0.007s sys 0.010s
I20260810 11:30:44.157661 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:44.157758 27231 raft_consensus.cc:348] T a22cdf7d273d427cb32b811aa5caa3a3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.158134 27231 raft_consensus.cc:374] T a22cdf7d273d427cb32b811aa5caa3a3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.158221 27231 raft_consensus.cc:729] T a22cdf7d273d427cb32b811aa5caa3a3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.158437 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:44.158555 27231 consensus_queue.cc:260] T a22cdf7d273d427cb32b811aa5caa3a3 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.159373 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:44.159505 27231 ts_tablet_manager.cc:1428] T a22cdf7d273d427cb32b811aa5caa3a3 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:44.159843 29221 tablet.cc:1722] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:44.160284 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d1d0d55b526749059470504a27887b22 (table default.Table_a164cd4bbc4344ae905f395ab1e6cffb [id=62f404c62e4040fc801f70cafddf9d95]). Expected version 1 got 0
I20260810 11:30:44.160813 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9e329b95fc8e41c3967079896294942a (table default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53]). Expected version 2 got 0
I20260810 11:30:44.162418 29178 raft_consensus.cc:482] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 443ec871f1ed4232b932ecfb0b18510d)
I20260810 11:30:44.162629 29178 raft_consensus.cc:504] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.163697 29178 leader_election.cc:288] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:44.164872 26991 leader_election.cc:341] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 7e78fb1bf0534deca5cc5a603fd77592
I20260810 11:30:44.169538 29110 ts_tablet_manager.cc:1918] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:44.170332 29110 log.cc:1196] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/1aa4562a2247405187d9dbd1baa48f39
I20260810 11:30:44.170940 29110 ts_tablet_manager.cc:1939] T 1aa4562a2247405187d9dbd1baa48f39 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:44.169680 27231 tablet_bootstrap.cc:492] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:44.174837 27231 tablet_bootstrap.cc:654] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:44.176255 26991 leader_election.cc:341] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 603fe104b7ab485eab6b225a58bddc1c
I20260810 11:30:44.176380 26991 leader_election.cc:302] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:44.176667 29123 raft_consensus.cc:2726] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:44.172436 29223 tablet.cc:1722] T 271a0607ec28441c91bac32c2f2bf44b P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 11:30:44.171876 26993 leader_election.cc:341] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 7e78fb1bf0534deca5cc5a603fd77592
I20260810 11:30:44.177315 26993 leader_election.cc:302] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:44.179749 29123 raft_consensus.cc:2726] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:44.180738 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 61) took 1381 ms. Trace:
I20260810 11:30:44.182235 29110 rpcz_store.cc:276] 0810 11:30:42.799434 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.800360 (+ 926us) service_pool.cc:227] Handling call
0810 11:30:44.062201 (+1261841us) ts_tablet_manager.cc:1145] Deleting tablet 1aa4562a2247405187d9dbd1baa48f39
0810 11:30:44.062221 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.153529 (+ 91308us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.169417 (+ 15888us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.180712 (+ 11295us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2056,"tablet-delete.queue_time_us":1261586}
I20260810 11:30:44.183801 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 62) took 1382 ms. Trace:
I20260810 11:30:44.184386 29110 rpcz_store.cc:276] 0810 11:30:42.800943 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.801207 (+ 264us) service_pool.cc:227] Handling call
0810 11:30:44.183638 (+1382431us) ts_tablet_manager.cc:1145] Deleting tablet d000f0ebaf0049a7bdaad93e307e16e2
0810 11:30:44.183655 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.183780 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1382235}
I20260810 11:30:44.185787 29110 tablet_replica.cc:330] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:44.186197 29110 raft_consensus.cc:2229] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:44.186473 29110 raft_consensus.cc:2258] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:44.187088 29110 ts_tablet_manager.cc:1905] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:44.181840 29228 tablet.cc:1722] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:44.191334 29123 raft_consensus.cc:482] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.191506 29123 raft_consensus.cc:504] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.192138 29123 leader_election.cc:288] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:44.192814 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab2471d06e0841e7bebae4ca1865618c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:44.193535 26993 leader_election.cc:341] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.195760 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab2471d06e0841e7bebae4ca1865618c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:44.196326 26991 leader_election.cc:341] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.196466 26991 leader_election.cc:302] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:44.196841 29123 raft_consensus.cc:2726] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:44.197983 27228 tablet_bootstrap.cc:492] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:44.198328 27228 ts_tablet_manager.cc:1397] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.101s user 0.001s sys 0.007s
I20260810 11:30:44.199582 27228 raft_consensus.cc:348] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.200184 27228 raft_consensus.cc:374] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.200300 27228 raft_consensus.cc:729] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.200645 27228 consensus_queue.cc:260] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.201287 28466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 11:30:44.201972 27228 ts_tablet_manager.cc:1428] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 11:30:44.196311 27231 tablet_bootstrap.cc:492] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:44.207732 27231 ts_tablet_manager.cc:1397] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.003s
I20260810 11:30:44.208148 27228 tablet_bootstrap.cc:492] T 490ada0a918d48c3a07e12eed58bda19 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:44.209146 29123 raft_consensus.cc:482] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.209280 29123 raft_consensus.cc:504] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.209822 29123 leader_election.cc:288] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:44.210789 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d560157da0624333b91a18481b058f91" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:44.210860 29110 ts_tablet_manager.cc:1918] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:44.210989 29110 log.cc:1196] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/81f24c84cdd945b78f39f24015eb1e43
I20260810 11:30:44.211221 27231 raft_consensus.cc:348] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.211437 29110 ts_tablet_manager.cc:1939] T 81f24c84cdd945b78f39f24015eb1e43 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:44.211484 27231 raft_consensus.cc:374] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.211541 27231 raft_consensus.cc:729] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.211745 27231 consensus_queue.cc:260] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.212230 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d560157da0624333b91a18481b058f91" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:44.212363 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 63) took 1410 ms. Trace:
I20260810 11:30:44.212517 29110 rpcz_store.cc:276] 0810 11:30:42.801585 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.803401 (+ 1816us) service_pool.cc:227] Handling call
0810 11:30:44.185737 (+1382336us) ts_tablet_manager.cc:1145] Deleting tablet 81f24c84cdd945b78f39f24015eb1e43
0810 11:30:44.185749 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.197298 (+ 11549us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.210758 (+ 13460us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.212340 (+ 1582us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1382128}
I20260810 11:30:44.213125 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 64) took 1409 ms. Trace:
I20260810 11:30:44.213390 29110 rpcz_store.cc:276] 0810 11:30:42.803806 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.804049 (+ 243us) service_pool.cc:227] Handling call
0810 11:30:44.212954 (+1408905us) ts_tablet_manager.cc:1145] Deleting tablet 8228600e3f6b4f9993dd25e4ceb57e4d
0810 11:30:44.212966 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.213098 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1408691}
I20260810 11:30:44.173977 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]) successfully deleted
I20260810 11:30:44.183838 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 1aa4562a2247405187d9dbd1baa48f39 (table default.Table_5318e36611c342278e64da2f02be8a08 [id=3b8a0c6cf3fa45c18cedc4967f725ba3]) successfully deleted
I20260810 11:30:44.213994 28466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
W20260810 11:30:44.214277 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet d000f0ebaf0049a7bdaad93e307e16e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d000f0ebaf0049a7bdaad93e307e16e2 already in progress: creating tablet
I20260810 11:30:44.214522 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 65) took 1409 ms. Trace:
I20260810 11:30:44.214567 28466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 11:30:44.214730 29110 rpcz_store.cc:276] 0810 11:30:42.804433 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.804655 (+ 222us) service_pool.cc:227] Handling call
0810 11:30:44.213800 (+1409145us) ts_tablet_manager.cc:1145] Deleting tablet 3ae27bf110114b70a3e3f6cf64f31b98
0810 11:30:44.213822 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.214378 (+ 556us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1408974}
I20260810 11:30:44.215086 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1f64d4b9320c4cb39f57573d781a47d3 (table default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0]). Expected version 4 got 0
I20260810 11:30:44.215577 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 66) took 1410 ms. Trace:
I20260810 11:30:44.215619 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:44.215786 29110 rpcz_store.cc:276] 0810 11:30:42.804962 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.805128 (+ 166us) service_pool.cc:227] Handling call
0810 11:30:44.215443 (+1410315us) ts_tablet_manager.cc:1145] Deleting tablet 2da86554bc51486e91f1ea5995a245b5
0810 11:30:44.215454 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.215559 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1410053}
I20260810 11:30:44.216137 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:44.216372 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 67) took 1410 ms. Trace:
I20260810 11:30:44.216574 29110 rpcz_store.cc:276] 0810 11:30:42.805647 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.805934 (+ 287us) service_pool.cc:227] Handling call
0810 11:30:44.216137 (+1410203us) ts_tablet_manager.cc:1145] Deleting tablet 34bd3c0edf6b49d1891c0ee9af344872
0810 11:30:44.216191 (+ 54us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.216354 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1409977}
I20260810 11:30:44.217077 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 68) took 1410 ms. Trace:
I20260810 11:30:44.217010 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
W20260810 11:30:44.217200 26991 leader_election.cc:341] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.217495 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:44.217200 29110 rpcz_store.cc:276] 0810 11:30:42.806396 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.806619 (+ 223us) service_pool.cc:227] Handling call
0810 11:30:44.216938 (+1410319us) ts_tablet_manager.cc:1145] Deleting tablet e276b0fa124d42dfb3fe750d245e44d8
0810 11:30:44.216947 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.217063 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1410130}
I20260810 11:30:44.218062 29110 tablet_replica.cc:330] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:44.218165 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 83992214ba314d3fa674e00d8eaddec6 (table default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655]). Expected version 1 got 0
I20260810 11:30:44.218303 29110 raft_consensus.cc:2229] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:44.218621 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:44.218652 27228 tablet_bootstrap.cc:654] T 490ada0a918d48c3a07e12eed58bda19 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.220839 27231 ts_tablet_manager.cc:1428] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
W20260810 11:30:44.220934 26993 leader_election.cc:341] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.229285 26993 leader_election.cc:302] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:44.229622 27231 tablet_bootstrap.cc:492] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:44.230779 29034 tablet.cc:1722] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:44.231086 29178 raft_consensus.cc:2726] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:44.231407 27231 tablet_bootstrap.cc:654] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.234900 28987 ts_tablet_manager.cc:1918] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260810 11:30:44.235138 28987 log.cc:1196] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/f7ada1df82eb44ecb9a6c615b5410e6f
I20260810 11:30:44.235621 28987 ts_tablet_manager.cc:1939] T f7ada1df82eb44ecb9a6c615b5410e6f P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:44.220163 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 81f24c84cdd945b78f39f24015eb1e43 (table default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e]) successfully deleted
W20260810 11:30:44.238039 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 8228600e3f6b4f9993dd25e4ceb57e4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8228600e3f6b4f9993dd25e4ceb57e4d already in progress: creating tablet
W20260810 11:30:44.238777 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 3ae27bf110114b70a3e3f6cf64f31b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae27bf110114b70a3e3f6cf64f31b98 already in progress: creating tablet
I20260810 11:30:44.238957 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:44.239606 27228 tablet_bootstrap.cc:492] T 490ada0a918d48c3a07e12eed58bda19 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:44.239715 27222 tablet_bootstrap.cc:492] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:44.239881 27222 ts_tablet_manager.cc:1397] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.221s user 0.009s sys 0.009s
I20260810 11:30:44.240350 27228 ts_tablet_manager.cc:1397] T 490ada0a918d48c3a07e12eed58bda19 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.032s user 0.006s sys 0.001s
I20260810 11:30:44.241127 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 94) took 2328 ms. Trace:
I20260810 11:30:44.241380 29110 raft_consensus.cc:2258] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:44.241852 27228 raft_consensus.cc:348] T 490ada0a918d48c3a07e12eed58bda19 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.242110 27228 raft_consensus.cc:374] T 490ada0a918d48c3a07e12eed58bda19 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.242165 27228 raft_consensus.cc:729] T 490ada0a918d48c3a07e12eed58bda19 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.242365 27228 consensus_queue.cc:260] T 490ada0a918d48c3a07e12eed58bda19 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.244366 29110 ts_tablet_manager.cc:1905] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:44.239158 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 2da86554bc51486e91f1ea5995a245b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2da86554bc51486e91f1ea5995a245b5 already in progress: creating tablet
W20260810 11:30:44.245503 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 34bd3c0edf6b49d1891c0ee9af344872 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34bd3c0edf6b49d1891c0ee9af344872 already in progress: creating tablet
W20260810 11:30:44.246093 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet e276b0fa124d42dfb3fe750d245e44d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e276b0fa124d42dfb3fe750d245e44d8 already in progress: creating tablet
I20260810 11:30:44.247049 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bd6b328baa2346afbbe9f513ae4db3df (table default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6]). Expected version 1 got 0
I20260810 11:30:44.247220 28987 rpcz_store.cc:276] 0810 11:30:41.912321 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.941215 (+ 28894us) service_pool.cc:227] Handling call
0810 11:30:43.961483 (+2020268us) ts_tablet_manager.cc:1145] Deleting tablet f7ada1df82eb44ecb9a6c615b5410e6f
0810 11:30:43.961500 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.177167 (+215667us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.234720 (+ 57553us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.241105 (+ 6385us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2003805}
I20260810 11:30:44.247963 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 96) took 2306 ms. Trace:
I20260810 11:30:44.248916 28987 rpcz_store.cc:276] 0810 11:30:41.941997 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.942054 (+ 57us) service_pool.cc:227] Handling call
0810 11:30:44.247811 (+2305757us) ts_tablet_manager.cc:1145] Deleting tablet cc76d30f37094391b75076c92ccc277f
0810 11:30:44.247825 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.247944 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2290143}
I20260810 11:30:44.248486 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet f7ada1df82eb44ecb9a6c615b5410e6f (table default.Table_635ef5268ea1426bb6578ba498e616e3 [id=fef997439a4346d2a9c6f2a4277ede5a]) successfully deleted
I20260810 11:30:44.254326 27228 ts_tablet_manager.cc:1428] T 490ada0a918d48c3a07e12eed58bda19 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260810 11:30:44.255833 29178 raft_consensus.cc:482] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 443ec871f1ed4232b932ecfb0b18510d)
I20260810 11:30:44.256083 29178 raft_consensus.cc:504] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.256809 29178 leader_election.cc:288] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:44.257756 26991 leader_election.cc:341] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: ff9b649e43a9456fa51cf3330290bb91
I20260810 11:30:44.260365 28987 tablet_replica.cc:330] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
W20260810 11:30:44.260092 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet cc76d30f37094391b75076c92ccc277f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc76d30f37094391b75076c92ccc277f already in progress: creating tablet
I20260810 11:30:44.254758 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:44.261263 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:44.263088 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:44.263342 28987 raft_consensus.cc:2229] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:44.264338 29110 ts_tablet_manager.cc:1918] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:44.265260 29110 log.cc:1196] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/4b5a7f67ec5b48c2b5a510add0282a76
I20260810 11:30:44.265843 29110 ts_tablet_manager.cc:1939] T 4b5a7f67ec5b48c2b5a510add0282a76 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:44.266970 27228 tablet_bootstrap.cc:492] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:44.268146 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 69) took 1461 ms. Trace:
I20260810 11:30:44.269102 27228 tablet_bootstrap.cc:654] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.269238 29110 rpcz_store.cc:276] 0810 11:30:42.807166 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.807261 (+ 95us) service_pool.cc:227] Handling call
0810 11:30:44.218016 (+1410755us) ts_tablet_manager.cc:1145] Deleting tablet 4b5a7f67ec5b48c2b5a510add0282a76
0810 11:30:44.218026 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.253220 (+ 35194us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.264180 (+ 10960us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.268115 (+ 3935us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22452,"tablet-delete.queue_time_us":1410582}
I20260810 11:30:44.269992 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 70) took 1462 ms. Trace:
I20260810 11:30:44.270335 28987 raft_consensus.cc:2258] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:44.272919 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
W20260810 11:30:44.274191 26993 leader_election.cc:341] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: ff9b649e43a9456fa51cf3330290bb91
I20260810 11:30:44.276666 29110 rpcz_store.cc:276] 0810 11:30:42.807676 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.807912 (+ 236us) service_pool.cc:227] Handling call
0810 11:30:44.269783 (+1461871us) ts_tablet_manager.cc:1145] Deleting tablet ee803ddf27594d2b9e19fe440fc269c7
0810 11:30:44.269801 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.269957 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1461615}
I20260810 11:30:44.276906 26993 leader_election.cc:302] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:44.273308 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 4b5a7f67ec5b48c2b5a510add0282a76 (table default.Table_393d03f5197d43b6977bf48bd7818a0e [id=bc7f10791af946e5957625fb1f912c4e]) successfully deleted
I20260810 11:30:44.277179 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 71) took 1468 ms. Trace:
I20260810 11:30:44.277212 29178 raft_consensus.cc:2726] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:44.277262 29110 rpcz_store.cc:276] 0810 11:30:42.808608 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.882616 (+ 74008us) service_pool.cc:227] Handling call
0810 11:30:44.277008 (+1394392us) ts_tablet_manager.cc:1145] Deleting tablet f6e264e8507446809f3c386fdb3c34ae
0810 11:30:44.277022 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.277157 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1393765}
I20260810 11:30:44.277693 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 72) took 1393 ms. Trace:
W20260810 11:30:44.273540 26702 consensus_peers.cc:487] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1860e56467624dcdb288e13b004f78cc. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:44.278509 28987 ts_tablet_manager.cc:1905] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:44.279124 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet ee803ddf27594d2b9e19fe440fc269c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee803ddf27594d2b9e19fe440fc269c7 already in progress: creating tablet
I20260810 11:30:44.279134 29110 rpcz_store.cc:276] 0810 11:30:42.884106 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.884170 (+ 64us) service_pool.cc:227] Handling call
0810 11:30:44.277540 (+1393370us) ts_tablet_manager.cc:1145] Deleting tablet b6395bce17ee40c2822669246ce7eb42
0810 11:30:44.277552 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.277674 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1392692}
I20260810 11:30:44.279639 29110 tablet_replica.cc:330] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:44.279758 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet f6e264e8507446809f3c386fdb3c34ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6e264e8507446809f3c386fdb3c34ae already in progress: creating tablet
W20260810 11:30:44.280153 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet b6395bce17ee40c2822669246ce7eb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6395bce17ee40c2822669246ce7eb42 already in progress: creating tablet
I20260810 11:30:44.281397 29110 raft_consensus.cc:2229] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:44.281986 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:44.282150 29110 raft_consensus.cc:2258] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:44.282400 26700 consensus_peers.cc:487] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1860e56467624dcdb288e13b004f78cc. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:44.245959 27222 raft_consensus.cc:348] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.282680 27222 raft_consensus.cc:374] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.282769 27222 raft_consensus.cc:729] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.283043 27222 consensus_queue.cc:260] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.285203 27222 ts_tablet_manager.cc:1428] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.045s user 0.002s sys 0.000s
I20260810 11:30:44.285269 29110 ts_tablet_manager.cc:1905] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:44.285646 27231 tablet_bootstrap.cc:492] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:44.285787 27231 ts_tablet_manager.cc:1397] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.056s user 0.010s sys 0.010s
I20260810 11:30:44.286648 27231 raft_consensus.cc:348] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.286895 27231 raft_consensus.cc:374] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.286957 27231 raft_consensus.cc:729] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.287238 27231 consensus_queue.cc:260] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.288914 27231 ts_tablet_manager.cc:1428] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 11:30:44.289693 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:44.289839 27231 tablet_bootstrap.cc:492] T 5deec04c1be64473accf8b9df14bd22e P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:44.292613 27222 tablet_bootstrap.cc:492] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:44.293125 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:44.295023 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:44.295521 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:44.297714 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]). Expected version 2 got 0
I20260810 11:30:44.298303 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:44.298914 27231 tablet_bootstrap.cc:654] T 5deec04c1be64473accf8b9df14bd22e P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.302928 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:44.303699 27222 tablet_bootstrap.cc:654] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.310487 29110 ts_tablet_manager.cc:1918] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:44.311327 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:44.313191 29110 log.cc:1196] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/10210204d5ff4e5e97c98fd255f674a5
I20260810 11:30:44.313789 29110 ts_tablet_manager.cc:1939] T 10210204d5ff4e5e97c98fd255f674a5 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:44.314069 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:44.314252 27231 tablet_bootstrap.cc:492] T 5deec04c1be64473accf8b9df14bd22e P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:44.314414 27231 ts_tablet_manager.cc:1397] T 5deec04c1be64473accf8b9df14bd22e P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.008s
I20260810 11:30:44.314479 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:44.314790 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet fccc21cfc1ce4eb586f03276ec6e987f (table default.Table_65da57b4be754a5b9cbc73361a4f1b93 [id=e22f19a993564e53b1cc76633f25f505]). Expected version 1 got 0
I20260810 11:30:44.315624 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 73) took 1416 ms. Trace:
I20260810 11:30:44.315985 27228 tablet_bootstrap.cc:492] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:44.316148 27228 ts_tablet_manager.cc:1397] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.000s
I20260810 11:30:44.316382 27231 raft_consensus.cc:348] T 5deec04c1be64473accf8b9df14bd22e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.316713 27231 raft_consensus.cc:374] T 5deec04c1be64473accf8b9df14bd22e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.316783 27231 raft_consensus.cc:729] T 5deec04c1be64473accf8b9df14bd22e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.317054 27231 consensus_queue.cc:260] T 5deec04c1be64473accf8b9df14bd22e P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.317096 27228 raft_consensus.cc:348] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.317390 27228 raft_consensus.cc:374] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.317482 27228 raft_consensus.cc:729] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.317766 27228 consensus_queue.cc:260] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.316430 29110 rpcz_store.cc:276] 0810 11:30:42.898981 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.916996 (+ 18015us) service_pool.cc:227] Handling call
0810 11:30:44.279571 (+1362575us) ts_tablet_manager.cc:1145] Deleting tablet 10210204d5ff4e5e97c98fd255f674a5
0810 11:30:44.279587 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.296628 (+ 17041us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.310244 (+ 13616us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.315603 (+ 5359us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1362186}
I20260810 11:30:44.319305 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 74) took 1401 ms. Trace:
I20260810 11:30:44.319689 29110 rpcz_store.cc:276] 0810 11:30:42.917587 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.917630 (+ 43us) service_pool.cc:227] Handling call
0810 11:30:44.318697 (+1401067us) ts_tablet_manager.cc:1145] Deleting tablet c60baf810a544a4a90dccd2337a39043
0810 11:30:44.319098 (+ 401us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.319274 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1400819}
I20260810 11:30:44.320617 29110 tablet_replica.cc:330] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:44.320474 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 10210204d5ff4e5e97c98fd255f674a5 (table default.Table_4d9bc84fc41e4b87ac2f6432852e5d61 [id=9b708c86ff534253961e7c29909eb1bd]) successfully deleted
W20260810 11:30:44.322428 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet c60baf810a544a4a90dccd2337a39043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c60baf810a544a4a90dccd2337a39043 already in progress: creating tablet
I20260810 11:30:44.322597 27231 ts_tablet_manager.cc:1428] T 5deec04c1be64473accf8b9df14bd22e P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s
I20260810 11:30:44.322939 27231 tablet_bootstrap.cc:492] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:44.323127 29110 raft_consensus.cc:2229] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:44.323367 29110 raft_consensus.cc:2258] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:44.324465 29110 ts_tablet_manager.cc:1905] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:44.325434 27231 tablet_bootstrap.cc:654] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.326741 27228 ts_tablet_manager.cc:1428] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260810 11:30:44.334173 27228 tablet_bootstrap.cc:492] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:44.338078 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b4a37afa17d04e3181e7513ac8d23c24 (table default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96]). Expected version 1 got 0
I20260810 11:30:44.341238 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f85c0767ad164075b87ba672cafafb47 (table default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe]). Expected version 3 got 0
I20260810 11:30:44.342355 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:44.343621 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:44.344131 28987 ts_tablet_manager.cc:1918] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:44.344343 29178 raft_consensus.cc:482] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.344607 28987 log.cc:1196] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/2634beb347714fc7a2e05865adb34a22
I20260810 11:30:44.344511 29178 raft_consensus.cc:504] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.344724 29110 ts_tablet_manager.cc:1918] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:44.344868 29110 log.cc:1196] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/db59523b71224370bf5fce6b56592f71
I20260810 11:30:44.345180 29178 leader_election.cc:288] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:44.345343 29110 ts_tablet_manager.cc:1939] T db59523b71224370bf5fce6b56592f71 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:44.345958 28987 ts_tablet_manager.cc:1939] T 2634beb347714fc7a2e05865adb34a22 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:44.346297 27228 tablet_bootstrap.cc:654] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.346283 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 75) took 1414 ms. Trace:
I20260810 11:30:44.346374 29110 rpcz_store.cc:276] 0810 11:30:42.931936 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.931991 (+ 55us) service_pool.cc:227] Handling call
0810 11:30:44.320541 (+1388550us) ts_tablet_manager.cc:1145] Deleting tablet db59523b71224370bf5fce6b56592f71
0810 11:30:44.320574 (+ 33us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.330656 (+ 10082us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.344628 (+ 13972us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.346262 (+ 1634us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1502,"tablet-delete.queue_time_us":1388346}
I20260810 11:30:44.346750 29110 tablet_replica.cc:330] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:44.346957 29110 raft_consensus.cc:2229] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:44.346320 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "372b49dc083d46538442fcbfdfeb3545" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:44.347272 29110 raft_consensus.cc:2258] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:44.348766 26991 leader_election.cc:341] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.347723 26760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "372b49dc083d46538442fcbfdfeb3545" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:44.349642 26993 leader_election.cc:341] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.349779 26993 leader_election.cc:302] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:44.350415 29178 raft_consensus.cc:2726] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:44.347065 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet db59523b71224370bf5fce6b56592f71 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]) successfully deleted
I20260810 11:30:44.352638 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:44.353693 27231 tablet_bootstrap.cc:492] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:44.353833 27231 ts_tablet_manager.cc:1397] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.031s user 0.000s sys 0.005s
I20260810 11:30:44.354885 27231 raft_consensus.cc:348] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.355194 27231 raft_consensus.cc:374] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.355255 27231 raft_consensus.cc:729] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.355463 27231 consensus_queue.cc:260] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.356305 27231 ts_tablet_manager.cc:1428] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:44.356616 27231 tablet_bootstrap.cc:492] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:44.358527 26581 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 460a679219cb4a7f9aecfec58a98238b (table default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599]). Expected version 1 got 0
I20260810 11:30:44.358767 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 99) took 2416 ms. Trace:
I20260810 11:30:44.359210 28987 rpcz_store.cc:276] 0810 11:30:41.942441 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.942488 (+ 47us) service_pool.cc:227] Handling call
0810 11:30:44.260299 (+2317811us) ts_tablet_manager.cc:1145] Deleting tablet 2634beb347714fc7a2e05865adb34a22
0810 11:30:44.260316 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.288052 (+ 27736us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.341965 (+ 53913us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.356367 (+ 14402us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2302468}
I20260810 11:30:44.360622 27222 tablet_bootstrap.cc:492] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:44.360960 28987 tablet_replica.cc:330] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:44.361200 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 2634beb347714fc7a2e05865adb34a22 (table default.Table_538c35ba9808453e870597b4257cefaa [id=e74be4ed04f542bda950d5f318b74c65]) successfully deleted
I20260810 11:30:44.361611 27222 ts_tablet_manager.cc:1397] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.069s user 0.005s sys 0.000s
I20260810 11:30:44.362608 27222 raft_consensus.cc:348] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.362860 27222 raft_consensus.cc:374] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.362998 27222 raft_consensus.cc:729] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.363327 27222 consensus_queue.cc:260] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.365305 29110 ts_tablet_manager.cc:1905] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:44.366387 27222 ts_tablet_manager.cc:1428] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 11:30:44.370095 27222 tablet_bootstrap.cc:492] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:44.372255 27231 tablet_bootstrap.cc:654] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.373719 27222 tablet_bootstrap.cc:654] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.375003 28987 raft_consensus.cc:2229] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:44.376955 28987 raft_consensus.cc:2258] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:44.393800 27231 tablet_bootstrap.cc:492] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:44.393983 27231 ts_tablet_manager.cc:1397] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.037s user 0.005s sys 0.000s
I20260810 11:30:44.394254 29110 ts_tablet_manager.cc:1918] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:44.395088 27231 raft_consensus.cc:348] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.396301 27231 raft_consensus.cc:374] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.396400 27231 raft_consensus.cc:729] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.396696 27231 consensus_queue.cc:260] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.397526 27231 ts_tablet_manager.cc:1428] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 11:30:44.397795 29110 log.cc:1196] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/49db12565dbc4187b78a98ed35c40fed
I20260810 11:30:44.399046 29110 ts_tablet_manager.cc:1939] T 49db12565dbc4187b78a98ed35c40fed P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:44.401041 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 76) took 1468 ms. Trace:
I20260810 11:30:44.401638 29110 rpcz_store.cc:276] 0810 11:30:42.932328 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.932374 (+ 46us) service_pool.cc:227] Handling call
0810 11:30:44.346681 (+1414307us) ts_tablet_manager.cc:1145] Deleting tablet 49db12565dbc4187b78a98ed35c40fed
0810 11:30:44.346717 (+ 36us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.376880 (+ 30163us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.394109 (+ 17229us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.401020 (+ 6911us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1413998}
I20260810 11:30:44.402318 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 77) took 1468 ms. Trace:
I20260810 11:30:44.402529 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 49db12565dbc4187b78a98ed35c40fed (table default.Table_49be430f1e8f475482b54850772c0430 [id=82e113439bc04ce9955f59612ba480dc]) successfully deleted
I20260810 11:30:44.402786 29110 rpcz_store.cc:276] 0810 11:30:42.934171 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.934218 (+ 47us) service_pool.cc:227] Handling call
0810 11:30:44.402185 (+1467967us) ts_tablet_manager.cc:1145] Deleting tablet ea66da5bc20e4718901ffc473677421c
0810 11:30:44.402195 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.402303 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1467780}
I20260810 11:30:44.403108 27231 tablet_bootstrap.cc:492] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:44.404182 29110 tablet_replica.cc:330] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:44.404294 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet ea66da5bc20e4718901ffc473677421c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea66da5bc20e4718901ffc473677421c already in progress: creating tablet
I20260810 11:30:44.404651 29110 raft_consensus.cc:2229] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:44.404889 29110 pending_rounds.cc:62] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215: Trying to abort 1 pending ops.
I20260810 11:30:44.404939 29110 pending_rounds.cc:68] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936472706523136 op_type: NO_OP noop_request { }
I20260810 11:30:44.405061 29110 raft_consensus.cc:2866] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:44.405143 29110 raft_consensus.cc:2258] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:44.404915 27228 tablet_bootstrap.cc:492] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:44.405447 27228 ts_tablet_manager.cc:1397] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.071s user 0.002s sys 0.004s
I20260810 11:30:44.409821 29110 ts_tablet_manager.cc:1905] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:44.410375 27231 tablet_bootstrap.cc:654] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.422271 27231 tablet_bootstrap.cc:492] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:44.422472 27231 ts_tablet_manager.cc:1397] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.003s
I20260810 11:30:44.423650 27231 raft_consensus.cc:348] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.424049 27231 raft_consensus.cc:374] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.424109 27231 raft_consensus.cc:729] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.424456 27231 consensus_queue.cc:260] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.428452 27231 ts_tablet_manager.cc:1428] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260810 11:30:44.428965 27231 tablet_bootstrap.cc:492] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:44.431486 27231 tablet_bootstrap.cc:654] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.432789 28987 ts_tablet_manager.cc:1905] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:44.434579 29110 ts_tablet_manager.cc:1918] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:44.440029 29110 log.cc:1196] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/809b5b6b65d244cd9186517e39494839
I20260810 11:30:44.441062 29110 ts_tablet_manager.cc:1939] T 809b5b6b65d244cd9186517e39494839 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:44.442219 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 78) took 1507 ms. Trace:
I20260810 11:30:44.443308 29110 rpcz_store.cc:276] 0810 11:30:42.934555 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.934597 (+ 42us) service_pool.cc:227] Handling call
0810 11:30:44.404138 (+1469541us) ts_tablet_manager.cc:1145] Deleting tablet 809b5b6b65d244cd9186517e39494839
0810 11:30:44.404149 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.414301 (+ 10152us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.434471 (+ 20170us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.442200 (+ 7729us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1469359}
I20260810 11:30:44.444017 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 809b5b6b65d244cd9186517e39494839 (table default.Table_8a7d3a80b9424a56a1b4583e39cadf99 [id=072a54ad9981451c9a5004a46fecd6c1]) successfully deleted
I20260810 11:30:44.444109 29110 tablet_replica.cc:330] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:44.444327 29110 raft_consensus.cc:2229] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:44.444491 29110 raft_consensus.cc:2258] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:44.445081 29110 ts_tablet_manager.cc:1905] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:44.448724 27228 raft_consensus.cc:348] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.449045 27228 raft_consensus.cc:374] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.449136 27228 raft_consensus.cc:729] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.449527 27228 consensus_queue.cc:260] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.450249 27228 ts_tablet_manager.cc:1428] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.045s user 0.002s sys 0.000s
I20260810 11:30:44.461274 27228 tablet_bootstrap.cc:492] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:44.461787 26914 raft_consensus.cc:3037] T f8e6fc49f5e54f6c8fb710220a6cbf0f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:44.464736 27228 tablet_bootstrap.cc:654] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.471503 28987 ts_tablet_manager.cc:1918] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:44.475162 29110 ts_tablet_manager.cc:1918] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:44.477198 29178 consensus_queue.cc:1035] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:44.477463 29110 log.cc:1196] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/7e78fb1bf0534deca5cc5a603fd77592
I20260810 11:30:44.478050 29110 ts_tablet_manager.cc:1939] T 7e78fb1bf0534deca5cc5a603fd77592 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:44.479140 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 80) took 1530 ms. Trace:
I20260810 11:30:44.480453 26881 tablet_service.cc:1467] Processing CreateTablet for tablet c8c9267e2da64738b5f7550c83b7c4a3 (DEFAULT_TABLE table=default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.481112 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8c9267e2da64738b5f7550c83b7c4a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.481403 29110 rpcz_store.cc:276] 0810 11:30:42.948916 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.948995 (+ 79us) service_pool.cc:227] Handling call
0810 11:30:44.444060 (+1495065us) ts_tablet_manager.cc:1145] Deleting tablet 7e78fb1bf0534deca5cc5a603fd77592
0810 11:30:44.444072 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.453894 (+ 9822us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.474968 (+ 21074us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.479118 (+ 4150us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1494751}
I20260810 11:30:44.482367 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 7e78fb1bf0534deca5cc5a603fd77592 (table default.Table_3d15fcde44db49a7ba17fd166381299f [id=e88ac45e937f49b2a8be4256d1a7279e]) successfully deleted
I20260810 11:30:44.482466 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 81) took 1533 ms. Trace:
I20260810 11:30:44.489507 27038 tablet_service.cc:1467] Processing CreateTablet for tablet c8c9267e2da64738b5f7550c83b7c4a3 (DEFAULT_TABLE table=default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.490341 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8c9267e2da64738b5f7550c83b7c4a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.500936 28753 consensus_queue.cc:1035] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:44.507658 27231 tablet_bootstrap.cc:492] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:44.507861 27231 ts_tablet_manager.cc:1397] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.023s
I20260810 11:30:44.508678 27231 raft_consensus.cc:348] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.508931 27231 raft_consensus.cc:374] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.508994 27231 raft_consensus.cc:729] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.509258 27231 consensus_queue.cc:260] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.511119 27231 ts_tablet_manager.cc:1428] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 11:30:44.511505 27231 tablet_bootstrap.cc:492] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:44.514114 27231 tablet_bootstrap.cc:654] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.514146 27228 tablet_bootstrap.cc:492] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:44.514477 27228 ts_tablet_manager.cc:1397] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.053s user 0.001s sys 0.004s
I20260810 11:30:44.515475 27228 raft_consensus.cc:348] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.515779 27228 raft_consensus.cc:374] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.515869 27228 raft_consensus.cc:729] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.516145 27228 consensus_queue.cc:260] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.516856 27228 ts_tablet_manager.cc:1428] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 11:30:44.517249 27228 tablet_bootstrap.cc:492] T d560157da0624333b91a18481b058f91 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:44.518632 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:44.475441 27222 tablet_bootstrap.cc:492] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:44.519054 27222 ts_tablet_manager.cc:1397] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.149s user 0.004s sys 0.000s
I20260810 11:30:44.520016 27228 tablet_bootstrap.cc:654] T d560157da0624333b91a18481b058f91 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.519934 27222 raft_consensus.cc:348] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.520164 27222 raft_consensus.cc:374] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.520219 27222 raft_consensus.cc:729] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.520452 27222 consensus_queue.cc:260] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.488461 26743 tablet_service.cc:1467] Processing CreateTablet for tablet c8c9267e2da64738b5f7550c83b7c4a3 (DEFAULT_TABLE table=default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:44.521106 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8c9267e2da64738b5f7550c83b7c4a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:44.525926 27222 ts_tablet_manager.cc:1428] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260810 11:30:44.526443 27222 tablet_bootstrap.cc:492] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:44.530170 27231 tablet_bootstrap.cc:492] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:44.530336 27231 ts_tablet_manager.cc:1397] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.005s
I20260810 11:30:44.531121 27231 raft_consensus.cc:348] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.531364 27231 raft_consensus.cc:374] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.531421 27231 raft_consensus.cc:729] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.531675 27231 consensus_queue.cc:260] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.532208 27231 ts_tablet_manager.cc:1428] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:44.532487 27231 tablet_bootstrap.cc:492] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:44.535236 27222 tablet_bootstrap.cc:654] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.536283 28987 log.cc:1196] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/420ba6e9f74c4ae5bf450f369e7fbdb3
I20260810 11:30:44.536908 27231 tablet_bootstrap.cc:654] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.538226 28728 consensus_queue.cc:1035] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:44.542081 27228 tablet_bootstrap.cc:492] T d560157da0624333b91a18481b058f91 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:44.542289 27228 ts_tablet_manager.cc:1397] T d560157da0624333b91a18481b058f91 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.004s
I20260810 11:30:44.543274 27228 raft_consensus.cc:348] T d560157da0624333b91a18481b058f91 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.543496 27228 raft_consensus.cc:374] T d560157da0624333b91a18481b058f91 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.543553 27228 raft_consensus.cc:729] T d560157da0624333b91a18481b058f91 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.547940 28987 ts_tablet_manager.cc:1939] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:44.549639 27228 consensus_queue.cc:260] T d560157da0624333b91a18481b058f91 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.551453 27228 ts_tablet_manager.cc:1428] T d560157da0624333b91a18481b058f91 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260810 11:30:44.551873 27228 tablet_bootstrap.cc:492] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:44.554612 27231 tablet_bootstrap.cc:492] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:44.554847 27231 ts_tablet_manager.cc:1397] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.002s
I20260810 11:30:44.555603 27231 raft_consensus.cc:348] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.555831 27231 raft_consensus.cc:374] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.555882 27231 raft_consensus.cc:729] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.556138 27231 consensus_queue.cc:260] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.556957 27231 ts_tablet_manager.cc:1428] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 11:30:44.557291 27231 tablet_bootstrap.cc:492] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:44.558786 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 100) took 2616 ms. Trace:
I20260810 11:30:44.559971 27228 tablet_bootstrap.cc:654] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.565261 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:44.566035 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:44.566884 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:44.567654 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:44.568475 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:44.568888 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d1d0d55b526749059470504a27887b22 (table default.Table_a164cd4bbc4344ae905f395ab1e6cffb [id=62f404c62e4040fc801f70cafddf9d95]). Expected version 1 got 0
I20260810 11:30:44.569116 28987 rpcz_store.cc:276] 0810 11:30:41.942569 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.942671 (+ 102us) service_pool.cc:227] Handling call
0810 11:30:44.360900 (+2418229us) ts_tablet_manager.cc:1145] Deleting tablet 420ba6e9f74c4ae5bf450f369e7fbdb3
0810 11:30:44.360916 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.467470 (+106554us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.471328 (+ 3858us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.558750 (+ 87422us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2402999}
I20260810 11:30:44.569692 28987 tablet_replica.cc:330] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:44.570007 28987 raft_consensus.cc:2229] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:44.570906 28987 raft_consensus.cc:2258] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:44.571749 28987 ts_tablet_manager.cc:1905] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:44.590430 27222 tablet_bootstrap.cc:492] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:44.590792 27222 ts_tablet_manager.cc:1397] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.064s user 0.008s sys 0.000s
I20260810 11:30:44.591609 27222 raft_consensus.cc:348] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.592005 27222 raft_consensus.cc:374] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.592152 27222 raft_consensus.cc:729] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.594607 28726 consensus_queue.cc:1035] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:44.596374 27231 tablet_bootstrap.cc:654] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.570117 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 (table default.Table_4e27e43aa8d9444ca022be053fcd700e [id=b6297673b9854cf79ae182f5f51ebd36]) successfully deleted
I20260810 11:30:44.601837 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:44.602278 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:44.603214 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:44.604773 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:44.609819 27222 consensus_queue.cc:260] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.610570 27222 ts_tablet_manager.cc:1428] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260810 11:30:44.611066 27222 tablet_bootstrap.cc:492] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:44.489368 29110 rpcz_store.cc:276] 0810 11:30:42.949082 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.949136 (+ 54us) service_pool.cc:227] Handling call
0810 11:30:44.482326 (+1533190us) ts_tablet_manager.cc:1145] Deleting tablet 7c203cd90d2f472fa27cfabed5b87119
0810 11:30:44.482340 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.482448 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":99,"tablet-delete.queue_time_us":1532962}
W20260810 11:30:44.616389 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7c203cd90d2f472fa27cfabed5b87119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c203cd90d2f472fa27cfabed5b87119 already in progress: creating tablet
I20260810 11:30:44.616882 28728 raft_consensus.cc:482] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.617127 28728 raft_consensus.cc:504] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.618119 27231 tablet_bootstrap.cc:492] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:44.618263 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "372b49dc083d46538442fcbfdfeb3545" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:44.618376 27231 ts_tablet_manager.cc:1397] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.010s
W20260810 11:30:44.618831 26700 leader_election.cc:341] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.618866 28728 leader_election.cc:288] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:44.620201 27222 tablet_bootstrap.cc:654] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.621565 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 82) took 1671 ms. Trace:
I20260810 11:30:44.621929 29110 rpcz_store.cc:276] 0810 11:30:42.949624 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.950106 (+ 482us) service_pool.cc:227] Handling call
0810 11:30:44.616142 (+1666036us) ts_tablet_manager.cc:1145] Deleting tablet 23637a02b6464e17aa2a69ea5cc4ddfe
0810 11:30:44.621452 (+ 5310us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.621543 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1665799}
I20260810 11:30:44.623116 29110 tablet_replica.cc:330] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:44.623440 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 23637a02b6464e17aa2a69ea5cc4ddfe because the tablet was not found. No further retry: Not found: Tablet not found: 23637a02b6464e17aa2a69ea5cc4ddfe
I20260810 11:30:44.623936 29110 raft_consensus.cc:2229] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:44.622941 28728 raft_consensus.cc:482] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.624656 28728 raft_consensus.cc:504] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.625710 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5deec04c1be64473accf8b9df14bd22e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:44.626359 26700 leader_election.cc:341] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.626961 28728 leader_election.cc:288] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:44.628050 29110 raft_consensus.cc:2258] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:44.629560 27222 tablet_bootstrap.cc:492] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:44.629748 27222 ts_tablet_manager.cc:1397] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.002s
I20260810 11:30:44.630318 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:44.630635 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:44.630749 27222 raft_consensus.cc:348] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.631155 27222 raft_consensus.cc:374] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.631242 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:44.631276 27222 raft_consensus.cc:729] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.631537 27222 consensus_queue.cc:260] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.633157 27222 ts_tablet_manager.cc:1428] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:44.634099 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:44.634567 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "372b49dc083d46538442fcbfdfeb3545" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:44.634681 27048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5deec04c1be64473accf8b9df14bd22e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:44.634812 27055 raft_consensus.cc:2454] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:44.634837 27048 raft_consensus.cc:2454] T 5deec04c1be64473accf8b9df14bd22e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:44.634958 27231 raft_consensus.cc:348] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.635217 27231 raft_consensus.cc:374] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.635277 27231 raft_consensus.cc:729] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.635471 27231 consensus_queue.cc:260] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.636075 27231 ts_tablet_manager.cc:1428] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.018s user 0.000s sys 0.001s
I20260810 11:30:44.636452 27231 tablet_bootstrap.cc:492] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:44.638137 27231 tablet_bootstrap.cc:654] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.638588 29110 ts_tablet_manager.cc:1905] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:44.641566 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:44.646911 27231 tablet_bootstrap.cc:492] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:44.647145 27231 ts_tablet_manager.cc:1397] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260810 11:30:44.647491 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:44.647816 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:44.648041 27231 raft_consensus.cc:348] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.648350 27231 raft_consensus.cc:374] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.648439 27231 raft_consensus.cc:729] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.648674 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:44.648782 27231 consensus_queue.cc:260] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.649631 27231 ts_tablet_manager.cc:1428] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 11:30:44.649631 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:44.635543 26702 leader_election.cc:302] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:44.641103 28987 ts_tablet_manager.cc:1918] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260810 11:30:44.638825 26700 consensus_peers.cc:487] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1aa4562a2247405187d9dbd1baa48f39. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:44.652318 26702 leader_election.cc:302] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:44.652400 28987 log.cc:1196] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/10210204d5ff4e5e97c98fd255f674a5
I20260810 11:30:44.652714 28726 raft_consensus.cc:2781] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:44.652805 28726 raft_consensus.cc:482] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:44.652878 28726 raft_consensus.cc:3037] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:44.653188 28987 ts_tablet_manager.cc:1939] T 10210204d5ff4e5e97c98fd255f674a5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:44.654142 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 101) took 2711 ms. Trace:
I20260810 11:30:44.654297 28987 rpcz_store.cc:276] 0810 11:30:41.942688 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.942746 (+ 58us) service_pool.cc:227] Handling call
0810 11:30:44.569621 (+2626875us) ts_tablet_manager.cc:1145] Deleting tablet 10210204d5ff4e5e97c98fd255f674a5
0810 11:30:44.569638 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.575567 (+ 5929us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.640967 (+ 65400us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.654115 (+ 13148us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2611676}
I20260810 11:30:44.654677 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:44.655282 28987 tablet_replica.cc:330] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:44.655149 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 10210204d5ff4e5e97c98fd255f674a5 (table default.Table_4d9bc84fc41e4b87ac2f6432852e5d61 [id=9b708c86ff534253961e7c29909eb1bd]) successfully deleted
I20260810 11:30:44.655730 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:44.655804 28726 raft_consensus.cc:504] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.656414 28726 leader_election.cc:288] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:44.656670 28987 raft_consensus.cc:2229] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:44.657079 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5deec04c1be64473accf8b9df14bd22e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:44.657792 28987 raft_consensus.cc:2258] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:44.657855 26700 leader_election.cc:341] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.659065 27048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5deec04c1be64473accf8b9df14bd22e" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:44.659276 27048 raft_consensus.cc:3037] T 5deec04c1be64473accf8b9df14bd22e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:44.660706 26702 consensus_peers.cc:487] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1aa4562a2247405187d9dbd1baa48f39. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:44.657963 28726 raft_consensus.cc:2781] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:44.660961 28726 raft_consensus.cc:482] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:44.661093 28726 raft_consensus.cc:3037] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:44.662202 27048 raft_consensus.cc:2454] T 5deec04c1be64473accf8b9df14bd22e P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:44.662815 26702 leader_election.cc:302] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:44.663327 28640 raft_consensus.cc:2781] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:44.663457 28640 raft_consensus.cc:686] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:44.663715 28640 consensus_queue.cc:237] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.667671 28726 raft_consensus.cc:504] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.670885 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "372b49dc083d46538442fcbfdfeb3545" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:44.671238 28726 leader_election.cc:288] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:44.671504 26700 leader_election.cc:341] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.671777 27048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "372b49dc083d46538442fcbfdfeb3545" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:44.672065 27048 raft_consensus.cc:3037] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:44.673487 28987 ts_tablet_manager.cc:1905] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:44.677186 26580 catalog_manager.cc:5495] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:44.676961 26821 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:44.682806 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:44.678620 27048 raft_consensus.cc:2454] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:44.634284 27222 tablet_bootstrap.cc:492] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:44.684049 26702 leader_election.cc:302] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:44.684608 28726 raft_consensus.cc:2781] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:44.684906 28726 raft_consensus.cc:686] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:44.685220 28726 consensus_queue.cc:237] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.686038 27222 tablet_bootstrap.cc:654] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.686219 29178 raft_consensus.cc:482] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.686383 29178 raft_consensus.cc:504] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.687047 29178 leader_election.cc:288] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:44.687817 26760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40f5eecfc66a4711aef60c1a2bff6b97" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:44.687892 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40f5eecfc66a4711aef60c1a2bff6b97" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:44.688522 26993 leader_election.cc:341] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:44.689153 26991 leader_election.cc:341] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.689258 26991 leader_election.cc:302] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:44.689450 29178 raft_consensus.cc:2726] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:44.693037 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:44.693490 26580 catalog_manager.cc:5495] T add1743851c34d58afb7e4886325d659 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:44.694494 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:44.695711 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:44.697086 27231 tablet_bootstrap.cc:492] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:44.699384 27231 tablet_bootstrap.cc:654] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:44.702215 26993 consensus_peers.cc:487] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a63227e69df14a4ea935087fd31ece63. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:44.702641 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet fccc21cfc1ce4eb586f03276ec6e987f (table default.Table_65da57b4be754a5b9cbc73361a4f1b93 [id=e22f19a993564e53b1cc76633f25f505]). Expected version 1 got 0
I20260810 11:30:44.703011 27228 tablet_bootstrap.cc:492] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:44.703269 27228 ts_tablet_manager.cc:1397] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.151s user 0.030s sys 0.049s
I20260810 11:30:44.703261 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:44.703822 29110 ts_tablet_manager.cc:1918] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:44.703974 29110 log.cc:1196] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/110b5acc36bd4d6bba13735e5daec75f
I20260810 11:30:44.704325 29110 ts_tablet_manager.cc:1939] T 110b5acc36bd4d6bba13735e5daec75f P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:44.704439 27228 raft_consensus.cc:348] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.704847 27228 raft_consensus.cc:374] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.708365 27228 raft_consensus.cc:729] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.708813 27228 consensus_queue.cc:260] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.720296 26908 raft_consensus.cc:3037] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:44.724262 27222 tablet_bootstrap.cc:492] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:44.724371 29123 consensus_queue.cc:1035] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:44.724547 27222 ts_tablet_manager.cc:1397] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.090s user 0.004s sys 0.000s
I20260810 11:30:44.725596 27222 raft_consensus.cc:348] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.725878 27222 raft_consensus.cc:374] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.725960 27222 raft_consensus.cc:729] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.726603 27222 consensus_queue.cc:260] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.727298 27222 ts_tablet_manager.cc:1428] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:44.732024 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 83) took 1776 ms. Trace:
I20260810 11:30:44.733331 29110 rpcz_store.cc:276] 0810 11:30:42.955925 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.955979 (+ 54us) service_pool.cc:227] Handling call
0810 11:30:44.623062 (+1667083us) ts_tablet_manager.cc:1145] Deleting tablet 110b5acc36bd4d6bba13735e5daec75f
0810 11:30:44.623073 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.641857 (+ 18784us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.703710 (+ 61853us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.731990 (+ 28280us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7334,"tablet-delete.queue_time_us":1666756}
I20260810 11:30:44.703994 26580 catalog_manager.cc:5495] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:44.739773 29086 raft_consensus.cc:482] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.740000 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 84) took 1783 ms. Trace:
I20260810 11:30:44.740005 29086 raft_consensus.cc:504] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.740131 29110 rpcz_store.cc:276] 0810 11:30:42.957031 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.957081 (+ 50us) service_pool.cc:227] Handling call
0810 11:30:44.739787 (+1782706us) ts_tablet_manager.cc:1145] Deleting tablet 518c777e40ec40dcb3484c0374384959
0810 11:30:44.739808 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.739971 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1782365}
I20260810 11:30:44.740741 29086 leader_election.cc:288] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:44.742072 29110 tablet_replica.cc:330] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:44.728773 27222 tablet_bootstrap.cc:492] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:44.739411 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 110b5acc36bd4d6bba13735e5daec75f (table default.Table_24bdc44050024c23aa90a182bdcecb50 [id=4ea7ee58aac74fba84dbbcc009017421]) successfully deleted
I20260810 11:30:44.743422 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
W20260810 11:30:44.743563 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 518c777e40ec40dcb3484c0374384959 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 518c777e40ec40dcb3484c0374384959 already in progress: creating tablet
I20260810 11:30:44.744421 26573 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet e69916a35fba4714bbc565921738888f
I20260810 11:30:44.744501 26575 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_51a0b22255e14dd996d464ccf6176c70 [id=5335295210c1486e927e4228ccdb1de0] alter complete (version 4)
I20260810 11:30:44.745054 26573 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 149) took 4141 ms. Trace:
I20260810 11:30:44.745203 26573 rpcz_store.cc:276] 0810 11:30:40.603267 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.635321 (+2032054us) service_pool.cc:227] Handling call
0810 11:30:42.636119 (+ 798us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:42.636291 (+ 172us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:42.636359 (+ 68us) catalog_manager.cc:2761] Locking tablets
0810 11:30:42.636515 (+ 156us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:42.665933 (+ 29418us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:42.666997 (+ 1064us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:44.744356 (+2077359us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:44.744980 (+ 624us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.637707 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.637856 (+ 149us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.637863 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:42.637865 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:42.638026 (+ 161us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.638044 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.638051 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.638201 (+ 150us) tablet.cc:699] Row locks acquired
0810 11:30:42.638205 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:42.638256 (+ 51us) write_op.cc:270] Start()
0810 11:30:42.638302 (+ 46us) write_op.cc:276] Timestamp: P: 1786361442638227 usec, L: 0
0810 11:30:42.638307 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.638567 (+ 260us) log.cc:842] Serialized 734 byte log entry
0810 11:30:42.643393 (+ 4826us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.643547 (+ 154us) write_op.cc:301] APPLY: starting
0810 11:30:42.643578 (+ 31us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.643630 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.643707 (+ 77us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.643815 (+ 108us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.643858 (+ 43us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:42.643865 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:42.643972 (+ 107us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.644085 (+ 113us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.644110 (+ 25us) write_op.cc:454] Released schema lock
0810 11:30:42.644118 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:42.644186 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.644190 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":100,"apply.run_cpu_time_us":703,"apply.run_wall_time_us":703,"num_ops":2,"prepare.queue_time_us":356,"prepare.run_cpu_time_us":1036,"prepare.run_wall_time_us":1637,"raft.queue_time_us":189,"raft.run_cpu_time_us":402,"raft.run_wall_time_us":401,"replication_time_us":5058}]]}
I20260810 11:30:44.748638 26578 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_5ba00bd0ab7d4cdcb1494f9491c64291 [id=5c8a2cbef71f4c9fb038a49e1ca7f704] alter complete (version 2)
I20260810 11:30:44.756054 26577 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet d4873fe8318040a2b7e021708a875f43
I20260810 11:30:44.756085 27228 ts_tablet_manager.cc:1428] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.052s user 0.002s sys 0.000s
I20260810 11:30:44.756939 26577 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 148) took 4174 ms. Trace:
I20260810 11:30:44.757346 26577 rpcz_store.cc:276] 0810 11:30:40.582587 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.536718 (+1954131us) service_pool.cc:227] Handling call
0810 11:30:42.687854 (+151136us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:42.688089 (+ 235us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:42.688146 (+ 57us) catalog_manager.cc:2761] Locking tablets
0810 11:30:42.688315 (+ 169us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:42.705835 (+ 17520us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:42.705955 (+ 120us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:44.755998 (+2050043us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:44.756610 (+ 612us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.689186 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.689300 (+ 114us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.689306 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:42.689309 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:42.689454 (+ 145us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.689483 (+ 29us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.689488 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.689614 (+ 126us) tablet.cc:699] Row locks acquired
0810 11:30:42.689619 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:42.689665 (+ 46us) write_op.cc:270] Start()
0810 11:30:42.689702 (+ 37us) write_op.cc:276] Timestamp: P: 1786361442689635 usec, L: 0
0810 11:30:42.689707 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.689889 (+ 182us) log.cc:842] Serialized 774 byte log entry
0810 11:30:42.704871 (+ 14982us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.705160 (+ 289us) write_op.cc:301] APPLY: starting
0810 11:30:42.705182 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.705236 (+ 54us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.705268 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.705358 (+ 90us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.705403 (+ 45us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:42.705409 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:42.705509 (+ 100us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.705586 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.705612 (+ 26us) write_op.cc:454] Released schema lock
0810 11:30:42.705620 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:42.705692 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.705696 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":213,"apply.run_cpu_time_us":606,"apply.run_wall_time_us":605,"num_ops":2,"prepare.queue_time_us":46,"prepare.run_cpu_time_us":814,"prepare.run_wall_time_us":815,"raft.queue_time_us":66,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":15133}]]}
I20260810 11:30:44.760722 26574 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet d08250001e1542f9978bc6f89ace458b
I20260810 11:30:44.761143 27228 tablet_bootstrap.cc:492] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:44.761171 26574 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 151) took 4148 ms. Trace:
I20260810 11:30:44.761292 26574 rpcz_store.cc:276] 0810 11:30:40.613117 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.657930 (+2044813us) service_pool.cc:227] Handling call
0810 11:30:42.689040 (+ 31110us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:42.690607 (+ 1567us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:42.690684 (+ 77us) catalog_manager.cc:2761] Locking tablets
0810 11:30:42.690828 (+ 144us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:42.741525 (+ 50697us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.741536 (+ 11us) write_op.cc:454] Released schema lock
0810 11:30:42.793286 (+ 51750us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:42.795331 (+ 2045us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:44.760636 (+1965305us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:44.761134 (+ 498us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.725987 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.726203 (+ 216us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.726215 (+ 12us) write_op.cc:435] Acquired schema lock
0810 11:30:42.726220 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:42.726420 (+ 200us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.726444 (+ 24us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.726453 (+ 9us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.726635 (+ 182us) tablet.cc:699] Row locks acquired
0810 11:30:42.726640 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:42.726694 (+ 54us) write_op.cc:270] Start()
0810 11:30:42.726745 (+ 51us) write_op.cc:276] Timestamp: P: 1786361442726658 usec, L: 0
0810 11:30:42.726752 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.727094 (+ 342us) log.cc:842] Serialized 734 byte log entry
0810 11:30:42.735577 (+ 8483us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.735769 (+ 192us) write_op.cc:301] APPLY: starting
0810 11:30:42.735793 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.735857 (+ 64us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.735910 (+ 53us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.736013 (+ 103us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.736080 (+ 67us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:42.736091 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:42.736203 (+ 112us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.736288 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.736314 (+ 26us) write_op.cc:454] Released schema lock
0810 11:30:42.736326 (+ 12us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":124,"apply.run_cpu_time_us":637,"apply.run_wall_time_us":636,"num_ops":2,"prepare.queue_time_us":34415,"prepare.run_cpu_time_us":1296,"prepare.run_wall_time_us":1813,"raft.queue_time_us":360,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":412,"replication_time_us":8789}]]}
I20260810 11:30:44.762465 26574 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_2c7697ec19204b3d823f5684c30978e2" } new_table_name: "default.Table_6abaa68586814b00811cc1b2211bd8ed" modify_external_catalogs: true
I20260810 11:30:44.763994 26571 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet b945038c03e343489af6ae7e50131d97
I20260810 11:30:44.764420 26571 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 155) took 3966 ms. Trace:
I20260810 11:30:44.764513 26571 rpcz_store.cc:276] 0810 11:30:40.798221 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.745923 (+1947702us) service_pool.cc:227] Handling call
0810 11:30:42.746604 (+ 681us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:42.746812 (+ 208us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:42.746898 (+ 86us) catalog_manager.cc:2761] Locking tablets
0810 11:30:42.747104 (+ 206us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:42.768792 (+ 21688us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:42.768889 (+ 97us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:44.763944 (+1995055us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:44.764353 (+ 409us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.752245 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.752417 (+ 172us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.752429 (+ 12us) write_op.cc:435] Acquired schema lock
0810 11:30:42.752433 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:42.752645 (+ 212us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.752668 (+ 23us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.752675 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.752837 (+ 162us) tablet.cc:699] Row locks acquired
0810 11:30:42.752841 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:42.752896 (+ 55us) write_op.cc:270] Start()
0810 11:30:42.752948 (+ 52us) write_op.cc:276] Timestamp: P: 1786361442752857 usec, L: 0
0810 11:30:42.752955 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.753247 (+ 292us) log.cc:842] Serialized 734 byte log entry
0810 11:30:42.767806 (+ 14559us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.767927 (+ 121us) write_op.cc:301] APPLY: starting
0810 11:30:42.767948 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.767995 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.768020 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.768138 (+ 118us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.768175 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:42.768180 (+ 5us) write_op.cc:312] APPLY: finished
0810 11:30:42.768259 (+ 79us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.768321 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.768340 (+ 19us) write_op.cc:454] Released schema lock
0810 11:30:42.768347 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:42.768404 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.768410 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":59,"apply.run_cpu_time_us":552,"apply.run_wall_time_us":553,"num_ops":2,"prepare.queue_time_us":4186,"prepare.run_cpu_time_us":1173,"prepare.run_wall_time_us":3147,"raft.queue_time_us":140,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":14820}]]}
I20260810 11:30:44.765403 26571 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_7fdd2b7a6d02462b92ed03909ab16141" } new_table_name: "default.Table_c165e15433ec4785bfa7365a319f4c60" modify_external_catalogs: true
I20260810 11:30:44.770643 27228 tablet_bootstrap.cc:654] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:44.771167 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet d4873fe8318040a2b7e021708a875f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:44.771565 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet b945038c03e343489af6ae7e50131d97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:44.771852 29086 raft_consensus.cc:482] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.771925 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet e69916a35fba4714bbc565921738888f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:44.772109 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet d08250001e1542f9978bc6f89ace458b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:44.772017 29086 raft_consensus.cc:504] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.772836 29086 leader_election.cc:288] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:44.779414 26575 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_7a4ecd0031184ff1907aafdfb64b2085 [id=b206753d4f4142be82ee28150226bd53] alter complete (version 2)
I20260810 11:30:44.804917 26908 raft_consensus.cc:3037] T 490ada0a918d48c3a07e12eed58bda19 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:44.815696 26963 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:44.822481 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:44.824235 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet fc558690dce44e999e55e9bf1b6ca172 with delete_type TABLET_DATA_DELETED (replaced by tablet 0bb01711769f457aa0696bb59582166d) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:44.825168 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 1860e56467624dcdb288e13b004f78cc with delete_type TABLET_DATA_DELETED (replaced by tablet 214be3356fda4c8484596196c0985721) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:44.855155 26571 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2acbbbd72845428384d65c8c423c0db6 consensus state has no leader
I20260810 11:30:44.856253 26571 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 168) took 3128 ms. Trace:
I20260810 11:30:44.856729 26571 rpcz_store.cc:276] 0810 11:30:41.727777 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.765215 (+3037438us) service_pool.cc:227] Handling call
0810 11:30:44.765589 (+ 374us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:44.765791 (+ 202us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:44.766022 (+ 231us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:44.766107 (+ 85us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:44.854769 (+ 88662us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:44.856054 (+ 1285us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:44.842290 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:44.842391 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:44.842396 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:44.842399 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:44.842505 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:44.842514 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:44.842518 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:44.842566 (+ 48us) tablet.cc:699] Row locks acquired
0810 11:30:44.842569 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:44.842597 (+ 28us) write_op.cc:270] Start()
0810 11:30:44.842623 (+ 26us) write_op.cc:276] Timestamp: P: 1786361444842549 usec, L: 0
0810 11:30:44.842627 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:44.842869 (+ 242us) log.cc:842] Serialized 405 byte log entry
0810 11:30:44.853564 (+ 10695us) op_driver.cc:444] REPLICATION: finished
0810 11:30:44.854330 (+ 766us) write_op.cc:301] APPLY: starting
0810 11:30:44.854387 (+ 57us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:44.854417 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:44.854441 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:44.854475 (+ 34us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:44.854501 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:44.854508 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:44.854556 (+ 48us) log.cc:842] Serialized 23 byte log entry
0810 11:30:44.854591 (+ 35us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:44.854606 (+ 15us) write_op.cc:454] Released schema lock
0810 11:30:44.854611 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:44.854657 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:44.854661 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":739,"apply.run_cpu_time_us":367,"apply.run_wall_time_us":367,"mutex_wait_us":74857,"num_ops":1,"prepare.queue_time_us":75745,"prepare.run_cpu_time_us":692,"prepare.run_wall_time_us":692,"raft.queue_time_us":152,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":2,"replication_time_us":10922,"threads_started":1}]]}
I20260810 11:30:44.889729 26571 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_09ff2cfcae6d4c1b96479fd190b3c084" } new_table_name: "default.Table_eb5718a38c5c40bb81705b1a1e420f90" modify_external_catalogs: true
W20260810 11:30:44.872493 26574 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b607279006c4baeae79325926088014 consensus state has no leader
I20260810 11:30:44.891752 26574 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 167) took 3172 ms. Trace:
I20260810 11:30:44.891944 26574 rpcz_store.cc:276] 0810 11:30:41.719250 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.762254 (+3043004us) service_pool.cc:227] Handling call
0810 11:30:44.762724 (+ 470us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:44.762970 (+ 246us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:44.763180 (+ 210us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:44.763347 (+ 167us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:44.869870 (+106523us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:44.891710 (+ 21840us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:44.841456 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:44.841624 (+ 168us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:44.841631 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:44.841634 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:44.841732 (+ 98us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:44.841743 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:44.841748 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:44.841810 (+ 62us) tablet.cc:699] Row locks acquired
0810 11:30:44.841812 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:44.841851 (+ 39us) write_op.cc:270] Start()
0810 11:30:44.841894 (+ 43us) write_op.cc:276] Timestamp: P: 1786361444841800 usec, L: 0
0810 11:30:44.841898 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:44.842154 (+ 256us) log.cc:842] Serialized 405 byte log entry
0810 11:30:44.853480 (+ 11326us) op_driver.cc:444] REPLICATION: finished
0810 11:30:44.853800 (+ 320us) write_op.cc:301] APPLY: starting
0810 11:30:44.853819 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:44.853864 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:44.853903 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:44.853961 (+ 58us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:44.853999 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:44.854006 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:44.854093 (+ 87us) log.cc:842] Serialized 23 byte log entry
0810 11:30:44.854158 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:44.854178 (+ 20us) write_op.cc:454] Released schema lock
0810 11:30:44.854186 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:44.854243 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:44.854247 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":260,"apply.run_cpu_time_us":503,"apply.run_wall_time_us":502,"mutex_wait_us":77407,"num_ops":1,"prepare.queue_time_us":77556,"prepare.run_cpu_time_us":812,"prepare.run_wall_time_us":813,"raft.queue_time_us":792,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":4,"replication_time_us":11538}]]}
I20260810 11:30:44.893657 26574 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_f3567f07068942e9a5d42f9877f39bb7" } modify_external_catalogs: true
I20260810 11:30:44.893961 26574 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_f3567f07068942e9a5d42f9877f39bb7" } modify_external_catalogs: true
I20260810 11:30:44.886199 26572 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_d131ea1f8baf4495af3322c319b9b4e1 [id=1c6a2d6a4fa2472a9aff02fecc10077a] alter complete (version 2)
I20260810 11:30:44.915374 29086 raft_consensus.cc:482] T 490ada0a918d48c3a07e12eed58bda19 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.915575 29086 raft_consensus.cc:504] T 490ada0a918d48c3a07e12eed58bda19 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.916239 29086 leader_election.cc:288] T 490ada0a918d48c3a07e12eed58bda19 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:44.919872 29086 raft_consensus.cc:482] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.920106 29086 raft_consensus.cc:504] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.920969 29086 leader_election.cc:288] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:44.971693 26567 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2acbbbd72845428384d65c8c423c0db6 consensus state has no leader
I20260810 11:30:44.744913 27048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3e78dcaa55491393f529ea33007786" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:44.775027 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a22cdf7d273d427cb32b811aa5caa3a3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:44.975595 27055 raft_consensus.cc:2454] T a22cdf7d273d427cb32b811aa5caa3a3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:44.777527 27031 tablet_service.cc:1514] Processing DeleteTablet for tablet d4873fe8318040a2b7e021708a875f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.777761 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet e69916a35fba4714bbc565921738888f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.777894 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet d08250001e1542f9978bc6f89ace458b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.778007 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet b945038c03e343489af6ae7e50131d97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.802659 27033 tablet_service.cc:1514] Processing DeleteTablet for tablet fc558690dce44e999e55e9bf1b6ca172 with delete_type TABLET_DATA_DELETED (replaced by tablet 0bb01711769f457aa0696bb59582166d) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.803191 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 1860e56467624dcdb288e13b004f78cc with delete_type TABLET_DATA_DELETED (replaced by tablet 214be3356fda4c8484596196c0985721) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.803439 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d5e146eeec4fe0be33c1c169d32e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.809518 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet 10210204d5ff4e5e97c98fd255f674a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.809600 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 55c8749861874eca9b63d3db97afa2b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.812485 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.812765 27020 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.812922 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f24c84cdd945b78f39f24015eb1e43 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b95f3ec8ff34c89a68cd1edf8391f9b) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.830137 29123 raft_consensus.cc:482] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.980787 29123 raft_consensus.cc:504] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.981585 29123 leader_election.cc:288] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:44.844549 28753 raft_consensus.cc:482] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.981803 28753 raft_consensus.cc:504] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.982295 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6926d0dc68fa48ae8ffabf5b5272b3d0" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:44.982503 28753 leader_election.cc:288] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:44.982748 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 0713f4f14a284050a7774a70ab974f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:44.866699 29178 raft_consensus.cc:482] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.983135 29110 raft_consensus.cc:2229] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:44.983166 26991 leader_election.cc:341] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.983093 29178 raft_consensus.cc:504] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.983331 29110 raft_consensus.cc:2258] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:44.983700 29178 leader_election.cc:288] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:44.983759 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8083fa130cd04dae9d61aeed977c1c63" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:44.984158 29110 ts_tablet_manager.cc:1905] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:44.943041 29290 raft_consensus.cc:482] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.960878 27027 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.963529 27026 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.984464 29290 raft_consensus.cc:504] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.967631 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da86554bc51486e91f1ea5995a245b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.982326 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:44.985077 29290 leader_election.cc:288] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:44.972725 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet ee803ddf27594d2b9e19fe440fc269c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 82de53efa73447fe84e70dbb11a16a5f) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.972725 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b5a7f67ec5b48c2b5a510add0282a76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.973037 27036 tablet_service.cc:1514] Processing DeleteTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7acf847a1fd74ccc89b5bffe1bbb76f3) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:44.741580 26760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3e78dcaa55491393f529ea33007786" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:44.746953 28640 raft_consensus.cc:482] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.751452 28987 ts_tablet_manager.cc:1918] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:44.985873 28987 log.cc:1196] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/64818ca5827e41d99428903ddb8688d9
I20260810 11:30:44.986557 28987 ts_tablet_manager.cc:1939] T 64818ca5827e41d99428903ddb8688d9 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
W20260810 11:30:44.986755 26849 leader_election.cc:341] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.767513 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet e69916a35fba4714bbc565921738888f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:44.767720 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet d4873fe8318040a2b7e021708a875f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:44.767858 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet d08250001e1542f9978bc6f89ace458b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:44.771744 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet b945038c03e343489af6ae7e50131d97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:44.775326 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a22cdf7d273d427cb32b811aa5caa3a3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:44.987547 26768 raft_consensus.cc:2454] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:44.813649 28727 consensus_queue.cc:1035] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:44.987829 29086 raft_consensus.cc:482] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:44.916965 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "490ada0a918d48c3a07e12eed58bda19" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:44.988095 26991 leader_election.cc:341] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.922230 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "256ad2e2d8e54a4caa1b5091bab60dd5" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:44.987969 29086 raft_consensus.cc:504] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.985841 28640 raft_consensus.cc:504] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.989189 29086 leader_election.cc:288] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:44.989298 28640 leader_election.cc:288] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:44.943011 27231 tablet_bootstrap.cc:492] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:44.989720 27231 ts_tablet_manager.cc:1397] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.293s user 0.002s sys 0.002s
I20260810 11:30:44.989722 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34bd3c0edf6b49d1891c0ee9af344872" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:44.990573 27231 raft_consensus.cc:348] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:44.990841 27231 raft_consensus.cc:374] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:44.990922 27231 raft_consensus.cc:729] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:44.991250 26849 leader_election.cc:302] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:44.991201 27231 consensus_queue.cc:260] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:44.991693 26849 leader_election.cc:341] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.992102 27231 ts_tablet_manager.cc:1428] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:44.992620 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "809b5b6b65d244cd9186517e39494839" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:44.975477 28726 consensus_queue.cc:1035] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:44.992924 26767 raft_consensus.cc:2379] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
I20260810 11:30:44.993778 27231 tablet_bootstrap.cc:492] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
W20260810 11:30:44.993778 26991 leader_election.cc:341] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.994451 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 97) took 3052 ms. Trace:
I20260810 11:30:44.994566 28987 rpcz_store.cc:276] 0810 11:30:41.942122 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.942273 (+ 151us) service_pool.cc:227] Handling call
0810 11:30:44.654983 (+2712710us) ts_tablet_manager.cc:1145] Deleting tablet 64818ca5827e41d99428903ddb8688d9
0810 11:30:44.655237 (+ 254us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.734882 (+ 79645us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.751282 (+ 16400us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:44.994430 (+243148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6740,"tablet-delete.queue_time_us":2696929}
I20260810 11:30:44.995004 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 95) took 3053 ms. Trace:
I20260810 11:30:44.995239 28987 rpcz_store.cc:276] 0810 11:30:41.941706 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.943539 (+ 1833us) service_pool.cc:227] Handling call
0810 11:30:44.994873 (+3051334us) ts_tablet_manager.cc:1145] Deleting tablet 713663be70014b17b17056a865e7db63
0810 11:30:44.994889 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:44.994989 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3036694}
I20260810 11:30:44.995613 28987 tablet_replica.cc:330] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:44.995880 28987 raft_consensus.cc:2229] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:44.996290 28987 raft_consensus.cc:2258] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:44.997416 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afbe6ce99f7c4f7cb939bea086cd90be" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:44.998086 26991 leader_election.cc:341] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:44.999369 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d560157da0624333b91a18481b058f91" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:44.999678 26913 raft_consensus.cc:2454] T d560157da0624333b91a18481b058f91 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:45.000077 29059 raft_consensus.cc:2781] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:45.000157 29059 raft_consensus.cc:482] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:45.000219 29059 raft_consensus.cc:3037] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.002477 26700 leader_election.cc:302] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:45.003305 28726 raft_consensus.cc:2781] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:45.003428 28726 raft_consensus.cc:482] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:45.003517 28726 raft_consensus.cc:3037] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.006086 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.006723 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.007890 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d560157da0624333b91a18481b058f91" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:45.008203 27055 raft_consensus.cc:2454] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:45.009162 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 64818ca5827e41d99428903ddb8688d9 (table default.Table_fb7b13261243442c9c4d8749871c1d1a [id=926b5b59f3fc4de6baeac9dbfdeed8f5]) successfully deleted
W20260810 11:30:45.009738 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 713663be70014b17b17056a865e7db63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 713663be70014b17b17056a865e7db63 already in progress: creating tablet
I20260810 11:30:45.010390 28728 consensus_queue.cc:1035] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:45.011417 28987 ts_tablet_manager.cc:1905] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:45.013084 28640 consensus_queue.cc:1035] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:45.015012 28640 consensus_queue.cc:1035] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:45.020519 27110 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
W20260810 11:30:45.020720 26576 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.194:35117 (request call id 268) took 3681 ms (client timeout 1000 ms). Trace:
W20260810 11:30:45.020917 26576 rpcz_store.cc:269] 0810 11:30:41.339159 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.522391 (+183232us) service_pool.cc:227] Handling call
0810 11:30:45.020631 (+3498240us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.516860 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.516997 (+ 137us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.517004 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:42.517007 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:42.517166 (+ 159us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.517181 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.517186 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.517303 (+ 117us) tablet.cc:699] Row locks acquired
0810 11:30:42.517305 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:42.517365 (+ 60us) write_op.cc:270] Start()
0810 11:30:42.517405 (+ 40us) write_op.cc:276] Timestamp: P: 1786361442517338 usec, L: 0
0810 11:30:42.517410 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.517670 (+ 260us) log.cc:842] Serialized 919 byte log entry
0810 11:30:42.540063 (+ 22393us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.540414 (+ 351us) write_op.cc:301] APPLY: starting
0810 11:30:42.540436 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.540492 (+ 56us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.540540 (+ 48us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.540651 (+ 111us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.540694 (+ 43us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:42.540702 (+ 8us) write_op.cc:312] APPLY: finished
0810 11:30:42.540815 (+ 113us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.540891 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.540918 (+ 27us) write_op.cc:454] Released schema lock
0810 11:30:42.540927 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:42.541001 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.541005 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":68786,"reported_tablets":190,"child_traces":[["op",{"apply.queue_time_us":282,"apply.run_cpu_time_us":673,"apply.run_wall_time_us":673,"num_ops":2,"prepare.queue_time_us":11831,"prepare.run_cpu_time_us":951,"prepare.run_wall_time_us":951,"raft.queue_time_us":2014,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":424,"replication_time_us":22617}]]}
W20260810 11:30:45.029413 26578 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.195:32877 (request call id 343) took 3905 ms (client timeout 1000 ms). Trace:
I20260810 11:30:45.034467 27222 tablet_bootstrap.cc:654] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:45.035522 26700 consensus_peers.cc:487] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:45.037945 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.038379 29059 raft_consensus.cc:504] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.038988 28726 raft_consensus.cc:504] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.039404 29059 leader_election.cc:288] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:45.040635 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a22cdf7d273d427cb32b811aa5caa3a3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:45.042909 26767 raft_consensus.cc:3037] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.047879 27231 tablet_bootstrap.cc:654] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.049638 26767 raft_consensus.cc:2454] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:45.050356 26849 leader_election.cc:302] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:45.050808 29059 raft_consensus.cc:2781] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:45.050966 29059 raft_consensus.cc:686] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:45.051313 29059 consensus_queue.cc:237] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.061385 29305 raft_consensus.cc:482] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:45.063371 27222 tablet_bootstrap.cc:492] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:45.063694 27222 ts_tablet_manager.cc:1397] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.335s user 0.005s sys 0.001s
I20260810 11:30:45.063895 28727 consensus_queue.cc:1035] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:45.063503 28726 leader_election.cc:288] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:45.064363 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d560157da0624333b91a18481b058f91" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:45.064708 26913 raft_consensus.cc:3037] T d560157da0624333b91a18481b058f91 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.061614 29305 raft_consensus.cc:504] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.068496 29305 leader_election.cc:288] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:45.071449 26578 rpcz_store.cc:269] 0810 11:30:41.124179 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.517866 (+393687us) service_pool.cc:227] Handling call
0810 11:30:42.132013 (+614147us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.132020 (+ 7us) write_op.cc:454] Released schema lock
0810 11:30:42.272431 (+140411us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.272437 (+ 6us) write_op.cc:454] Released schema lock
0810 11:30:42.696138 (+423701us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.696145 (+ 7us) write_op.cc:454] Released schema lock
0810 11:30:45.029231 (+2333086us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.114719 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.114860 (+ 141us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.114869 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:42.114872 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:42.115230 (+ 358us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.115250 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.115258 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.115516 (+ 258us) tablet.cc:699] Row locks acquired
0810 11:30:42.115520 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:42.115573 (+ 53us) write_op.cc:270] Start()
0810 11:30:42.115617 (+ 44us) write_op.cc:276] Timestamp: P: 1786361442115532 usec, L: 0
0810 11:30:42.115621 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.115917 (+ 296us) log.cc:842] Serialized 919 byte log entry
0810 11:30:42.127635 (+ 11718us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.127801 (+ 166us) write_op.cc:301] APPLY: starting
0810 11:30:42.127822 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.127889 (+ 67us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.127923 (+ 34us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.128088 (+ 165us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.128137 (+ 49us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:42.128143 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:42.128245 (+ 102us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.128318 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.128343 (+ 25us) write_op.cc:454] Released schema lock
0810 11:30:42.128354 (+ 11us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0810 11:30:42.262304 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.262475 (+ 171us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.262487 (+ 12us) write_op.cc:435] Acquired schema lock
0810 11:30:42.262492 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:42.262625 (+ 133us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.262642 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.262650 (+ 8us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:42.262739 (+ 89us) tablet.cc:699] Row locks acquired
0810 11:30:42.262744 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:42.262803 (+ 59us) write_op.cc:270] Start()
0810 11:30:42.262856 (+ 53us) write_op.cc:276] Timestamp: P: 1786361442262746 usec, L: 0
0810 11:30:42.262863 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.263211 (+ 348us) log.cc:842] Serialized 356 byte log entry
0810 11:30:42.268206 (+ 4995us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.268441 (+ 235us) write_op.cc:301] APPLY: starting
0810 11:30:42.268468 (+ 27us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.268529 (+ 61us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.268625 (+ 96us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.268728 (+ 103us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.268788 (+ 60us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:42.268800 (+ 12us) write_op.cc:312] APPLY: finished
0810 11:30:42.268940 (+ 140us) log.cc:842] Serialized 23 byte log entry
0810 11:30:42.269022 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.269048 (+ 26us) write_op.cc:454] Released schema lock
0810 11:30:42.269057 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0810 11:30:42.680807 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.680959 (+ 152us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.680968 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:42.680971 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:42.681107 (+ 136us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.681123 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.681128 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:42.681205 (+ 77us) tablet.cc:699] Row locks acquired
0810 11:30:42.681207 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:42.681253 (+ 46us) write_op.cc:270] Start()
0810 11:30:42.681293 (+ 40us) write_op.cc:276] Timestamp: P: 1786361442681226 usec, L: 0
0810 11:30:42.681297 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.681528 (+ 231us) log.cc:842] Serialized 356 byte log entry
0810 11:30:42.692630 (+ 11102us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.692822 (+ 192us) write_op.cc:301] APPLY: starting
0810 11:30:42.692840 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.692882 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.692913 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.692975 (+ 62us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.693022 (+ 47us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:42.693029 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:42.693112 (+ 83us) log.cc:842] Serialized 23 byte log entry
0810 11:30:42.693173 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.693191 (+ 18us) write_op.cc:454] Released schema lock
0810 11:30:42.693198 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":195,"child_traces":[["op",{"apply.queue_time_us":108,"apply.run_cpu_time_us":621,"apply.run_wall_time_us":620,"num_ops":2,"prepare.queue_time_us":4794,"prepare.run_cpu_time_us":1367,"prepare.run_wall_time_us":1368,"raft.queue_time_us":1093,"raft.run_cpu_time_us":653,"raft.run_wall_time_us":653,"replication_time_us":11977}],["op",{"apply.queue_time_us":139,"apply.run_cpu_time_us":699,"apply.run_wall_time_us":698,"num_ops":1,"prepare.queue_time_us":64,"prepare.run_cpu_time_us":1055,"prepare.run_wall_time_us":1057,"raft.queue_time_us":1452,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":296,"replication_time_us":5300}],["op",{"apply.queue_time_us":135,"apply.run_cpu_time_us":429,"apply.run_wall_time_us":428,"mutex_wait_us":126,"num_ops":1,"prepare.queue_time_us":9301,"prepare.run_cpu_time_us":950,"prepare.run_wall_time_us":1012,"raft.queue_time_us":217,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":276,"replication_time_us":11245}]]}
I20260810 11:30:45.076426 26913 raft_consensus.cc:2454] T d560157da0624333b91a18481b058f91 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:45.077713 26700 leader_election.cc:302] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:45.079528 28728 raft_consensus.cc:2781] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:45.079768 28728 raft_consensus.cc:686] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:45.079960 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc558690dce44e999e55e9bf1b6ca172" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:45.080302 26767 raft_consensus.cc:2454] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:45.080128 28728 consensus_queue.cc:237] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.090446 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet b6395bce17ee40c2822669246ce7eb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.090714 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7acf847a1fd74ccc89b5bffe1bbb76f3) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.091203 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da86554bc51486e91f1ea5995a245b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.091496 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f24c84cdd945b78f39f24015eb1e43 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b95f3ec8ff34c89a68cd1edf8391f9b) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.092337 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet b6395bce17ee40c2822669246ce7eb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:45.093315 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet c60baf810a544a4a90dccd2337a39043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:45.094352 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e78fb1bf0534deca5cc5a603fd77592 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:45.094901 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet f6e264e8507446809f3c386fdb3c34ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:45.096099 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet b121c13e9241468aa224e17093eb38f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b607279006c4baeae79325926088014) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:45.097064 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet db59523b71224370bf5fce6b56592f71 with delete_type TABLET_DATA_DELETED (replaced by tablet bd34a4de1b93402c8a4bce1215660e77) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:45.097680 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:45.098110 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet ea66da5bc20e4718901ffc473677421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:45.099321 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3406f12d9c492cbd0d86fa7a57de82 with delete_type TABLET_DATA_DELETED (replaced by tablet 72e0b69e7c7e4343b309d16c030d4306) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:45.099220 27222 raft_consensus.cc:348] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.099673 27222 raft_consensus.cc:374] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.100077 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 49db12565dbc4187b78a98ed35c40fed with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1e46f80f7f4e3a84638421892e6236) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:45.100423 27222 raft_consensus.cc:729] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.100610 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:45.100835 27222 consensus_queue.cc:260] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.103008 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c203cd90d2f472fa27cfabed5b87119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:45.103868 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cc17c55109b47eeb91920c3ed8178e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6179cb2be2c442ee97161fe1f4661b64) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:45.104405 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 110b5acc36bd4d6bba13735e5daec75f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:45.107039 27048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d560157da0624333b91a18481b058f91" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:45.107477 27048 raft_consensus.cc:3037] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.118860 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet c60baf810a544a4a90dccd2337a39043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.120425 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet ac4b1821ac30452cbe7a8f844d9b37e5 with delete_type TABLET_DATA_DELETED (replaced by tablet a45422addab84e9083df8665a0cf9322) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.120926 28640 raft_consensus.cc:482] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:45.121658 26849 leader_election.cc:302] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:45.123423 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet ee803ddf27594d2b9e19fe440fc269c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 82de53efa73447fe84e70dbb11a16a5f) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.123662 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e78fb1bf0534deca5cc5a603fd77592 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.125262 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet b121c13e9241468aa224e17093eb38f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b607279006c4baeae79325926088014) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.101629 27222 ts_tablet_manager.cc:1428] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.038s user 0.001s sys 0.001s
I20260810 11:30:45.126420 29305 raft_consensus.cc:2781] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:45.126757 29305 raft_consensus.cc:482] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:45.126897 29305 raft_consensus.cc:3037] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.126968 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 518c777e40ec40dcb3484c0374384959 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:58800
W20260810 11:30:45.112210 26564 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.253:34547, user_credentials={real_user=slave}} blocked reactor thread for 66580.4us
I20260810 11:30:45.131055 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cd4f555b5d840c182a31b3c94da9619 with delete_type TABLET_DATA_DELETED (replaced by tablet 7161d94d80b24eeaa357cc0922a874af) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:45.132511 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "256ad2e2d8e54a4caa1b5091bab60dd5" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:45.132820 27057 raft_consensus.cc:2454] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:45.132511 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a22cdf7d273d427cb32b811aa5caa3a3" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:45.133203 27058 raft_consensus.cc:3037] T a22cdf7d273d427cb32b811aa5caa3a3 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.137743 27058 raft_consensus.cc:2454] T a22cdf7d273d427cb32b811aa5caa3a3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:45.142102 27231 tablet_bootstrap.cc:492] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:45.142311 27231 ts_tablet_manager.cc:1397] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.150s user 0.007s sys 0.007s
W20260810 11:30:45.142609 26848 leader_election.cc:341] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.142748 26848 leader_election.cc:302] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:45.143353 29086 raft_consensus.cc:2726] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:45.145750 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.146014 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet db59523b71224370bf5fce6b56592f71 with delete_type TABLET_DATA_DELETED (replaced by tablet bd34a4de1b93402c8a4bce1215660e77) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.145736 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet e31b380f99854eb8b63e1f9eede1fc7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.151433 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet f6e264e8507446809f3c386fdb3c34ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.143360 27231 raft_consensus.cc:348] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.152508 27228 tablet_bootstrap.cc:492] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:45.152770 27228 ts_tablet_manager.cc:1397] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.392s user 0.035s sys 0.075s
I20260810 11:30:45.150898 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet cc76d30f37094391b75076c92ccc277f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.152765 27231 raft_consensus.cc:374] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.153211 27231 raft_consensus.cc:729] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.154197 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet ea66da5bc20e4718901ffc473677421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.154037 27231 consensus_queue.cc:260] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.154639 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 49db12565dbc4187b78a98ed35c40fed with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1e46f80f7f4e3a84638421892e6236) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.155371 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.156754 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "490ada0a918d48c3a07e12eed58bda19" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:45.157879 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c203cd90d2f472fa27cfabed5b87119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.158054 27231 ts_tablet_manager.cc:1428] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.014s user 0.002s sys 0.002s
I20260810 11:30:45.159029 27231 tablet_bootstrap.cc:492] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:45.160611 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet b200bdb394d3439b86fff48494be8e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:40 UTC) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:45.160631 26848 leader_election.cc:341] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 809b5b6b65d244cd9186517e39494839
I20260810 11:30:45.161089 26848 leader_election.cc:302] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:45.123185 28726 consensus_queue.cc:1035] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260810 11:30:45.161578 29086 raft_consensus.cc:3037] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.161649 29284 tablet_replica.cc:330] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:45.161768 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 110b5acc36bd4d6bba13735e5daec75f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.162137 29284 raft_consensus.cc:2229] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:45.162168 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ccef06fa06c4c519d8760fa948d6c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.162392 29284 raft_consensus.cc:2258] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.163329 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cc17c55109b47eeb91920c3ed8178e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6179cb2be2c442ee97161fe1f4661b64) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.163759 29284 ts_tablet_manager.cc:1905] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:45.168181 29086 raft_consensus.cc:2726] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:45.126868 27222 tablet_bootstrap.cc:492] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:45.146106 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6926d0dc68fa48ae8ffabf5b5272b3d0" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:45.127630 28727 consensus_queue.cc:1035] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260810 11:30:45.121076 28640 raft_consensus.cc:504] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.170213 28640 leader_election.cc:288] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:45.148224 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8083fa130cd04dae9d61aeed977c1c63" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:45.172937 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 78633fbe048b4534ae3277ce6b7c4313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:39 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.173705 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 518c777e40ec40dcb3484c0374384959 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.175110 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet d14091e1c111438bac8bcf3d36123d80 with delete_type TABLET_DATA_DELETED (replaced by tablet ce73798a721b4a6d892f0c24b6b40e2c) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.161633 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 23637a02b6464e17aa2a69ea5cc4ddfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.175787 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c715bdcff8c4cdabfddf871f6fdc388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.176317 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cd4f555b5d840c182a31b3c94da9619 with delete_type TABLET_DATA_DELETED (replaced by tablet 7161d94d80b24eeaa357cc0922a874af) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.176784 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.177433 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet a63227e69df14a4ea935087fd31ece63 with delete_type TABLET_DATA_DELETED (replaced by tablet aa71cedba3d34c288a3e3be99d474ce4) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.177526 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet a835d30ef9fc474ab927bb119a95d83c with delete_type TABLET_DATA_DELETED (replaced by tablet 2a1fbf3890ee4a829b4c8c61fe1e978f) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.177806 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 318d5b8453fe4c438d0fa32cb91c409e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.178316 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 713663be70014b17b17056a865e7db63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:45.180295 29290 raft_consensus.cc:482] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:45.180490 29290 raft_consensus.cc:504] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.180609 29305 raft_consensus.cc:504] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.181195 29290 leader_election.cc:288] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:45.181448 29305 leader_election.cc:288] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:45.183717 28987 ts_tablet_manager.cc:1918] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:45.184551 28987 log.cc:1196] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/7ff5b980ce4e41d7a6e1ca0e740b739c
I20260810 11:30:45.186793 28987 ts_tablet_manager.cc:1939] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:45.182158 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52a9367b7a8345739b5b9acf9ea1e6d8" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:45.192380 26991 leader_election.cc:341] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.194525 27228 raft_consensus.cc:348] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.194828 27228 raft_consensus.cc:374] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.194901 27228 raft_consensus.cc:729] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.195135 27228 consensus_queue.cc:260] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.196440 27228 ts_tablet_manager.cc:1428] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.044s user 0.000s sys 0.002s
I20260810 11:30:45.197034 27228 tablet_bootstrap.cc:492] T 372b49dc083d46538442fcbfdfeb3545 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:45.200259 29110 ts_tablet_manager.cc:1918] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:45.191169 27222 tablet_bootstrap.cc:654] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.192121 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc558690dce44e999e55e9bf1b6ca172" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:45.201138 26767 raft_consensus.cc:3037] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.204010 27228 tablet_bootstrap.cc:654] T 372b49dc083d46538442fcbfdfeb3545 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.212863 26767 raft_consensus.cc:2454] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
W20260810 11:30:45.213701 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 89816.8us
I20260810 11:30:45.213724 26849 leader_election.cc:302] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:45.215420 29284 ts_tablet_manager.cc:1918] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:45.217615 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 98) took 3275 ms. Trace:
I20260810 11:30:45.217739 28987 rpcz_store.cc:276] 0810 11:30:41.942243 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.943726 (+ 1483us) service_pool.cc:227] Handling call
0810 11:30:44.995560 (+3051834us) ts_tablet_manager.cc:1145] Deleting tablet 7ff5b980ce4e41d7a6e1ca0e740b739c
0810 11:30:44.995574 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.088458 (+ 92884us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.183411 (+ 94953us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.217585 (+ 34174us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3037161}
I20260810 11:30:45.215930 29297 raft_consensus.cc:2781] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:45.221805 29297 raft_consensus.cc:686] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
W20260810 11:30:45.222680 26848 leader_election.cc:341] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: fc558690dce44e999e55e9bf1b6ca172
I20260810 11:30:45.222597 29297 consensus_queue.cc:237] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.225126 29284 log.cc:1196] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/d4873fe8318040a2b7e021708a875f43
I20260810 11:30:45.225903 27228 tablet_bootstrap.cc:492] T 372b49dc083d46538442fcbfdfeb3545 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:45.226842 29284 ts_tablet_manager.cc:1939] T d4873fe8318040a2b7e021708a875f43 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:45.228464 27228 ts_tablet_manager.cc:1397] T 372b49dc083d46538442fcbfdfeb3545 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.000s
I20260810 11:30:45.235011 26848 leader_election.cc:302] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:45.241169 28987 tablet_replica.cc:330] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:45.241501 28987 raft_consensus.cc:2229] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:45.241612 29059 raft_consensus.cc:2781] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:45.241763 29059 raft_consensus.cc:482] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:45.241859 29059 raft_consensus.cc:3037] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.241918 26848 leader_election.cc:302] T 490ada0a918d48c3a07e12eed58bda19 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:45.241947 28987 raft_consensus.cc:2258] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:45.243911 26848 leader_election.cc:341] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: fc558690dce44e999e55e9bf1b6ca172
I20260810 11:30:45.247668 29059 raft_consensus.cc:504] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.248530 29059 leader_election.cc:288] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:45.254056 27228 raft_consensus.cc:348] T 372b49dc083d46538442fcbfdfeb3545 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.254627 27228 raft_consensus.cc:374] T 372b49dc083d46538442fcbfdfeb3545 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.255416 27228 raft_consensus.cc:729] T 372b49dc083d46538442fcbfdfeb3545 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.200532 29110 log.cc:1196] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/603fe104b7ab485eab6b225a58bddc1c
I20260810 11:30:45.216200 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34bd3c0edf6b49d1891c0ee9af344872" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:45.259212 29086 raft_consensus.cc:2726] T 490ada0a918d48c3a07e12eed58bda19 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:45.259212 27058 raft_consensus.cc:2454] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:45.220342 29178 raft_consensus.cc:482] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:45.259837 29178 raft_consensus.cc:504] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.260780 29178 leader_election.cc:288] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:45.261637 26702 leader_election.cc:302] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:45.262260 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "256ad2e2d8e54a4caa1b5091bab60dd5" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:45.262624 27057 raft_consensus.cc:3037] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.211028 27048 raft_consensus.cc:2454] T d560157da0624333b91a18481b058f91 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:45.267130 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet d4873fe8318040a2b7e021708a875f43 (table default.Table_065fc82a2823470b89b4cff36ca03027 [id=60ce1267de814f218c27ac084a08a26a]) successfully deleted
I20260810 11:30:45.271387 28727 raft_consensus.cc:2781] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:45.271742 28727 raft_consensus.cc:482] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:45.271857 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "256ad2e2d8e54a4caa1b5091bab60dd5" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:45.272480 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6e264e8507446809f3c386fdb3c34ae" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:45.271835 28727 raft_consensus.cc:3037] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.273478 26913 raft_consensus.cc:2454] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:45.274101 27057 raft_consensus.cc:2454] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:45.274201 27228 consensus_queue.cc:260] T 372b49dc083d46538442fcbfdfeb3545 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.275156 27228 ts_tablet_manager.cc:1428] T 372b49dc083d46538442fcbfdfeb3545 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.027s user 0.003s sys 0.001s
I20260810 11:30:45.275586 27228 tablet_bootstrap.cc:492] T afbe6ce99f7c4f7cb939bea086cd90be P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:45.277446 29284 tablet_replica.cc:330] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:45.277787 29284 raft_consensus.cc:2229] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:45.277981 29284 raft_consensus.cc:2258] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:45.280798 26849 leader_election.cc:341] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.280287 26991 leader_election.cc:302] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:45.286603 29178 raft_consensus.cc:2781] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:45.286744 29178 raft_consensus.cc:482] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:45.286818 29178 raft_consensus.cc:3037] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.286676 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afbe6ce99f7c4f7cb939bea086cd90be" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:45.286970 26767 raft_consensus.cc:2454] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:45.286598 28727 raft_consensus.cc:504] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.287858 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34bd3c0edf6b49d1891c0ee9af344872" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:45.288311 26767 raft_consensus.cc:2379] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 482e605580be48cbbacce05a3e61c215 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:45.281797 27231 tablet_bootstrap.cc:654] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.291733 29178 raft_consensus.cc:504] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.292503 29110 ts_tablet_manager.cc:1939] T 603fe104b7ab485eab6b225a58bddc1c P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:45.293146 29290 raft_consensus.cc:482] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 11:30:45.293179 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 163800us
I20260810 11:30:45.293378 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 85) took 2328 ms. Trace:
I20260810 11:30:45.293303 29290 raft_consensus.cc:504] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.293462 29110 rpcz_store.cc:276] 0810 11:30:42.964914 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.964975 (+ 61us) service_pool.cc:227] Handling call
0810 11:30:44.741995 (+1777020us) ts_tablet_manager.cc:1145] Deleting tablet 603fe104b7ab485eab6b225a58bddc1c
0810 11:30:44.742014 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.075945 (+333931us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.200101 (+124156us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.293356 (+ 93255us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1776511}
I20260810 11:30:45.293817 29110 tablet_replica.cc:330] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:45.293973 29290 leader_election.cc:288] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:45.294212 29110 raft_consensus.cc:2229] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:45.294410 29110 raft_consensus.cc:2258] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.294637 29178 leader_election.cc:288] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:45.295131 29110 ts_tablet_manager.cc:1905] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:45.295742 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34bd3c0edf6b49d1891c0ee9af344872" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:45.295419 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34bd3c0edf6b49d1891c0ee9af344872" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:45.296181 28987 ts_tablet_manager.cc:1905] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:45.296319 29178 raft_consensus.cc:482] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:45.296468 29178 raft_consensus.cc:504] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.297194 29178 leader_election.cc:288] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:45.297230 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52a9367b7a8345739b5b9acf9ea1e6d8" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:45.298753 26848 leader_election.cc:302] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
W20260810 11:30:45.298946 26848 raft_consensus.cc:2670] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 11:30:45.299316 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6e264e8507446809f3c386fdb3c34ae" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:45.299393 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6e264e8507446809f3c386fdb3c34ae" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:45.299602 26908 raft_consensus.cc:3037] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.299616 26762 raft_consensus.cc:2454] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:45.301276 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f048b690d764c83a4a9ce4cbadc75b0" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:45.301406 28728 raft_consensus.cc:482] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:45.302248 28728 raft_consensus.cc:504] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.302961 28728 leader_election.cc:288] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:45.303714 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65756c37fe514194bebe76921419653c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:45.303977 27061 raft_consensus.cc:2454] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:45.304384 26908 raft_consensus.cc:2454] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:45.304522 26702 leader_election.cc:302] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:45.305123 28727 leader_election.cc:288] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:45.305091 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet b945038c03e343489af6ae7e50131d97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b945038c03e343489af6ae7e50131d97 already in progress: creating tablet
I20260810 11:30:45.305447 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6e264e8507446809f3c386fdb3c34ae" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:45.305665 26762 raft_consensus.cc:3037] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.306306 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34bd3c0edf6b49d1891c0ee9af344872" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:45.306594 27057 raft_consensus.cc:3037] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.304829 29315 raft_consensus.cc:2781] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:45.304790 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859477ecf37240a4888542d2559f99cd" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:45.308228 29315 raft_consensus.cc:482] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:45.308408 29315 raft_consensus.cc:3037] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.305053 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f048b690d764c83a4a9ce4cbadc75b0" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:45.308841 26913 raft_consensus.cc:2454] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
W20260810 11:30:45.309429 26991 leader_election.cc:341] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.309729 26991 leader_election.cc:302] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:45.310122 29178 raft_consensus.cc:2781] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:45.310171 26762 raft_consensus.cc:2454] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:45.310248 29178 raft_consensus.cc:482] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:45.310433 29178 raft_consensus.cc:3037] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.314025 29178 raft_consensus.cc:504] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.316248 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859477ecf37240a4888542d2559f99cd" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:45.315253 26993 leader_election.cc:341] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.316650 26993 leader_election.cc:302] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:45.316895 29290 raft_consensus.cc:2726] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:45.317368 26993 leader_election.cc:341] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.317582 26993 leader_election.cc:302] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:45.317875 29290 raft_consensus.cc:2726] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:45.317878 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 603fe104b7ab485eab6b225a58bddc1c (table default.Table_a5fcf59dae954757a15883ee4da1bf29 [id=758863f16efe460e90394a491cad8914]) successfully deleted
I20260810 11:30:45.318365 26993 leader_election.cc:302] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:45.315865 26991 leader_election.cc:302] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:45.318811 29290 raft_consensus.cc:2781] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:45.318884 29290 raft_consensus.cc:482] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:45.318965 29290 raft_consensus.cc:3037] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.319589 27231 tablet_bootstrap.cc:492] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:45.319749 27231 ts_tablet_manager.cc:1397] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.161s user 0.003s sys 0.004s
I20260810 11:30:45.317883 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 7ff5b980ce4e41d7a6e1ca0e740b739c (table default.Table_2d72673d9e86472ca07d3c7d36f51108 [id=7f2c916845a443209bff1b685821499f]) successfully deleted
I20260810 11:30:45.321024 27231 raft_consensus.cc:348] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.321347 27231 raft_consensus.cc:374] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 11:30:45.321408 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet e69916a35fba4714bbc565921738888f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e69916a35fba4714bbc565921738888f already in progress: creating tablet
I20260810 11:30:45.321497 27231 raft_consensus.cc:729] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.321768 27231 consensus_queue.cc:260] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.322304 27231 ts_tablet_manager.cc:1428] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 11:30:45.322588 27231 tablet_bootstrap.cc:492] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
W20260810 11:30:45.322847 26700 consensus_peers.cc:487] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:45.323257 26700 leader_election.cc:341] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:45.323518 26700 leader_election.cc:341] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.323298 29290 raft_consensus.cc:504] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.326063 29284 ts_tablet_manager.cc:1905] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:45.328763 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet d08250001e1542f9978bc6f89ace458b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d08250001e1542f9978bc6f89ace458b already in progress: creating tablet
I20260810 11:30:45.328917 27231 tablet_bootstrap.cc:654] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.329165 29290 leader_election.cc:288] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:45.330786 29290 raft_consensus.cc:2781] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:45.331252 29290 raft_consensus.cc:686] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:45.331677 29290 consensus_queue.cc:237] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.333580 26993 leader_election.cc:302] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:45.336534 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afbe6ce99f7c4f7cb939bea086cd90be" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:45.337900 26993 leader_election.cc:341] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.338955 26993 leader_election.cc:302] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:45.339720 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65756c37fe514194bebe76921419653c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:45.344810 29291 raft_consensus.cc:2726] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:45.339672 26991 leader_election.cc:341] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.346463 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f048b690d764c83a4a9ce4cbadc75b0" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:45.346777 26914 raft_consensus.cc:3037] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.347422 27231 tablet_bootstrap.cc:492] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:45.347609 27231 ts_tablet_manager.cc:1397] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.005s
I20260810 11:30:45.351399 26914 raft_consensus.cc:2454] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:45.353119 29315 raft_consensus.cc:504] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.354079 27231 raft_consensus.cc:348] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.357162 27231 raft_consensus.cc:374] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.357405 27231 raft_consensus.cc:729] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.357760 27231 consensus_queue.cc:260] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.355022 29178 leader_election.cc:288] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:45.338603 27057 raft_consensus.cc:2454] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:45.358415 29293 raft_consensus.cc:2726] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:45.356172 26993 leader_election.cc:341] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:45.359457 26993 leader_election.cc:341] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.360059 26702 leader_election.cc:302] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:45.360692 26993 leader_election.cc:302] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:45.356956 26991 leader_election.cc:302] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
W20260810 11:30:45.361994 26700 leader_election.cc:341] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.362766 29293 raft_consensus.cc:2726] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:45.362821 29142 raft_consensus.cc:2781] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:45.362967 29293 raft_consensus.cc:2781] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:45.363088 29293 raft_consensus.cc:686] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:45.362950 29142 raft_consensus.cc:686] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:45.363570 29142 consensus_queue.cc:237] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.363391 29293 consensus_queue.cc:237] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.365605 27228 tablet_bootstrap.cc:654] T afbe6ce99f7c4f7cb939bea086cd90be P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.370023 27222 tablet_bootstrap.cc:492] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:45.370239 27222 ts_tablet_manager.cc:1397] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.243s user 0.002s sys 0.006s
I20260810 11:30:45.370100 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65756c37fe514194bebe76921419653c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:45.370389 27057 raft_consensus.cc:3037] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.371332 27222 raft_consensus.cc:348] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.371614 27222 raft_consensus.cc:374] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.371696 27222 raft_consensus.cc:729] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.372051 27222 consensus_queue.cc:260] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.372720 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afbe6ce99f7c4f7cb939bea086cd90be" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:45.372867 27222 ts_tablet_manager.cc:1428] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.002s sys 0.002s
I20260810 11:30:45.373003 26762 raft_consensus.cc:3037] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.373224 27222 tablet_bootstrap.cc:492] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:45.375111 27057 raft_consensus.cc:2454] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:45.375730 27222 tablet_bootstrap.cc:654] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.375682 26702 leader_election.cc:302] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:45.375972 29315 leader_election.cc:288] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:45.376047 29316 raft_consensus.cc:2781] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:45.376303 29316 raft_consensus.cc:686] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:45.376892 29316 consensus_queue.cc:237] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.377743 26762 raft_consensus.cc:2454] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:45.379242 27231 ts_tablet_manager.cc:1428] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.032s user 0.000s sys 0.004s
I20260810 11:30:45.381434 27231 tablet_bootstrap.cc:492] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:45.382314 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f048b690d764c83a4a9ce4cbadc75b0" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:45.388994 26993 leader_election.cc:302] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:45.391202 29291 raft_consensus.cc:2781] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:45.391693 29284 ts_tablet_manager.cc:1918] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 11:30:45.391924 26993 leader_election.cc:341] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.393193 29291 raft_consensus.cc:686] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:45.393627 29291 consensus_queue.cc:237] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.387008 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:45.405987 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:45.406391 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:45.406957 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:45.417675 27231 tablet_bootstrap.cc:654] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.405571 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65756c37fe514194bebe76921419653c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:45.419734 26700 leader_election.cc:341] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.420197 29284 log.cc:1196] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/256ad2e2d8e54a4caa1b5091bab60dd5
I20260810 11:30:45.421005 29284 ts_tablet_manager.cc:1939] T 256ad2e2d8e54a4caa1b5091bab60dd5 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:45.423300 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 256ad2e2d8e54a4caa1b5091bab60dd5 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]) successfully deleted
I20260810 11:30:45.428776 29284 tablet_replica.cc:330] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:45.429132 29284 raft_consensus.cc:2229] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:45.434867 27231 tablet_bootstrap.cc:492] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:45.435097 27231 ts_tablet_manager.cc:1397] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.054s user 0.006s sys 0.006s
I20260810 11:30:45.436497 27231 raft_consensus.cc:348] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.436852 27231 raft_consensus.cc:374] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.436952 27231 raft_consensus.cc:729] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.437263 27231 consensus_queue.cc:260] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.439239 27231 ts_tablet_manager.cc:1428] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 11:30:45.441356 27231 tablet_bootstrap.cc:492] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:45.443169 28987 ts_tablet_manager.cc:1918] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:45.443416 29284 pending_rounds.cc:62] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700: Trying to abort 1 pending ops.
I20260810 11:30:45.443491 29284 pending_rounds.cc:68] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936479636938752 op_type: NO_OP noop_request { }
I20260810 11:30:45.443708 29284 raft_consensus.cc:2866] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:45.443817 29284 raft_consensus.cc:2258] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.445451 27231 tablet_bootstrap.cc:654] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.447903 29284 ts_tablet_manager.cc:1905] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:45.449244 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:45.450228 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:45.450837 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:45.451642 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:45.453704 27231 tablet_bootstrap.cc:492] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:45.453985 27231 ts_tablet_manager.cc:1397] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.002s
I20260810 11:30:45.455339 27231 raft_consensus.cc:348] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.455713 27231 raft_consensus.cc:374] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.455799 27231 raft_consensus.cc:729] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.456179 27231 consensus_queue.cc:260] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.458518 27231 ts_tablet_manager.cc:1428] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20260810 11:30:45.460506 27231 tablet_bootstrap.cc:492] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:45.464304 27231 tablet_bootstrap.cc:654] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.471400 29284 ts_tablet_manager.cc:1918] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:45.475401 27231 tablet_bootstrap.cc:492] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:45.475625 27231 ts_tablet_manager.cc:1397] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260810 11:30:45.476953 27231 raft_consensus.cc:348] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.477353 27231 raft_consensus.cc:374] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.477442 27231 raft_consensus.cc:729] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.477797 27231 consensus_queue.cc:260] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.479939 27231 ts_tablet_manager.cc:1428] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 11:30:45.481433 27231 tablet_bootstrap.cc:492] T 1549a26ba0f6427fae87b204c5d49eff P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:45.491724 27231 tablet_bootstrap.cc:654] T 1549a26ba0f6427fae87b204c5d49eff P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.445230 29142 raft_consensus.cc:482] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 482e605580be48cbbacce05a3e61c215)
I20260810 11:30:45.494091 27222 tablet_bootstrap.cc:492] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:45.504722 28987 log.cc:1196] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/834c9c99ec424bb39e8a003e9204b2bc
I20260810 11:30:45.504828 27222 ts_tablet_manager.cc:1397] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.132s user 0.004s sys 0.001s
I20260810 11:30:45.504799 29142 raft_consensus.cc:504] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.505396 28987 ts_tablet_manager.cc:1939] T 834c9c99ec424bb39e8a003e9204b2bc P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:45.505793 29142 leader_election.cc:288] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:45.505909 27222 raft_consensus.cc:348] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.506269 27222 raft_consensus.cc:374] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.506325 27222 raft_consensus.cc:729] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.506565 27222 consensus_queue.cc:260] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.507347 27222 ts_tablet_manager.cc:1428] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260810 11:30:45.508483 26700 leader_election.cc:341] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 55c8749861874eca9b63d3db97afa2b1
I20260810 11:30:45.510557 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:45.511103 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:45.511348 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:45.511727 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:45.512241 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:45.473634 27228 tablet_bootstrap.cc:492] T afbe6ce99f7c4f7cb939bea086cd90be P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:45.520907 29284 log.cc:1196] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/fc558690dce44e999e55e9bf1b6ca172
I20260810 11:30:45.521008 27228 ts_tablet_manager.cc:1397] T afbe6ce99f7c4f7cb939bea086cd90be P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.246s user 0.002s sys 0.021s
I20260810 11:30:45.521627 29284 ts_tablet_manager.cc:1939] T fc558690dce44e999e55e9bf1b6ca172 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:45.522197 27228 raft_consensus.cc:348] T afbe6ce99f7c4f7cb939bea086cd90be P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.522559 27228 raft_consensus.cc:374] T afbe6ce99f7c4f7cb939bea086cd90be P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.522634 27228 raft_consensus.cc:729] T afbe6ce99f7c4f7cb939bea086cd90be P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.522881 27228 consensus_queue.cc:260] T afbe6ce99f7c4f7cb939bea086cd90be P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.523728 27228 ts_tablet_manager.cc:1428] T afbe6ce99f7c4f7cb939bea086cd90be P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:45.525251 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet fc558690dce44e999e55e9bf1b6ca172 (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]) successfully deleted
W20260810 11:30:45.525703 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 1860e56467624dcdb288e13b004f78cc because the tablet was not found. No further retry: Not found: Tablet not found: 1860e56467624dcdb288e13b004f78cc
W20260810 11:30:45.525971 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 0713f4f14a284050a7774a70ab974f30 because the tablet was not found. No further retry: Not found: Tablet not found: 0713f4f14a284050a7774a70ab974f30
W20260810 11:30:45.526207 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 1aa4562a2247405187d9dbd1baa48f39 because the tablet was not found. No further retry: Not found: Tablet not found: 1aa4562a2247405187d9dbd1baa48f39
W20260810 11:30:45.526566 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 8228600e3f6b4f9993dd25e4ceb57e4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8228600e3f6b4f9993dd25e4ceb57e4d already in progress: creating tablet
W20260810 11:30:45.526930 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 3ae27bf110114b70a3e3f6cf64f31b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae27bf110114b70a3e3f6cf64f31b98 already in progress: creating tablet
W20260810 11:30:45.527242 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet d000f0ebaf0049a7bdaad93e307e16e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d000f0ebaf0049a7bdaad93e307e16e2 already in progress: creating tablet
W20260810 11:30:45.531414 26702 leader_election.cc:341] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 55c8749861874eca9b63d3db97afa2b1
I20260810 11:30:45.531603 26702 leader_election.cc:302] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:45.532390 29291 raft_consensus.cc:482] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:45.533020 29142 raft_consensus.cc:2726] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:45.533674 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 102) took 3590 ms. Trace:
I20260810 11:30:45.533815 28987 rpcz_store.cc:276] 0810 11:30:41.942869 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.945960 (+ 3091us) service_pool.cc:227] Handling call
0810 11:30:45.241087 (+3295127us) ts_tablet_manager.cc:1145] Deleting tablet 834c9c99ec424bb39e8a003e9204b2bc
0810 11:30:45.241107 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.300069 (+ 58962us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.443054 (+142985us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.532940 (+ 89886us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x618000004d18. stack: 00007f81b1fa466e 00007f81b1fa4430 00007f81b102b5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f81b1f9a0fd 00007f81b1f9b16e 00007f81c4eefcfd 00007f81c4e6d883 00007f81c110f752 00007f81c1141404 00007f81c1122870 00007f81c11225fd 00000000009edb7c 00007f81b1fea344
0810 11:30:45.533652 (+ 712us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":61877120,"tablet-delete.queue_time_us":3263861}
I20260810 11:30:45.534267 28987 tablet_replica.cc:330] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:45.534533 28987 raft_consensus.cc:2229] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:45.534698 28987 raft_consensus.cc:2258] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.535071 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 834c9c99ec424bb39e8a003e9204b2bc (table default.Table_e930e7d079ef4035bde1d9a4ef134d62 [id=ad637cef46ef40eeb3182153bcd52f6d]) successfully deleted
I20260810 11:30:45.536320 27222 tablet_bootstrap.cc:492] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:45.536521 29291 raft_consensus.cc:504] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.537246 29291 leader_election.cc:288] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:45.538622 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
W20260810 11:30:45.538789 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet b6395bce17ee40c2822669246ce7eb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6395bce17ee40c2822669246ce7eb42 already in progress: creating tablet
I20260810 11:30:45.539137 27222 tablet_bootstrap.cc:654] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:45.540289 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet e276b0fa124d42dfb3fe750d245e44d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e276b0fa124d42dfb3fe750d245e44d8 already in progress: creating tablet
I20260810 11:30:45.540884 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:45.540949 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b95f3ec8ff34c89a68cd1edf8391f9b" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:45.541239 26991 consensus_peers.cc:487] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d4873fe8318040a2b7e021708a875f43. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:45.541329 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
W20260810 11:30:45.541920 26993 leader_election.cc:341] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.542126 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:45.542142 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b95f3ec8ff34c89a68cd1edf8391f9b" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:45.542738 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:45.543267 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:45.543438 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:45.544288 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:45.546299 27228 tablet_bootstrap.cc:492] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
W20260810 11:30:45.548260 26991 leader_election.cc:341] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.548399 26991 leader_election.cc:302] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:45.548853 29293 raft_consensus.cc:2726] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:45.551003 28987 ts_tablet_manager.cc:1905] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:45.553412 27228 tablet_bootstrap.cc:654] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:45.555570 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 2da86554bc51486e91f1ea5995a245b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2da86554bc51486e91f1ea5995a245b5 already in progress: creating tablet
I20260810 11:30:45.555785 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:45.556432 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:45.556926 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:45.557279 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:45.557669 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:45.558420 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:45.558908 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
W20260810 11:30:45.559813 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 81f24c84cdd945b78f39f24015eb1e43 because the tablet was not found. No further retry: Not found: Tablet not found: 81f24c84cdd945b78f39f24015eb1e43
I20260810 11:30:45.560220 29110 ts_tablet_manager.cc:1918] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:45.560348 29110 log.cc:1196] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/10e6c41db71a4146840f06c5b7412d9c
I20260810 11:30:45.562950 29110 ts_tablet_manager.cc:1939] T 10e6c41db71a4146840f06c5b7412d9c P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:45.564198 27228 tablet_bootstrap.cc:492] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:45.564392 27228 ts_tablet_manager.cc:1397] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.004s
I20260810 11:30:45.564944 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 87) took 2598 ms. Trace:
I20260810 11:30:45.565119 29110 rpcz_store.cc:276] 0810 11:30:42.966534 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.966634 (+ 100us) service_pool.cc:227] Handling call
0810 11:30:45.293771 (+2327137us) ts_tablet_manager.cc:1145] Deleting tablet 10e6c41db71a4146840f06c5b7412d9c
0810 11:30:45.293782 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.489801 (+196019us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.560103 (+ 70302us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.564912 (+ 4809us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2326833}
I20260810 11:30:45.565531 27228 raft_consensus.cc:348] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.565807 27228 raft_consensus.cc:374] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.565879 27228 raft_consensus.cc:729] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.565764 29110 tablet_replica.cc:330] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:45.566251 29110 raft_consensus.cc:2229] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:45.566126 27228 consensus_queue.cc:260] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.567097 27228 ts_tablet_manager.cc:1428] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260810 11:30:45.567553 26573 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
I20260810 11:30:45.568823 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 10e6c41db71a4146840f06c5b7412d9c (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]) successfully deleted
I20260810 11:30:45.569427 29110 raft_consensus.cc:2258] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.570142 29110 ts_tablet_manager.cc:1905] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:45.573218 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet c60baf810a544a4a90dccd2337a39043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c60baf810a544a4a90dccd2337a39043 already in progress: creating tablet
I20260810 11:30:45.576380 29284 tablet_replica.cc:330] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:45.576670 29284 raft_consensus.cc:2229] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:45.576848 29284 raft_consensus.cc:2258] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.577695 27228 tablet_bootstrap.cc:492] T 5deec04c1be64473accf8b9df14bd22e P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:45.577750 29284 ts_tablet_manager.cc:1905] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:45.580039 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ac4b1821ac30452cbe7a8f844d9b37e5 because the tablet was not found. No further retry: Not found: Tablet not found: ac4b1821ac30452cbe7a8f844d9b37e5
W20260810 11:30:45.580607 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ee803ddf27594d2b9e19fe440fc269c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee803ddf27594d2b9e19fe440fc269c7 already in progress: creating tablet
W20260810 11:30:45.580958 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7e78fb1bf0534deca5cc5a603fd77592 because the tablet was not found. No further retry: Not found: Tablet not found: 7e78fb1bf0534deca5cc5a603fd77592
W20260810 11:30:45.581250 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet b121c13e9241468aa224e17093eb38f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b121c13e9241468aa224e17093eb38f4 already in progress: creating tablet
W20260810 11:30:45.581539 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet db59523b71224370bf5fce6b56592f71 because the tablet was not found. No further retry: Not found: Tablet not found: db59523b71224370bf5fce6b56592f71
W20260810 11:30:45.581818 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 34bd3c0edf6b49d1891c0ee9af344872 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34bd3c0edf6b49d1891c0ee9af344872 already in progress: creating tablet
W20260810 11:30:45.582110 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet e31b380f99854eb8b63e1f9eede1fc7c because the tablet was not found. No further retry: Not found: Tablet not found: e31b380f99854eb8b63e1f9eede1fc7c
I20260810 11:30:45.584869 27228 tablet_bootstrap.cc:654] T 5deec04c1be64473accf8b9df14bd22e P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.585842 27231 tablet_bootstrap.cc:492] T 1549a26ba0f6427fae87b204c5d49eff P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:45.586014 27231 ts_tablet_manager.cc:1397] T 1549a26ba0f6427fae87b204c5d49eff P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.105s user 0.004s sys 0.004s
I20260810 11:30:45.587088 27231 raft_consensus.cc:348] T 1549a26ba0f6427fae87b204c5d49eff P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.587409 27231 raft_consensus.cc:374] T 1549a26ba0f6427fae87b204c5d49eff P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.587474 27231 raft_consensus.cc:729] T 1549a26ba0f6427fae87b204c5d49eff P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.587775 27231 consensus_queue.cc:260] T 1549a26ba0f6427fae87b204c5d49eff P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.588552 27231 ts_tablet_manager.cc:1428] T 1549a26ba0f6427fae87b204c5d49eff P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 11:30:45.589254 27231 tablet_bootstrap.cc:492] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:45.591492 29291 raft_consensus.cc:482] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:45.591631 29291 raft_consensus.cc:504] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.592185 29291 leader_election.cc:288] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:45.595420 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72209a805e3e4b4ea1bf99508e0f75db" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:45.596019 29142 consensus_queue.cc:1035] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:45.596205 27231 tablet_bootstrap.cc:654] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:45.602694 26993 leader_election.cc:341] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.614631 27231 tablet_bootstrap.cc:492] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:45.614810 27231 ts_tablet_manager.cc:1397] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.004s
I20260810 11:30:45.614784 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72209a805e3e4b4ea1bf99508e0f75db" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:45.615600 27231 raft_consensus.cc:348] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.615825 27231 raft_consensus.cc:374] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.615876 27231 raft_consensus.cc:729] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.616290 29284 ts_tablet_manager.cc:1918] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:45.616444 29284 log.cc:1196] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/f6e264e8507446809f3c386fdb3c34ae
I20260810 11:30:45.616475 29291 raft_consensus.cc:482] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:45.616641 29291 raft_consensus.cc:504] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.616875 29284 ts_tablet_manager.cc:1939] T f6e264e8507446809f3c386fdb3c34ae P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:45.616743 27231 consensus_queue.cc:260] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.617341 29291 leader_election.cc:288] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
W20260810 11:30:45.618144 26991 leader_election.cc:341] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.618506 26991 leader_election.cc:302] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:45.618624 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet f6e264e8507446809f3c386fdb3c34ae (table default.Table_ae66005f117b4fe9bd3fb52adb6efb32 [id=03cc701eb88641fa844ee3d192b321ab]) successfully deleted
I20260810 11:30:45.619360 29290 raft_consensus.cc:2726] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:45.620398 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "932ac2ae54324e6e830291ed449a31a8" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:45.621495 27222 tablet_bootstrap.cc:492] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:45.621770 27222 ts_tablet_manager.cc:1397] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.086s user 0.008s sys 0.001s
I20260810 11:30:45.626511 27222 raft_consensus.cc:348] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.627054 27222 raft_consensus.cc:374] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.627202 27222 raft_consensus.cc:729] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.627604 27222 consensus_queue.cc:260] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.628716 27222 ts_tablet_manager.cc:1428] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260810 11:30:45.630663 27222 tablet_bootstrap.cc:492] T 8083fa130cd04dae9d61aeed977c1c63 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:45.632843 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "932ac2ae54324e6e830291ed449a31a8" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:45.633870 26991 leader_election.cc:341] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.634449 27222 tablet_bootstrap.cc:654] T 8083fa130cd04dae9d61aeed977c1c63 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:45.639729 26993 leader_election.cc:341] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.640030 26993 leader_election.cc:302] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:45.640723 29293 raft_consensus.cc:2726] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:45.645685 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet cc76d30f37094391b75076c92ccc277f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc76d30f37094391b75076c92ccc277f already in progress: creating tablet
I20260810 11:30:45.645859 27228 tablet_bootstrap.cc:492] T 5deec04c1be64473accf8b9df14bd22e P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:45.646082 27228 ts_tablet_manager.cc:1397] T 5deec04c1be64473accf8b9df14bd22e P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.009s
W20260810 11:30:45.647189 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ea66da5bc20e4718901ffc473677421c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea66da5bc20e4718901ffc473677421c already in progress: creating tablet
I20260810 11:30:45.648010 27228 raft_consensus.cc:348] T 5deec04c1be64473accf8b9df14bd22e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.648442 27228 raft_consensus.cc:374] T 5deec04c1be64473accf8b9df14bd22e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 11:30:45.648407 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 49db12565dbc4187b78a98ed35c40fed because the tablet was not found. No further retry: Not found: Tablet not found: 49db12565dbc4187b78a98ed35c40fed
I20260810 11:30:45.650010 29284 tablet_replica.cc:330] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:45.652359 29110 ts_tablet_manager.cc:1918] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:45.652673 29110 log.cc:1196] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/91b6078efadf496fb252f725bdf56b02
I20260810 11:30:45.653328 29110 ts_tablet_manager.cc:1939] T 91b6078efadf496fb252f725bdf56b02 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:45.654556 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 88) took 2680 ms. Trace:
I20260810 11:30:45.657260 29284 raft_consensus.cc:2229] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:45.657552 29284 raft_consensus.cc:2258] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.658221 29284 ts_tablet_manager.cc:1905] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:45.658870 26908 raft_consensus.cc:3037] T 372b49dc083d46538442fcbfdfeb3545 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.648524 27228 raft_consensus.cc:729] T 5deec04c1be64473accf8b9df14bd22e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.664940 29142 consensus_queue.cc:1035] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:45.664882 27228 consensus_queue.cc:260] T 5deec04c1be64473accf8b9df14bd22e P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.667322 27228 ts_tablet_manager.cc:1428] T 5deec04c1be64473accf8b9df14bd22e P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.021s user 0.000s sys 0.005s
I20260810 11:30:45.669064 27228 tablet_bootstrap.cc:492] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:45.671466 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:45.672108 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:45.672760 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:45.673139 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 271a0607ec28441c91bac32c2f2bf44b (table default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e]). Expected version 1 got 0
I20260810 11:30:45.678740 26577 catalog_manager.cc:5495] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:45.680723 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
I20260810 11:30:45.618517 27231 ts_tablet_manager.cc:1428] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 11:30:45.685832 27231 tablet_bootstrap.cc:492] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:45.685469 29110 rpcz_store.cc:276] 0810 11:30:42.974610 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.974677 (+ 67us) service_pool.cc:227] Handling call
0810 11:30:45.565709 (+2591032us) ts_tablet_manager.cc:1145] Deleting tablet 91b6078efadf496fb252f725bdf56b02
0810 11:30:45.565724 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.610296 (+ 44572us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.652212 (+ 41916us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.654528 (+ 2316us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2590423}
I20260810 11:30:45.692827 27231 tablet_bootstrap.cc:654] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.683748 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:45.694005 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:45.694380 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:45.694988 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:45.695302 29284 ts_tablet_manager.cc:1918] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:45.698778 29110 tablet_replica.cc:330] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:45.699123 29284 log.cc:1196] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/809b5b6b65d244cd9186517e39494839
I20260810 11:30:45.699657 29284 ts_tablet_manager.cc:1939] T 809b5b6b65d244cd9186517e39494839 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:45.696928 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 91b6078efadf496fb252f725bdf56b02 (table default.Table_f5acadd3f7ff49d4883a695e2348164f [id=02cec75d98d0411ba2eb17ae8f083f00]) successfully deleted
I20260810 11:30:45.699947 29110 raft_consensus.cc:2229] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:45.700142 29110 raft_consensus.cc:2258] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.700855 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:45.702423 29110 ts_tablet_manager.cc:1905] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:45.702407 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 809b5b6b65d244cd9186517e39494839 (table default.Table_8a7d3a80b9424a56a1b4583e39cadf99 [id=072a54ad9981451c9a5004a46fecd6c1]) successfully deleted
I20260810 11:30:45.703630 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
W20260810 11:30:45.704695 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7c203cd90d2f472fa27cfabed5b87119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c203cd90d2f472fa27cfabed5b87119 already in progress: creating tablet
I20260810 11:30:45.705617 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
W20260810 11:30:45.708271 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet b200bdb394d3439b86fff48494be8e3d because the tablet was not found. No further retry: Not found: Tablet not found: b200bdb394d3439b86fff48494be8e3d
W20260810 11:30:45.709322 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 110b5acc36bd4d6bba13735e5daec75f because the tablet was not found. No further retry: Not found: Tablet not found: 110b5acc36bd4d6bba13735e5daec75f
W20260810 11:30:45.709663 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 3ccef06fa06c4c519d8760fa948d6c8b because the tablet was not found. No further retry: Not found: Tablet not found: 3ccef06fa06c4c519d8760fa948d6c8b
I20260810 11:30:45.710292 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
W20260810 11:30:45.711095 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 0cc17c55109b47eeb91920c3ed8178e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0cc17c55109b47eeb91920c3ed8178e0 already in progress: creating tablet
I20260810 11:30:45.713279 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:45.719926 27231 tablet_bootstrap.cc:492] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
W20260810 11:30:45.714003 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 78633fbe048b4534ae3277ce6b7c4313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78633fbe048b4534ae3277ce6b7c4313 already in progress: creating tablet
I20260810 11:30:45.720150 27231 ts_tablet_manager.cc:1397] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.006s
W20260810 11:30:45.720610 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 518c777e40ec40dcb3484c0374384959 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 518c777e40ec40dcb3484c0374384959 already in progress: creating tablet
I20260810 11:30:45.721274 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:45.721483 27231 raft_consensus.cc:348] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.722034 27231 raft_consensus.cc:374] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.722133 27231 raft_consensus.cc:729] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
W20260810 11:30:45.722115 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet d14091e1c111438bac8bcf3d36123d80 because the tablet was not found. No further retry: Not found: Tablet not found: d14091e1c111438bac8bcf3d36123d80
I20260810 11:30:45.722582 27231 consensus_queue.cc:260] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.723242 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
W20260810 11:30:45.724041 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 23637a02b6464e17aa2a69ea5cc4ddfe because the tablet was not found. No further retry: Not found: Tablet not found: 23637a02b6464e17aa2a69ea5cc4ddfe
W20260810 11:30:45.724861 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 6c715bdcff8c4cdabfddf871f6fdc388 because the tablet was not found. No further retry: Not found: Tablet not found: 6c715bdcff8c4cdabfddf871f6fdc388
I20260810 11:30:45.725442 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
W20260810 11:30:45.726181 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7cd4f555b5d840c182a31b3c94da9619 because the tablet was not found. No further retry: Not found: Tablet not found: 7cd4f555b5d840c182a31b3c94da9619
W20260810 11:30:45.726902 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 already in progress: creating tablet
I20260810 11:30:45.727715 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:45.728788 29284 tablet_replica.cc:330] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:45.729091 29284 raft_consensus.cc:2229] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:45.728485 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet a835d30ef9fc474ab927bb119a95d83c because the tablet was not found. No further retry: Not found: Tablet not found: a835d30ef9fc474ab927bb119a95d83c
I20260810 11:30:45.730204 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:45.730415 27222 tablet_bootstrap.cc:492] T 8083fa130cd04dae9d61aeed977c1c63 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:45.730571 29284 raft_consensus.cc:2258] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.730695 27222 ts_tablet_manager.cc:1397] T 8083fa130cd04dae9d61aeed977c1c63 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.100s user 0.008s sys 0.001s
I20260810 11:30:45.731406 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:45.731635 27222 raft_consensus.cc:348] T 8083fa130cd04dae9d61aeed977c1c63 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.731894 27222 raft_consensus.cc:374] T 8083fa130cd04dae9d61aeed977c1c63 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.731963 27222 raft_consensus.cc:729] T 8083fa130cd04dae9d61aeed977c1c63 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.732417 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:45.732349 27222 consensus_queue.cc:260] T 8083fa130cd04dae9d61aeed977c1c63 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.732906 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:45.733027 27222 ts_tablet_manager.cc:1428] T 8083fa130cd04dae9d61aeed977c1c63 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 11:30:45.733372 27222 tablet_bootstrap.cc:492] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:45.733683 29284 ts_tablet_manager.cc:1905] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:45.734385 27231 ts_tablet_manager.cc:1428] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260810 11:30:45.738243 29316 consensus_queue.cc:1035] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:45.739655 27231 tablet_bootstrap.cc:492] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:45.743841 29284 ts_tablet_manager.cc:1918] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:45.743997 29284 log.cc:1196] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/a63227e69df14a4ea935087fd31ece63
I20260810 11:30:45.744480 29284 ts_tablet_manager.cc:1939] T a63227e69df14a4ea935087fd31ece63 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
W20260810 11:30:45.747081 26991 consensus_peers.cc:487] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:45.737736 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:45.747841 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:45.748311 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 760aeada57464892ae3b9013a761c509 (table default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e]). Expected version 1 got 0
I20260810 11:30:45.748690 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:45.750735 27231 tablet_bootstrap.cc:654] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.750731 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:45.751614 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:45.755398 29316 raft_consensus.cc:482] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:45.755659 29316 raft_consensus.cc:504] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.756641 29316 leader_election.cc:288] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:45.756531 26577 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
W20260810 11:30:45.758644 26700 leader_election.cc:341] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: b200bdb394d3439b86fff48494be8e3d
W20260810 11:30:45.758785 26702 leader_election.cc:341] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: b200bdb394d3439b86fff48494be8e3d
I20260810 11:30:45.758903 26702 leader_election.cc:302] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:45.759488 29316 raft_consensus.cc:2726] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:45.766963 27222 tablet_bootstrap.cc:654] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.766892 28727 raft_consensus.cc:482] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:45.767262 28727 raft_consensus.cc:504] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.768119 28727 leader_election.cc:288] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:45.768893 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43fee1a9a6f9482fbbe6ab6599c27fb9" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:45.769551 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43fee1a9a6f9482fbbe6ab6599c27fb9" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:45.769796 27058 raft_consensus.cc:2454] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
W20260810 11:30:45.770099 26700 leader_election.cc:341] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.771000 26702 leader_election.cc:302] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:45.771503 28727 raft_consensus.cc:2781] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:45.771593 28727 raft_consensus.cc:482] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:45.771661 28727 raft_consensus.cc:3037] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.775712 28727 raft_consensus.cc:504] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.782634 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43fee1a9a6f9482fbbe6ab6599c27fb9" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:45.782816 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43fee1a9a6f9482fbbe6ab6599c27fb9" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:45.783123 27058 raft_consensus.cc:3037] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.783639 26913 raft_consensus.cc:3037] T 5deec04c1be64473accf8b9df14bd22e P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.788437 27058 raft_consensus.cc:2454] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:45.788682 28727 leader_election.cc:288] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:45.789186 26700 leader_election.cc:341] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.790925 28727 consensus_queue.cc:1035] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:45.798612 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet a63227e69df14a4ea935087fd31ece63 (table default.Table_d863b14a3a96454e8ee5a85fb2ab30c8 [id=a40ab01e5be24248b3af7ef1dc456da6]) successfully deleted
I20260810 11:30:45.790921 27231 tablet_bootstrap.cc:492] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:45.803874 27231 ts_tablet_manager.cc:1397] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.064s user 0.000s sys 0.006s
I20260810 11:30:45.804183 26702 leader_election.cc:302] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:45.804854 29315 raft_consensus.cc:2781] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:45.805027 29315 raft_consensus.cc:686] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:45.805042 27231 raft_consensus.cc:348] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.805398 27231 raft_consensus.cc:374] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.805464 27231 raft_consensus.cc:729] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.805401 29315 consensus_queue.cc:237] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.805680 27231 consensus_queue.cc:260] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.806372 27231 ts_tablet_manager.cc:1428] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:45.806751 27231 tablet_bootstrap.cc:492] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:45.791571 29110 ts_tablet_manager.cc:1918] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:45.807402 29110 log.cc:1196] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/256ad2e2d8e54a4caa1b5091bab60dd5
I20260810 11:30:45.808228 29110 ts_tablet_manager.cc:1939] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
W20260810 11:30:45.808463 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 318d5b8453fe4c438d0fa32cb91c409e because the tablet was not found. No further retry: Not found: Tablet not found: 318d5b8453fe4c438d0fa32cb91c409e
I20260810 11:30:45.803505 28466 rpc_server.cc:307] RPC server started. Bound to: 127.25.195.253:34547
I20260810 11:30:45.810357 27231 tablet_bootstrap.cc:654] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:45.811429 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 713663be70014b17b17056a865e7db63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 713663be70014b17b17056a865e7db63 already in progress: creating tablet
I20260810 11:30:45.816735 28466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/master-1/data/info.pb
I20260810 11:30:45.817313 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 89) took 2838 ms. Trace:
I20260810 11:30:45.803520 29387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.195.253:34547 every 8 connection(s)
I20260810 11:30:45.818137 26383 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNjNKA2/build/asan/bin/kudu as pid 28466
I20260810 11:30:45.820143 29110 rpcz_store.cc:276] 0810 11:30:42.978944 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.978999 (+ 55us) service_pool.cc:227] Handling call
0810 11:30:45.698692 (+2719693us) ts_tablet_manager.cc:1145] Deleting tablet 256ad2e2d8e54a4caa1b5091bab60dd5
0810 11:30:45.698714 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.761612 (+ 62898us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.791405 (+ 29793us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.817284 (+ 25879us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2719491}
I20260810 11:30:45.823213 27231 tablet_bootstrap.cc:492] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:45.823715 27231 ts_tablet_manager.cc:1397] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.009s
I20260810 11:30:45.823768 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 256ad2e2d8e54a4caa1b5091bab60dd5 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]) successfully deleted
I20260810 11:30:45.824988 27231 raft_consensus.cc:348] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:45.825309 27231 raft_consensus.cc:374] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.825373 27231 raft_consensus.cc:729] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.825791 27231 consensus_queue.cc:260] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:45.826414 29110 tablet_replica.cc:330] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:45.826635 29110 raft_consensus.cc:2229] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:45.827234 27231 ts_tablet_manager.cc:1428] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 11:30:45.827584 27231 tablet_bootstrap.cc:492] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:45.828166 28727 raft_consensus.cc:482] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:45.828341 28727 raft_consensus.cc:504] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.829954 27231 tablet_bootstrap.cc:654] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:45.830179 26700 leader_election.cc:341] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 256ad2e2d8e54a4caa1b5091bab60dd5
I20260810 11:30:45.830695 29110 raft_consensus.cc:2258] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.831401 29110 ts_tablet_manager.cc:1905] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:45.844507 29110 ts_tablet_manager.cc:1918] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260810 11:30:45.846169 29110 log.cc:1196] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/3851d39aeb3142938a5ac558ab438c21
I20260810 11:30:45.847329 29110 ts_tablet_manager.cc:1939] T 3851d39aeb3142938a5ac558ab438c21 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:45.848546 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 90) took 2869 ms. Trace:
I20260810 11:30:45.849731 29110 rpcz_store.cc:276] 0810 11:30:42.979324 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.979385 (+ 61us) service_pool.cc:227] Handling call
0810 11:30:45.826360 (+2846975us) ts_tablet_manager.cc:1145] Deleting tablet 3851d39aeb3142938a5ac558ab438c21
0810 11:30:45.826373 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.838983 (+ 12610us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.844387 (+ 5404us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.848524 (+ 4137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3807,"tablet-delete.queue_time_us":2846800}
I20260810 11:30:45.850701 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 3851d39aeb3142938a5ac558ab438c21 (table default.Table_07ad990413b541f5b90b5f0f813635d3 [id=b6d04667c02048fda37c47346472dba5]) successfully deleted
I20260810 11:30:45.850814 29110 tablet_replica.cc:330] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:45.851330 29110 raft_consensus.cc:2229] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:45.851856 29110 raft_consensus.cc:2258] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.854387 29110 ts_tablet_manager.cc:1905] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:45.857275 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:45.858362 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:45.865653 27231 tablet_bootstrap.cc:492] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:45.865983 27231 ts_tablet_manager.cc:1397] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.006s
I20260810 11:30:45.865711 29110 ts_tablet_manager.cc:1918] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:45.866655 29110 log.cc:1196] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/43fee1a9a6f9482fbbe6ab6599c27fb9
I20260810 11:30:45.866979 27231 raft_consensus.cc:348] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:45.867216 27231 raft_consensus.cc:374] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.867347 27231 raft_consensus.cc:729] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.867688 29110 ts_tablet_manager.cc:1939] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:45.867605 27231 consensus_queue.cc:260] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:45.867828 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:45.868484 27231 ts_tablet_manager.cc:1428] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:45.868856 27231 tablet_bootstrap.cc:492] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:45.869087 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 81b800247b4e4171b82dcde68e39fb00 (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]). Expected version 1 got 0
I20260810 11:30:45.870332 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
I20260810 11:30:45.871397 28987 ts_tablet_manager.cc:1918] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:45.871551 28987 log.cc:1196] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/55c8749861874eca9b63d3db97afa2b1
I20260810 11:30:45.871631 27231 tablet_bootstrap.cc:654] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.872012 28987 ts_tablet_manager.cc:1939] T 55c8749861874eca9b63d3db97afa2b1 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
W20260810 11:30:45.876926 27290 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet afbe6ce99f7c4f7cb939bea086cd90be consensus state has no leader
I20260810 11:30:45.877347 29314 consensus_queue.cc:1035] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:45.878324 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 91) took 2898 ms. Trace:
I20260810 11:30:45.878435 29110 rpcz_store.cc:276] 0810 11:30:42.979766 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.979812 (+ 46us) service_pool.cc:227] Handling call
0810 11:30:45.850758 (+2870946us) ts_tablet_manager.cc:1145] Deleting tablet 43fee1a9a6f9482fbbe6ab6599c27fb9
0810 11:30:45.850772 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.857897 (+ 7125us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.865594 (+ 7697us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.878303 (+ 12709us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2870796}
I20260810 11:30:45.879407 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 92) took 2899 ms. Trace:
I20260810 11:30:45.879531 29110 rpcz_store.cc:276] 0810 11:30:42.980182 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.980229 (+ 47us) service_pool.cc:227] Handling call
0810 11:30:45.879089 (+2898860us) ts_tablet_manager.cc:1145] Deleting tablet 78633fbe048b4534ae3277ce6b7c4313
0810 11:30:45.879108 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.879377 (+ 269us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2898701}
I20260810 11:30:45.879985 29110 tablet_replica.cc:330] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:45.880283 29110 raft_consensus.cc:2229] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:45.880472 29110 raft_consensus.cc:2258] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.881156 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 103) took 3934 ms. Trace:
I20260810 11:30:45.881285 28987 rpcz_store.cc:276] 0810 11:30:41.946426 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.947113 (+ 687us) service_pool.cc:227] Handling call
0810 11:30:45.534221 (+3587108us) ts_tablet_manager.cc:1145] Deleting tablet 55c8749861874eca9b63d3db97afa2b1
0810 11:30:45.534232 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.810397 (+276165us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.871263 (+ 60866us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.881127 (+ 9864us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3556951}
I20260810 11:30:45.882318 29314 raft_consensus.cc:482] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:45.882525 29314 raft_consensus.cc:504] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.882723 28987 tablet_replica.cc:330] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:45.882916 28987 raft_consensus.cc:2229] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:45.883069 28987 raft_consensus.cc:2258] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.883191 29314 leader_election.cc:288] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:45.885269 29290 raft_consensus.cc:482] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:45.885450 28987 ts_tablet_manager.cc:1905] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:45.885479 29290 raft_consensus.cc:504] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.886349 29290 leader_election.cc:288] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:45.887075 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6926d0dc68fa48ae8ffabf5b5272b3d0" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:45.887149 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3e78dcaa55491393f529ea33007786" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:45.887916 26700 leader_election.cc:341] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.888335 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6926d0dc68fa48ae8ffabf5b5272b3d0" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:45.888726 27058 raft_consensus.cc:2454] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:45.888741 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3e78dcaa55491393f529ea33007786" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:45.888823 29110 ts_tablet_manager.cc:1905] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:45.888983 26908 raft_consensus.cc:2454] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:45.889292 26702 leader_election.cc:302] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
W20260810 11:30:45.889642 26993 leader_election.cc:341] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.889825 29314 raft_consensus.cc:2781] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:45.889930 29314 raft_consensus.cc:482] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:45.890035 29314 raft_consensus.cc:3037] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.890455 26991 leader_election.cc:302] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:45.890831 29290 raft_consensus.cc:2781] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:45.890914 29290 raft_consensus.cc:482] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:45.890978 29290 raft_consensus.cc:3037] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.894147 29290 raft_consensus.cc:504] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.895983 29110 ts_tablet_manager.cc:1918] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:45.896122 29110 log.cc:1196] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/ff9b649e43a9456fa51cf3330290bb91
I20260810 11:30:45.896034 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3e78dcaa55491393f529ea33007786" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:45.896183 28727 leader_election.cc:288] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:45.879442 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 (table default.Table_340e7b53369c44cda0cb60ddbb328ccc [id=7861512191c341b9a85c6a1885a52ca7]) successfully deleted
W20260810 11:30:45.898981 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 78633fbe048b4534ae3277ce6b7c4313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78633fbe048b4534ae3277ce6b7c4313 already in progress: creating tablet
I20260810 11:30:45.881975 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 55c8749861874eca9b63d3db97afa2b1 (table default.Table_1c6221759f954488a1e7df4252c2a6ae [id=996f45529be941409f77e6682591b900]) successfully deleted
I20260810 11:30:45.900317 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:45.900342 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3e78dcaa55491393f529ea33007786" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:45.901224 26908 raft_consensus.cc:3037] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.902899 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:45.903333 29314 raft_consensus.cc:504] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.904299 26908 raft_consensus.cc:2454] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
W20260810 11:30:45.905150 26702 leader_election.cc:341] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 256ad2e2d8e54a4caa1b5091bab60dd5
I20260810 11:30:45.905292 26702 leader_election.cc:302] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:45.905378 29314 leader_election.cc:288] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:45.905805 29314 raft_consensus.cc:2726] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:45.896531 29110 ts_tablet_manager.cc:1939] T ff9b649e43a9456fa51cf3330290bb91 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:45.907284 27222 tablet_bootstrap.cc:492] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:45.907455 27222 ts_tablet_manager.cc:1397] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.174s user 0.002s sys 0.004s
I20260810 11:30:45.908226 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:45.908286 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 93) took 2927 ms. Trace:
I20260810 11:30:45.908295 27222 raft_consensus.cc:348] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.908412 29110 rpcz_store.cc:276] 0810 11:30:42.980607 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.980652 (+ 45us) service_pool.cc:227] Handling call
0810 11:30:45.879876 (+2899224us) ts_tablet_manager.cc:1145] Deleting tablet ff9b649e43a9456fa51cf3330290bb91
0810 11:30:45.879943 (+ 67us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.892619 (+ 12676us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.895851 (+ 3232us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.908253 (+ 12402us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2899089}
I20260810 11:30:45.909262 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:45.908550 27222 raft_consensus.cc:374] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.910097 27222 raft_consensus.cc:729] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.910363 29110 tablet_replica.cc:330] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:45.910354 27222 consensus_queue.cc:260] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.910625 29110 raft_consensus.cc:2229] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:45.910806 29110 raft_consensus.cc:2258] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.911008 27222 ts_tablet_manager.cc:1428] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:45.911324 27222 tablet_bootstrap.cc:492] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:45.911453 29110 ts_tablet_manager.cc:1905] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:45.896974 26993 leader_election.cc:341] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.909718 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6926d0dc68fa48ae8ffabf5b5272b3d0" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:45.916294 27057 raft_consensus.cc:3037] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:45.923251 29314 consensus_queue.cc:1035] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:45.913444 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet ff9b649e43a9456fa51cf3330290bb91 (table default.Table_4ce8a3965b484cdb8c1f9b7d7e318755 [id=1ef3626d71d5408692ce0f62d2d5eca1]) successfully deleted
I20260810 11:30:45.928341 29110 ts_tablet_manager.cc:1918] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:45.928903 29110 log.cc:1196] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/a8a65a0e8b1f4e4b8d9a82059b766cda
I20260810 11:30:45.929826 29110 ts_tablet_manager.cc:1939] T a8a65a0e8b1f4e4b8d9a82059b766cda P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:45.931382 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 94) took 2950 ms. Trace:
I20260810 11:30:45.931668 29110 rpcz_store.cc:276] 0810 11:30:42.980932 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.980973 (+ 41us) service_pool.cc:227] Handling call
0810 11:30:45.910299 (+2929326us) ts_tablet_manager.cc:1145] Deleting tablet a8a65a0e8b1f4e4b8d9a82059b766cda
0810 11:30:45.910312 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.915795 (+ 5483us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.928072 (+ 12277us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.931346 (+ 3274us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2929196}
I20260810 11:30:45.906569 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6926d0dc68fa48ae8ffabf5b5272b3d0" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:45.931857 27057 raft_consensus.cc:2454] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:45.923439 29297 consensus_queue.cc:1035] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:45.932718 29110 tablet_replica.cc:330] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:45.932920 26702 leader_election.cc:302] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:45.933037 29110 raft_consensus.cc:2229] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:45.933403 29110 raft_consensus.cc:2258] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.933466 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet a8a65a0e8b1f4e4b8d9a82059b766cda (table default.Table_ad62ebe50ede4d7d96922bac3e954f9e [id=a9ff451e18b54994abfa288ecac98560]) successfully deleted
I20260810 11:30:45.933698 29290 leader_election.cc:288] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:45.933974 29142 raft_consensus.cc:2781] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:45.934161 29142 raft_consensus.cc:686] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:45.934293 29110 ts_tablet_manager.cc:1905] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:45.934494 29142 consensus_queue.cc:237] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.937701 27222 tablet_bootstrap.cc:654] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.945384 29110 ts_tablet_manager.cc:1918] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:45.945760 29110 log.cc:1196] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/a835d30ef9fc474ab927bb119a95d83c
I20260810 11:30:45.946414 29110 ts_tablet_manager.cc:1939] T a835d30ef9fc474ab927bb119a95d83c P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:45.947893 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 95) took 2966 ms. Trace:
I20260810 11:30:45.948272 29110 rpcz_store.cc:276] 0810 11:30:42.981237 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.981276 (+ 39us) service_pool.cc:227] Handling call
0810 11:30:45.932652 (+2951376us) ts_tablet_manager.cc:1145] Deleting tablet a835d30ef9fc474ab927bb119a95d83c
0810 11:30:45.932669 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.939521 (+ 6852us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.945177 (+ 5656us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.947853 (+ 2676us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2951246}
I20260810 11:30:45.949235 29110 tablet_replica.cc:330] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:45.949283 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet a835d30ef9fc474ab927bb119a95d83c (table default.Table_eecd0244ecc849339f452f38db67c973 [id=41d3dec833b54d1e855194862cb1726b]) successfully deleted
I20260810 11:30:45.949558 29110 raft_consensus.cc:2229] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:45.949921 29110 raft_consensus.cc:2258] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.950771 29110 ts_tablet_manager.cc:1905] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:45.958914 29110 ts_tablet_manager.cc:1918] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:45.959517 29110 log.cc:1196] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/a63227e69df14a4ea935087fd31ece63
I20260810 11:30:45.962579 29110 ts_tablet_manager.cc:1939] T a63227e69df14a4ea935087fd31ece63 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:45.964113 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 96) took 2982 ms. Trace:
I20260810 11:30:45.964326 29110 rpcz_store.cc:276] 0810 11:30:42.981493 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.981527 (+ 34us) service_pool.cc:227] Handling call
0810 11:30:45.949167 (+2967640us) ts_tablet_manager.cc:1145] Deleting tablet a63227e69df14a4ea935087fd31ece63
0810 11:30:45.949184 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.954575 (+ 5391us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.958526 (+ 3951us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.964083 (+ 5557us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2967471}
I20260810 11:30:45.965880 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet a63227e69df14a4ea935087fd31ece63 (table default.Table_d863b14a3a96454e8ee5a85fb2ab30c8 [id=a40ab01e5be24248b3af7ef1dc456da6]) successfully deleted
I20260810 11:30:45.966010 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 97) took 2984 ms. Trace:
I20260810 11:30:45.966144 29110 rpcz_store.cc:276] 0810 11:30:42.981788 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.981825 (+ 37us) service_pool.cc:227] Handling call
0810 11:30:45.965861 (+2984036us) ts_tablet_manager.cc:1145] Deleting tablet 3ccef06fa06c4c519d8760fa948d6c8b
0810 11:30:45.965881 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.965989 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2983907}
W20260810 11:30:45.966969 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 3ccef06fa06c4c519d8760fa948d6c8b because the tablet was not found. No further retry: Not found: Tablet not found: 3ccef06fa06c4c519d8760fa948d6c8b
I20260810 11:30:45.967360 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 98) took 2985 ms. Trace:
I20260810 11:30:45.967490 29110 rpcz_store.cc:276] 0810 11:30:42.982098 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.982139 (+ 41us) service_pool.cc:227] Handling call
0810 11:30:45.967177 (+2985038us) ts_tablet_manager.cc:1145] Deleting tablet cc76d30f37094391b75076c92ccc277f
0810 11:30:45.967197 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.967334 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2984879}
I20260810 11:30:45.968451 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 100) took 2970 ms. Trace:
W20260810 11:30:45.968508 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet cc76d30f37094391b75076c92ccc277f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc76d30f37094391b75076c92ccc277f already in progress: creating tablet
I20260810 11:30:45.968876 29110 rpcz_store.cc:276] 0810 11:30:42.997927 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.998012 (+ 85us) service_pool.cc:227] Handling call
0810 11:30:45.968326 (+2970314us) ts_tablet_manager.cc:1145] Deleting tablet 6c715bdcff8c4cdabfddf871f6fdc388
0810 11:30:45.968343 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.968429 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2969888}
W20260810 11:30:45.969632 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 6c715bdcff8c4cdabfddf871f6fdc388 because the tablet was not found. No further retry: Not found: Tablet not found: 6c715bdcff8c4cdabfddf871f6fdc388
I20260810 11:30:45.969889 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 101) took 2969 ms. Trace:
I20260810 11:30:45.970072 29110 rpcz_store.cc:276] 0810 11:30:43.000816 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.000888 (+ 72us) service_pool.cc:227] Handling call
0810 11:30:45.969767 (+2968879us) ts_tablet_manager.cc:1145] Deleting tablet d14091e1c111438bac8bcf3d36123d80
0810 11:30:45.969781 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.969865 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2968632}
W20260810 11:30:45.970717 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet d14091e1c111438bac8bcf3d36123d80 because the tablet was not found. No further retry: Not found: Tablet not found: d14091e1c111438bac8bcf3d36123d80
I20260810 11:30:45.970768 29110 tablet_replica.cc:330] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:45.971058 29110 raft_consensus.cc:2229] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:45.971339 29110 raft_consensus.cc:2258] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.972496 29110 ts_tablet_manager.cc:1905] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:45.973416 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:45.973984 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:45.974704 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:45.975405 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:45.976161 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
W20260810 11:30:45.976770 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 53621.5us
W20260810 11:30:45.976895 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 48814.3us
I20260810 11:30:45.977264 26991 leader_election.cc:302] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
W20260810 11:30:45.977391 26700 leader_election.cc:341] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:45.977775 29290 raft_consensus.cc:2781] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:45.978015 29290 raft_consensus.cc:686] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:45.978288 29290 consensus_queue.cc:237] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.979159 27231 tablet_bootstrap.cc:492] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:45.979293 27231 ts_tablet_manager.cc:1397] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.111s user 0.006s sys 0.017s
I20260810 11:30:45.980171 27231 raft_consensus.cc:348] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:45.980441 27231 raft_consensus.cc:374] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.980505 27231 raft_consensus.cc:729] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.980767 27231 consensus_queue.cc:260] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:45.981488 27231 ts_tablet_manager.cc:1428] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 11:30:45.981808 27231 tablet_bootstrap.cc:492] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:45.984336 27231 tablet_bootstrap.cc:654] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:45.986413 27222 tablet_bootstrap.cc:492] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:45.986660 27222 ts_tablet_manager.cc:1397] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.075s user 0.008s sys 0.000s
I20260810 11:30:45.987679 27222 raft_consensus.cc:348] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.988034 27222 raft_consensus.cc:374] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:45.988173 27222 raft_consensus.cc:729] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:45.988493 27222 consensus_queue.cc:260] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:45.989143 27222 ts_tablet_manager.cc:1428] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:45.989697 29110 ts_tablet_manager.cc:1918] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:45.992648 26963 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:45.992679 29110 log.cc:1196] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/64818ca5827e41d99428903ddb8688d9
I20260810 11:30:45.993111 29110 ts_tablet_manager.cc:1939] T 64818ca5827e41d99428903ddb8688d9 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:45.994947 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 102) took 2969 ms. Trace:
I20260810 11:30:45.995066 29110 rpcz_store.cc:276] 0810 11:30:43.025143 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.025202 (+ 59us) service_pool.cc:227] Handling call
0810 11:30:45.970698 (+2945496us) ts_tablet_manager.cc:1145] Deleting tablet 64818ca5827e41d99428903ddb8688d9
0810 11:30:45.970713 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.977024 (+ 6311us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.989586 (+ 12562us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:45.994921 (+ 5335us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2881475}
I20260810 11:30:45.996987 29110 tablet_replica.cc:330] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:45.997505 29110 raft_consensus.cc:2229] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:45.998008 29110 raft_consensus.cc:2258] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:45.999058 29110 ts_tablet_manager.cc:1905] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:46.000228 27231 tablet_bootstrap.cc:492] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:46.000758 27231 ts_tablet_manager.cc:1397] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.004s
I20260810 11:30:46.002101 27231 raft_consensus.cc:348] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.002426 27231 raft_consensus.cc:374] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.002528 27231 raft_consensus.cc:729] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.002873 29290 raft_consensus.cc:482] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.003047 27231 consensus_queue.cc:260] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.003259 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:46.003696 27231 ts_tablet_manager.cc:1428] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 11:30:46.004026 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:46.004720 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:46.005463 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:46.006263 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
W20260810 11:30:45.984293 26567 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 consensus state has no leader
I20260810 11:30:45.995734 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 64818ca5827e41d99428903ddb8688d9 (table default.Table_fb7b13261243442c9c4d8749871c1d1a [id=926b5b59f3fc4de6baeac9dbfdeed8f5]) successfully deleted
I20260810 11:30:46.007306 27231 tablet_bootstrap.cc:492] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:46.009145 27231 tablet_bootstrap.cc:654] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:46.009514 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:46.003211 29290 raft_consensus.cc:504] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.011255 29290 leader_election.cc:288] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:46.011780 29412 consensus_queue.cc:1035] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:46.011250 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:46.012751 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8228600e3f6b4f9993dd25e4ceb57e4d" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:46.012826 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:46.013172 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
W20260810 11:30:46.014335 26991 leader_election.cc:341] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.019455 29110 ts_tablet_manager.cc:1918] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:46.019788 29110 log.cc:1196] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/318d5b8453fe4c438d0fa32cb91c409e
I20260810 11:30:46.020355 29110 ts_tablet_manager.cc:1939] T 318d5b8453fe4c438d0fa32cb91c409e P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:46.002936 28987 ts_tablet_manager.cc:1918] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:46.012382 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8228600e3f6b4f9993dd25e4ceb57e4d" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:46.021116 27222 tablet_bootstrap.cc:492] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:46.021364 28987 log.cc:1196] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/44d5e146eeec4fe0be33c1c169d32e68
W20260810 11:30:46.021517 26993 leader_election.cc:341] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.021660 26993 leader_election.cc:302] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:46.022086 29178 raft_consensus.cc:2726] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:46.022173 28987 ts_tablet_manager.cc:1939] T 44d5e146eeec4fe0be33c1c169d32e68 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:46.023137 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 104) took 4075 ms. Trace:
I20260810 11:30:46.023173 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 103) took 2997 ms. Trace:
I20260810 11:30:46.023262 29110 rpcz_store.cc:276] 0810 11:30:43.025518 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.025573 (+ 55us) service_pool.cc:227] Handling call
0810 11:30:45.996938 (+2971365us) ts_tablet_manager.cc:1145] Deleting tablet 318d5b8453fe4c438d0fa32cb91c409e
0810 11:30:45.996951 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.015866 (+ 18915us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.019341 (+ 3475us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.023153 (+ 3812us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":117028,"tablet-delete.queue_time_us":2907657}
I20260810 11:30:46.023340 28987 rpcz_store.cc:276] 0810 11:30:41.947685 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.948261 (+ 576us) service_pool.cc:227] Handling call
0810 11:30:45.882668 (+3934407us) ts_tablet_manager.cc:1145] Deleting tablet 44d5e146eeec4fe0be33c1c169d32e68
0810 11:30:45.882682 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:45.917452 (+ 34770us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.002797 (+ 85345us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.023053 (+ 20256us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3905245}
I20260810 11:30:46.023874 29110 tablet_replica.cc:330] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:46.024209 29110 raft_consensus.cc:2229] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:46.024246 28987 tablet_replica.cc:330] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:46.024432 29110 raft_consensus.cc:2258] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:46.024430 28987 raft_consensus.cc:2229] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:46.024775 28987 pending_rounds.cc:62] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d: Trying to abort 1 pending ops.
I20260810 11:30:46.024905 28987 pending_rounds.cc:68] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936471894773760 op_type: NO_OP noop_request { }
I20260810 11:30:46.025131 29110 ts_tablet_manager.cc:1905] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:46.025141 28987 raft_consensus.cc:2866] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:46.025236 28987 raft_consensus.cc:2258] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:46.026588 28987 ts_tablet_manager.cc:1905] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:46.033802 27231 tablet_bootstrap.cc:492] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:46.034113 27231 ts_tablet_manager.cc:1397] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.001s
I20260810 11:30:46.035151 27231 raft_consensus.cc:348] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.035624 27231 raft_consensus.cc:374] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.035744 27231 raft_consensus.cc:729] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.036074 27231 consensus_queue.cc:260] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.036458 26821 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:46.037186 27231 ts_tablet_manager.cc:1428] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:46.037539 27231 tablet_bootstrap.cc:492] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:46.038291 29178 raft_consensus.cc:482] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.038424 29178 raft_consensus.cc:504] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.039207 29178 leader_election.cc:288] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:46.040024 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1e46f80f7f4e3a84638421892e6236" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:46.040236 27231 tablet_bootstrap.cc:654] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:46.023865 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 318d5b8453fe4c438d0fa32cb91c409e (table default.Table_0ca6793e2c374e8d8d93872a0b2283d6 [id=ae0e3b2d14964558848b1a00a6ddc2c6]) successfully deleted
I20260810 11:30:46.024108 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 44d5e146eeec4fe0be33c1c169d32e68 (table default.Table_733cd3d375dd4cf9b1297c9395073c3c [id=9b6492211433453495bdb14155a56a85]) successfully deleted
W20260810 11:30:46.042554 26991 leader_election.cc:341] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.044791 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:46.047263 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:46.049549 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1e46f80f7f4e3a84638421892e6236" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:46.049772 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
W20260810 11:30:46.050443 26993 leader_election.cc:341] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.050585 26993 leader_election.cc:302] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:46.050998 29290 raft_consensus.cc:2726] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:46.051074 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:46.052980 29412 raft_consensus.cc:482] T afbe6ce99f7c4f7cb939bea086cd90be P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.053162 29412 raft_consensus.cc:504] T afbe6ce99f7c4f7cb939bea086cd90be P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.053817 29412 leader_election.cc:288] T afbe6ce99f7c4f7cb939bea086cd90be P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:46.054749 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:46.056226 27048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afbe6ce99f7c4f7cb939bea086cd90be" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:46.056664 26578 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:46.059577 29110 ts_tablet_manager.cc:1918] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:46.059729 29110 log.cc:1196] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/f7ada1df82eb44ecb9a6c615b5410e6f
I20260810 11:30:46.061545 29110 ts_tablet_manager.cc:1939] T f7ada1df82eb44ecb9a6c615b5410e6f P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:46.063750 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 105) took 3037 ms. Trace:
I20260810 11:30:46.064019 27222 tablet_bootstrap.cc:654] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:46.065025 29110 rpcz_store.cc:276] 0810 11:30:43.026374 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.026416 (+ 42us) service_pool.cc:227] Handling call
0810 11:30:46.023829 (+2997413us) ts_tablet_manager.cc:1145] Deleting tablet f7ada1df82eb44ecb9a6c615b5410e6f
0810 11:30:46.023840 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.032040 (+ 8200us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.059465 (+ 27425us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.063723 (+ 4258us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":116964,"tablet-delete.queue_time_us":2934437}
I20260810 11:30:46.065831 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet f7ada1df82eb44ecb9a6c615b5410e6f (table default.Table_635ef5268ea1426bb6578ba498e616e3 [id=fef997439a4346d2a9c6f2a4277ede5a]) successfully deleted
I20260810 11:30:46.065903 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 106) took 3039 ms. Trace:
I20260810 11:30:46.065992 29110 rpcz_store.cc:276] 0810 11:30:43.026722 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.026809 (+ 87us) service_pool.cc:227] Handling call
0810 11:30:46.065682 (+3038873us) ts_tablet_manager.cc:1145] Deleting tablet 713663be70014b17b17056a865e7db63
0810 11:30:46.065694 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.065863 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":116968,"tablet-delete.queue_time_us":2976237}
W20260810 11:30:46.070003 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 713663be70014b17b17056a865e7db63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 713663be70014b17b17056a865e7db63 already in progress: creating tablet
I20260810 11:30:46.072134 28987 ts_tablet_manager.cc:1918] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:46.073972 29110 tablet_replica.cc:330] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:46.074250 29110 raft_consensus.cc:2229] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:46.074739 29110 raft_consensus.cc:2258] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:46.075505 29110 ts_tablet_manager.cc:1905] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:46.074596 29314 raft_consensus.cc:482] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.083462 29314 raft_consensus.cc:504] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.084264 29314 leader_election.cc:288] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:46.080978 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afbe6ce99f7c4f7cb939bea086cd90be" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:46.084825 26767 raft_consensus.cc:2379] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
I20260810 11:30:46.085224 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3e78dcaa55491393f529ea33007786" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:46.085784 28987 log.cc:1196] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/1860e56467624dcdb288e13b004f78cc
I20260810 11:30:46.088649 26965 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:46.086463 27222 tablet_bootstrap.cc:492] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:46.089543 27222 ts_tablet_manager.cc:1397] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.008s
I20260810 11:30:46.090765 27222 raft_consensus.cc:348] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.091127 27222 raft_consensus.cc:374] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.091255 27222 raft_consensus.cc:729] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.091406 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3e78dcaa55491393f529ea33007786" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:46.091696 26913 raft_consensus.cc:2379] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate 482e605580be48cbbacce05a3e61c215 in this term.
I20260810 11:30:46.091610 27222 consensus_queue.cc:260] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.092167 29110 ts_tablet_manager.cc:1918] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:46.092202 27222 ts_tablet_manager.cc:1428] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:46.092305 29110 log.cc:1196] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/2634beb347714fc7a2e05865adb34a22
I20260810 11:30:46.092605 27222 tablet_bootstrap.cc:492] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:46.092574 26849 leader_election.cc:302] T afbe6ce99f7c4f7cb939bea086cd90be P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:46.092751 29110 ts_tablet_manager.cc:1939] T 2634beb347714fc7a2e05865adb34a22 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:46.093082 29297 raft_consensus.cc:3037] T afbe6ce99f7c4f7cb939bea086cd90be P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.093936 26700 leader_election.cc:302] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:46.094345 29142 raft_consensus.cc:3037] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.095465 27222 tablet_bootstrap.cc:654] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:46.095665 29297 raft_consensus.cc:2726] T afbe6ce99f7c4f7cb939bea086cd90be P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:46.097404 29142 raft_consensus.cc:2726] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:46.097494 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 107) took 3070 ms. Trace:
I20260810 11:30:46.097630 29110 rpcz_store.cc:276] 0810 11:30:43.026834 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.027069 (+ 235us) service_pool.cc:227] Handling call
0810 11:30:46.073910 (+3046841us) ts_tablet_manager.cc:1145] Deleting tablet 2634beb347714fc7a2e05865adb34a22
0810 11:30:46.073925 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.088343 (+ 14418us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.092058 (+ 3715us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.097467 (+ 5409us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":116967,"tablet-delete.queue_time_us":2984396}
I20260810 11:30:46.098294 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 2634beb347714fc7a2e05865adb34a22 (table default.Table_538c35ba9808453e870597b4257cefaa [id=e74be4ed04f542bda950d5f318b74c65]) successfully deleted
I20260810 11:30:46.098649 29110 tablet_replica.cc:330] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:46.098914 29110 raft_consensus.cc:2229] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:46.099135 29110 raft_consensus.cc:2258] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:46.099941 29110 ts_tablet_manager.cc:1905] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:46.104513 27228 tablet_bootstrap.cc:654] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:46.105242 28987 ts_tablet_manager.cc:1939] T 1860e56467624dcdb288e13b004f78cc P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:46.108034 27112 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:46.121543 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 105) took 4172 ms. Trace:
I20260810 11:30:46.122745 28987 rpcz_store.cc:276] 0810 11:30:41.949025 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:41.949633 (+ 608us) service_pool.cc:227] Handling call
0810 11:30:46.023684 (+4074051us) ts_tablet_manager.cc:1145] Deleting tablet 1860e56467624dcdb288e13b004f78cc
0810 11:30:46.024202 (+ 518us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.030406 (+ 6204us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.072005 (+ 41599us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.121508 (+ 49503us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":56,"tablet-delete.queue_time_us":4046111}
I20260810 11:30:46.124207 27231 tablet_bootstrap.cc:492] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:46.125124 27231 ts_tablet_manager.cc:1397] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.088s user 0.007s sys 0.000s
I20260810 11:30:46.126271 27231 raft_consensus.cc:348] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.126664 27231 raft_consensus.cc:374] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.122567 27222 tablet_bootstrap.cc:492] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:46.126740 27231 raft_consensus.cc:729] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.126945 27222 ts_tablet_manager.cc:1397] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.003s
I20260810 11:30:46.127022 27231 consensus_queue.cc:260] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.127806 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 1860e56467624dcdb288e13b004f78cc (table default.Table_5a4c04e087c3490fae87a17247850531 [id=323f239c11f84a69beaf74e68c0cf50a]) successfully deleted
I20260810 11:30:46.132486 27222 raft_consensus.cc:348] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.144289 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:46.145627 27231 ts_tablet_manager.cc:1428] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260810 11:30:46.129211 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 111) took 3546 ms. Trace:
I20260810 11:30:46.143905 26823 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:46.145867 27222 raft_consensus.cc:374] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.146886 27222 raft_consensus.cc:729] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.146663 28987 rpcz_store.cc:276] 0810 11:30:42.583135 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.583189 (+ 54us) service_pool.cc:227] Handling call
0810 11:30:46.127542 (+3544353us) ts_tablet_manager.cc:1145] Deleting tablet 2801709d53614916abac370f7ae5e913
0810 11:30:46.127560 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.129186 (+ 1626us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3544070}
I20260810 11:30:46.148006 28987 tablet_replica.cc:330] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:46.148504 28987 raft_consensus.cc:2229] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:46.148824 28987 raft_consensus.cc:2258] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:46.150307 28987 ts_tablet_manager.cc:1905] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:46.154704 27231 tablet_bootstrap.cc:492] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:46.150579 27222 consensus_queue.cc:260] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.158236 27222 ts_tablet_manager.cc:1428] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.031s user 0.003s sys 0.000s
I20260810 11:30:46.158870 27222 tablet_bootstrap.cc:492] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:46.160012 27228 tablet_bootstrap.cc:492] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:46.160249 27228 ts_tablet_manager.cc:1397] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.491s user 0.020s sys 0.005s
W20260810 11:30:46.149024 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2801709d53614916abac370f7ae5e913 because the tablet was not found. No further retry: Not found: Tablet not found: 2801709d53614916abac370f7ae5e913
I20260810 11:30:46.162658 27228 raft_consensus.cc:348] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.162926 27228 raft_consensus.cc:374] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.162987 27228 raft_consensus.cc:729] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.164225 29110 ts_tablet_manager.cc:1918] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:46.164390 29110 log.cc:1196] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/420ba6e9f74c4ae5bf450f369e7fbdb3
I20260810 11:30:46.164418 27228 consensus_queue.cc:260] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.164865 29110 ts_tablet_manager.cc:1939] T 420ba6e9f74c4ae5bf450f369e7fbdb3 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:46.166064 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
W20260810 11:30:46.166893 26700 consensus_peers.cc:487] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:46.167336 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:46.171350 28987 ts_tablet_manager.cc:1918] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:46.171918 26576 catalog_manager.cc:5495] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:46.174021 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 109) took 3146 ms. Trace:
I20260810 11:30:46.173493 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:46.174916 29110 rpcz_store.cc:276] 0810 11:30:43.027158 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.027216 (+ 58us) service_pool.cc:227] Handling call
0810 11:30:46.098039 (+3070823us) ts_tablet_manager.cc:1145] Deleting tablet 420ba6e9f74c4ae5bf450f369e7fbdb3
0810 11:30:46.098052 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.103988 (+ 5936us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.163752 (+ 59764us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.173984 (+ 10232us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":116974,"tablet-delete.queue_time_us":3008536}
I20260810 11:30:46.174708 26576 catalog_manager.cc:5495] T 5409c96c1949416e85cfcaa8f2f61227 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:46.176486 29110 tablet_replica.cc:330] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:46.176687 27228 ts_tablet_manager.cc:1428] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.016s user 0.002s sys 0.002s
I20260810 11:30:46.177083 27228 tablet_bootstrap.cc:492] T 5409c96c1949416e85cfcaa8f2f61227 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:46.176354 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 (table default.Table_4e27e43aa8d9444ca022be053fcd700e [id=b6297673b9854cf79ae182f5f51ebd36]) successfully deleted
I20260810 11:30:46.178552 27228 tablet_bootstrap.cc:654] T 5409c96c1949416e85cfcaa8f2f61227 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:46.179322 26576 catalog_manager.cc:5495] T b755744059b04967857c1b00e951b8ee P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:46.180127 29110 raft_consensus.cc:2229] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:46.180474 29110 raft_consensus.cc:2258] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:46.181983 26965 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:46.172858 27222 tablet_bootstrap.cc:654] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:46.182685 29142 raft_consensus.cc:482] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.183948 29142 raft_consensus.cc:504] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.185175 29142 leader_election.cc:288] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:46.186931 29290 consensus_queue.cc:1035] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:46.187395 28987 log.cc:1196] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/256ad2e2d8e54a4caa1b5091bab60dd5
I20260810 11:30:46.188002 28987 ts_tablet_manager.cc:1939] T 256ad2e2d8e54a4caa1b5091bab60dd5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:46.187124 29110 ts_tablet_manager.cc:1905] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:46.190094 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40f5eecfc66a4711aef60c1a2bff6b97" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:46.183254 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:46.190339 27057 raft_consensus.cc:2454] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:46.191087 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 81b800247b4e4171b82dcde68e39fb00 (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]). Expected version 1 got 0
I20260810 11:30:46.191395 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
I20260810 11:30:46.192058 26576 catalog_manager.cc:5495] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:46.190919 26702 leader_election.cc:302] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:46.192905 29142 raft_consensus.cc:2781] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:46.193085 29142 raft_consensus.cc:482] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:46.193241 29142 raft_consensus.cc:3037] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.193825 28727 raft_consensus.cc:482] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.193949 28727 raft_consensus.cc:504] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.194823 28727 leader_election.cc:288] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:46.195111 29290 raft_consensus.cc:482] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.195327 29290 raft_consensus.cc:504] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.195958 29290 leader_election.cc:288] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:46.196106 29142 raft_consensus.cc:504] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.196744 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e276b0fa124d42dfb3fe750d245e44d8" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:46.196782 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e276b0fa124d42dfb3fe750d245e44d8" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:46.197412 26993 leader_election.cc:341] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:46.197551 26991 leader_election.cc:341] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.197664 26991 leader_election.cc:302] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:46.197791 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 112) took 3614 ms. Trace:
I20260810 11:30:46.198442 29290 raft_consensus.cc:2726] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:46.199441 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40f5eecfc66a4711aef60c1a2bff6b97" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:46.199694 27058 raft_consensus.cc:3037] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.203639 27058 raft_consensus.cc:2454] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:46.204493 26702 leader_election.cc:302] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:46.204661 28987 rpcz_store.cc:276] 0810 11:30:42.583865 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.583914 (+ 49us) service_pool.cc:227] Handling call
0810 11:30:46.147938 (+3564024us) ts_tablet_manager.cc:1145] Deleting tablet 256ad2e2d8e54a4caa1b5091bab60dd5
0810 11:30:46.147953 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.167739 (+ 19786us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.171227 (+ 3488us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.197772 (+ 26545us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3563604}
I20260810 11:30:46.198621 29142 leader_election.cc:288] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:46.205543 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1549a26ba0f6427fae87b204c5d49eff" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:46.205915 29142 raft_consensus.cc:2781] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:46.206080 27057 raft_consensus.cc:2454] T 1549a26ba0f6427fae87b204c5d49eff P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:46.199536 27222 tablet_bootstrap.cc:492] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:46.206282 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 256ad2e2d8e54a4caa1b5091bab60dd5 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]) successfully deleted
I20260810 11:30:46.206354 27222 ts_tablet_manager.cc:1397] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.048s user 0.005s sys 0.000s
I20260810 11:30:46.207322 27222 raft_consensus.cc:348] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.207543 27222 raft_consensus.cc:374] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.207593 27222 raft_consensus.cc:729] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.207834 27222 consensus_queue.cc:260] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.208050 26702 leader_election.cc:302] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:46.208305 29316 raft_consensus.cc:2781] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:46.208381 29316 raft_consensus.cc:482] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:46.208436 29316 raft_consensus.cc:3037] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.211380 29316 raft_consensus.cc:504] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.212363 29316 leader_election.cc:288] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:46.213099 27222 ts_tablet_manager.cc:1428] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260810 11:30:46.213117 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1549a26ba0f6427fae87b204c5d49eff" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:46.213263 29142 raft_consensus.cc:686] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:46.213399 27057 raft_consensus.cc:3037] T 1549a26ba0f6427fae87b204c5d49eff P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.213526 29142 consensus_queue.cc:237] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.215356 27231 tablet_bootstrap.cc:654] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:46.215332 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 113) took 3630 ms. Trace:
I20260810 11:30:46.215428 28987 rpcz_store.cc:276] 0810 11:30:42.584629 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.584678 (+ 49us) service_pool.cc:227] Handling call
0810 11:30:46.205152 (+3620474us) ts_tablet_manager.cc:1145] Deleting tablet 3851d39aeb3142938a5ac558ab438c21
0810 11:30:46.215203 (+ 10051us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.215314 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3620065}
W20260810 11:30:46.215992 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 3851d39aeb3142938a5ac558ab438c21 because the tablet was not found. No further retry: Not found: Tablet not found: 3851d39aeb3142938a5ac558ab438c21
I20260810 11:30:46.216701 27222 tablet_bootstrap.cc:492] T e25557126afd4f51a31fba73cd7da219 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:46.219600 27057 raft_consensus.cc:2454] T 1549a26ba0f6427fae87b204c5d49eff P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:46.220006 27222 tablet_bootstrap.cc:654] T e25557126afd4f51a31fba73cd7da219 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:46.220253 26702 leader_election.cc:302] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:46.220796 29316 raft_consensus.cc:2781] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:46.221050 29316 raft_consensus.cc:686] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:46.221424 28987 tablet_replica.cc:330] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:46.225709 27231 tablet_bootstrap.cc:492] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
W20260810 11:30:46.225796 26991 consensus_peers.cc:487] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6e264e8507446809f3c386fdb3c34ae. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:46.225922 27231 ts_tablet_manager.cc:1397] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.071s user 0.001s sys 0.002s
I20260810 11:30:46.226874 28987 raft_consensus.cc:2229] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:46.226792 27231 raft_consensus.cc:348] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.227134 27231 raft_consensus.cc:374] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.227206 27231 raft_consensus.cc:729] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.227440 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:46.227864 28987 pending_rounds.cc:62] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d: Trying to abort 1 pending ops.
I20260810 11:30:46.221376 29316 consensus_queue.cc:237] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.228329 28987 pending_rounds.cc:68] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936480212508672 op_type: NO_OP noop_request { }
I20260810 11:30:46.228510 28987 raft_consensus.cc:2866] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:46.228715 28987 raft_consensus.cc:2258] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:46.229099 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:46.230073 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:46.230979 28987 ts_tablet_manager.cc:1905] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:46.227425 27231 consensus_queue.cc:260] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.239681 27231 ts_tablet_manager.cc:1428] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260810 11:30:46.240087 29407 raft_consensus.cc:482] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.240358 29407 raft_consensus.cc:504] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.241238 29407 leader_election.cc:288] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:46.243765 29400 sys_catalog.cc:263] Verifying existing consensus state
I20260810 11:30:46.240193 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:46.245756 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:46.251511 29110 ts_tablet_manager.cc:1918] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:46.251821 29110 log.cc:1196] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/7ff5b980ce4e41d7a6e1ca0e740b739c
I20260810 11:30:46.252492 29110 ts_tablet_manager.cc:1939] T 7ff5b980ce4e41d7a6e1ca0e740b739c P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:46.252970 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:46.253496 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:46.255050 29142 raft_consensus.cc:482] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.255352 29142 raft_consensus.cc:504] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.256875 29142 leader_election.cc:288] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:46.257536 26849 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.25.195.254:41125, user_credentials={real_user=slave}} blocked reactor thread for 74548.7us
I20260810 11:30:46.261083 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:46.261814 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:46.265578 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8083fa130cd04dae9d61aeed977c1c63" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:46.265952 26767 raft_consensus.cc:2454] T 8083fa130cd04dae9d61aeed977c1c63 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:46.269505 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:46.269824 29407 raft_consensus.cc:482] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.270006 29407 raft_consensus.cc:504] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.270584 29407 leader_election.cc:288] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:46.271965 29290 raft_consensus.cc:482] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.272188 29290 raft_consensus.cc:504] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.272766 27222 tablet_bootstrap.cc:492] T e25557126afd4f51a31fba73cd7da219 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:46.272967 27222 ts_tablet_manager.cc:1397] T e25557126afd4f51a31fba73cd7da219 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.056s user 0.006s sys 0.001s
I20260810 11:30:46.273650 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b945038c03e343489af6ae7e50131d97" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:46.274384 26991 leader_election.cc:341] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.274358 27222 raft_consensus.cc:348] T e25557126afd4f51a31fba73cd7da219 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.274657 27222 raft_consensus.cc:374] T e25557126afd4f51a31fba73cd7da219 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.274587 29290 leader_election.cc:288] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:46.274767 27222 raft_consensus.cc:729] T e25557126afd4f51a31fba73cd7da219 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.275060 27222 consensus_queue.cc:260] T e25557126afd4f51a31fba73cd7da219 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.275601 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b945038c03e343489af6ae7e50131d97" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:46.275810 27222 ts_tablet_manager.cc:1428] T e25557126afd4f51a31fba73cd7da219 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:46.276131 27222 tablet_bootstrap.cc:492] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
W20260810 11:30:46.276252 26993 leader_election.cc:341] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.276405 26993 leader_election.cc:302] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:46.276818 29290 raft_consensus.cc:2726] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:46.277129 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:46.277837 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:46.279884 28987 ts_tablet_manager.cc:1918] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:46.280948 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:46.281489 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40f5eecfc66a4711aef60c1a2bff6b97" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:46.281884 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40f5eecfc66a4711aef60c1a2bff6b97" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:46.281956 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1549a26ba0f6427fae87b204c5d49eff" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:46.282228 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1549a26ba0f6427fae87b204c5d49eff" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:46.281847 26576 catalog_manager.cc:5495] T 490ada0a918d48c3a07e12eed58bda19 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:46.282704 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:46.283844 28987 log.cc:1196] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/34bd3c0edf6b49d1891c0ee9af344872
I20260810 11:30:46.285529 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72209a805e3e4b4ea1bf99508e0f75db" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:46.289325 28987 ts_tablet_manager.cc:1939] T 34bd3c0edf6b49d1891c0ee9af344872 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:46.284930 26576 catalog_manager.cc:5495] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:46.290079 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:46.291096 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:46.291798 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:46.292157 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:46.293474 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 114) took 3703 ms. Trace:
I20260810 11:30:46.293609 28987 rpcz_store.cc:276] 0810 11:30:42.590251 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.590343 (+ 92us) service_pool.cc:227] Handling call
0810 11:30:46.221347 (+3631004us) ts_tablet_manager.cc:1145] Deleting tablet 34bd3c0edf6b49d1891c0ee9af344872
0810 11:30:46.221366 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.258133 (+ 36767us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.279742 (+ 21609us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.293446 (+ 13704us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3630374}
I20260810 11:30:46.294234 27110 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:46.294380 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 34bd3c0edf6b49d1891c0ee9af344872 (table default.Table_92fc349e41184823a7fe2bab5c946f0c [id=18fc89ba8e7e4a97a04dd030c340a95f]) successfully deleted
I20260810 11:30:46.294742 28987 tablet_replica.cc:330] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:46.294960 28987 raft_consensus.cc:2229] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:46.295157 28987 raft_consensus.cc:2258] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:46.295948 28987 ts_tablet_manager.cc:1905] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:46.297015 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:46.297864 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:46.298298 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:46.299544 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:46.304668 29290 raft_consensus.cc:482] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.305124 29290 raft_consensus.cc:504] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.307060 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d000f0ebaf0049a7bdaad93e307e16e2" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:46.308087 26991 leader_election.cc:341] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.309563 29400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Bootstrap starting.
I20260810 11:30:46.311931 29290 leader_election.cc:288] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:46.309306 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d000f0ebaf0049a7bdaad93e307e16e2" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:46.317926 26993 leader_election.cc:341] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.318125 26993 leader_election.cc:302] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:46.318778 29290 raft_consensus.cc:2726] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:46.319355 26993 consensus_peers.cc:487] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:46.322499 26573 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_a164cd4bbc4344ae905f395ab1e6cffb [id=62f404c62e4040fc801f70cafddf9d95] alter complete (version 1)
I20260810 11:30:46.322788 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72209a805e3e4b4ea1bf99508e0f75db" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:46.323072 27061 raft_consensus.cc:2454] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:46.324136 26702 leader_election.cc:302] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:46.324539 29291 raft_consensus.cc:482] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.324702 29291 raft_consensus.cc:504] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.325441 29291 leader_election.cc:288] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:46.330458 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8083fa130cd04dae9d61aeed977c1c63" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:46.330796 27057 raft_consensus.cc:2454] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:46.332331 29438 tablet.cc:1722] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:46.333449 26571 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 169) took 4580 ms. Trace:
I20260810 11:30:46.333621 26571 rpcz_store.cc:276] 0810 11:30:41.752961 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.889244 (+3136283us) service_pool.cc:227] Handling call
0810 11:30:44.890253 (+ 1009us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:44.890564 (+ 311us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:44.890835 (+ 271us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:44.890953 (+ 118us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:45.094362 (+203409us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:46.333392 (+1239030us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:44.917542 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:44.917768 (+ 226us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:44.917776 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:44.917778 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:44.917902 (+ 124us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:44.917914 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:44.917919 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:44.918004 (+ 85us) tablet.cc:699] Row locks acquired
0810 11:30:44.918007 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:44.918055 (+ 48us) write_op.cc:270] Start()
0810 11:30:44.918095 (+ 40us) write_op.cc:276] Timestamp: P: 1786361444917993 usec, L: 0
0810 11:30:44.918099 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:44.918323 (+ 224us) log.cc:842] Serialized 405 byte log entry
0810 11:30:45.090991 (+172668us) op_driver.cc:444] REPLICATION: finished
0810 11:30:45.092524 (+ 1533us) write_op.cc:301] APPLY: starting
0810 11:30:45.092536 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:45.092627 (+ 91us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:45.092658 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:45.092709 (+ 51us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:45.092750 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:45.092761 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:45.092835 (+ 74us) log.cc:842] Serialized 23 byte log entry
0810 11:30:45.092885 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:45.092903 (+ 18us) write_op.cc:454] Released schema lock
0810 11:30:45.092911 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:45.092968 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:45.092974 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1496,"apply.run_cpu_time_us":501,"apply.run_wall_time_us":500,"num_ops":1,"prepare.queue_time_us":26000,"prepare.run_cpu_time_us":825,"prepare.run_wall_time_us":878,"replication_time_us":172875}]]}
W20260810 11:30:46.335079 26571 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.195:32877 (request call id 346) took 1029 ms (client timeout 1000 ms). Trace:
W20260810 11:30:46.335233 26571 rpcz_store.cc:269] 0810 11:30:45.305971 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.334755 (+1028784us) service_pool.cc:214] Skipping call since client already timed out
0810 11:30:46.335028 (+ 273us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260810 11:30:46.337548 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ae27bf110114b70a3e3f6cf64f31b98" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:46.341452 26848 leader_election.cc:341] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 43fee1a9a6f9482fbbe6ab6599c27fb9
I20260810 11:30:46.343176 26848 leader_election.cc:302] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:46.344084 29297 raft_consensus.cc:2781] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:46.344193 29297 raft_consensus.cc:482] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:46.344275 29297 raft_consensus.cc:3037] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.347216 29297 raft_consensus.cc:504] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.347886 29297 leader_election.cc:288] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:46.350776 26993 leader_election.cc:341] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.362505 26577 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_d18775ce6afa40d8841110e330d32273 [id=458cd8860fa448759ff4f5ee12c77599] alter complete (version 1)
I20260810 11:30:46.363421 27048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8083fa130cd04dae9d61aeed977c1c63" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:46.363659 27048 raft_consensus.cc:3037] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.367854 26573 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_ce3793ec2a8449f7802d520eef6fdcc7 [id=52440110b86442d3a04f71c44dc8d655] alter complete (version 1)
I20260810 11:30:46.371294 27048 raft_consensus.cc:2454] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:46.373551 28727 raft_consensus.cc:2781] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:46.373656 28727 raft_consensus.cc:482] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260810 11:30:46.373474 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 49375.3us
I20260810 11:30:46.373718 28727 raft_consensus.cc:3037] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.373781 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ae27bf110114b70a3e3f6cf64f31b98" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:46.373474 29436 tablet.cc:1722] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:46.374881 29314 raft_consensus.cc:482] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.377307 27228 tablet_bootstrap.cc:492] T 5409c96c1949416e85cfcaa8f2f61227 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:46.377480 27228 ts_tablet_manager.cc:1397] T 5409c96c1949416e85cfcaa8f2f61227 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.200s user 0.013s sys 0.015s
W20260810 11:30:46.376900 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 88072.6us
W20260810 11:30:46.377509 29430 log.cc:924] Time spent T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260810 11:30:46.378268 27228 raft_consensus.cc:348] T 5409c96c1949416e85cfcaa8f2f61227 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.378520 27228 raft_consensus.cc:374] T 5409c96c1949416e85cfcaa8f2f61227 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.378619 27228 raft_consensus.cc:729] T 5409c96c1949416e85cfcaa8f2f61227 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.378829 27228 consensus_queue.cc:260] T 5409c96c1949416e85cfcaa8f2f61227 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.379436 27228 ts_tablet_manager.cc:1428] T 5409c96c1949416e85cfcaa8f2f61227 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:46.379776 27228 tablet_bootstrap.cc:492] T b755744059b04967857c1b00e951b8ee P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:46.381296 27228 tablet_bootstrap.cc:654] T b755744059b04967857c1b00e951b8ee P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:46.374392 26991 leader_election.cc:341] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.396618 26991 leader_election.cc:302] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:46.376158 29291 consensus_queue.cc:1035] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:46.377858 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 108) took 3350 ms. Trace:
I20260810 11:30:46.397253 29110 rpcz_store.cc:276] 0810 11:30:43.026923 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.027292 (+ 369us) service_pool.cc:227] Handling call
0810 11:30:46.176414 (+3149122us) ts_tablet_manager.cc:1145] Deleting tablet 7ff5b980ce4e41d7a6e1ca0e740b739c
0810 11:30:46.176431 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.223895 (+ 47464us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.251338 (+ 27443us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.377830 (+126492us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":116973,"tablet-delete.queue_time_us":3086874}
I20260810 11:30:46.397996 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 112) took 3368 ms. Trace:
I20260810 11:30:46.378888 27231 tablet_bootstrap.cc:492] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:46.398168 29110 rpcz_store.cc:276] 0810 11:30:43.029899 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.029940 (+ 41us) service_pool.cc:227] Handling call
0810 11:30:46.397767 (+3367827us) ts_tablet_manager.cc:1145] Deleting tablet ce73798a721b4a6d892f0c24b6b40e2c
0810 11:30:46.397786 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.397950 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":117019,"tablet-delete.queue_time_us":3308198}
I20260810 11:30:46.398566 29110 tablet_replica.cc:330] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:46.399016 29110 raft_consensus.cc:2229] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:46.399259 29110 raft_consensus.cc:2258] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:46.400027 29110 ts_tablet_manager.cc:1905] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:46.400988 27228 tablet_bootstrap.cc:492] T b755744059b04967857c1b00e951b8ee P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:46.401082 29291 raft_consensus.cc:2726] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:46.400924 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43fee1a9a6f9482fbbe6ab6599c27fb9" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:46.401154 27228 ts_tablet_manager.cc:1397] T b755744059b04967857c1b00e951b8ee P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.000s
I20260810 11:30:46.402040 27228 raft_consensus.cc:348] T b755744059b04967857c1b00e951b8ee P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.402304 27228 raft_consensus.cc:374] T b755744059b04967857c1b00e951b8ee P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.402390 27228 raft_consensus.cc:729] T b755744059b04967857c1b00e951b8ee P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.402673 27228 consensus_queue.cc:260] T b755744059b04967857c1b00e951b8ee P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.403396 27228 ts_tablet_manager.cc:1428] T b755744059b04967857c1b00e951b8ee P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:46.403724 27228 tablet_bootstrap.cc:492] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:46.406219 27228 tablet_bootstrap.cc:654] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:46.407269 29142 consensus_queue.cc:1035] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:46.413018 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 7ff5b980ce4e41d7a6e1ca0e740b739c (table default.Table_2d72673d9e86472ca07d3c7d36f51108 [id=7f2c916845a443209bff1b685821499f]) successfully deleted
W20260810 11:30:46.413630 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet ce73798a721b4a6d892f0c24b6b40e2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce73798a721b4a6d892f0c24b6b40e2c already in progress: creating tablet
I20260810 11:30:46.415288 26848 leader_election.cc:302] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:46.415740 29407 raft_consensus.cc:2781] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:46.415897 29407 raft_consensus.cc:686] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:46.416188 29407 consensus_queue.cc:237] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.418452 26578 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_3e5423642f624ac59254222ea8d0a520 [id=affd9fae6f704dcea386ebc27c87323e] alter complete (version 1)
I20260810 11:30:46.418483 26574 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 4efa31ad2ce8436b9638e6759d9b5421
I20260810 11:30:46.424754 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 4efa31ad2ce8436b9638e6759d9b5421 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:44 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:46.425905 29447 tablet_replica.cc:330] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:46.426545 29447 raft_consensus.cc:2229] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:46.427430 29447 raft_consensus.cc:2258] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:46.428485 29447 ts_tablet_manager.cc:1905] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:46.428664 26573 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a] alter complete (version 2)
I20260810 11:30:46.429100 29290 raft_consensus.cc:482] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.429365 29290 raft_consensus.cc:504] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.430145 29290 leader_election.cc:288] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:46.430959 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25557126afd4f51a31fba73cd7da219" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:46.431649 26991 leader_election.cc:341] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.432339 26580 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_608daedb6681462f817a1cd881a57828 [id=f87826dabbbc4330a602412d9e802be6] alter complete (version 1)
I20260810 11:30:46.433146 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25557126afd4f51a31fba73cd7da219" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:46.433471 26762 raft_consensus.cc:2454] T e25557126afd4f51a31fba73cd7da219 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:46.434017 26993 leader_election.cc:302] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:46.434451 29290 raft_consensus.cc:2781] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:46.434576 29290 raft_consensus.cc:482] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:46.434849 29290 raft_consensus.cc:3037] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.438427 29290 raft_consensus.cc:504] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.440419 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25557126afd4f51a31fba73cd7da219" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:46.441277 26991 leader_election.cc:341] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.445674 29447 ts_tablet_manager.cc:1918] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:46.446249 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8083fa130cd04dae9d61aeed977c1c63" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:46.446413 29447 log.cc:1196] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/4efa31ad2ce8436b9638e6759d9b5421
I20260810 11:30:46.446522 26762 raft_consensus.cc:3037] T 8083fa130cd04dae9d61aeed977c1c63 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.446949 29447 ts_tablet_manager.cc:1939] T 4efa31ad2ce8436b9638e6759d9b5421 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:46.452044 27231 tablet_bootstrap.cc:654] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:46.404830 26700 leader_election.cc:341] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:46.455579 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 50777.3us
I20260810 11:30:46.375007 29314 raft_consensus.cc:504] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.457158 29314 leader_election.cc:288] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:46.458294 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab2471d06e0841e7bebae4ca1865618c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:46.458601 27057 raft_consensus.cc:2454] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:46.459010 26702 leader_election.cc:302] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:46.462996 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 4efa31ad2ce8436b9638e6759d9b5421 (table default.Table_f3567f07068942e9a5d42f9877f39bb7 [id=c557d3488f464c5bbff89fd13e52b02a]) successfully deleted
I20260810 11:30:46.466230 29290 leader_election.cc:288] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:46.467550 26849 leader_election.cc:302] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:46.468286 29297 raft_consensus.cc:2726] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:46.480024 26574 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 170) took 3798 ms. Trace:
I20260810 11:30:46.480209 26574 rpcz_store.cc:276] 0810 11:30:42.681154 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.893453 (+2212299us) service_pool.cc:227] Handling call
0810 11:30:44.894180 (+ 727us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:44.894338 (+ 158us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:44.894401 (+ 63us) catalog_manager.cc:2761] Locking tablets
0810 11:30:44.948852 (+ 54451us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:45.095330 (+146478us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:45.095466 (+ 136us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:46.418423 (+1322957us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:46.479871 (+ 61448us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:44.951108 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:44.951242 (+ 134us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:44.951250 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:44.951253 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:44.951403 (+ 150us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:44.951418 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:44.951423 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:44.951551 (+ 128us) tablet.cc:699] Row locks acquired
0810 11:30:44.951554 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:44.951615 (+ 61us) write_op.cc:270] Start()
0810 11:30:44.951679 (+ 64us) write_op.cc:276] Timestamp: P: 1786361444951549 usec, L: 0
0810 11:30:44.951685 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:44.951944 (+ 259us) log.cc:842] Serialized 734 byte log entry
0810 11:30:45.091044 (+139100us) op_driver.cc:444] REPLICATION: finished
0810 11:30:45.093066 (+ 2022us) write_op.cc:301] APPLY: starting
0810 11:30:45.093078 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:45.093118 (+ 40us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:45.093195 (+ 77us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:45.093264 (+ 69us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:45.093301 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:45.093310 (+ 9us) write_op.cc:312] APPLY: finished
0810 11:30:45.093440 (+ 130us) log.cc:842] Serialized 29 byte log entry
0810 11:30:45.093496 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:45.093516 (+ 20us) write_op.cc:454] Released schema lock
0810 11:30:45.093533 (+ 17us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:45.093596 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:45.093602 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1988,"apply.run_cpu_time_us":586,"apply.run_wall_time_us":586,"num_ops":2,"prepare.queue_time_us":61,"prepare.run_cpu_time_us":919,"prepare.run_wall_time_us":919,"replication_time_us":139340,"thread_start_us":176552,"threads_started":1}]]}
I20260810 11:30:46.477134 26760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25557126afd4f51a31fba73cd7da219" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:46.484436 26760 raft_consensus.cc:3037] T e25557126afd4f51a31fba73cd7da219 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.491923 29110 ts_tablet_manager.cc:1918] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:46.504679 29110 log.cc:1196] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/e31b380f99854eb8b63e1f9eede1fc7c
I20260810 11:30:46.507118 29110 ts_tablet_manager.cc:1939] T e31b380f99854eb8b63e1f9eede1fc7c P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
W20260810 11:30:46.521618 26572 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.193:48791 (request call id 303) took 4045 ms (client timeout 1000 ms). Trace:
W20260810 11:30:46.521953 26572 rpcz_store.cc:269] 0810 11:30:42.476261 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.496886 (+ 20625us) service_pool.cc:227] Handling call
0810 11:30:42.957216 (+460330us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.957224 (+ 8us) write_op.cc:454] Released schema lock
0810 11:30:46.521514 (+3564290us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:42.945299 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:42.945468 (+ 169us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:42.945479 (+ 11us) write_op.cc:435] Acquired schema lock
0810 11:30:42.945484 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:42.945645 (+ 161us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:42.945670 (+ 25us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:42.945679 (+ 9us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:42.945821 (+ 142us) tablet.cc:699] Row locks acquired
0810 11:30:42.945823 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:42.945879 (+ 56us) write_op.cc:270] Start()
0810 11:30:42.945947 (+ 68us) write_op.cc:276] Timestamp: P: 1786361442945861 usec, L: 0
0810 11:30:42.945954 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:42.946358 (+ 404us) log.cc:842] Serialized 919 byte log entry
0810 11:30:42.951585 (+ 5227us) op_driver.cc:444] REPLICATION: finished
0810 11:30:42.951747 (+ 162us) write_op.cc:301] APPLY: starting
0810 11:30:42.951766 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:42.951814 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:42.951887 (+ 73us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:42.951986 (+ 99us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:42.952028 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:42.952036 (+ 8us) write_op.cc:312] APPLY: finished
0810 11:30:42.952253 (+ 217us) log.cc:842] Serialized 29 byte log entry
0810 11:30:42.952335 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:42.952359 (+ 24us) write_op.cc:454] Released schema lock
0810 11:30:42.952367 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0810 11:30:44.836727 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:44.836871 (+ 144us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:44.836880 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:44.836882 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:44.837023 (+ 141us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:44.837039 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:44.837044 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:44.837119 (+ 75us) tablet.cc:699] Row locks acquired
0810 11:30:44.837121 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:44.837170 (+ 49us) write_op.cc:270] Start()
0810 11:30:44.837213 (+ 43us) write_op.cc:276] Timestamp: P: 1786361444837115 usec, L: 0
0810 11:30:44.837217 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:44.837548 (+ 331us) log.cc:842] Serialized 356 byte log entry
0810 11:30:44.845833 (+ 8285us) op_driver.cc:444] REPLICATION: finished
0810 11:30:44.846013 (+ 180us) write_op.cc:301] APPLY: starting
0810 11:30:44.846033 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:44.846080 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:44.846113 (+ 33us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:44.846177 (+ 64us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:44.846216 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:44.846225 (+ 9us) write_op.cc:312] APPLY: finished
0810 11:30:44.846361 (+ 136us) log.cc:842] Serialized 23 byte log entry
0810 11:30:44.846532 (+ 171us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:44.846554 (+ 22us) write_op.cc:454] Released schema lock
0810 11:30:44.846562 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:44.846624 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:44.846628 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":134148,"reported_tablets":201,"child_traces":[["op",{"apply.queue_time_us":102,"apply.run_cpu_time_us":688,"apply.run_wall_time_us":687,"num_ops":2,"prepare.queue_time_us":1366,"prepare.run_cpu_time_us":1284,"prepare.run_wall_time_us":1285,"raft.queue_time_us":2198,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":247,"replication_time_us":5599}],["op",{"apply.queue_time_us":126,"apply.run_cpu_time_us":676,"apply.run_wall_time_us":675,"num_ops":1,"prepare.queue_time_us":80791,"prepare.run_cpu_time_us":977,"prepare.run_wall_time_us":978,"raft.queue_time_us":173,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":251,"replication_time_us":8584}]]}
I20260810 11:30:46.549934 27222 tablet_bootstrap.cc:654] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:46.545320 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 4efa31ad2ce8436b9638e6759d9b5421 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:44 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:46.551510 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 79) took 3616 ms. Trace:
I20260810 11:30:46.551774 29110 rpcz_store.cc:276] 0810 11:30:42.934936 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.934983 (+ 47us) service_pool.cc:227] Handling call
0810 11:30:46.398481 (+3463498us) ts_tablet_manager.cc:1145] Deleting tablet e31b380f99854eb8b63e1f9eede1fc7c
0810 11:30:46.398495 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.409951 (+ 11456us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.491755 (+ 81804us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.551431 (+ 59676us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":88099,"tablet-delete.queue_time_us":3279970}
I20260810 11:30:46.552477 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 113) took 3261 ms. Trace:
I20260810 11:30:46.552706 29110 rpcz_store.cc:276] 0810 11:30:43.290785 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.290832 (+ 47us) service_pool.cc:227] Handling call
0810 11:30:46.552292 (+3261460us) ts_tablet_manager.cc:1145] Deleting tablet 8b303be24f4e46d0b966e8191d76297b
0810 11:30:46.552307 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.552428 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3261221}
I20260810 11:30:46.545656 29291 raft_consensus.cc:482] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.559387 29291 raft_consensus.cc:504] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.560622 29291 leader_election.cc:288] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:46.561652 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e69916a35fba4714bbc565921738888f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:46.562507 26991 leader_election.cc:341] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.563162 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 114) took 3271 ms. Trace:
I20260810 11:30:46.563337 29110 rpcz_store.cc:276] 0810 11:30:43.291183 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.291224 (+ 41us) service_pool.cc:227] Handling call
0810 11:30:46.562985 (+3271761us) ts_tablet_manager.cc:1145] Deleting tablet b945cb22353f4d99a3836e3c0b8e26e3
0810 11:30:46.563003 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.563123 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3271600}
I20260810 11:30:46.564147 29110 tablet_replica.cc:330] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:46.573416 29110 raft_consensus.cc:2229] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:46.574868 29110 raft_consensus.cc:2258] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:46.576896 29110 ts_tablet_manager.cc:1905] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:46.582386 29316 raft_consensus.cc:2781] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:46.582621 29316 raft_consensus.cc:482] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:46.582754 29316 raft_consensus.cc:3037] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.586001 26573 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_65da57b4be754a5b9cbc73361a4f1b93 [id=e22f19a993564e53b1cc76633f25f505] alter complete (version 1)
I20260810 11:30:46.589221 26760 raft_consensus.cc:2454] T e25557126afd4f51a31fba73cd7da219 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:46.586835 28727 raft_consensus.cc:504] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.605588 28727 leader_election.cc:288] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:46.611006 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet e31b380f99854eb8b63e1f9eede1fc7c (table default.Table_5ffe87ce66134f859f413c9a6ec537b5 [id=98340b81af5d4da9b563a14d7470e1ae]) successfully deleted
W20260810 11:30:46.611373 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 8b303be24f4e46d0b966e8191d76297b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b303be24f4e46d0b966e8191d76297b already in progress: creating tablet
W20260810 11:30:46.611657 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet b945cb22353f4d99a3836e3c0b8e26e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b945cb22353f4d99a3836e3c0b8e26e3 already in progress: creating tablet
I20260810 11:30:46.612144 29291 consensus_queue.cc:1035] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:46.618477 27231 tablet_bootstrap.cc:492] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:46.618670 27231 ts_tablet_manager.cc:1397] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.240s user 0.004s sys 0.001s
I20260810 11:30:46.619364 27231 raft_consensus.cc:348] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.619597 27231 raft_consensus.cc:374] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.619664 27231 raft_consensus.cc:729] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.619910 27231 consensus_queue.cc:260] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.620679 27231 ts_tablet_manager.cc:1428] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:46.621024 27231 tablet_bootstrap.cc:492] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:46.623203 27231 tablet_bootstrap.cc:654] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:46.627671 26760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e69916a35fba4714bbc565921738888f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:46.628952 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72209a805e3e4b4ea1bf99508e0f75db" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:46.629288 27057 raft_consensus.cc:3037] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.631124 28987 ts_tablet_manager.cc:1918] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:46.631244 28987 log.cc:1196] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/fc558690dce44e999e55e9bf1b6ca172
I20260810 11:30:46.631600 28987 ts_tablet_manager.cc:1939] T fc558690dce44e999e55e9bf1b6ca172 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:46.632197 27057 raft_consensus.cc:2454] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
W20260810 11:30:46.633003 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 176812us
I20260810 11:30:46.643064 29110 ts_tablet_manager.cc:1918] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260810 11:30:46.648442 26700 leader_election.cc:341] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.651201 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:46.651779 26571 catalog_manager.cc:5495] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:46.652238 29110 log.cc:1196] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/d512c335e340437fa32f2dc16dca6812
I20260810 11:30:46.653194 29110 ts_tablet_manager.cc:1939] T d512c335e340437fa32f2dc16dca6812 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:46.655869 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:46.656313 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:46.656725 26571 catalog_manager.cc:5495] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:46.657485 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:46.657848 26571 catalog_manager.cc:5495] T d560157da0624333b91a18481b058f91 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:46.658685 26571 catalog_manager.cc:5495] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:46.659104 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:46.641914 26762 raft_consensus.cc:2454] T 8083fa130cd04dae9d61aeed977c1c63 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:46.659723 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 81b800247b4e4171b82dcde68e39fb00 (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]). Expected version 1 got 0
I20260810 11:30:46.659986 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
W20260810 11:30:46.660346 26700 leader_election.cc:341] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.660631 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
W20260810 11:30:46.660694 26700 leader_election.cc:341] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.661131 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:46.662034 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:46.662452 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9de57b6d03e34ee783b822b30090c077 (table default.Table_eb5718a38c5c40bb81705b1a1e420f90 [id=7d0dd215c30648438a460f730b0b7ba4]). Expected version 1 got 0
I20260810 11:30:46.662717 27228 tablet_bootstrap.cc:492] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:46.662950 27228 ts_tablet_manager.cc:1397] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.259s user 0.033s sys 0.032s
I20260810 11:30:46.647125 27222 tablet_bootstrap.cc:492] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:46.663616 27222 ts_tablet_manager.cc:1397] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.388s user 0.007s sys 0.008s
I20260810 11:30:46.663859 27228 raft_consensus.cc:348] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.651156 26993 leader_election.cc:302] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:46.664297 27228 raft_consensus.cc:374] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.651433 29454 consensus_queue.cc:1035] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:46.633934 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 115) took 4042 ms. Trace:
I20260810 11:30:46.664705 28987 rpcz_store.cc:276] 0810 11:30:42.591395 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.591473 (+ 78us) service_pool.cc:227] Handling call
0810 11:30:46.294688 (+3703215us) ts_tablet_manager.cc:1145] Deleting tablet fc558690dce44e999e55e9bf1b6ca172
0810 11:30:46.294703 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.614433 (+319730us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.631002 (+ 16569us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.633913 (+ 2911us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3702910}
I20260810 11:30:46.665197 28987 tablet_replica.cc:330] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:46.665468 28987 raft_consensus.cc:2229] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:46.665535 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:46.665696 28987 raft_consensus.cc:2258] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:46.665977 26700 leader_election.cc:341] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.666355 28987 ts_tablet_manager.cc:1905] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:46.666437 26993 leader_election.cc:341] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.666611 26993 leader_election.cc:302] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:46.666699 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:46.667291 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:46.667688 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:46.667721 29316 raft_consensus.cc:504] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.667856 29454 raft_consensus.cc:2781] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:46.668231 29454 raft_consensus.cc:686] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:46.668491 27228 raft_consensus.cc:729] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.668907 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:46.668907 29454 consensus_queue.cc:237] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.669476 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:46.670347 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:46.670256 27228 consensus_queue.cc:260] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.670809 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:46.671311 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:46.671793 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:46.672058 29455 raft_consensus.cc:2726] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:46.672441 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:46.672751 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:46.673326 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:46.673806 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:46.674059 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:46.674813 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:46.675438 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:46.675814 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:46.676510 26571 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:46.681769 27228 ts_tablet_manager.cc:1428] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260810 11:30:46.682482 29316 leader_election.cc:288] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:46.684963 27228 tablet_bootstrap.cc:492] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:46.688189 27228 tablet_bootstrap.cc:654] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:46.652100 26702 leader_election.cc:302] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:46.691259 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab2471d06e0841e7bebae4ca1865618c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:46.691702 29463 raft_consensus.cc:2781] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:46.692574 29463 raft_consensus.cc:686] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:46.693080 29463 consensus_queue.cc:237] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:46.673997 26700 consensus_peers.cc:487] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:46.696245 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet fc558690dce44e999e55e9bf1b6ca172 (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]) successfully deleted
I20260810 11:30:46.698611 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.698580 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 4efa31ad2ce8436b9638e6759d9b5421 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:44 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.700484 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 1860e56467624dcdb288e13b004f78cc with delete_type TABLET_DATA_DELETED (replaced by tablet 214be3356fda4c8484596196c0985721) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.700709 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.700943 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d5e146eeec4fe0be33c1c169d32e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.701292 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 55c8749861874eca9b63d3db97afa2b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.701429 27057 raft_consensus.cc:3037] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.702170 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 834c9c99ec424bb39e8a003e9204b2bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.702499 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 10210204d5ff4e5e97c98fd255f674a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:24 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.702939 27222 raft_consensus.cc:348] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.707708 27057 raft_consensus.cc:2454] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:46.716921 29454 raft_consensus.cc:482] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.717329 29454 raft_consensus.cc:504] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.718710 29454 leader_election.cc:288] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:46.719429 29454 raft_consensus.cc:482] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6079090b1124d84aa4477974bb53700)
I20260810 11:30:46.719386 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee803ddf27594d2b9e19fe440fc269c7" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:46.719790 29454 raft_consensus.cc:504] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:46.720150 26991 leader_election.cc:341] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.721002 29454 leader_election.cc:288] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:46.721170 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 116) took 3418 ms. Trace:
I20260810 11:30:46.721374 29110 rpcz_store.cc:276] 0810 11:30:43.302964 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.315454 (+ 12490us) service_pool.cc:227] Handling call
0810 11:30:46.564015 (+3248561us) ts_tablet_manager.cc:1145] Deleting tablet d512c335e340437fa32f2dc16dca6812
0810 11:30:46.564039 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.591946 (+ 27907us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.642843 (+ 50897us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.721019 (+ 78176us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3248115}
I20260810 11:30:46.721798 29110 tablet_replica.cc:330] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:46.722122 29110 raft_consensus.cc:2229] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:46.722261 26991 leader_election.cc:341] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 6dc4fd6ca8a541f99eed57a6f51c1f0a
I20260810 11:30:46.722522 29110 raft_consensus.cc:2258] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:46.723244 29110 ts_tablet_manager.cc:1905] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:46.725322 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]) successfully deleted
I20260810 11:30:46.725478 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab2471d06e0841e7bebae4ca1865618c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:46.725926 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72209a805e3e4b4ea1bf99508e0f75db" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:46.726572 27222 raft_consensus.cc:374] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.703665 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet cb6805a5dd264939850ea2cd9a850a1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:15 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.703841 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.703994 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 91b6078efadf496fb252f725bdf56b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.727059 26734 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.704181 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 10e6c41db71a4146840f06c5b7412d9c with delete_type TABLET_DATA_DELETED (replaced by tablet 72209a805e3e4b4ea1bf99508e0f75db) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.704329 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet a8a65a0e8b1f4e4b8d9a82059b766cda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.704525 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet a835d30ef9fc474ab927bb119a95d83c with delete_type TABLET_DATA_DELETED (replaced by tablet 2a1fbf3890ee4a829b4c8c61fe1e978f) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.704892 26738 tablet_service.cc:1514] Processing DeleteTablet for tablet a63227e69df14a4ea935087fd31ece63 with delete_type TABLET_DATA_DELETED (replaced by tablet aa71cedba3d34c288a3e3be99d474ce4) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.727350 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 2634beb347714fc7a2e05865adb34a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.715888 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet 318d5b8453fe4c438d0fa32cb91c409e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.718114 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ada1df82eb44ecb9a6c615b5410e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.720618 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 713663be70014b17b17056a865e7db63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.726110 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet cc76d30f37094391b75076c92ccc277f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.727615 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.726768 27222 raft_consensus.cc:729] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.703199 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 78633fbe048b4534ae3277ce6b7c4313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:39 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:46.726619 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet 64818ca5827e41d99428903ddb8688d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:46.711927 26702 consensus_peers.cc:487] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43fee1a9a6f9482fbbe6ab6599c27fb9. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:46.727897 27222 consensus_queue.cc:260] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.728523 26702 leader_election.cc:302] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:46.728696 27222 ts_tablet_manager.cc:1428] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.065s user 0.002s sys 0.001s
I20260810 11:30:46.729003 27222 tablet_bootstrap.cc:492] T 0f048b690d764c83a4a9ce4cbadc75b0 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:46.729754 29463 raft_consensus.cc:2781] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:46.729986 29463 raft_consensus.cc:686] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:46.730319 29463 consensus_queue.cc:237] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.735204 29142 raft_consensus.cc:482] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6079090b1124d84aa4477974bb53700)
I20260810 11:30:46.735478 29142 raft_consensus.cc:504] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.736243 29110 ts_tablet_manager.cc:1918] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:46.736523 29142 leader_election.cc:288] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:46.737231 27049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dc4fd6ca8a541f99eed57a6f51c1f0a" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:46.737821 29110 log.cc:1196] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/6dc4fd6ca8a541f99eed57a6f51c1f0a
W20260810 11:30:46.738207 26702 leader_election.cc:341] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Illegal state: Tablet not RUNNING: STOPPED
I20260810 11:30:46.738443 29110 ts_tablet_manager.cc:1939] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:46.738722 29436 tablet.cc:1722] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:46.738902 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 123) took 2805 ms. Trace:
I20260810 11:30:46.739043 29110 rpcz_store.cc:276] 0810 11:30:43.933209 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.933267 (+ 58us) service_pool.cc:227] Handling call
0810 11:30:46.721690 (+2788423us) ts_tablet_manager.cc:1145] Deleting tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a
0810 11:30:46.721702 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.732114 (+ 10412us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.736074 (+ 3960us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.738861 (+ 2787us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2788168}
I20260810 11:30:46.739681 29110 tablet_replica.cc:330] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:46.739638 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]) successfully deleted
I20260810 11:30:46.741364 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dc4fd6ca8a541f99eed57a6f51c1f0a" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:46.741710 26768 raft_consensus.cc:2454] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
I20260810 11:30:46.742241 26993 leader_election.cc:302] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
W20260810 11:30:46.742441 26993 raft_consensus.cc:2670] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 482e605580be48cbbacce05a3e61c215: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 11:30:46.744920 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee803ddf27594d2b9e19fe440fc269c7" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:46.745824 26993 leader_election.cc:341] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.745951 26993 leader_election.cc:302] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:46.746197 29436 tablet.cc:1722] T 9de57b6d03e34ee783b822b30090c077 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:46.751750 27222 tablet_bootstrap.cc:654] T 0f048b690d764c83a4a9ce4cbadc75b0 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:46.766206 27228 tablet_bootstrap.cc:492] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:46.766480 27228 ts_tablet_manager.cc:1397] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.082s user 0.005s sys 0.000s
I20260810 11:30:46.767359 27228 raft_consensus.cc:348] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.767720 27228 raft_consensus.cc:374] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.767894 27228 raft_consensus.cc:729] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.768244 27228 consensus_queue.cc:260] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.771549 29407 raft_consensus.cc:482] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.771723 29407 raft_consensus.cc:504] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.772462 29407 leader_election.cc:288] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:46.773254 28987 ts_tablet_manager.cc:1918] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:46.774544 28987 log.cc:1196] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/b200bdb394d3439b86fff48494be8e3d
I20260810 11:30:46.777649 29316 raft_consensus.cc:482] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.777825 29316 raft_consensus.cc:504] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.778728 29316 leader_election.cc:288] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:46.778746 28987 ts_tablet_manager.cc:1939] T b200bdb394d3439b86fff48494be8e3d P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:46.780764 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab2471d06e0841e7bebae4ca1865618c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:46.790958 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:46.791296 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:46.791658 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:46.792188 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 81b800247b4e4171b82dcde68e39fb00 (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]). Expected version 1 got 0
W20260810 11:30:46.793252 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 47435us
I20260810 11:30:46.793823 29438 tablet.cc:1722] T 1801d3af4a4548dba8b0d8ea2fecf5ba P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:46.793987 27228 ts_tablet_manager.cc:1428] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20260810 11:30:46.795672 29480 tablet.cc:1722] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:46.797211 27228 tablet_bootstrap.cc:492] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
W20260810 11:30:46.797420 26700 leader_election.cc:341] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:46.797829 26700 leader_election.cc:341] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.806456 27228 tablet_bootstrap.cc:654] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:46.808868 26702 leader_election.cc:341] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 809b5b6b65d244cd9186517e39494839
I20260810 11:30:46.809901 29316 consensus_queue.cc:1035] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:46.812788 29178 raft_consensus.cc:2726] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:46.813406 29457 raft_consensus.cc:482] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.813645 29457 raft_consensus.cc:504] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.814507 29457 leader_election.cc:288] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:46.815322 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9de57b6d03e34ee783b822b30090c077 (table default.Table_eb5718a38c5c40bb81705b1a1e420f90 [id=7d0dd215c30648438a460f730b0b7ba4]). Expected version 1 got 0
I20260810 11:30:46.815619 29457 raft_consensus.cc:482] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.815793 29457 raft_consensus.cc:504] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.816354 29457 leader_election.cc:288] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:46.816548 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
I20260810 11:30:46.817416 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4124999339e4133b2bd47b3739da373" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:46.817806 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
W20260810 11:30:46.818313 26991 leader_election.cc:341] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.818969 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:46.821261 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a0284718f694a0591888e81357721b0" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:46.821982 29455 raft_consensus.cc:482] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.823398 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:46.828930 26760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52a9367b7a8345739b5b9acf9ea1e6d8" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:46.829317 26760 raft_consensus.cc:2454] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
W20260810 11:30:46.832631 26700 consensus_peers.cc:487] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:46.833015 26700 leader_election.cc:341] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:46.833731 26700 leader_election.cc:341] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 6dc4fd6ca8a541f99eed57a6f51c1f0a
I20260810 11:30:46.833834 26700 leader_election.cc:302] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
W20260810 11:30:46.834406 26700 leader_election.cc:341] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Not found: Tablet not found: 809b5b6b65d244cd9186517e39494839
I20260810 11:30:46.834528 26700 leader_election.cc:302] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:46.836297 28727 raft_consensus.cc:2726] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:46.836877 26849 leader_election.cc:302] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:46.837370 26912 raft_consensus.cc:3037] T 5409c96c1949416e85cfcaa8f2f61227 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.837507 29407 raft_consensus.cc:2781] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:46.837649 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:46.837764 29407 raft_consensus.cc:482] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:46.837921 29407 raft_consensus.cc:3037] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.838330 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:46.838585 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:46.839756 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:46.840626 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
W20260810 11:30:46.842964 26991 leader_election.cc:341] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.843104 29455 raft_consensus.cc:504] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.843791 26760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a0284718f694a0591888e81357721b0" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:46.844152 29407 raft_consensus.cc:504] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.844370 29455 leader_election.cc:288] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:46.845592 29297 raft_consensus.cc:482] T b755744059b04967857c1b00e951b8ee P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.846135 29297 raft_consensus.cc:504] T b755744059b04967857c1b00e951b8ee P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:46.846856 26993 leader_election.cc:341] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.847491 29297 leader_election.cc:288] T b755744059b04967857c1b00e951b8ee P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:46.848001 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:46.846946 27049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52a9367b7a8345739b5b9acf9ea1e6d8" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:46.848351 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:46.849398 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2da86554bc51486e91f1ea5995a245b5" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:46.849537 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:46.847847 27048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52a9367b7a8345739b5b9acf9ea1e6d8" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:46.850311 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:46.850939 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:46.850914 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b755744059b04967857c1b00e951b8ee" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:46.851540 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52a9367b7a8345739b5b9acf9ea1e6d8" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:46.851769 26762 raft_consensus.cc:3037] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.843791 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4124999339e4133b2bd47b3739da373" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:46.836674 28727 raft_consensus.cc:2726] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:46.852596 27228 tablet_bootstrap.cc:492] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:46.852811 27228 ts_tablet_manager.cc:1397] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.058s user 0.005s sys 0.004s
I20260810 11:30:46.853133 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:46.852967 26760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2da86554bc51486e91f1ea5995a245b5" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:46.853520 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:46.854322 27228 raft_consensus.cc:348] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.856123 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:46.854707 27228 raft_consensus.cc:374] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.856550 27228 raft_consensus.cc:729] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.856926 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:46.857043 27228 consensus_queue.cc:260] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.857425 26762 raft_consensus.cc:2454] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:46.857280 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:46.858312 27228 ts_tablet_manager.cc:1428] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260810 11:30:46.860162 27049 raft_consensus.cc:2454] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:46.861147 26993 leader_election.cc:302] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:46.860028 29438 tablet.cc:1722] T 9de57b6d03e34ee783b822b30090c077 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:46.862620 29455 raft_consensus.cc:2726] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:46.862538 26993 leader_election.cc:341] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:46.862823 26991 leader_election.cc:341] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.865959 26849 leader_election.cc:302] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:46.859656 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:46.869959 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:46.870599 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:46.871182 26993 leader_election.cc:302] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:46.871627 29455 raft_consensus.cc:2726] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:46.871908 26993 leader_election.cc:341] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.872395 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:46.873080 29454 consensus_queue.cc:1035] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260810 11:30:46.864337 29480 tablet.cc:1722] T 9de57b6d03e34ee783b822b30090c077 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:46.877132 29297 raft_consensus.cc:2781] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:46.877297 29297 raft_consensus.cc:686] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:46.877653 29297 consensus_queue.cc:237] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.878679 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:46.879197 26993 leader_election.cc:302] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:46.880709 29454 raft_consensus.cc:2726] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:46.881276 27048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b755744059b04967857c1b00e951b8ee" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:46.882295 26848 leader_election.cc:302] T b755744059b04967857c1b00e951b8ee P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:46.820603 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 116) took 4220 ms. Trace:
I20260810 11:30:46.885000 28987 rpcz_store.cc:276] 0810 11:30:42.599850 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.600150 (+ 300us) service_pool.cc:227] Handling call
0810 11:30:46.665141 (+4064991us) ts_tablet_manager.cc:1145] Deleting tablet b200bdb394d3439b86fff48494be8e3d
0810 11:30:46.665156 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.670497 (+ 5341us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.771858 (+101361us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.820400 (+ 48542us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4064274}
I20260810 11:30:46.885741 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:46.885891 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 117) took 4284 ms. Trace:
I20260810 11:30:46.886070 28987 rpcz_store.cc:276] 0810 11:30:42.601216 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.604438 (+ 3222us) service_pool.cc:227] Handling call
0810 11:30:46.885758 (+4281320us) ts_tablet_manager.cc:1145] Deleting tablet 7d3406f12d9c492cbd0d86fa7a57de82
0810 11:30:46.885772 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.885868 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4280555}
I20260810 11:30:46.886490 28987 tablet_replica.cc:330] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:46.886781 28987 raft_consensus.cc:2229] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:46.887356 28987 pending_rounds.cc:62] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d: Trying to abort 1 pending ops.
I20260810 11:30:46.887435 28987 pending_rounds.cc:68] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936473775083520 op_type: NO_OP noop_request { }
I20260810 11:30:46.887611 28987 raft_consensus.cc:2866] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:46.887717 28987 raft_consensus.cc:2258] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:46.886855 29480 tablet.cc:1722] T 1801d3af4a4548dba8b0d8ea2fecf5ba P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:46.886034 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet b200bdb394d3439b86fff48494be8e3d (table default.Table_376e60b3deca4fd2a33be856f0457166 [id=b88e11526dbd42c2a6b51fcc1cf731d3]) successfully deleted
W20260810 11:30:46.889662 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7d3406f12d9c492cbd0d86fa7a57de82 because the tablet was not found. No further retry: Not found: Tablet not found: 7d3406f12d9c492cbd0d86fa7a57de82
I20260810 11:30:46.889866 28987 ts_tablet_manager.cc:1905] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:46.858928 29407 leader_election.cc:288] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:46.896948 29407 raft_consensus.cc:2726] T b755744059b04967857c1b00e951b8ee P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:46.908608 29454 raft_consensus.cc:482] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.908927 29454 raft_consensus.cc:504] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.909952 29454 leader_election.cc:288] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:46.921550 27228 tablet_bootstrap.cc:492] T 72209a805e3e4b4ea1bf99508e0f75db P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:46.928429 27231 tablet_bootstrap.cc:492] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:46.928942 27231 ts_tablet_manager.cc:1397] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.308s user 0.010s sys 0.001s
I20260810 11:30:46.900831 27222 tablet_bootstrap.cc:492] T 0f048b690d764c83a4a9ce4cbadc75b0 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:46.911836 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7de2d60cf87c48459e6663a68ac96714" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:46.930539 27222 ts_tablet_manager.cc:1397] T 0f048b690d764c83a4a9ce4cbadc75b0 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.202s user 0.005s sys 0.003s
W20260810 11:30:46.930994 26993 leader_election.cc:341] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.931881 29454 raft_consensus.cc:482] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:46.931852 27222 raft_consensus.cc:348] T 0f048b690d764c83a4a9ce4cbadc75b0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.932089 27222 raft_consensus.cc:374] T 0f048b690d764c83a4a9ce4cbadc75b0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.932139 27222 raft_consensus.cc:729] T 0f048b690d764c83a4a9ce4cbadc75b0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.932015 29454 raft_consensus.cc:504] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.932370 27222 consensus_queue.cc:260] T 0f048b690d764c83a4a9ce4cbadc75b0 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:46.932689 29454 leader_election.cc:288] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:46.932729 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:46.933104 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:46.933152 27222 ts_tablet_manager.cc:1428] T 0f048b690d764c83a4a9ce4cbadc75b0 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:46.933429 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc76d30f37094391b75076c92ccc277f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:46.934054 26993 leader_election.cc:341] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:46.940073 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 74173.7us
I20260810 11:30:46.943897 26914 raft_consensus.cc:3037] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:46.945020 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:46.945786 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 81b800247b4e4171b82dcde68e39fb00 (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda]). Expected version 1 got 0
I20260810 11:30:46.946151 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
I20260810 11:30:46.946496 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:46.947274 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:46.947543 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9de57b6d03e34ee783b822b30090c077 (table default.Table_eb5718a38c5c40bb81705b1a1e420f90 [id=7d0dd215c30648438a460f730b0b7ba4]). Expected version 1 got 0
I20260810 11:30:46.948380 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:46.952493 27231 raft_consensus.cc:348] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.952833 27231 raft_consensus.cc:374] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:46.952899 27231 raft_consensus.cc:729] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:46.953449 27231 consensus_queue.cc:260] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:46.954082 27231 ts_tablet_manager.cc:1428] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
I20260810 11:30:46.957283 27228 tablet_bootstrap.cc:654] T 72209a805e3e4b4ea1bf99508e0f75db P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:46.948819 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:46.958890 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:46.958930 28727 consensus_queue.cc:1035] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:46.959220 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:46.959686 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:46.960188 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:46.960985 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:46.963459 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:46.964124 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:46.964422 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:46.964610 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:46.964820 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
W20260810 11:30:46.964820 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 82551.8us
I20260810 11:30:46.965631 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:46.965888 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:46.966135 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:46.966379 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7de2d60cf87c48459e6663a68ac96714" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:46.966367 26572 catalog_manager.cc:5495] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:46.966696 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc76d30f37094391b75076c92ccc277f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:46.966892 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]). Expected version 1 got 0
I20260810 11:30:46.967130 29455 consensus_queue.cc:1035] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:46.967509 26572 catalog_manager.cc:5495] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:46.968014 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
W20260810 11:30:46.973609 26991 leader_election.cc:341] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.973781 26991 leader_election.cc:302] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:46.974023 29455 raft_consensus.cc:2726] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:46.975148 26991 leader_election.cc:341] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:46.975275 26991 leader_election.cc:302] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:46.975910 27222 tablet_bootstrap.cc:492] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:46.978173 29455 raft_consensus.cc:2726] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:46.980839 26572 catalog_manager.cc:5495] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:46.981559 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:46.982661 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:46.983994 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:46.984252 28987 ts_tablet_manager.cc:1918] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:46.984537 28987 log.cc:1196] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/1aa4562a2247405187d9dbd1baa48f39
I20260810 11:30:46.984690 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 1801d3af4a4548dba8b0d8ea2fecf5ba (table default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b]). Expected version 2 got 0
I20260810 11:30:46.985707 26572 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:46.986824 26573 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_50f879f623d840fb9433e7ba8380272e [id=77e0fa171ab74850a2119422513f0b96] alter complete (version 1)
I20260810 11:30:46.992377 27222 tablet_bootstrap.cc:654] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:46.996917 28987 ts_tablet_manager.cc:1939] T 1aa4562a2247405187d9dbd1baa48f39 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:47.003803 26578 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd] alter complete (version 2)
I20260810 11:30:47.005651 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 120) took 4362 ms. Trace:
I20260810 11:30:47.005734 26573 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_c76f533fe5374540a2971695143b3042 [id=6e4c5823f76c4b78bcbfacf90251ddfe] alter complete (version 3)
I20260810 11:30:47.005909 28987 rpcz_store.cc:276] 0810 11:30:42.642767 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.643004 (+ 237us) service_pool.cc:227] Handling call
0810 11:30:46.886440 (+4243436us) ts_tablet_manager.cc:1145] Deleting tablet 1aa4562a2247405187d9dbd1baa48f39
0810 11:30:46.886452 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:46.935925 (+ 49473us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:46.984081 (+ 48156us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.005619 (+ 21538us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12032,"tablet-delete.queue_time_us":4243190}
I20260810 11:30:47.007035 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 121) took 4362 ms. Trace:
I20260810 11:30:47.007157 28987 rpcz_store.cc:276] 0810 11:30:42.644780 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.648133 (+ 3353us) service_pool.cc:227] Handling call
0810 11:30:47.006805 (+4358672us) ts_tablet_manager.cc:1145] Deleting tablet d000f0ebaf0049a7bdaad93e307e16e2
0810 11:30:47.006858 (+ 53us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.007014 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4358344}
I20260810 11:30:47.008252 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 122) took 4359 ms. Trace:
I20260810 11:30:47.008426 28987 rpcz_store.cc:276] 0810 11:30:42.648787 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.651908 (+ 3121us) service_pool.cc:227] Handling call
0810 11:30:47.007963 (+4356055us) ts_tablet_manager.cc:1145] Deleting tablet 81f24c84cdd945b78f39f24015eb1e43
0810 11:30:47.007999 (+ 36us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.008150 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4355477}
I20260810 11:30:47.011680 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 123) took 4359 ms. Trace:
I20260810 11:30:47.011920 28987 rpcz_store.cc:276] 0810 11:30:42.652507 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.653207 (+ 700us) service_pool.cc:227] Handling call
0810 11:30:47.011487 (+4358280us) ts_tablet_manager.cc:1145] Deleting tablet 8228600e3f6b4f9993dd25e4ceb57e4d
0810 11:30:47.011505 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.011648 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4357891}
I20260810 11:30:47.012876 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 124) took 4359 ms. Trace:
I20260810 11:30:47.014302 28987 rpcz_store.cc:276] 0810 11:30:42.653751 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.653892 (+ 141us) service_pool.cc:227] Handling call
0810 11:30:47.012736 (+4358844us) ts_tablet_manager.cc:1145] Deleting tablet 3ae27bf110114b70a3e3f6cf64f31b98
0810 11:30:47.012750 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.012856 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4358603}
I20260810 11:30:47.014861 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 1aa4562a2247405187d9dbd1baa48f39 (table default.Table_5318e36611c342278e64da2f02be8a08 [id=3b8a0c6cf3fa45c18cedc4967f725ba3]) successfully deleted
W20260810 11:30:47.015349 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet d000f0ebaf0049a7bdaad93e307e16e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d000f0ebaf0049a7bdaad93e307e16e2 already in progress: creating tablet
W20260810 11:30:47.015759 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 81f24c84cdd945b78f39f24015eb1e43 because the tablet was not found. No further retry: Not found: Tablet not found: 81f24c84cdd945b78f39f24015eb1e43
W20260810 11:30:47.016124 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 8228600e3f6b4f9993dd25e4ceb57e4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8228600e3f6b4f9993dd25e4ceb57e4d already in progress: creating tablet
W20260810 11:30:47.016510 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 3ae27bf110114b70a3e3f6cf64f31b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae27bf110114b70a3e3f6cf64f31b98 already in progress: creating tablet
I20260810 11:30:47.017937 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 125) took 4364 ms. Trace:
I20260810 11:30:47.018162 28987 rpcz_store.cc:276] 0810 11:30:42.653854 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.655612 (+ 1758us) service_pool.cc:227] Handling call
0810 11:30:47.015717 (+4360105us) ts_tablet_manager.cc:1145] Deleting tablet ee803ddf27594d2b9e19fe440fc269c7
0810 11:30:47.015734 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.017897 (+ 2163us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4359861}
I20260810 11:30:47.019132 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 126) took 4363 ms. Trace:
I20260810 11:30:47.019311 28987 rpcz_store.cc:276] 0810 11:30:42.656126 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.656366 (+ 240us) service_pool.cc:227] Handling call
0810 11:30:47.018873 (+4362507us) ts_tablet_manager.cc:1145] Deleting tablet b6395bce17ee40c2822669246ce7eb42
0810 11:30:47.018891 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.019109 (+ 218us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4362268}
I20260810 11:30:47.020895 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 127) took 4363 ms. Trace:
I20260810 11:30:47.021327 28987 rpcz_store.cc:276] 0810 11:30:42.657240 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.657457 (+ 217us) service_pool.cc:227] Handling call
0810 11:30:47.020474 (+4363017us) ts_tablet_manager.cc:1145] Deleting tablet e276b0fa124d42dfb3fe750d245e44d8
0810 11:30:47.020487 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.020874 (+ 387us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4362814}
I20260810 11:30:47.022174 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 128) took 4363 ms. Trace:
I20260810 11:30:47.022339 28987 rpcz_store.cc:276] 0810 11:30:42.658771 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.658930 (+ 159us) service_pool.cc:227] Handling call
0810 11:30:47.022048 (+4363118us) ts_tablet_manager.cc:1145] Deleting tablet 4b5a7f67ec5b48c2b5a510add0282a76
0810 11:30:47.022059 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.022154 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4362955}
I20260810 11:30:47.023209 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 129) took 4363 ms. Trace:
I20260810 11:30:47.023392 28987 rpcz_store.cc:276] 0810 11:30:42.659284 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.661249 (+ 1965us) service_pool.cc:227] Handling call
0810 11:30:47.023081 (+4361832us) ts_tablet_manager.cc:1145] Deleting tablet 2da86554bc51486e91f1ea5995a245b5
0810 11:30:47.023093 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.023189 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4358945}
I20260810 11:30:47.023973 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 131) took 4361 ms. Trace:
I20260810 11:30:47.024127 28987 rpcz_store.cc:276] 0810 11:30:42.662847 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.663575 (+ 728us) service_pool.cc:227] Handling call
0810 11:30:47.023885 (+4360310us) ts_tablet_manager.cc:1145] Deleting tablet 49db12565dbc4187b78a98ed35c40fed
0810 11:30:47.023900 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.023956 (+ 56us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4359510}
I20260810 11:30:47.024724 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 130) took 4362 ms. Trace:
I20260810 11:30:47.024878 28987 rpcz_store.cc:276] 0810 11:30:42.661984 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.662466 (+ 482us) service_pool.cc:227] Handling call
0810 11:30:47.024611 (+4362145us) ts_tablet_manager.cc:1145] Deleting tablet c60baf810a544a4a90dccd2337a39043
0810 11:30:47.024623 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.024706 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4360150}
I20260810 11:30:47.025408 28987 tablet_replica.cc:330] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:47.025707 28987 raft_consensus.cc:2229] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:47.025969 28987 raft_consensus.cc:2258] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:47.027145 28987 ts_tablet_manager.cc:1905] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:47.029067 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ee803ddf27594d2b9e19fe440fc269c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee803ddf27594d2b9e19fe440fc269c7 already in progress: creating tablet
I20260810 11:30:47.029249 27222 tablet_bootstrap.cc:492] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
W20260810 11:30:47.029580 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet b6395bce17ee40c2822669246ce7eb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6395bce17ee40c2822669246ce7eb42 already in progress: creating tablet
W20260810 11:30:47.029806 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet e276b0fa124d42dfb3fe750d245e44d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e276b0fa124d42dfb3fe750d245e44d8 already in progress: creating tablet
W20260810 11:30:47.030229 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 4b5a7f67ec5b48c2b5a510add0282a76 because the tablet was not found. No further retry: Not found: Tablet not found: 4b5a7f67ec5b48c2b5a510add0282a76
W20260810 11:30:47.030522 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2da86554bc51486e91f1ea5995a245b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2da86554bc51486e91f1ea5995a245b5 already in progress: creating tablet
W20260810 11:30:47.030859 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 49db12565dbc4187b78a98ed35c40fed because the tablet was not found. No further retry: Not found: Tablet not found: 49db12565dbc4187b78a98ed35c40fed
W20260810 11:30:47.031172 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet c60baf810a544a4a90dccd2337a39043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c60baf810a544a4a90dccd2337a39043 already in progress: creating tablet
I20260810 11:30:47.031435 27222 ts_tablet_manager.cc:1397] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.056s user 0.006s sys 0.000s
I20260810 11:30:47.033623 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.035656 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a with delete_type TABLET_DATA_DELETED (replaced by tablet c8c9267e2da64738b5f7550c83b7c4a3) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.036278 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet fc558690dce44e999e55e9bf1b6ca172 with delete_type TABLET_DATA_DELETED (replaced by tablet 0bb01711769f457aa0696bb59582166d) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.036809 26914 raft_consensus.cc:3037] T b755744059b04967857c1b00e951b8ee P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:47.037714 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7acf847a1fd74ccc89b5bffe1bbb76f3) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.037782 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet c60baf810a544a4a90dccd2337a39043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.038244 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da86554bc51486e91f1ea5995a245b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.038429 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet ce73798a721b4a6d892f0c24b6b40e2c with delete_type TABLET_DATA_DELETED (replaced by tablet 81b800247b4e4171b82dcde68e39fb00) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.038564 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet cc76d30f37094391b75076c92ccc277f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.038854 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet e69916a35fba4714bbc565921738888f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.039243 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.040061 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.040126 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a with delete_type TABLET_DATA_DELETED (replaced by tablet c8c9267e2da64738b5f7550c83b7c4a3) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.040498 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet ea66da5bc20e4718901ffc473677421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.040526 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.041525 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet ee803ddf27594d2b9e19fe440fc269c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 82de53efa73447fe84e70dbb11a16a5f) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.042167 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet b121c13e9241468aa224e17093eb38f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b607279006c4baeae79325926088014) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.042210 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet f6e264e8507446809f3c386fdb3c34ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.042950 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet b6395bce17ee40c2822669246ce7eb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.043195 27036 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.043677 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.043898 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.043967 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet 2634beb347714fc7a2e05865adb34a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:17 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.044796 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet ce73798a721b4a6d892f0c24b6b40e2c with delete_type TABLET_DATA_DELETED (replaced by tablet 81b800247b4e4171b82dcde68e39fb00) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.045320 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.045496 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet e31b380f99854eb8b63e1f9eede1fc7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.046379 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet b945cb22353f4d99a3836e3c0b8e26e3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ee50a7da224437baed913995e6587dd) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.047079 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b303be24f4e46d0b966e8191d76297b with delete_type TABLET_DATA_DELETED (replaced by tablet ccdf2bb9f3b347ceb970a0d3115816df) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.048599 27036 tablet_service.cc:1514] Processing DeleteTablet for tablet 91b6078efadf496fb252f725bdf56b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.048838 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.049017 27036 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.049095 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet 3851d39aeb3142938a5ac558ab438c21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.049443 27026 tablet_service.cc:1514] Processing DeleteTablet for tablet 78633fbe048b4534ae3277ce6b7c4313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:39 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.049971 28987 ts_tablet_manager.cc:1918] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:47.050034 27036 tablet_service.cc:1514] Processing DeleteTablet for tablet a835d30ef9fc474ab927bb119a95d83c with delete_type TABLET_DATA_DELETED (replaced by tablet 2a1fbf3890ee4a829b4c8c61fe1e978f) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.050209 28987 log.cc:1196] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/f6e264e8507446809f3c386fdb3c34ae
I20260810 11:30:47.050271 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet a63227e69df14a4ea935087fd31ece63 with delete_type TABLET_DATA_DELETED (replaced by tablet aa71cedba3d34c288a3e3be99d474ce4) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.050450 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet a8a65a0e8b1f4e4b8d9a82059b766cda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.050658 27026 tablet_service.cc:1514] Processing DeleteTablet for tablet ff9b649e43a9456fa51cf3330290bb91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.050733 28987 ts_tablet_manager.cc:1939] T f6e264e8507446809f3c386fdb3c34ae P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:47.052313 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 10e6c41db71a4146840f06c5b7412d9c with delete_type TABLET_DATA_DELETED (replaced by tablet 72209a805e3e4b4ea1bf99508e0f75db) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.052793 27027 tablet_service.cc:1514] Processing DeleteTablet for tablet d512c335e340437fa32f2dc16dca6812 with delete_type TABLET_DATA_DELETED (replaced by tablet 7abf8e1e7f2c4519902cf31c6e0e86e2) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.055774 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 132) took 4391 ms. Trace:
I20260810 11:30:47.055902 28987 rpcz_store.cc:276] 0810 11:30:42.663917 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.664681 (+ 764us) service_pool.cc:227] Handling call
0810 11:30:47.025361 (+4360680us) ts_tablet_manager.cc:1145] Deleting tablet f6e264e8507446809f3c386fdb3c34ae
0810 11:30:47.025371 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.034801 (+ 9430us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.046812 (+ 12011us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.055740 (+ 8928us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4360408}
I20260810 11:30:47.056347 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 133) took 4390 ms. Trace:
I20260810 11:30:47.056437 28987 rpcz_store.cc:276] 0810 11:30:42.665624 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.666450 (+ 826us) service_pool.cc:227] Handling call
0810 11:30:47.056202 (+4389752us) ts_tablet_manager.cc:1145] Deleting tablet db59523b71224370bf5fce6b56592f71
0810 11:30:47.056217 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.056329 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4389549}
I20260810 11:30:47.056802 28987 tablet_replica.cc:330] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:47.056841 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet f6e264e8507446809f3c386fdb3c34ae (table default.Table_ae66005f117b4fe9bd3fb52adb6efb32 [id=03cc701eb88641fa844ee3d192b321ab]) successfully deleted
I20260810 11:30:47.057024 28987 raft_consensus.cc:2229] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:47.057206 28987 raft_consensus.cc:2258] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:47.057542 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet 603fe104b7ab485eab6b225a58bddc1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.057844 28987 ts_tablet_manager.cc:1905] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:47.058166 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet cc76d30f37094391b75076c92ccc277f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.058921 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet 713663be70014b17b17056a865e7db63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.060858 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ada1df82eb44ecb9a6c615b5410e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.061456 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet 318d5b8453fe4c438d0fa32cb91c409e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.061812 29489 raft_consensus.cc:482] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:47.062041 29489 raft_consensus.cc:504] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.062920 29489 leader_election.cc:288] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:47.063678 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34bd3c0edf6b49d1891c0ee9af344872" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:47.063947 27057 raft_consensus.cc:2379] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
W20260810 11:30:47.064499 26849 leader_election.cc:341] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 34bd3c0edf6b49d1891c0ee9af344872
I20260810 11:30:47.064760 26849 leader_election.cc:302] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
W20260810 11:30:47.065146 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet db59523b71224370bf5fce6b56592f71 because the tablet was not found. No further retry: Not found: Tablet not found: db59523b71224370bf5fce6b56592f71
I20260810 11:30:47.065546 29297 raft_consensus.cc:3037] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:47.066311 28987 ts_tablet_manager.cc:1918] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:47.066547 28987 log.cc:1196] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/809b5b6b65d244cd9186517e39494839
I20260810 11:30:47.067016 28987 ts_tablet_manager.cc:1939] T 809b5b6b65d244cd9186517e39494839 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:47.068048 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 134) took 4401 ms. Trace:
I20260810 11:30:47.068184 28987 rpcz_store.cc:276] 0810 11:30:42.666884 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.668092 (+ 1208us) service_pool.cc:227] Handling call
0810 11:30:47.056745 (+4388653us) ts_tablet_manager.cc:1145] Deleting tablet 809b5b6b65d244cd9186517e39494839
0810 11:30:47.056759 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.062168 (+ 5409us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.066187 (+ 4019us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.068026 (+ 1839us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4388456}
I20260810 11:30:47.068949 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet 64818ca5827e41d99428903ddb8688d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.069247 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 135) took 4400 ms. Trace:
I20260810 11:30:47.069375 28987 rpcz_store.cc:276] 0810 11:30:42.668447 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.671758 (+ 3311us) service_pool.cc:227] Handling call
0810 11:30:47.069094 (+4397336us) ts_tablet_manager.cc:1145] Deleting tablet 7c203cd90d2f472fa27cfabed5b87119
0810 11:30:47.069109 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.069226 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4397163}
I20260810 11:30:47.069648 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet 64818ca5827e41d99428903ddb8688d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.069936 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 136) took 4397 ms. Trace:
I20260810 11:30:47.070060 28987 rpcz_store.cc:276] 0810 11:30:42.672520 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.673543 (+ 1023us) service_pool.cc:227] Handling call
0810 11:30:47.069814 (+4396271us) ts_tablet_manager.cc:1145] Deleting tablet ea66da5bc20e4718901ffc473677421c
0810 11:30:47.069828 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.069919 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4396081}
I20260810 11:30:47.070621 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 137) took 4396 ms. Trace:
I20260810 11:30:47.070784 28987 rpcz_store.cc:276] 0810 11:30:42.673860 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.674205 (+ 345us) service_pool.cc:227] Handling call
0810 11:30:47.070493 (+4396288us) ts_tablet_manager.cc:1145] Deleting tablet 7e78fb1bf0534deca5cc5a603fd77592
0810 11:30:47.070508 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.070580 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4396091}
I20260810 11:30:47.071346 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 138) took 4396 ms. Trace:
I20260810 11:30:47.071578 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b303be24f4e46d0b966e8191d76297b with delete_type TABLET_DATA_DELETED (replaced by tablet ccdf2bb9f3b347ceb970a0d3115816df) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.071610 28987 rpcz_store.cc:276] 0810 11:30:42.674578 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.675294 (+ 716us) service_pool.cc:227] Handling call
0810 11:30:47.071181 (+4395887us) ts_tablet_manager.cc:1145] Deleting tablet 0713f4f14a284050a7774a70ab974f30
0810 11:30:47.071194 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.071269 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4395701}
I20260810 11:30:47.072191 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c203cd90d2f472fa27cfabed5b87119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.072245 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 139) took 4396 ms. Trace:
I20260810 11:30:47.072497 28987 rpcz_store.cc:276] 0810 11:30:42.675637 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.677725 (+ 2088us) service_pool.cc:227] Handling call
0810 11:30:47.072075 (+4394350us) ts_tablet_manager.cc:1145] Deleting tablet e31b380f99854eb8b63e1f9eede1fc7c
0810 11:30:47.072087 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.072143 (+ 56us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4394133}
I20260810 11:30:47.072646 29297 raft_consensus.cc:2726] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:47.073169 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 140) took 4394 ms. Trace:
I20260810 11:30:47.073081 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 809b5b6b65d244cd9186517e39494839 (table default.Table_8a7d3a80b9424a56a1b4583e39cadf99 [id=072a54ad9981451c9a5004a46fecd6c1]) successfully deleted
I20260810 11:30:47.073438 28987 rpcz_store.cc:276] 0810 11:30:42.678323 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.678834 (+ 511us) service_pool.cc:227] Handling call
0810 11:30:47.072974 (+4394140us) ts_tablet_manager.cc:1145] Deleting tablet 0713f4f14a284050a7774a70ab974f30
0810 11:30:47.072986 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.073042 (+ 56us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4393974}
I20260810 11:30:47.074064 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 141) took 4394 ms. Trace:
I20260810 11:30:47.074323 28987 rpcz_store.cc:276] 0810 11:30:42.679146 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.680283 (+ 1137us) service_pool.cc:227] Handling call
0810 11:30:47.073866 (+4393583us) ts_tablet_manager.cc:1145] Deleting tablet b121c13e9241468aa224e17093eb38f4
0810 11:30:47.073878 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.073966 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4390254}
I20260810 11:30:47.074932 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 142) took 4394 ms. Trace:
I20260810 11:30:47.076387 28987 rpcz_store.cc:276] 0810 11:30:42.680542 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.682479 (+ 1937us) service_pool.cc:227] Handling call
0810 11:30:47.074757 (+4392278us) ts_tablet_manager.cc:1145] Deleting tablet 23637a02b6464e17aa2a69ea5cc4ddfe
0810 11:30:47.074771 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.074831 (+ 60us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4390977}
W20260810 11:30:47.076836 26581 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.195:32877 (request call id 344) took 4150 ms (client timeout 1000 ms). Trace:
W20260810 11:30:47.076992 26581 rpcz_store.cc:269] 0810 11:30:42.926521 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.927849 (+ 1328us) service_pool.cc:227] Handling call
0810 11:30:47.076736 (+4148887us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":285145,"reported_tablets":203}
I20260810 11:30:47.077195 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 143) took 4394 ms. Trace:
I20260810 11:30:47.077459 28987 rpcz_store.cc:276] 0810 11:30:42.682743 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.683828 (+ 1085us) service_pool.cc:227] Handling call
0810 11:30:47.076959 (+4393131us) ts_tablet_manager.cc:1145] Deleting tablet 110b5acc36bd4d6bba13735e5daec75f
0810 11:30:47.076972 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.077111 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4392970}
I20260810 11:30:47.077613 26581 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_c68a4d11e9de4ef5a80903d5658bd5f8" } new_table_name: "default.Table_eb5bb59579c043d7b1d98e60e42899af" modify_external_catalogs: true
I20260810 11:30:47.078150 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 144) took 4393 ms. Trace:
I20260810 11:30:47.078406 28987 rpcz_store.cc:276] 0810 11:30:42.684208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.684624 (+ 416us) service_pool.cc:227] Handling call
0810 11:30:47.077887 (+4393263us) ts_tablet_manager.cc:1145] Deleting tablet 518c777e40ec40dcb3484c0374384959
0810 11:30:47.077898 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.077985 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4393061}
I20260810 11:30:47.079051 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 145) took 4393 ms. Trace:
I20260810 11:30:47.079300 28987 rpcz_store.cc:276] 0810 11:30:42.685296 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.685367 (+ 71us) service_pool.cc:227] Handling call
0810 11:30:47.078826 (+4393459us) ts_tablet_manager.cc:1145] Deleting tablet 0cc17c55109b47eeb91920c3ed8178e0
0810 11:30:47.078837 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.078923 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4393300}
I20260810 11:30:47.079849 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 146) took 4394 ms. Trace:
I20260810 11:30:47.080072 28987 rpcz_store.cc:276] 0810 11:30:42.685932 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.685971 (+ 39us) service_pool.cc:227] Handling call
0810 11:30:47.079677 (+4393706us) ts_tablet_manager.cc:1145] Deleting tablet 7cd4f555b5d840c182a31b3c94da9619
0810 11:30:47.079689 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.079748 (+ 59us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4392441}
W20260810 11:30:47.085177 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7c203cd90d2f472fa27cfabed5b87119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c203cd90d2f472fa27cfabed5b87119 already in progress: creating tablet
I20260810 11:30:47.089788 27228 tablet_bootstrap.cc:492] T 72209a805e3e4b4ea1bf99508e0f75db P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
W20260810 11:30:47.092803 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ea66da5bc20e4718901ffc473677421c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea66da5bc20e4718901ffc473677421c already in progress: creating tablet
W20260810 11:30:47.093156 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7e78fb1bf0534deca5cc5a603fd77592 because the tablet was not found. No further retry: Not found: Tablet not found: 7e78fb1bf0534deca5cc5a603fd77592
W20260810 11:30:47.093516 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 0713f4f14a284050a7774a70ab974f30 because the tablet was not found. No further retry: Not found: Tablet not found: 0713f4f14a284050a7774a70ab974f30
W20260810 11:30:47.093847 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet e31b380f99854eb8b63e1f9eede1fc7c because the tablet was not found. No further retry: Not found: Tablet not found: e31b380f99854eb8b63e1f9eede1fc7c
W20260810 11:30:47.094282 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 0713f4f14a284050a7774a70ab974f30 because the tablet was not found. No further retry: Not found: Tablet not found: 0713f4f14a284050a7774a70ab974f30
I20260810 11:30:47.093906 27228 ts_tablet_manager.cc:1397] T 72209a805e3e4b4ea1bf99508e0f75db P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.173s user 0.009s sys 0.002s
W20260810 11:30:47.094594 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet b121c13e9241468aa224e17093eb38f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b121c13e9241468aa224e17093eb38f4 already in progress: creating tablet
W20260810 11:30:47.094935 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 23637a02b6464e17aa2a69ea5cc4ddfe because the tablet was not found. No further retry: Not found: Tablet not found: 23637a02b6464e17aa2a69ea5cc4ddfe
W20260810 11:30:47.095218 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 110b5acc36bd4d6bba13735e5daec75f because the tablet was not found. No further retry: Not found: Tablet not found: 110b5acc36bd4d6bba13735e5daec75f
W20260810 11:30:47.095604 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 518c777e40ec40dcb3484c0374384959 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 518c777e40ec40dcb3484c0374384959 already in progress: creating tablet
W20260810 11:30:47.095959 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 0cc17c55109b47eeb91920c3ed8178e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0cc17c55109b47eeb91920c3ed8178e0 already in progress: creating tablet
W20260810 11:30:47.096103 26573 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.194:35117 (request call id 270) took 3283 ms (client timeout 1000 ms). Trace:
I20260810 11:30:47.096807 27228 raft_consensus.cc:348] T 72209a805e3e4b4ea1bf99508e0f75db P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.100114 27228 raft_consensus.cc:374] T 72209a805e3e4b4ea1bf99508e0f75db P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:47.100744 27228 raft_consensus.cc:729] T 72209a805e3e4b4ea1bf99508e0f75db P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:47.101624 27228 consensus_queue.cc:260] T 72209a805e3e4b4ea1bf99508e0f75db P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:47.096462 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7cd4f555b5d840c182a31b3c94da9619 because the tablet was not found. No further retry: Not found: Tablet not found: 7cd4f555b5d840c182a31b3c94da9619
W20260810 11:30:47.088492 26567 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2acbbbd72845428384d65c8c423c0db6 consensus state has no leader
W20260810 11:30:47.092180 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 because the tablet was not found. No further retry: Not found: Tablet not found: 256ad2e2d8e54a4caa1b5091bab60dd5
W20260810 11:30:47.105960 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a because the tablet was not found. No further retry: Not found: Tablet not found: 6dc4fd6ca8a541f99eed57a6f51c1f0a
W20260810 11:30:47.106420 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet fc558690dce44e999e55e9bf1b6ca172 because the tablet was not found. No further retry: Not found: Tablet not found: fc558690dce44e999e55e9bf1b6ca172
W20260810 11:30:47.106959 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet e276b0fa124d42dfb3fe750d245e44d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e276b0fa124d42dfb3fe750d245e44d8 already in progress: creating tablet
W20260810 11:30:47.108093 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet c60baf810a544a4a90dccd2337a39043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c60baf810a544a4a90dccd2337a39043 already in progress: creating tablet
W20260810 11:30:47.108471 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 2da86554bc51486e91f1ea5995a245b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2da86554bc51486e91f1ea5995a245b5 already in progress: creating tablet
W20260810 11:30:47.108898 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ce73798a721b4a6d892f0c24b6b40e2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce73798a721b4a6d892f0c24b6b40e2c already in progress: creating tablet
W20260810 11:30:47.109330 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet cc76d30f37094391b75076c92ccc277f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc76d30f37094391b75076c92ccc277f already in progress: creating tablet
W20260810 11:30:47.109638 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet e69916a35fba4714bbc565921738888f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e69916a35fba4714bbc565921738888f already in progress: creating tablet
W20260810 11:30:47.110205 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet d000f0ebaf0049a7bdaad93e307e16e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d000f0ebaf0049a7bdaad93e307e16e2 already in progress: creating tablet
W20260810 11:30:47.110544 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 3ae27bf110114b70a3e3f6cf64f31b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae27bf110114b70a3e3f6cf64f31b98 already in progress: creating tablet
W20260810 11:30:47.110993 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ea66da5bc20e4718901ffc473677421c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea66da5bc20e4718901ffc473677421c already in progress: creating tablet
W20260810 11:30:47.111325 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 8228600e3f6b4f9993dd25e4ceb57e4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8228600e3f6b4f9993dd25e4ceb57e4d already in progress: creating tablet
W20260810 11:30:47.113598 26571 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 81b800247b4e4171b82dcde68e39fb00 (table default.Table_f7aaec87f80f4f5f92f5e00a9effebcc [id=abc46123737f48398c9ed367a3aeebda], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 81b800247b4e4171b82dcde68e39fb00 consensus state has no leader
W20260810 11:30:47.115948 26571 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 consensus state has no leader
W20260810 11:30:47.096302 26573 rpcz_store.cc:269] 0810 11:30:43.812409 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.746414 (+934005us) service_pool.cc:227] Handling call
0810 11:30:46.367567 (+1621153us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:46.367575 (+ 8us) write_op.cc:454] Released schema lock
0810 11:30:46.396320 (+ 28745us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:46.396330 (+ 10us) write_op.cc:454] Released schema lock
0810 11:30:46.585777 (+189447us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:46.585786 (+ 9us) write_op.cc:454] Released schema lock
0810 11:30:46.612847 (+ 27061us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:46.612855 (+ 8us) write_op.cc:454] Released schema lock
0810 11:30:47.096050 (+483195us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:45.597138 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:45.597286 (+ 148us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:45.597296 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:45.597300 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:45.597425 (+ 125us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:45.597442 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:45.597446 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:45.597521 (+ 75us) tablet.cc:699] Row locks acquired
0810 11:30:45.597523 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:45.597571 (+ 48us) write_op.cc:270] Start()
0810 11:30:45.597609 (+ 38us) write_op.cc:276] Timestamp: P: 1786361445597163 usec, L: 0
0810 11:30:45.597613 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:45.597842 (+ 229us) log.cc:842] Serialized 356 byte log entry
0810 11:30:45.623414 (+ 25572us) op_driver.cc:444] REPLICATION: finished
0810 11:30:45.623526 (+ 112us) write_op.cc:301] APPLY: starting
0810 11:30:45.623551 (+ 25us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:45.623613 (+ 62us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:45.623668 (+ 55us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:45.623761 (+ 93us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:45.623808 (+ 47us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:45.623815 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:45.623931 (+ 116us) log.cc:842] Serialized 23 byte log entry
0810 11:30:45.624010 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:45.624037 (+ 27us) write_op.cc:454] Released schema lock
0810 11:30:45.624047 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:45.624147 (+ 100us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:45.624151 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:46.346062 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:46.346192 (+ 130us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:46.346199 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:46.346202 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:46.346317 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:46.346333 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:46.346338 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:46.346411 (+ 73us) tablet.cc:699] Row locks acquired
0810 11:30:46.346413 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:46.346457 (+ 44us) write_op.cc:270] Start()
0810 11:30:46.346557 (+ 100us) write_op.cc:276] Timestamp: P: 1786361446346405 usec, L: 0
0810 11:30:46.346561 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:46.346788 (+ 227us) log.cc:842] Serialized 356 byte log entry
0810 11:30:46.351581 (+ 4793us) op_driver.cc:444] REPLICATION: finished
0810 11:30:46.351724 (+ 143us) write_op.cc:301] APPLY: starting
0810 11:30:46.351742 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:46.351789 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:46.351817 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:46.351878 (+ 61us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:46.351915 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:46.351921 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:46.352017 (+ 96us) log.cc:842] Serialized 23 byte log entry
0810 11:30:46.352086 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:46.352108 (+ 22us) write_op.cc:454] Released schema lock
0810 11:30:46.352115 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0810 11:30:46.376728 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:46.376897 (+ 169us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:46.376907 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:46.376912 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:46.377068 (+ 156us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:46.377089 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:46.377097 (+ 8us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:46.377211 (+ 114us) tablet.cc:699] Row locks acquired
0810 11:30:46.377215 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:46.377264 (+ 49us) write_op.cc:270] Start()
0810 11:30:46.377313 (+ 49us) write_op.cc:276] Timestamp: P: 1786361446377208 usec, L: 0
0810 11:30:46.377319 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:46.377559 (+ 240us) log.cc:842] Serialized 356 byte log entry
0810 11:30:46.384068 (+ 6509us) op_driver.cc:444] REPLICATION: finished
0810 11:30:46.386929 (+ 2861us) write_op.cc:301] APPLY: starting
0810 11:30:46.386967 (+ 38us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:46.387026 (+ 59us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:46.387062 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:46.387141 (+ 79us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:46.387184 (+ 43us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:46.387190 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:46.387292 (+ 102us) log.cc:842] Serialized 23 byte log entry
0810 11:30:46.387388 (+ 96us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:46.387420 (+ 32us) write_op.cc:454] Released schema lock
0810 11:30:46.387432 (+ 12us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0810 11:30:46.577486 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:46.577674 (+ 188us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:46.577685 (+ 11us) write_op.cc:435] Acquired schema lock
0810 11:30:46.577687 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:46.577812 (+ 125us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:46.577827 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:46.577832 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:46.577903 (+ 71us) tablet.cc:699] Row locks acquired
0810 11:30:46.577905 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:46.577951 (+ 46us) write_op.cc:270] Start()
0810 11:30:46.577992 (+ 41us) write_op.cc:276] Timestamp: P: 1786361446577548 usec, L: 0
0810 11:30:46.577999 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:46.578268 (+ 269us) log.cc:842] Serialized 356 byte log entry
0810 11:30:46.582017 (+ 3749us) op_driver.cc:444] REPLICATION: finished
0810 11:30:46.582140 (+ 123us) write_op.cc:301] APPLY: starting
0810 11:30:46.582157 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:46.582201 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:46.582249 (+ 48us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:46.582311 (+ 62us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:46.582352 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:46.582357 (+ 5us) write_op.cc:312] APPLY: finished
0810 11:30:46.582452 (+ 95us) log.cc:842] Serialized 23 byte log entry
0810 11:30:46.582526 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:46.582550 (+ 24us) write_op.cc:454] Released schema lock
0810 11:30:46.582559 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0810 11:30:46.599295 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:46.599436 (+ 141us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:46.599444 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:46.599446 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:46.599580 (+ 134us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:46.599595 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:46.599599 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:46.599671 (+ 72us) tablet.cc:699] Row locks acquired
0810 11:30:46.599673 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:46.599717 (+ 44us) write_op.cc:270] Start()
0810 11:30:46.599757 (+ 40us) write_op.cc:276] Timestamp: P: 1786361446599314 usec, L: 0
0810 11:30:46.599761 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:46.600009 (+ 248us) log.cc:842] Serialized 356 byte log entry
0810 11:30:46.606882 (+ 6873us) op_driver.cc:444] REPLICATION: finished
0810 11:30:46.607346 (+ 464us) write_op.cc:301] APPLY: starting
0810 11:30:46.607373 (+ 27us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:46.607503 (+ 130us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:46.607548 (+ 45us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:46.607618 (+ 70us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:46.607663 (+ 45us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:46.607674 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:46.607788 (+ 114us) log.cc:842] Serialized 23 byte log entry
0810 11:30:46.607875 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:46.607903 (+ 28us) write_op.cc:454] Released schema lock
0810 11:30:46.607914 (+ 11us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0810 11:30:46.992509 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:46.992719 (+ 210us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:46.992730 (+ 11us) write_op.cc:435] Acquired schema lock
0810 11:30:46.992735 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:46.992888 (+ 153us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:46.992910 (+ 22us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:46.992918 (+ 8us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:46.993008 (+ 90us) tablet.cc:699] Row locks acquired
0810 11:30:46.993010 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:46.993051 (+ 41us) write_op.cc:270] Start()
0810 11:30:46.993091 (+ 40us) write_op.cc:276] Timestamp: P: 1786361446992610 usec, L: 0
0810 11:30:46.993095 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:46.993328 (+ 233us) log.cc:842] Serialized 356 byte log entry
0810 11:30:47.000725 (+ 7397us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.002040 (+ 1315us) write_op.cc:301] APPLY: starting
0810 11:30:47.002097 (+ 57us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.002180 (+ 83us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.002224 (+ 44us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.002314 (+ 90us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.002353 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:47.002359 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:47.002543 (+ 184us) log.cc:842] Serialized 23 byte log entry
0810 11:30:47.002624 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.002647 (+ 23us) write_op.cc:454] Released schema lock
0810 11:30:47.002655 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.002719 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.002722 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":158677,"reported_tablets":186,"child_traces":[["op",{"apply.queue_time_us":40,"apply.run_cpu_time_us":690,"apply.run_wall_time_us":691,"num_ops":1,"prepare.queue_time_us":23313,"prepare.run_cpu_time_us":1001,"prepare.run_wall_time_us":3965,"raft.queue_time_us":2038,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":413,"replication_time_us":25767,"thread_start_us":26208,"threads_started":1}],["op",{"apply.queue_time_us":86,"apply.run_cpu_time_us":461,"apply.run_wall_time_us":460,"num_ops":1,"prepare.queue_time_us":1713,"prepare.run_cpu_time_us":848,"prepare.run_wall_time_us":849,"raft.queue_time_us":1160,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":310,"replication_time_us":4990}],["op",{"apply.queue_time_us":2760,"apply.run_cpu_time_us":603,"apply.run_wall_time_us":603,"num_ops":1,"prepare.queue_time_us":69,"prepare.run_cpu_time_us":956,"prepare.run_wall_time_us":956,"raft.queue_time_us":492,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":343,"replication_time_us":6704}],["op",{"apply.queue_time_us":77,"apply.run_cpu_time_us":498,"apply.run_wall_time_us":497,"num_ops":1,"prepare.queue_time_us":4596,"prepare.run_cpu_time_us":930,"prepare.run_wall_time_us":932,"raft.queue_time_us":125,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":296,"replication_time_us":3991}],["op",{"apply.queue_time_us":321,"apply.run_cpu_time_us":669,"apply.run_wall_time_us":669,"num_ops":1,"prepare.queue_time_us":11864,"prepare.run_cpu_time_us":867,"prepare.run_wall_time_us":867,"raft.queue_time_us":515,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":304,"replication_time_us":7052}],["op",{"apply.queue_time_us":1213,"apply.run_cpu_time_us":753,"apply.run_wall_time_us":752,"num_ops":1,"prepare.queue_time_us":4052,"prepare.run_cpu_time_us":952,"prepare.run_wall_time_us":952,"raft.queue_time_us":1650,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":351,"replication_time_us":7209}]]}
W20260810 11:30:47.087677 26577 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.195:32877 (request call id 345) took 3089 ms (client timeout 1000 ms). Trace:
I20260810 11:30:47.129709 26573 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_710852962fc94eebadae58bb908b6a3b" } new_table_name: "default.Table_4e93c67b823f48028820e1e95415e455" modify_external_catalogs: true
W20260810 11:30:47.129309 26577 rpcz_store.cc:269] 0810 11:30:43.997998 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.758241 (+760243us) service_pool.cc:227] Handling call
0810 11:30:45.777876 (+1019635us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:45.777887 (+ 11us) write_op.cc:454] Released schema lock
0810 11:30:47.087501 (+1309614us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:45.764919 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:45.765135 (+ 216us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:45.765143 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:45.765146 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:45.765414 (+ 268us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:45.765441 (+ 27us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:45.765448 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:45.765533 (+ 85us) tablet.cc:699] Row locks acquired
0810 11:30:45.765536 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:45.765586 (+ 50us) write_op.cc:270] Start()
0810 11:30:45.765631 (+ 45us) write_op.cc:276] Timestamp: P: 1786361445765159 usec, L: 0
0810 11:30:45.765635 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:45.765927 (+ 292us) log.cc:842] Serialized 536 byte log entry
0810 11:30:45.773539 (+ 7612us) op_driver.cc:444] REPLICATION: finished
0810 11:30:45.773708 (+ 169us) write_op.cc:301] APPLY: starting
0810 11:30:45.773730 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:45.773780 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:45.773855 (+ 75us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:45.773944 (+ 89us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:45.774015 (+ 71us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:45.774022 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:45.774122 (+ 100us) log.cc:842] Serialized 23 byte log entry
0810 11:30:45.774195 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:45.774220 (+ 25us) write_op.cc:454] Released schema lock
0810 11:30:45.774228 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0810 11:30:46.355229 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:46.355362 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:46.355367 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:46.355370 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:46.355502 (+ 132us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:46.355522 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:46.355529 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:46.355621 (+ 92us) tablet.cc:699] Row locks acquired
0810 11:30:46.355626 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:46.355673 (+ 47us) write_op.cc:270] Start()
0810 11:30:46.355718 (+ 45us) write_op.cc:276] Timestamp: P: 1786361446355619 usec, L: 0
0810 11:30:46.355724 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:46.355966 (+ 242us) log.cc:842] Serialized 356 byte log entry
0810 11:30:46.360503 (+ 4537us) op_driver.cc:444] REPLICATION: finished
0810 11:30:46.360701 (+ 198us) write_op.cc:301] APPLY: starting
0810 11:30:46.360723 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:46.360778 (+ 55us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:46.360834 (+ 56us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:46.360912 (+ 78us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:46.360962 (+ 50us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:46.360972 (+ 10us) write_op.cc:312] APPLY: finished
0810 11:30:46.361070 (+ 98us) log.cc:842] Serialized 23 byte log entry
0810 11:30:46.361144 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:46.361170 (+ 26us) write_op.cc:454] Released schema lock
0810 11:30:46.361180 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:46.361249 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:46.361255 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":48444,"reported_tablets":209,"child_traces":[["op",{"apply.queue_time_us":104,"apply.run_cpu_time_us":605,"apply.run_wall_time_us":604,"num_ops":1,"prepare.queue_time_us":60,"prepare.run_cpu_time_us":1152,"prepare.run_wall_time_us":1152,"raft.queue_time_us":1435,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":360,"replication_time_us":7868}],["op",{"apply.queue_time_us":132,"apply.run_cpu_time_us":621,"apply.run_wall_time_us":620,"mutex_wait_us":9153,"num_ops":1,"prepare.queue_time_us":9223,"prepare.run_cpu_time_us":867,"prepare.run_wall_time_us":867,"raft.queue_time_us":83,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":267,"replication_time_us":4730}]]}
I20260810 11:30:47.131064 26577 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_8e946ba2788e406fb7cd8f38ab542b95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:47.131973 26577 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e946ba2788e406fb7cd8f38ab542b95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.135939 26965 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:47.110546 26574 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_a23328d9f82f426fa2993d07f5909694 [id=e08caac3c4e54a5c9ed82c003898f06e] alter complete (version 1)
W20260810 11:30:47.139850 26581 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb078d7c0d0e4cf5aa841a802e78d8ff consensus state has no leader
I20260810 11:30:47.105798 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cc17c55109b47eeb91920c3ed8178e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6179cb2be2c442ee97161fe1f4661b64) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.106107 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet b945cb22353f4d99a3836e3c0b8e26e3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ee50a7da224437baed913995e6587dd) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.106588 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet 78633fbe048b4534ae3277ce6b7c4313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:39 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.107234 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 518c777e40ec40dcb3484c0374384959 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.108358 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.108754 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet a63227e69df14a4ea935087fd31ece63 with delete_type TABLET_DATA_DELETED (replaced by tablet aa71cedba3d34c288a3e3be99d474ce4) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.151398 27228 ts_tablet_manager.cc:1428] T 72209a805e3e4b4ea1bf99508e0f75db P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.056s user 0.003s sys 0.000s
W20260810 11:30:47.154260 26578 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.194:35117 (request call id 271) took 2184 ms (client timeout 1000 ms). Trace:
W20260810 11:30:47.154695 26578 rpcz_store.cc:269] 0810 11:30:44.969420 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.120097 (+150677us) service_pool.cc:227] Handling call
0810 11:30:45.379064 (+258967us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa3fd8f 00007f9c61d34946 00007f9c61d34675 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:47.154149 (+1775085us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:46.154581 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:46.154728 (+ 147us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:46.154737 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:46.154742 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:46.154875 (+ 133us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:46.154891 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:46.154896 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:46.154971 (+ 75us) tablet.cc:699] Row locks acquired
0810 11:30:46.154973 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:46.155021 (+ 48us) write_op.cc:270] Start()
0810 11:30:46.155072 (+ 51us) write_op.cc:276] Timestamp: P: 1786361446154987 usec, L: 0
0810 11:30:46.155076 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:46.155302 (+ 226us) log.cc:842] Serialized 356 byte log entry
0810 11:30:46.167364 (+ 12062us) op_driver.cc:444] REPLICATION: finished
0810 11:30:46.167592 (+ 228us) write_op.cc:301] APPLY: starting
0810 11:30:46.167615 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:46.167665 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:46.167695 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:46.167764 (+ 69us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:46.167802 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:46.167808 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:46.167909 (+ 101us) log.cc:842] Serialized 23 byte log entry
0810 11:30:46.168004 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:46.168030 (+ 26us) write_op.cc:454] Released schema lock
0810 11:30:46.168038 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:46.168105 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:46.168109 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:46.993468 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:46.993549 (+ 81us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:46.993554 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:46.993567 (+ 13us) tablet.cc:660] Decoding operations
0810 11:30:46.993708 (+ 141us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:46.993718 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:46.993722 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:46.993769 (+ 47us) tablet.cc:699] Row locks acquired
0810 11:30:46.993771 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:46.993801 (+ 30us) write_op.cc:270] Start()
0810 11:30:46.993827 (+ 26us) write_op.cc:276] Timestamp: P: 1786361446993363 usec, L: 0
0810 11:30:46.993831 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:46.993969 (+ 138us) log.cc:842] Serialized 356 byte log entry
0810 11:30:47.000841 (+ 6872us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.002475 (+ 1634us) write_op.cc:301] APPLY: starting
0810 11:30:47.002487 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.002514 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.002555 (+ 41us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.002595 (+ 40us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.002619 (+ 24us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:47.002624 (+ 5us) write_op.cc:312] APPLY: finished
0810 11:30:47.002680 (+ 56us) log.cc:842] Serialized 23 byte log entry
0810 11:30:47.002714 (+ 34us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.002725 (+ 11us) write_op.cc:454] Released schema lock
0810 11:30:47.002728 (+ 3us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.016923 (+ 14195us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.016932 (+ 9us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":63049,"reported_tablets":193,"spinlock_wait_cycles":67434368,"child_traces":[["op",{"apply.queue_time_us":155,"apply.run_cpu_time_us":588,"apply.run_wall_time_us":587,"num_ops":1,"prepare.queue_time_us":3589,"prepare.run_cpu_time_us":860,"prepare.run_wall_time_us":861,"raft.queue_time_us":582,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":255,"replication_time_us":12253}],["op",{"apply.queue_time_us":1538,"apply.run_cpu_time_us":539,"apply.run_wall_time_us":14616,"num_ops":1,"prepare.queue_time_us":2120,"prepare.run_cpu_time_us":576,"prepare.run_wall_time_us":576,"raft.queue_time_us":1437,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":6990,"thread_start_us":19522,"threads_started":1}]]}
I20260810 11:30:47.159638 27228 tablet_bootstrap.cc:492] T 65756c37fe514194bebe76921419653c P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:47.163960 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet d08250001e1542f9978bc6f89ace458b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.164888 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet b945038c03e343489af6ae7e50131d97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.165563 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 4efa31ad2ce8436b9638e6759d9b5421 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:44 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.165534 29400 log.cc:824] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Log is configured to *not* fsync() on all Append() calls
I20260810 11:30:47.165648 29500 tablet_replica.cc:330] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:47.166297 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 713663be70014b17b17056a865e7db63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.167116 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet d4873fe8318040a2b7e021708a875f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.171671 26963 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:47.171273 29500 raft_consensus.cc:2229] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:47.186394 29453 raft_consensus.cc:482] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:47.113495 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 147) took 4095 ms. Trace:
I20260810 11:30:47.189896 28987 rpcz_store.cc:276] 0810 11:30:42.985151 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.985222 (+ 71us) service_pool.cc:227] Handling call
0810 11:30:47.080473 (+4095251us) ts_tablet_manager.cc:1145] Deleting tablet ce73798a721b4a6d892f0c24b6b40e2c
0810 11:30:47.080484 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.080598 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4077714}
I20260810 11:30:47.190837 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 148) took 4117 ms. Trace:
I20260810 11:30:47.192221 27231 tablet_bootstrap.cc:492] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:47.194249 28987 rpcz_store.cc:276] 0810 11:30:43.073325 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.073386 (+ 61us) service_pool.cc:227] Handling call
0810 11:30:47.190516 (+4117130us) ts_tablet_manager.cc:1145] Deleting tablet 8b303be24f4e46d0b966e8191d76297b
0810 11:30:47.190541 (+ 25us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.190737 (+ 196us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4106576}
I20260810 11:30:47.194893 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 149) took 4098 ms. Trace:
I20260810 11:30:47.195092 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7acf847a1fd74ccc89b5bffe1bbb76f3) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.196925 27231 tablet_bootstrap.cc:654] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:47.099085 29450 consensus_queue.cc:1035] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.117s
I20260810 11:30:47.198999 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.199230 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet fc558690dce44e999e55e9bf1b6ca172 with delete_type TABLET_DATA_DELETED (replaced by tablet 0bb01711769f457aa0696bb59582166d) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.199700 29110 raft_consensus.cc:2229] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:47.200438 29110 raft_consensus.cc:2258] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:47.200526 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet ea66da5bc20e4718901ffc473677421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.186622 29453 raft_consensus.cc:504] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.201701 29110 ts_tablet_manager.cc:1905] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:47.202349 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.202593 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.204136 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.205049 26821 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:47.208272 28987 rpcz_store.cc:276] 0810 11:30:43.095860 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.096542 (+ 682us) service_pool.cc:227] Handling call
0810 11:30:47.194611 (+4098069us) ts_tablet_manager.cc:1145] Deleting tablet b945cb22353f4d99a3836e3c0b8e26e3
0810 11:30:47.194624 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.194749 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4097787}
I20260810 11:30:47.216977 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet ee803ddf27594d2b9e19fe440fc269c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 82de53efa73447fe84e70dbb11a16a5f) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.217456 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet b121c13e9241468aa224e17093eb38f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b607279006c4baeae79325926088014) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.221381 28987 tablet_replica.cc:330] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:47.222792 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cc17c55109b47eeb91920c3ed8178e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6179cb2be2c442ee97161fe1f4661b64) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:47.175254 26574 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.194:35117 (request call id 272) took 1029 ms (client timeout 1000 ms). Trace:
W20260810 11:30:47.116520 26571 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet c8c9267e2da64738b5f7550c83b7c4a3 consensus state has no leader
W20260810 11:30:47.183393 26573 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bcc69e8f87134d25a1329be52b08e794 consensus state has no leader
I20260810 11:30:47.183727 26577 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 173) took 4236 ms. Trace:
I20260810 11:30:47.184247 26581 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 171) took 4483 ms. Trace:
W20260810 11:30:47.159546 26576 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.193:48791 (request call id 305) took 2126 ms (client timeout 1000 ms). Trace:
I20260810 11:30:47.229334 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet b200bdb394d3439b86fff48494be8e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:40 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.233484 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet c60baf810a544a4a90dccd2337a39043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.233845 29297 raft_consensus.cc:482] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:47.234818 27222 raft_consensus.cc:348] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.238736 29297 raft_consensus.cc:504] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.240988 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859477ecf37240a4888542d2559f99cd" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:47.241542 27057 raft_consensus.cc:2454] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:47.242844 29491 raft_consensus.cc:482] T 72209a805e3e4b4ea1bf99508e0f75db P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:47.243140 29491 raft_consensus.cc:504] T 72209a805e3e4b4ea1bf99508e0f75db P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.243903 29491 leader_election.cc:288] T 72209a805e3e4b4ea1bf99508e0f75db P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:47.244407 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.246942 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c203cd90d2f472fa27cfabed5b87119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.249514 29453 leader_election.cc:288] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:47.249640 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet f6e264e8507446809f3c386fdb3c34ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.250284 27222 raft_consensus.cc:374] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:47.251636 27222 raft_consensus.cc:729] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:47.250696 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da86554bc51486e91f1ea5995a245b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.251245 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 809b5b6b65d244cd9186517e39494839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:18 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.250427 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet b6395bce17ee40c2822669246ce7eb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.252034 28987 raft_consensus.cc:2229] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:47.252328 28987 raft_consensus.cc:2258] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:47.252964 27222 consensus_queue.cc:260] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.253156 26848 leader_election.cc:302] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:47.253398 28987 ts_tablet_manager.cc:1905] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:47.252574 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet 518c777e40ec40dcb3484c0374384959 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.253720 27222 ts_tablet_manager.cc:1428] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.222s user 0.003s sys 0.000s
I20260810 11:30:47.254245 27228 tablet_bootstrap.cc:654] T 65756c37fe514194bebe76921419653c P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:47.257452 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet fc558690dce44e999e55e9bf1b6ca172 with delete_type TABLET_DATA_DELETED (replaced by tablet 0bb01711769f457aa0696bb59582166d) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.253003 29297 leader_election.cc:288] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:47.259354 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1e46f80f7f4e3a84638421892e6236" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:47.260831 29297 raft_consensus.cc:2781] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:47.260337 27222 tablet_bootstrap.cc:492] T 859477ecf37240a4888542d2559f99cd P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:47.261083 29297 raft_consensus.cc:482] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:47.261269 29297 raft_consensus.cc:3037] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:47.261013 26700 consensus_peers.cc:487] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4efa31ad2ce8436b9638e6759d9b5421. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:47.261945 26700 leader_election.cc:341] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:47.248664 26581 rpcz_store.cc:276] 0810 11:30:42.700430 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.077328 (+4376898us) service_pool.cc:227] Handling call
0810 11:30:47.077966 (+ 638us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:47.078223 (+ 257us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:47.078607 (+ 384us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:47.078707 (+ 100us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:47.139526 (+ 60819us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:47.184063 (+ 44537us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.122258 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.122417 (+ 159us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.122429 (+ 12us) write_op.cc:435] Acquired schema lock
0810 11:30:47.122432 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:47.122685 (+ 253us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.122700 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.122705 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:47.122780 (+ 75us) tablet.cc:699] Row locks acquired
0810 11:30:47.122782 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:47.122845 (+ 63us) write_op.cc:270] Start()
0810 11:30:47.122883 (+ 38us) write_op.cc:276] Timestamp: P: 1786361447122813 usec, L: 0
0810 11:30:47.122887 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.123145 (+ 258us) log.cc:842] Serialized 405 byte log entry
0810 11:30:47.136450 (+ 13305us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.136583 (+ 133us) write_op.cc:301] APPLY: starting
0810 11:30:47.136603 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.136648 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.136678 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.136788 (+ 110us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.136830 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:47.136838 (+ 8us) write_op.cc:312] APPLY: finished
0810 11:30:47.136923 (+ 85us) log.cc:842] Serialized 23 byte log entry
0810 11:30:47.136992 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.137012 (+ 20us) write_op.cc:454] Released schema lock
0810 11:30:47.137019 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.137082 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.137086 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":61,"apply.run_cpu_time_us":577,"apply.run_wall_time_us":576,"num_ops":1,"prepare.queue_time_us":745,"prepare.run_cpu_time_us":1012,"prepare.run_wall_time_us":1012,"raft.queue_time_us":417,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":293,"replication_time_us":13535}]]}
I20260810 11:30:47.263520 26573 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 172) took 4503 ms. Trace:
W20260810 11:30:47.265391 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ce73798a721b4a6d892f0c24b6b40e2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce73798a721b4a6d892f0c24b6b40e2c already in progress: creating tablet
I20260810 11:30:47.265529 26577 rpcz_store.cc:276] 0810 11:30:42.947694 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.130757 (+4183063us) service_pool.cc:227] Handling call
0810 11:30:47.132081 (+ 1324us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:47.133797 (+ 1716us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:47.165686 (+ 31889us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:47.183532 (+ 17846us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:47.183648 (+ 116us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.134477 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.134654 (+ 177us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.134661 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:47.134663 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:47.134834 (+ 171us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.134849 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.134854 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.134955 (+ 101us) tablet.cc:699] Row locks acquired
0810 11:30:47.134957 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:47.135001 (+ 44us) write_op.cc:270] Start()
0810 11:30:47.135041 (+ 40us) write_op.cc:276] Timestamp: P: 1786361447134972 usec, L: 0
0810 11:30:47.135045 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.135298 (+ 253us) log.cc:842] Serialized 433 byte log entry
0810 11:30:47.163177 (+ 27879us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.164263 (+ 1086us) write_op.cc:301] APPLY: starting
0810 11:30:47.164280 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.164315 (+ 35us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.164354 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.164907 (+ 553us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.164940 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:47.164946 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:47.165023 (+ 77us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.165083 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.165102 (+ 19us) write_op.cc:454] Released schema lock
0810 11:30:47.165109 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.165164 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.165167 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1047,"apply.run_cpu_time_us":649,"apply.run_wall_time_us":958,"num_ops":2,"prepare.queue_time_us":56,"prepare.run_cpu_time_us":976,"prepare.run_wall_time_us":976,"replication_time_us":28113}]]}
I20260810 11:30:47.267716 26577 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_b2f434005a0c4715ba99f1f42e2d3eb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:47.266067 26574 rpcz_store.cc:269] 0810 11:30:46.114021 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.481030 (+367009us) service_pool.cc:227] Handling call
0810 11:30:47.143469 (+662439us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.014648 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.014864 (+ 216us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.014873 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:47.014876 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:47.015050 (+ 174us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.015069 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.015073 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:47.015164 (+ 91us) tablet.cc:699] Row locks acquired
0810 11:30:47.015168 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:47.015232 (+ 64us) write_op.cc:270] Start()
0810 11:30:47.015296 (+ 64us) write_op.cc:276] Timestamp: P: 1786361447014774 usec, L: 0
0810 11:30:47.015307 (+ 11us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.020884 (+ 5577us) log.cc:842] Serialized 356 byte log entry
0810 11:30:47.021117 (+ 233us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f9c62f1dd02 00007f9c642507f1 00007f9c6424f359 00007f9c642571bb 00007f9c64257038 00000000009edb7c 00007f9c57a55344 00007f9c57a5891b 00007f9c57a58798 00000000009edb7c
0810 11:30:47.108713 (+ 87596us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.109056 (+ 343us) write_op.cc:301] APPLY: starting
0810 11:30:47.109078 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.109125 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.109128 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.109268 (+ 140us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.109344 (+ 76us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:47.109357 (+ 13us) write_op.cc:312] APPLY: finished
0810 11:30:47.109460 (+ 103us) log.cc:842] Serialized 23 byte log entry
0810 11:30:47.109957 (+ 497us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.110183 (+ 226us) write_op.cc:454] Released schema lock
0810 11:30:47.110202 (+ 19us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.148887 (+ 38685us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.148901 (+ 14us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":56142,"reported_tablets":187,"child_traces":[["op",{"apply.queue_time_us":249,"apply.run_cpu_time_us":1068,"apply.run_wall_time_us":39966,"num_ops":1,"prepare.queue_time_us":82,"prepare.run_cpu_time_us":1555,"prepare.run_wall_time_us":6521,"replication_time_us":93370,"spinlock_wait_cycles":11978624}]]}
I20260810 11:30:47.271310 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72209a805e3e4b4ea1bf99508e0f75db" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:47.271641 27057 raft_consensus.cc:2379] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:47.271579 29297 raft_consensus.cc:504] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.272209 26574 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_9e670ff36955464297406906c99a67f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:47.273957 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859477ecf37240a4888542d2559f99cd" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:47.274166 27057 raft_consensus.cc:3037] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:47.275990 29297 leader_election.cc:288] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:47.277406 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 1860e56467624dcdb288e13b004f78cc with delete_type TABLET_DATA_DELETED (replaced by tablet 214be3356fda4c8484596196c0985721) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.277791 27057 raft_consensus.cc:2454] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:47.279199 26848 leader_election.cc:302] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:47.279933 29297 raft_consensus.cc:2781] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:47.281258 29297 raft_consensus.cc:686] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:47.284390 26578 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_088cb7f1722b4e86bea3634c8a1083a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:47.289412 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa4562a2247405187d9dbd1baa48f39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.289870 26581 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_5143e6e4d3cc412e8f21d70c5307c3ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:47.290648 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.273051 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859477ecf37240a4888542d2559f99cd" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:47.291230 26573 rpcz_store.cc:276] 0810 11:30:42.737549 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.129251 (+4391702us) service_pool.cc:227] Handling call
0810 11:30:47.130098 (+ 847us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:47.130397 (+ 299us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:47.130643 (+ 246us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:47.130739 (+ 96us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:47.165592 (+ 34853us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:47.240747 (+ 75155us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.131404 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.131516 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.131523 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:47.131526 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:47.131635 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.131648 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.131653 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:47.131763 (+ 110us) tablet.cc:699] Row locks acquired
0810 11:30:47.131765 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:47.131808 (+ 43us) write_op.cc:270] Start()
0810 11:30:47.131863 (+ 55us) write_op.cc:276] Timestamp: P: 1786361447131781 usec, L: 0
0810 11:30:47.131868 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.132119 (+ 251us) log.cc:842] Serialized 405 byte log entry
0810 11:30:47.163053 (+ 30934us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.163473 (+ 420us) write_op.cc:301] APPLY: starting
0810 11:30:47.163553 (+ 80us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.163612 (+ 59us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.163675 (+ 63us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.163742 (+ 67us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.163789 (+ 47us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:47.163796 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:47.163918 (+ 122us) log.cc:842] Serialized 23 byte log entry
0810 11:30:47.164020 (+ 102us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.164045 (+ 25us) write_op.cc:454] Released schema lock
0810 11:30:47.164055 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.164131 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.164135 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":235,"apply.run_cpu_time_us":848,"apply.run_wall_time_us":848,"num_ops":1,"prepare.queue_time_us":63,"prepare.run_cpu_time_us":839,"prepare.run_wall_time_us":839,"replication_time_us":31131}]]}
I20260810 11:30:47.292470 26573 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_4c872f1def0044fdb03a8901a227e7d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:47.293131 26849 leader_election.cc:341] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:47.293901 26573 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c872f1def0044fdb03a8901a227e7d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.294551 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.294992 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet e69916a35fba4714bbc565921738888f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:47.295092 26581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5143e6e4d3cc412e8f21d70c5307c3ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.295485 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:47.296087 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 8b303be24f4e46d0b966e8191d76297b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b303be24f4e46d0b966e8191d76297b already in progress: creating tablet
I20260810 11:30:47.296144 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7acf847a1fd74ccc89b5bffe1bbb76f3) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:47.296592 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet b945cb22353f4d99a3836e3c0b8e26e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b945cb22353f4d99a3836e3c0b8e26e3 already in progress: creating tablet
I20260810 11:30:47.297089 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet c60baf810a544a4a90dccd2337a39043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.298204 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da86554bc51486e91f1ea5995a245b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.286664 29297 consensus_queue.cc:237] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.299464 27228 tablet_bootstrap.cc:492] T 65756c37fe514194bebe76921419653c P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:47.299355 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet ce73798a721b4a6d892f0c24b6b40e2c with delete_type TABLET_DATA_DELETED (replaced by tablet 81b800247b4e4171b82dcde68e39fb00) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.300020 27228 ts_tablet_manager.cc:1397] T 65756c37fe514194bebe76921419653c P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.141s user 0.003s sys 0.007s
I20260810 11:30:47.301143 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet cc76d30f37094391b75076c92ccc277f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.301309 27228 raft_consensus.cc:348] T 65756c37fe514194bebe76921419653c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.301661 27228 raft_consensus.cc:374] T 65756c37fe514194bebe76921419653c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:47.301806 27228 raft_consensus.cc:729] T 65756c37fe514194bebe76921419653c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:47.302204 27228 consensus_queue.cc:260] T 65756c37fe514194bebe76921419653c P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.302838 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet ea66da5bc20e4718901ffc473677421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.303107 27228 ts_tablet_manager.cc:1428] T 65756c37fe514194bebe76921419653c P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:47.303525 27228 tablet_bootstrap.cc:492] T 40f5eecfc66a4711aef60c1a2bff6b97 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:47.304423 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f24c84cdd945b78f39f24015eb1e43 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b95f3ec8ff34c89a68cd1edf8391f9b) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.308892 29500 raft_consensus.cc:2258] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:47.310678 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e78fb1bf0534deca5cc5a603fd77592 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:47.308761 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 194440us
I20260810 11:30:47.315343 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet ac4b1821ac30452cbe7a8f844d9b37e5 with delete_type TABLET_DATA_DELETED (replaced by tablet a45422addab84e9083df8665a0cf9322) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.317868 27228 tablet_bootstrap.cc:654] T 40f5eecfc66a4711aef60c1a2bff6b97 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:47.318682 26575 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.194:35117 (request call id 269) took 4523 ms (client timeout 1000 ms). Trace:
W20260810 11:30:47.328788 26571 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.193:48791 (request call id 306) took 1203 ms (client timeout 1000 ms). Trace:
W20260810 11:30:47.329061 26571 rpcz_store.cc:269] 0810 11:30:46.080677 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.335715 (+255038us) service_pool.cc:227] Handling call
0810 11:30:46.712774 (+377059us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:46.712784 (+ 10us) write_op.cc:454] Released schema lock
0810 11:30:47.284008 (+571224us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:46.689283 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:46.689422 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:46.689430 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:46.689432 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:46.689617 (+ 185us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:46.689633 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:46.689638 (+ 5us) tablet.cc:683] Acquiring locks for 4 operations
0810 11:30:46.689771 (+ 133us) tablet.cc:699] Row locks acquired
0810 11:30:46.689773 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:46.689817 (+ 44us) write_op.cc:270] Start()
0810 11:30:46.689856 (+ 39us) write_op.cc:276] Timestamp: P: 1786361446689404 usec, L: 0
0810 11:30:46.689860 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:46.690144 (+ 284us) log.cc:842] Serialized 1686 byte log entry
0810 11:30:46.695145 (+ 5001us) op_driver.cc:444] REPLICATION: finished
0810 11:30:46.695270 (+ 125us) write_op.cc:301] APPLY: starting
0810 11:30:46.695288 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:46.695344 (+ 56us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:46.695382 (+ 38us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:46.695476 (+ 94us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:46.695515 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0810 11:30:46.695521 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:46.695623 (+ 102us) log.cc:842] Serialized 41 byte log entry
0810 11:30:46.695688 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:46.695714 (+ 26us) write_op.cc:454] Released schema lock
0810 11:30:46.695721 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":81722,"reported_tablets":197,"child_traces":[["op",{"apply.queue_time_us":73,"apply.run_cpu_time_us":511,"apply.run_wall_time_us":509,"num_ops":4,"prepare.queue_time_us":1097,"prepare.run_cpu_time_us":994,"prepare.run_wall_time_us":995,"raft.queue_time_us":75,"raft.run_cpu_time_us":437,"raft.run_wall_time_us":436,"replication_time_us":5255}]]}
I20260810 11:30:47.331559 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet b200bdb394d3439b86fff48494be8e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:40 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.330698 26571 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_eb450e88c0f145e091452700b678075b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:47.332702 26571 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb450e88c0f145e091452700b678075b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.328878 29500 ts_tablet_manager.cc:1905] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:47.330513 26895 tablet_service.cc:1514] Processing DeleteTablet for tablet db59523b71224370bf5fce6b56592f71 with delete_type TABLET_DATA_DELETED (replaced by tablet bd34a4de1b93402c8a4bce1215660e77) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:47.336105 26578 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_088cb7f1722b4e86bea3634c8a1083a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.331009 26893 tablet_service.cc:1514] Processing DeleteTablet for tablet 0713f4f14a284050a7774a70ab974f30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:16 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.331303 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet e31b380f99854eb8b63e1f9eede1fc7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:47.325018 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ee803ddf27594d2b9e19fe440fc269c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee803ddf27594d2b9e19fe440fc269c7 already in progress: creating tablet
I20260810 11:30:47.339954 29491 consensus_queue.cc:1035] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:47.340184 26564 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 74948.1us
W20260810 11:30:47.340703 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet b121c13e9241468aa224e17093eb38f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b121c13e9241468aa224e17093eb38f4 already in progress: creating tablet
W20260810 11:30:47.341163 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet f6e264e8507446809f3c386fdb3c34ae because the tablet was not found. No further retry: Not found: Tablet not found: f6e264e8507446809f3c386fdb3c34ae
W20260810 11:30:47.341599 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet b6395bce17ee40c2822669246ce7eb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6395bce17ee40c2822669246ce7eb42 already in progress: creating tablet
W20260810 11:30:47.343945 26572 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.195:32877 (request call id 347) took 955 ms (client timeout 1000 ms). Trace:
I20260810 11:30:47.352372 27048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1e46f80f7f4e3a84638421892e6236" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:47.353544 27048 raft_consensus.cc:2454] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:47.357908 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 49db12565dbc4187b78a98ed35c40fed with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1e46f80f7f4e3a84638421892e6236) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.358793 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 110b5acc36bd4d6bba13735e5daec75f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.365553 27032 tablet_service.cc:1467] Processing CreateTablet for tablet 9e2d88379f594676a68ffb8c64827a90 (DEFAULT_TABLE table=default.Table_8e946ba2788e406fb7cd8f38ab542b95 [id=f418462e0b954ecea6c1f2a45d14a586]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:47.366125 27032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e2d88379f594676a68ffb8c64827a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:47.274492 26760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859477ecf37240a4888542d2559f99cd" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
W20260810 11:30:47.370801 26849 leader_election.cc:341] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:47.384332 27231 tablet_bootstrap.cc:492] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:47.384723 27231 ts_tablet_manager.cc:1397] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.193s user 0.011s sys 0.005s
I20260810 11:30:47.386051 27231 raft_consensus.cc:348] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:47.387769 27231 raft_consensus.cc:374] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:47.388114 27231 raft_consensus.cc:729] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:47.388652 27231 consensus_queue.cc:260] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:47.327412 26577 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2f434005a0c4715ba99f1f42e2d3eb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:47.389243 26572 rpcz_store.cc:269] 0810 11:30:46.388781 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.533773 (+144992us) service_pool.cc:227] Handling call
0810 11:30:47.343836 (+810063us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.086580 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.086799 (+ 219us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.086807 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:47.086810 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:47.087045 (+ 235us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.087170 (+ 125us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.087178 (+ 8us) tablet.cc:683] Acquiring locks for 3 operations
0810 11:30:47.087303 (+ 125us) tablet.cc:699] Row locks acquired
0810 11:30:47.087306 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:47.087367 (+ 61us) write_op.cc:270] Start()
0810 11:30:47.087432 (+ 65us) write_op.cc:276] Timestamp: P: 1786361447087341 usec, L: 0
0810 11:30:47.087438 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.087849 (+ 411us) log.cc:842] Serialized 1302 byte log entry
0810 11:30:47.113306 (+ 25457us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.113458 (+ 152us) write_op.cc:301] APPLY: starting
0810 11:30:47.113476 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.113604 (+ 128us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.113644 (+ 40us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.113732 (+ 88us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.113773 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0810 11:30:47.113780 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:47.113879 (+ 99us) log.cc:842] Serialized 35 byte log entry
0810 11:30:47.113959 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.113994 (+ 35us) write_op.cc:454] Released schema lock
0810 11:30:47.114005 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.114081 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.114085 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38011,"reported_tablets":192,"child_traces":[["op",{"apply.queue_time_us":93,"apply.run_cpu_time_us":692,"apply.run_wall_time_us":692,"num_ops":3,"prepare.queue_time_us":19068,"prepare.run_cpu_time_us":1394,"prepare.run_wall_time_us":1394,"replication_time_us":25839}]]}
W20260810 11:30:47.328732 26575 rpcz_store.cc:269] 0810 11:30:42.794805 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:42.804177 (+ 9372us) service_pool.cc:227] Handling call
0810 11:30:47.318595 (+4514418us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:43.850353 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:43.850510 (+ 157us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:43.850519 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:43.850522 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:43.850645 (+ 123us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:43.850662 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:43.850666 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:43.850778 (+ 112us) tablet.cc:699] Row locks acquired
0810 11:30:43.850781 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:43.850831 (+ 50us) write_op.cc:270] Start()
0810 11:30:43.850872 (+ 41us) write_op.cc:276] Timestamp: P: 1786361443850774 usec, L: 0
0810 11:30:43.850876 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:43.851145 (+ 269us) log.cc:842] Serialized 536 byte log entry
0810 11:30:43.886392 (+ 35247us) op_driver.cc:444] REPLICATION: finished
0810 11:30:43.905241 (+ 18849us) write_op.cc:301] APPLY: starting
0810 11:30:43.905265 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:43.905310 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:43.905388 (+ 78us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:43.905483 (+ 95us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:43.905524 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:43.905530 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:43.905658 (+ 128us) log.cc:842] Serialized 23 byte log entry
0810 11:30:43.905762 (+ 104us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:43.905789 (+ 27us) write_op.cc:454] Released schema lock
0810 11:30:43.905797 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:43.905867 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:43.905872 (+ 5us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:43.934485 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:43.934697 (+ 212us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:43.934705 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:43.934708 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:43.934853 (+ 145us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:43.934867 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:43.934872 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:43.935052 (+ 180us) tablet.cc:699] Row locks acquired
0810 11:30:43.935056 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:43.935110 (+ 54us) write_op.cc:270] Start()
0810 11:30:43.935155 (+ 45us) write_op.cc:276] Timestamp: P: 1786361443935045 usec, L: 0
0810 11:30:43.935159 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:43.935389 (+ 230us) log.cc:842] Serialized 356 byte log entry
0810 11:30:43.939740 (+ 4351us) op_driver.cc:444] REPLICATION: finished
0810 11:30:43.939894 (+ 154us) write_op.cc:301] APPLY: starting
0810 11:30:43.939925 (+ 31us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:43.939969 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:43.939996 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:43.940054 (+ 58us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:43.940089 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:43.940095 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:43.940176 (+ 81us) log.cc:842] Serialized 23 byte log entry
0810 11:30:43.940235 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:43.940256 (+ 21us) write_op.cc:454] Released schema lock
0810 11:30:43.940263 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:43.940316 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:43.940319 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:44.745913 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:44.746050 (+ 137us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:44.746058 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:44.746060 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:44.746179 (+ 119us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:44.746198 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:44.746206 (+ 8us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:44.746288 (+ 82us) tablet.cc:699] Row locks acquired
0810 11:30:44.746292 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:44.746338 (+ 46us) write_op.cc:270] Start()
0810 11:30:44.746395 (+ 57us) write_op.cc:276] Timestamp: P: 1786361444746293 usec, L: 0
0810 11:30:44.746399 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:44.746624 (+ 225us) log.cc:842] Serialized 356 byte log entry
0810 11:30:44.778514 (+ 31890us) op_driver.cc:444] REPLICATION: finished
0810 11:30:44.778689 (+ 175us) write_op.cc:301] APPLY: starting
0810 11:30:44.778712 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:44.778760 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:44.778797 (+ 37us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:44.778856 (+ 59us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:44.778894 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:44.778901 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:44.778992 (+ 91us) log.cc:842] Serialized 23 byte log entry
0810 11:30:44.779075 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:44.779097 (+ 22us) write_op.cc:454] Released schema lock
0810 11:30:44.779104 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:44.779167 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:44.779170 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":223664,"reported_tablets":192,"child_traces":[["op",{"apply.queue_time_us":18755,"apply.run_cpu_time_us":731,"apply.run_wall_time_us":730,"num_ops":1,"prepare.queue_time_us":12022,"prepare.run_cpu_time_us":977,"prepare.run_wall_time_us":16215,"raft.queue_time_us":1179,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":304,"replication_time_us":35480,"thread_start_us":32982,"threads_started":2}],["op",{"apply.queue_time_us":106,"apply.run_cpu_time_us":474,"apply.run_wall_time_us":474,"num_ops":1,"prepare.queue_time_us":56,"prepare.run_cpu_time_us":1033,"prepare.run_wall_time_us":1033,"raft.queue_time_us":172,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":260,"replication_time_us":4555}],["op",{"apply.queue_time_us":117,"apply.run_cpu_time_us":538,"apply.run_wall_time_us":537,"num_ops":1,"prepare.queue_time_us":69,"prepare.run_cpu_time_us":865,"prepare.run_wall_time_us":864,"raft.queue_time_us":215,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":240,"replication_time_us":32081}]]}
I20260810 11:30:47.394580 26572 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_22bcc2f6dd5a4c26ab5b87185d38c2a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:47.395082 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72209a805e3e4b4ea1bf99508e0f75db" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:47.397387 26849 leader_election.cc:302] T 72209a805e3e4b4ea1bf99508e0f75db P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:47.398180 29491 raft_consensus.cc:3037] T 72209a805e3e4b4ea1bf99508e0f75db P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:47.402489 29491 raft_consensus.cc:2726] T 72209a805e3e4b4ea1bf99508e0f75db P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:47.402812 26572 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22bcc2f6dd5a4c26ab5b87185d38c2a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.408692 26768 raft_consensus.cc:3037] T 0f048b690d764c83a4a9ce4cbadc75b0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:47.411194 27231 ts_tablet_manager.cc:1428] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260810 11:30:47.411664 27231 tablet_bootstrap.cc:492] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:47.413528 27231 tablet_bootstrap.cc:654] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:47.327064 26580 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.193:48791 (request call id 304) took 3592 ms (client timeout 1000 ms). Trace:
W20260810 11:30:47.414968 26580 rpcz_store.cc:269] 0810 11:30:43.673193 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.933929 (+260736us) service_pool.cc:227] Handling call
0810 11:30:47.265318 (+3331389us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:44.748075 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:44.748218 (+ 143us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:44.748224 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:44.748227 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:44.748392 (+ 165us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:44.748404 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:44.748409 (+ 5us) tablet.cc:683] Acquiring locks for 3 operations
0810 11:30:44.748524 (+ 115us) tablet.cc:699] Row locks acquired
0810 11:30:44.748527 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:44.748618 (+ 91us) write_op.cc:270] Start()
0810 11:30:44.748657 (+ 39us) write_op.cc:276] Timestamp: P: 1786361444748570 usec, L: 0
0810 11:30:44.748661 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:44.748835 (+ 174us) log.cc:842] Serialized 1302 byte log entry
0810 11:30:44.798525 (+ 49690us) op_driver.cc:444] REPLICATION: finished
0810 11:30:44.798689 (+ 164us) write_op.cc:301] APPLY: starting
0810 11:30:44.798707 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:44.798761 (+ 54us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:44.798799 (+ 38us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:44.798938 (+ 139us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:44.799021 (+ 83us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0810 11:30:44.799029 (+ 8us) write_op.cc:312] APPLY: finished
0810 11:30:44.799254 (+ 225us) log.cc:842] Serialized 35 byte log entry
0810 11:30:44.799423 (+ 169us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:44.799473 (+ 50us) write_op.cc:454] Released schema lock
0810 11:30:44.799481 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:44.799584 (+ 103us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:44.799587 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:44.872811 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:44.872946 (+ 135us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:44.872955 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:44.872960 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:44.873082 (+ 122us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:44.873098 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:44.873103 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:44.873181 (+ 78us) tablet.cc:699] Row locks acquired
0810 11:30:44.873184 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:44.873231 (+ 47us) write_op.cc:270] Start()
0810 11:30:44.873273 (+ 42us) write_op.cc:276] Timestamp: P: 1786361444873174 usec, L: 0
0810 11:30:44.873276 (+ 3us) op_driver.cc:331] REPLICATION: starting
0810 11:30:44.873506 (+ 230us) log.cc:842] Serialized 356 byte log entry
0810 11:30:45.090907 (+217401us) op_driver.cc:444] REPLICATION: finished
0810 11:30:45.091499 (+ 592us) write_op.cc:301] APPLY: starting
0810 11:30:45.091523 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:45.091572 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:45.091691 (+ 119us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:45.091907 (+ 216us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:45.091952 (+ 45us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:45.091959 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:45.092077 (+ 118us) log.cc:842] Serialized 23 byte log entry
0810 11:30:45.092297 (+ 220us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:45.092318 (+ 21us) write_op.cc:454] Released schema lock
0810 11:30:45.092328 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:45.092402 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:45.092406 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":154657,"reported_tablets":201,"child_traces":[["op",{"apply.queue_time_us":103,"apply.run_cpu_time_us":958,"apply.run_wall_time_us":958,"num_ops":3,"prepare.queue_time_us":47,"prepare.run_cpu_time_us":859,"prepare.run_wall_time_us":859,"raft.queue_time_us":71,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":4,"replication_time_us":49833}],["op",{"apply.queue_time_us":472,"apply.run_cpu_time_us":1033,"apply.run_wall_time_us":1033,"num_ops":1,"prepare.queue_time_us":534,"prepare.run_cpu_time_us":835,"prepare.run_wall_time_us":906,"raft.queue_time_us":44,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":217595}]]}
I20260810 11:30:47.346920 26573 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 178) took 4294 ms. Trace:
I20260810 11:30:47.416581 27110 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:47.357786 26581 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 175) took 4352 ms. Trace:
I20260810 11:30:47.358304 26571 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 179) took 4295 ms. Trace:
I20260810 11:30:47.416957 26571 rpcz_store.cc:276] 0810 11:30:43.062727 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.330207 (+4267480us) service_pool.cc:227] Handling call
0810 11:30:47.332950 (+ 2743us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:47.333662 (+ 712us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:47.357971 (+ 24309us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:47.358066 (+ 95us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:47.358148 (+ 82us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.334271 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.334376 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.334383 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:47.334385 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:47.334481 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.334493 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.334512 (+ 19us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.334602 (+ 90us) tablet.cc:699] Row locks acquired
0810 11:30:47.334621 (+ 19us) write_op.cc:260] PREPARE: finished
0810 11:30:47.334841 (+ 220us) write_op.cc:270] Start()
0810 11:30:47.334928 (+ 87us) write_op.cc:276] Timestamp: P: 1786361447334740 usec, L: 0
0810 11:30:47.334935 (+ 7us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.335376 (+ 441us) log.cc:842] Serialized 433 byte log entry
0810 11:30:47.355254 (+ 19878us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.356158 (+ 904us) write_op.cc:301] APPLY: starting
0810 11:30:47.356174 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.356216 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.356279 (+ 63us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.356388 (+ 109us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.356417 (+ 29us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:47.356428 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:47.356497 (+ 69us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.356535 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.356548 (+ 13us) write_op.cc:454] Released schema lock
0810 11:30:47.356553 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.356624 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.356630 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":750,"apply.run_cpu_time_us":527,"apply.run_wall_time_us":527,"num_ops":2,"prepare.queue_time_us":69,"prepare.run_cpu_time_us":1202,"prepare.run_wall_time_us":1203,"replication_time_us":20303,"thread_start_us":3517,"threads_started":1}]]}
I20260810 11:30:47.418169 26571 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_3707854eb7e84012a34d64e31fc10636"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:47.419026 26571 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3707854eb7e84012a34d64e31fc10636 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.416431 26573 rpcz_store.cc:276] 0810 11:30:43.052175 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.292129 (+4239954us) service_pool.cc:227] Handling call
0810 11:30:47.294030 (+ 1901us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:47.294568 (+ 538us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:47.346215 (+ 51647us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:47.346689 (+ 474us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:47.346815 (+ 126us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.295137 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.295253 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.295260 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:47.295262 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:47.295364 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.295381 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.295388 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.295493 (+ 105us) tablet.cc:699] Row locks acquired
0810 11:30:47.295498 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:47.295555 (+ 57us) write_op.cc:270] Start()
0810 11:30:47.295615 (+ 60us) write_op.cc:276] Timestamp: P: 1786361447295506 usec, L: 0
0810 11:30:47.295620 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.295834 (+ 214us) log.cc:842] Serialized 433 byte log entry
0810 11:30:47.345022 (+ 49188us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.345141 (+ 119us) write_op.cc:301] APPLY: starting
0810 11:30:47.345160 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.345215 (+ 55us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.345298 (+ 83us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.345445 (+ 147us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.345486 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:47.345503 (+ 17us) write_op.cc:312] APPLY: finished
0810 11:30:47.345599 (+ 96us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.345673 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.345695 (+ 22us) write_op.cc:454] Released schema lock
0810 11:30:47.345702 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.345768 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.345772 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":66,"apply.run_cpu_time_us":685,"apply.run_wall_time_us":684,"num_ops":2,"prepare.queue_time_us":58,"prepare.run_cpu_time_us":820,"prepare.run_wall_time_us":820,"raft.queue_time_us":530,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":269,"replication_time_us":49368}]]}
I20260810 11:30:47.422245 26573 master_service.cc:946] ReplaceTablet: received request to replace tablet d50a8bdb17fa4332b288d03658c6b9c2 from {username='slave'} at 127.0.0.1:51252
W20260810 11:30:47.327566 26576 rpcz_store.cc:269] 0810 11:30:45.033588 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.140290 (+106702us) service_pool.cc:227] Handling call
0810 11:30:45.364590 (+224300us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa3fd8f 00007f9c61d34946 00007f9c61d34675 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:46.486811 (+1122221us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:46.486821 (+ 10us) write_op.cc:454] Released schema lock
0810 11:30:47.159446 (+672625us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:46.439962 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:46.440157 (+ 195us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:46.440165 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:46.440169 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:46.440521 (+ 352us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:46.440542 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:46.440552 (+ 10us) tablet.cc:683] Acquiring locks for 6 operations
0810 11:30:46.440807 (+ 255us) tablet.cc:699] Row locks acquired
0810 11:30:46.440812 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:46.440865 (+ 53us) write_op.cc:270] Start()
0810 11:30:46.440924 (+ 59us) write_op.cc:276] Timestamp: P: 1786361446440802 usec, L: 0
0810 11:30:46.440930 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:46.441251 (+ 321us) log.cc:842] Serialized 2452 byte log entry
0810 11:30:46.446967 (+ 5716us) op_driver.cc:444] REPLICATION: finished
0810 11:30:46.447105 (+ 138us) write_op.cc:301] APPLY: starting
0810 11:30:46.447131 (+ 26us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:46.447242 (+ 111us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:46.447283 (+ 41us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:46.447469 (+ 186us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:46.447525 (+ 56us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0810 11:30:46.447536 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:46.447699 (+ 163us) log.cc:842] Serialized 53 byte log entry
0810 11:30:46.447789 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:46.447829 (+ 40us) write_op.cc:454] Released schema lock
0810 11:30:46.447841 (+ 12us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":3650,"reported_tablets":202,"spinlock_wait_cycles":59823872,"child_traces":[["op",{"apply.queue_time_us":74,"apply.run_cpu_time_us":835,"apply.run_wall_time_us":834,"num_ops":6,"prepare.queue_time_us":88,"prepare.run_cpu_time_us":1444,"prepare.run_wall_time_us":1943,"raft.queue_time_us":52,"raft.run_cpu_time_us":407,"raft.run_wall_time_us":408,"replication_time_us":6003}]]}
I20260810 11:30:47.422703 26576 master_service.cc:946] ReplaceTablet: received request to replace tablet 7de2d60cf87c48459e6663a68ac96714 from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:47.401943 26575 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_4d69a84b6d0a4ad787d4f64c289e1a03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:47.403738 26577 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 176) took 4387 ms. Trace:
I20260810 11:30:47.423166 26577 rpcz_store.cc:276] 0810 11:30:43.015800 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.267233 (+4251433us) service_pool.cc:227] Handling call
0810 11:30:47.389244 (+122011us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:47.389964 (+ 720us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:47.403431 (+ 13467us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:47.403568 (+ 137us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:47.403683 (+ 115us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.392527 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.392748 (+ 221us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.392761 (+ 13us) write_op.cc:435] Acquired schema lock
0810 11:30:47.392765 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:47.392912 (+ 147us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.392934 (+ 22us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.392941 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.393096 (+ 155us) tablet.cc:699] Row locks acquired
0810 11:30:47.393099 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:47.393152 (+ 53us) write_op.cc:270] Start()
0810 11:30:47.393202 (+ 50us) write_op.cc:276] Timestamp: P: 1786361447393097 usec, L: 0
0810 11:30:47.393208 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.393502 (+ 294us) log.cc:842] Serialized 433 byte log entry
0810 11:30:47.401670 (+ 8168us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.401854 (+ 184us) write_op.cc:301] APPLY: starting
0810 11:30:47.401875 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.401958 (+ 83us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.401995 (+ 37us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.402157 (+ 162us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.402199 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:47.402206 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:47.402304 (+ 98us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.402389 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.402414 (+ 25us) write_op.cc:454] Released schema lock
0810 11:30:47.402422 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.402487 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.402491 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":90,"apply.run_cpu_time_us":702,"apply.run_wall_time_us":701,"num_ops":2,"prepare.queue_time_us":1643,"prepare.run_cpu_time_us":1119,"prepare.run_wall_time_us":1121,"raft.queue_time_us":1139,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":287,"replication_time_us":8410}]]}
W20260810 11:30:47.328490 26574 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e670ff36955464297406906c99a67f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.425489 26577 master_service.cc:946] ReplaceTablet: received request to replace tablet a3079a68c1c74b64bf13877bd0ee68c3 from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:47.366870 26578 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 174) took 4402 ms. Trace:
I20260810 11:30:47.421907 26580 master_service.cc:946] ReplaceTablet: received request to replace tablet 7de2d60cf87c48459e6663a68ac96714 from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:47.427255 29491 consensus_queue.cc:1035] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:47.416877 26581 rpcz_store.cc:276] 0810 11:30:43.005407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.263107 (+4257700us) service_pool.cc:227] Handling call
0810 11:30:47.295204 (+ 32097us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:47.295672 (+ 468us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:47.357294 (+ 61622us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:47.357450 (+ 156us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:47.357579 (+ 129us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.296810 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.296913 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.296918 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:47.296921 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:47.297024 (+ 103us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.297054 (+ 30us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.297059 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.297158 (+ 99us) tablet.cc:699] Row locks acquired
0810 11:30:47.297161 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:47.297200 (+ 39us) write_op.cc:270] Start()
0810 11:30:47.297236 (+ 36us) write_op.cc:276] Timestamp: P: 1786361447297158 usec, L: 0
0810 11:30:47.297241 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.297403 (+ 162us) log.cc:842] Serialized 433 byte log entry
0810 11:30:47.355106 (+ 57703us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.355314 (+ 208us) write_op.cc:301] APPLY: starting
0810 11:30:47.355336 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.355398 (+ 62us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.355433 (+ 35us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.355580 (+ 147us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.355629 (+ 49us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:47.355638 (+ 9us) write_op.cc:312] APPLY: finished
0810 11:30:47.355733 (+ 95us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.355814 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.355836 (+ 22us) write_op.cc:454] Released schema lock
0810 11:30:47.355845 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.355929 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.355936 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":117,"apply.run_cpu_time_us":695,"apply.run_wall_time_us":694,"num_ops":2,"prepare.queue_time_us":742,"prepare.run_cpu_time_us":667,"prepare.run_wall_time_us":666,"replication_time_us":57831}]]}
I20260810 11:30:47.428910 26578 rpcz_store.cc:276] 0810 11:30:42.965548 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.231503 (+4265955us) service_pool.cc:227] Handling call
0810 11:30:47.336593 (+105090us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:47.337416 (+ 823us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:47.366400 (+ 28984us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.366408 (+ 8us) write_op.cc:454] Released schema lock
0810 11:30:47.366520 (+ 112us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:47.366700 (+ 180us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:47.366811 (+ 111us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.338462 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.338639 (+ 177us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.338650 (+ 11us) write_op.cc:435] Acquired schema lock
0810 11:30:47.338655 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:47.338798 (+ 143us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.338815 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.338824 (+ 9us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.338955 (+ 131us) tablet.cc:699] Row locks acquired
0810 11:30:47.338960 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:47.339007 (+ 47us) write_op.cc:270] Start()
0810 11:30:47.339060 (+ 53us) write_op.cc:276] Timestamp: P: 1786361447338960 usec, L: 0
0810 11:30:47.339068 (+ 8us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.339327 (+ 259us) log.cc:842] Serialized 433 byte log entry
0810 11:30:47.358888 (+ 19561us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.359075 (+ 187us) write_op.cc:301] APPLY: starting
0810 11:30:47.359092 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.359133 (+ 41us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.359215 (+ 82us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.359392 (+ 177us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.359426 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:47.359433 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:47.359505 (+ 72us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.360047 (+ 542us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.360068 (+ 21us) write_op.cc:454] Released schema lock
0810 11:30:47.360077 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":136,"apply.run_cpu_time_us":656,"apply.run_wall_time_us":1074,"mutex_wait_us":47,"num_ops":2,"prepare.queue_time_us":71,"prepare.run_cpu_time_us":959,"prepare.run_wall_time_us":1368,"replication_time_us":19792}]]}
I20260810 11:30:47.429979 26578 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_37ba5cf5063749fbb2b8f0c05d4b73a3" } modify_external_catalogs: true
I20260810 11:30:47.431259 26581 master_service.cc:946] ReplaceTablet: received request to replace tablet e700aa4c0c45496db8a2b4f4d6d746a4 from {username='slave'} at 127.0.0.1:51252
W20260810 11:30:47.433332 26575 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d69a84b6d0a4ad787d4f64c289e1a03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.433729 29110 ts_tablet_manager.cc:1918] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:47.433899 29110 log.cc:1196] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/d4873fe8318040a2b7e021708a875f43
I20260810 11:30:47.435902 26578 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_37ba5cf5063749fbb2b8f0c05d4b73a3" } modify_external_catalogs: true
I20260810 11:30:47.440275 29110 ts_tablet_manager.cc:1939] T d4873fe8318040a2b7e021708a875f43 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:47.440505 26572 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 180) took 4336 ms. Trace:
I20260810 11:30:47.440900 26572 rpcz_store.cc:276] 0810 11:30:43.103996 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.390201 (+4286205us) service_pool.cc:227] Handling call
0810 11:30:47.414960 (+ 24759us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:47.415658 (+ 698us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:47.440113 (+ 24455us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:47.440257 (+ 144us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:47.440365 (+ 108us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.417059 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.417204 (+ 145us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.417214 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:47.417217 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:47.417326 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.417342 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.417347 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.417456 (+ 109us) tablet.cc:699] Row locks acquired
0810 11:30:47.417458 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:47.417505 (+ 47us) write_op.cc:270] Start()
0810 11:30:47.417545 (+ 40us) write_op.cc:276] Timestamp: P: 1786361447417449 usec, L: 0
0810 11:30:47.417550 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.417829 (+ 279us) log.cc:842] Serialized 433 byte log entry
0810 11:30:47.439344 (+ 21515us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.439486 (+ 142us) write_op.cc:301] APPLY: starting
0810 11:30:47.439505 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.439555 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.439633 (+ 78us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.439784 (+ 151us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.439826 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:47.439833 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:47.439921 (+ 88us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.439993 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.440015 (+ 22us) write_op.cc:454] Released schema lock
0810 11:30:47.440023 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.440089 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.440093 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":89,"apply.run_cpu_time_us":661,"apply.run_wall_time_us":660,"num_ops":2,"prepare.queue_time_us":748,"prepare.run_cpu_time_us":893,"prepare.run_wall_time_us":894,"raft.queue_time_us":803,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":306,"replication_time_us":21765}]]}
I20260810 11:30:47.441689 27228 tablet_bootstrap.cc:492] T 40f5eecfc66a4711aef60c1a2bff6b97 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:47.441926 27228 ts_tablet_manager.cc:1397] T 40f5eecfc66a4711aef60c1a2bff6b97 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.139s user 0.005s sys 0.020s
I20260810 11:30:47.442471 26572 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_bcf64628ba2c463ba5acce6617ec4324" } modify_external_catalogs: true
I20260810 11:30:47.442734 26572 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_bcf64628ba2c463ba5acce6617ec4324" } modify_external_catalogs: true
I20260810 11:30:47.443660 27228 raft_consensus.cc:348] T 40f5eecfc66a4711aef60c1a2bff6b97 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.444197 27228 raft_consensus.cc:374] T 40f5eecfc66a4711aef60c1a2bff6b97 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:47.444303 27228 raft_consensus.cc:729] T 40f5eecfc66a4711aef60c1a2bff6b97 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:47.444589 27228 consensus_queue.cc:260] T 40f5eecfc66a4711aef60c1a2bff6b97 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.445393 27228 ts_tablet_manager.cc:1428] T 40f5eecfc66a4711aef60c1a2bff6b97 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 11:30:47.447717 27228 tablet_bootstrap.cc:492] T ab2471d06e0841e7bebae4ca1865618c P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:47.449772 27228 tablet_bootstrap.cc:654] T ab2471d06e0841e7bebae4ca1865618c P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:47.450065 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 133) took 2672 ms. Trace:
I20260810 11:30:47.450251 29110 rpcz_store.cc:276] 0810 11:30:44.777386 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.777438 (+ 52us) service_pool.cc:227] Handling call
0810 11:30:46.739542 (+1962104us) ts_tablet_manager.cc:1145] Deleting tablet d4873fe8318040a2b7e021708a875f43
0810 11:30:46.739564 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.223309 (+483745us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.433563 (+210254us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.450037 (+ 16474us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13647,"tablet-delete.queue_time_us":1763539}
I20260810 11:30:47.450812 29110 tablet_replica.cc:330] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:47.452869 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet d4873fe8318040a2b7e021708a875f43 (table default.Table_065fc82a2823470b89b4cff36ca03027 [id=60ce1267de814f218c27ac084a08a26a]) successfully deleted
I20260810 11:30:47.453277 29491 raft_consensus.cc:482] T 40f5eecfc66a4711aef60c1a2bff6b97 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:47.454020 29491 raft_consensus.cc:504] T 40f5eecfc66a4711aef60c1a2bff6b97 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.455423 29110 raft_consensus.cc:2229] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:47.455610 29110 raft_consensus.cc:2258] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:47.455878 29491 leader_election.cc:288] T 40f5eecfc66a4711aef60c1a2bff6b97 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:47.456192 29110 ts_tablet_manager.cc:1905] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:47.456461 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40f5eecfc66a4711aef60c1a2bff6b97" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:47.456799 27057 raft_consensus.cc:2379] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:47.457031 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40f5eecfc66a4711aef60c1a2bff6b97" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:47.457590 26849 leader_election.cc:302] T 40f5eecfc66a4711aef60c1a2bff6b97 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:47.458287 29491 raft_consensus.cc:3037] T 40f5eecfc66a4711aef60c1a2bff6b97 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:47.461656 29491 raft_consensus.cc:2726] T 40f5eecfc66a4711aef60c1a2bff6b97 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:47.461715 26571 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 182) took 4332 ms. Trace:
I20260810 11:30:47.461843 26571 rpcz_store.cc:276] 0810 11:30:43.129658 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.417829 (+4288171us) service_pool.cc:227] Handling call
0810 11:30:47.419152 (+ 1323us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:47.419684 (+ 532us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:47.461418 (+ 41734us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:47.461543 (+ 125us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:47.461648 (+ 105us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.424696 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.424882 (+ 186us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.424890 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:47.424895 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:47.425097 (+ 202us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.425113 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.425122 (+ 9us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.425292 (+ 170us) tablet.cc:699] Row locks acquired
0810 11:30:47.425295 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:47.425342 (+ 47us) write_op.cc:270] Start()
0810 11:30:47.425397 (+ 55us) write_op.cc:276] Timestamp: P: 1786361447425285 usec, L: 0
0810 11:30:47.425402 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.425604 (+ 202us) log.cc:842] Serialized 433 byte log entry
0810 11:30:47.459136 (+ 33532us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.459463 (+ 327us) write_op.cc:301] APPLY: starting
0810 11:30:47.459476 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.459523 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.459552 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.459670 (+ 118us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.459705 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:47.459712 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:47.459797 (+ 85us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.459865 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.459881 (+ 16us) write_op.cc:454] Released schema lock
0810 11:30:47.459886 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.459939 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.459943 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":279,"apply.run_cpu_time_us":530,"apply.run_wall_time_us":530,"num_ops":2,"prepare.queue_time_us":4382,"prepare.run_cpu_time_us":1031,"prepare.run_wall_time_us":1031,"replication_time_us":33712}]]}
I20260810 11:30:47.463207 26574 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 177) took 4446 ms. Trace:
I20260810 11:30:47.463366 26574 rpcz_store.cc:276] 0810 11:30:43.017014 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.270711 (+4253697us) service_pool.cc:227] Handling call
0810 11:30:47.424123 (+153412us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:47.424686 (+ 563us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:47.462902 (+ 38216us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:47.463059 (+ 157us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:47.463153 (+ 94us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.425869 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.425982 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.425989 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:47.425992 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:47.426077 (+ 85us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.426088 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.426093 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.426165 (+ 72us) tablet.cc:699] Row locks acquired
0810 11:30:47.426168 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:47.426198 (+ 30us) write_op.cc:270] Start()
0810 11:30:47.426256 (+ 58us) write_op.cc:276] Timestamp: P: 1786361447426147 usec, L: 0
0810 11:30:47.426260 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.426451 (+ 191us) log.cc:842] Serialized 433 byte log entry
0810 11:30:47.459201 (+ 32750us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.460027 (+ 826us) write_op.cc:301] APPLY: starting
0810 11:30:47.460038 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.460068 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.460104 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.460181 (+ 77us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.460206 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:47.460227 (+ 21us) write_op.cc:312] APPLY: finished
0810 11:30:47.460278 (+ 51us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.460319 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.460331 (+ 12us) write_op.cc:454] Released schema lock
0810 11:30:47.460337 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.460383 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.460387 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":799,"apply.run_cpu_time_us":399,"apply.run_wall_time_us":398,"num_ops":2,"prepare.queue_time_us":613,"prepare.run_cpu_time_us":640,"prepare.run_wall_time_us":639,"replication_time_us":32927}]]}
I20260810 11:30:47.466566 27222 tablet_bootstrap.cc:654] T 859477ecf37240a4888542d2559f99cd P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:47.467484 26577 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet a3079a68c1c74b64bf13877bd0ee68c3
I20260810 11:30:47.467979 26577 catalog_manager.cc:6565] ReplaceTablet: tablet a3079a68c1c74b64bf13877bd0ee68c3 deleted and replaced by tablet f10ac7e043c240d8a14b2b4f96b864b9
I20260810 11:30:47.468300 26577 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 186) took 3781 ms. Trace:
I20260810 11:30:47.468685 26577 rpcz_store.cc:276] 0810 11:30:43.687153 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.425314 (+3738161us) service_pool.cc:227] Handling call
0810 11:30:47.468225 (+ 42911us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.432243 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.432358 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.432363 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:47.432365 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:47.432474 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.432487 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.432492 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.432614 (+ 122us) tablet.cc:699] Row locks acquired
0810 11:30:47.432617 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:47.432655 (+ 38us) write_op.cc:270] Start()
0810 11:30:47.432689 (+ 34us) write_op.cc:276] Timestamp: P: 1786361447432600 usec, L: 0
0810 11:30:47.432694 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.432853 (+ 159us) log.cc:842] Serialized 665 byte log entry
0810 11:30:47.459250 (+ 26397us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.460456 (+ 1206us) write_op.cc:301] APPLY: starting
0810 11:30:47.460466 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.460492 (+ 26us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.460526 (+ 34us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.460651 (+ 125us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.460700 (+ 49us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:47.460706 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:47.460769 (+ 63us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.460809 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.460821 (+ 12us) write_op.cc:454] Released schema lock
0810 11:30:47.460826 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.460900 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.460904 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":342912,"child_traces":[["op",{"apply.queue_time_us":1179,"apply.run_cpu_time_us":493,"apply.run_wall_time_us":492,"num_ops":2,"prepare.queue_time_us":58,"prepare.run_cpu_time_us":690,"prepare.run_wall_time_us":690,"replication_time_us":26542}]]}
I20260810 11:30:47.472952 26575 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 181) took 4365 ms. Trace:
I20260810 11:30:47.473191 26575 rpcz_store.cc:276] 0810 11:30:43.107480 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.393850 (+4286370us) service_pool.cc:227] Handling call
0810 11:30:47.433454 (+ 39604us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:47.434456 (+ 1002us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:47.472673 (+ 38217us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:47.472795 (+ 122us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:47.472888 (+ 93us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.435104 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.435315 (+ 211us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.435322 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:47.435325 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:47.435409 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.435421 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.435426 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.435554 (+ 128us) tablet.cc:699] Row locks acquired
0810 11:30:47.435557 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:47.435593 (+ 36us) write_op.cc:270] Start()
0810 11:30:47.435628 (+ 35us) write_op.cc:276] Timestamp: P: 1786361447435539 usec, L: 0
0810 11:30:47.435632 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.435795 (+ 163us) log.cc:842] Serialized 433 byte log entry
0810 11:30:47.459291 (+ 23496us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.460983 (+ 1692us) write_op.cc:301] APPLY: starting
0810 11:30:47.460993 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.461021 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.461042 (+ 21us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.461118 (+ 76us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.461142 (+ 24us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:47.461148 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:47.461194 (+ 46us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.461235 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.461247 (+ 12us) write_op.cc:454] Released schema lock
0810 11:30:47.461252 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.461292 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.461295 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1660,"apply.run_cpu_time_us":351,"apply.run_wall_time_us":350,"num_ops":2,"prepare.queue_time_us":60,"prepare.run_cpu_time_us":775,"prepare.run_wall_time_us":775,"replication_time_us":23645,"threads_started":1}]]}
I20260810 11:30:47.474042 29110 ts_tablet_manager.cc:1918] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:47.474190 29110 log.cc:1196] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/e69916a35fba4714bbc565921738888f
I20260810 11:30:47.474542 29110 ts_tablet_manager.cc:1939] T e69916a35fba4714bbc565921738888f P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:47.475920 27228 tablet_bootstrap.cc:492] T ab2471d06e0841e7bebae4ca1865618c P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:47.476115 27228 ts_tablet_manager.cc:1397] T ab2471d06e0841e7bebae4ca1865618c P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.001s
I20260810 11:30:47.477174 27228 raft_consensus.cc:348] T ab2471d06e0841e7bebae4ca1865618c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.477243 26742 tablet_service.cc:1467] Processing CreateTablet for tablet 9e2d88379f594676a68ffb8c64827a90 (DEFAULT_TABLE table=default.Table_8e946ba2788e406fb7cd8f38ab542b95 [id=f418462e0b954ecea6c1f2a45d14a586]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:47.477612 27228 raft_consensus.cc:374] T ab2471d06e0841e7bebae4ca1865618c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:47.477783 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e2d88379f594676a68ffb8c64827a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:47.477785 27228 raft_consensus.cc:729] T ab2471d06e0841e7bebae4ca1865618c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:47.478242 27228 consensus_queue.cc:260] T ab2471d06e0841e7bebae4ca1865618c P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.478953 27228 ts_tablet_manager.cc:1428] T ab2471d06e0841e7bebae4ca1865618c P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:47.479483 27228 tablet_bootstrap.cc:492] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:47.485337 29291 consensus_queue.cc:1035] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:47.487102 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 132) took 2709 ms. Trace:
I20260810 11:30:47.487228 29110 rpcz_store.cc:276] 0810 11:30:44.777259 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.777719 (+ 460us) service_pool.cc:227] Handling call
0810 11:30:47.450766 (+2673047us) ts_tablet_manager.cc:1145] Deleting tablet e69916a35fba4714bbc565921738888f
0810 11:30:47.450776 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.461135 (+ 10359us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.473904 (+ 12769us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.487079 (+ 13175us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4285,"tablet-delete.queue_time_us":2470729}
I20260810 11:30:47.487656 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 134) took 2710 ms. Trace:
I20260810 11:30:47.487763 29110 rpcz_store.cc:276] 0810 11:30:44.777558 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.777861 (+ 303us) service_pool.cc:227] Handling call
0810 11:30:47.487518 (+2709657us) ts_tablet_manager.cc:1145] Deleting tablet d08250001e1542f9978bc6f89ace458b
0810 11:30:47.487531 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.487640 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2507378}
I20260810 11:30:47.488819 27228 tablet_bootstrap.cc:654] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:47.488020 29110 tablet_replica.cc:330] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:47.490432 29110 raft_consensus.cc:2229] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:47.490669 29110 raft_consensus.cc:2258] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:47.490880 29516 tablet.cc:1722] T 77ffda3325af4096bbec689397f7a324 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:47.493851 29110 ts_tablet_manager.cc:1905] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:47.498766 26575 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_0b6cd084cecf499e9091685515cb1a3b" } new_table_name: "default.Table_8c0c1ab3bbb944c888930a5d8116d888" modify_external_catalogs: true
W20260810 11:30:47.500900 26700 consensus_peers.cc:487] T 1549a26ba0f6427fae87b204c5d49eff P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260810 11:30:47.501307 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 49405us
I20260810 11:30:47.499573 26574 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_52cf39e2586743a595ebe5b3172bd921" } modify_external_catalogs: true
I20260810 11:30:47.502128 26574 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_52cf39e2586743a595ebe5b3172bd921" } modify_external_catalogs: true
I20260810 11:30:47.499953 26571 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_341bf544f7b94ef2ba94afc342f8bc1f" } modify_external_catalogs: true
I20260810 11:30:47.502756 26571 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_341bf544f7b94ef2ba94afc342f8bc1f" } modify_external_catalogs: true
I20260810 11:30:47.501785 26577 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_ad3534a46309483687ef9dd9471f1008" } new_table_name: "default.Table_cb8549bfe5344b95b2c81538365c371b" modify_external_catalogs: true
I20260810 11:30:47.507766 27228 tablet_bootstrap.cc:492] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:47.507882 29504 raft_consensus.cc:482] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:47.508147 27228 ts_tablet_manager.cc:1397] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.003s
I20260810 11:30:47.509516 27228 raft_consensus.cc:348] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.510007 27228 raft_consensus.cc:374] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:47.510161 27228 raft_consensus.cc:729] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:47.508057 29504 raft_consensus.cc:504] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.510499 27228 consensus_queue.cc:260] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.510663 29504 leader_election.cc:288] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:47.511301 27228 ts_tablet_manager.cc:1428] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 11:30:47.511631 27228 tablet_bootstrap.cc:492] T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:47.512547 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "932ac2ae54324e6e830291ed449a31a8" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:47.514051 27228 tablet_bootstrap.cc:654] T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:47.518059 29110 ts_tablet_manager.cc:1918] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:47.518301 29110 log.cc:1196] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/b945038c03e343489af6ae7e50131d97
I20260810 11:30:47.518771 29110 ts_tablet_manager.cc:1939] T b945038c03e343489af6ae7e50131d97 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:47.519230 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 135) took 2741 ms. Trace:
I20260810 11:30:47.519644 29504 consensus_queue.cc:1035] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:47.520731 29110 rpcz_store.cc:276] 0810 11:30:44.777662 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.777976 (+ 314us) service_pool.cc:227] Handling call
0810 11:30:47.487979 (+2710003us) ts_tablet_manager.cc:1145] Deleting tablet b945038c03e343489af6ae7e50131d97
0810 11:30:47.487989 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.497674 (+ 9685us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.517903 (+ 20229us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.519211 (+ 1308us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2507752}
I20260810 11:30:47.521306 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 136) took 2718 ms. Trace:
I20260810 11:30:47.521467 29110 rpcz_store.cc:276] 0810 11:30:44.802485 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.802558 (+ 73us) service_pool.cc:227] Handling call
0810 11:30:47.521184 (+2718626us) ts_tablet_manager.cc:1145] Deleting tablet fc558690dce44e999e55e9bf1b6ca172
0810 11:30:47.521197 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.521287 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2540853}
I20260810 11:30:47.521965 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 137) took 2719 ms. Trace:
W20260810 11:30:47.526121 26700 leader_election.cc:341] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:47.528607 29110 rpcz_store.cc:276] 0810 11:30:44.802982 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.803064 (+ 82us) service_pool.cc:227] Handling call
0810 11:30:47.521879 (+2718815us) ts_tablet_manager.cc:1145] Deleting tablet 1860e56467624dcdb288e13b004f78cc
0810 11:30:47.521889 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.521948 (+ 59us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2541507}
I20260810 11:30:47.529372 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 138) took 2726 ms. Trace:
I20260810 11:30:47.529568 29110 rpcz_store.cc:276] 0810 11:30:44.803128 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.803381 (+ 253us) service_pool.cc:227] Handling call
0810 11:30:47.529232 (+2725851us) ts_tablet_manager.cc:1145] Deleting tablet 44d5e146eeec4fe0be33c1c169d32e68
0810 11:30:47.529249 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.529352 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2548794}
I20260810 11:30:47.530010 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 140) took 2720 ms. Trace:
I20260810 11:30:47.530165 29110 rpcz_store.cc:276] 0810 11:30:44.809326 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.809410 (+ 84us) service_pool.cc:227] Handling call
0810 11:30:47.529919 (+2720509us) ts_tablet_manager.cc:1145] Deleting tablet 10210204d5ff4e5e97c98fd255f674a5
0810 11:30:47.529931 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.529993 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2549442}
I20260810 11:30:47.530663 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 139) took 2721 ms. Trace:
I20260810 11:30:47.531068 29110 rpcz_store.cc:276] 0810 11:30:44.809113 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.809526 (+ 413us) service_pool.cc:227] Handling call
0810 11:30:47.530578 (+2721052us) ts_tablet_manager.cc:1145] Deleting tablet 55c8749861874eca9b63d3db97afa2b1
0810 11:30:47.530589 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.530647 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2550046}
I20260810 11:30:47.531590 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 142) took 2720 ms. Trace:
I20260810 11:30:47.532001 29110 rpcz_store.cc:276] 0810 11:30:44.811574 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.812367 (+ 793us) service_pool.cc:227] Handling call
0810 11:30:47.531492 (+2719125us) ts_tablet_manager.cc:1145] Deleting tablet 1aa4562a2247405187d9dbd1baa48f39
0810 11:30:47.531505 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.531573 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2550891}
I20260810 11:30:47.532544 29110 tablet_replica.cc:330] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:47.533075 29110 raft_consensus.cc:2229] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:47.533078 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet a3079a68c1c74b64bf13877bd0ee68c3 with delete_type TABLET_DATA_DELETED (replaced by tablet f10ac7e043c240d8a14b2b4f96b864b9) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.533614 29110 raft_consensus.cc:2258] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:47.534381 26577 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 192) took 2443 ms. Trace:
I20260810 11:30:47.534623 29110 ts_tablet_manager.cc:1905] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:47.534946 26577 rpcz_store.cc:276] 0810 11:30:45.090480 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.474511 (+2384031us) service_pool.cc:227] Handling call
0810 11:30:47.499215 (+ 24704us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa47586 00007f9c61d3ade6 00007f9c61d3ab15 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:47.503375 (+ 4160us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:47.503569 (+ 194us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:47.503768 (+ 199us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:47.503844 (+ 76us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:47.533719 (+ 29875us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:47.534339 (+ 620us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.504389 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.504493 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.504500 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:47.504502 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:47.504661 (+ 159us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.504676 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.504681 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:47.504755 (+ 74us) tablet.cc:699] Row locks acquired
0810 11:30:47.504757 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:47.504799 (+ 42us) write_op.cc:270] Start()
0810 11:30:47.504838 (+ 39us) write_op.cc:276] Timestamp: P: 1786361447504737 usec, L: 0
0810 11:30:47.504842 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.505165 (+ 323us) log.cc:842] Serialized 405 byte log entry
0810 11:30:47.512939 (+ 7774us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.513691 (+ 752us) write_op.cc:301] APPLY: starting
0810 11:30:47.513701 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.513733 (+ 32us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.513776 (+ 43us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.513812 (+ 36us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.513836 (+ 24us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:47.513842 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:47.513895 (+ 53us) log.cc:842] Serialized 23 byte log entry
0810 11:30:47.513940 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.513951 (+ 11us) write_op.cc:454] Released schema lock
0810 11:30:47.513956 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.514005 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.514008 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":55253888,"child_traces":[["op",{"apply.queue_time_us":721,"apply.run_cpu_time_us":358,"apply.run_wall_time_us":358,"num_ops":1,"prepare.queue_time_us":56,"prepare.run_cpu_time_us":894,"prepare.run_wall_time_us":893,"raft.queue_time_us":516,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"replication_time_us":8083}]]}
I20260810 11:30:47.538005 26577 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_7458a59fbdce4e9485d51df6fccf66a5" } new_table_name: "default.Table_11e3ca2d0589464586b01e41dcd46bbf" modify_external_catalogs: true
I20260810 11:30:47.544730 26823 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:47.551852 29110 ts_tablet_manager.cc:1918] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:47.558291 29110 log.cc:1196] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/d000f0ebaf0049a7bdaad93e307e16e2
I20260810 11:30:47.561116 29110 ts_tablet_manager.cc:1939] T d000f0ebaf0049a7bdaad93e307e16e2 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:47.563800 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 143) took 2752 ms. Trace:
I20260810 11:30:47.564821 26742 tablet_service.cc:1467] Processing CreateTablet for tablet cd2fd79e6d584a8986843db3ac4a9225 (DEFAULT_TABLE table=default.Table_4c872f1def0044fdb03a8901a227e7d1 [id=0b29f306903f4ab6a2ee38c6b1739f0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:47.564493 29110 rpcz_store.cc:276] 0810 11:30:44.812036 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.812691 (+ 655us) service_pool.cc:227] Handling call
0810 11:30:47.532477 (+2719786us) ts_tablet_manager.cc:1145] Deleting tablet d000f0ebaf0049a7bdaad93e307e16e2
0810 11:30:47.532489 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.545151 (+ 12662us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.551715 (+ 6564us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.563675 (+ 11960us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2551823}
I20260810 11:30:47.567056 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 144) took 2754 ms. Trace:
I20260810 11:30:47.567703 29110 rpcz_store.cc:276] 0810 11:30:44.812306 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.812851 (+ 545us) service_pool.cc:227] Handling call
0810 11:30:47.566309 (+2753458us) ts_tablet_manager.cc:1145] Deleting tablet 81f24c84cdd945b78f39f24015eb1e43
0810 11:30:47.566327 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.566987 (+ 660us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2585487}
I20260810 11:30:47.569698 29110 tablet_replica.cc:330] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:47.570777 29110 raft_consensus.cc:2229] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:47.571254 26572 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 0edef936026743a896d5a73c134a8bca
I20260810 11:30:47.571929 26572 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 189) took 2601 ms. Trace:
I20260810 11:30:47.571784 29110 raft_consensus.cc:2258] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:47.572074 26572 rpcz_store.cc:276] 0810 11:30:44.970107 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.441695 (+2471588us) service_pool.cc:227] Handling call
0810 11:30:47.442896 (+ 1201us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:47.443059 (+ 163us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:47.443123 (+ 64us) catalog_manager.cc:2761] Locking tablets
0810 11:30:47.516886 (+ 73763us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:47.570977 (+ 54091us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:47.571130 (+ 153us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:47.571182 (+ 52us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:47.571804 (+ 622us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.522541 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.522660 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.522667 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:47.522669 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:47.522798 (+ 129us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.522809 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.522814 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.522916 (+ 102us) tablet.cc:699] Row locks acquired
0810 11:30:47.522919 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:47.522956 (+ 37us) write_op.cc:270] Start()
0810 11:30:47.522990 (+ 34us) write_op.cc:276] Timestamp: P: 1786361447522893 usec, L: 0
0810 11:30:47.522993 (+ 3us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.523185 (+ 192us) log.cc:842] Serialized 734 byte log entry
0810 11:30:47.564550 (+ 41365us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.565693 (+ 1143us) write_op.cc:301] APPLY: starting
0810 11:30:47.565712 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.565782 (+ 70us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.565875 (+ 93us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.565962 (+ 87us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.566010 (+ 48us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:47.566021 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:47.566112 (+ 91us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.566172 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.566324 (+ 152us) write_op.cc:454] Released schema lock
0810 11:30:47.566348 (+ 24us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.566539 (+ 191us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.566544 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1096,"apply.run_cpu_time_us":938,"apply.run_wall_time_us":937,"num_ops":2,"prepare.queue_time_us":4656,"prepare.run_cpu_time_us":711,"prepare.run_wall_time_us":710,"replication_time_us":41536}]]}
I20260810 11:30:47.573339 26572 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_f7aaec87f80f4f5f92f5e00a9effebcc" } modify_external_catalogs: true
I20260810 11:30:47.573587 26572 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_f7aaec87f80f4f5f92f5e00a9effebcc" } modify_external_catalogs: true
I20260810 11:30:47.575228 26578 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 4827800160e64883ba7bcadafeb13ead
I20260810 11:30:47.575711 26578 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 188) took 2605 ms. Trace:
I20260810 11:30:47.575865 29110 ts_tablet_manager.cc:1905] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:47.575839 26578 rpcz_store.cc:276] 0810 11:30:44.969977 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.429697 (+2459720us) service_pool.cc:227] Handling call
0810 11:30:47.436257 (+ 6560us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:47.436440 (+ 183us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:47.436527 (+ 87us) catalog_manager.cc:2761] Locking tablets
0810 11:30:47.518089 (+ 81562us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:47.574994 (+ 56905us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:47.575103 (+ 109us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:47.575151 (+ 48us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:47.575608 (+ 457us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.523294 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.523377 (+ 83us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.523382 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:47.523385 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:47.523496 (+ 111us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.523503 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.523507 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.523584 (+ 77us) tablet.cc:699] Row locks acquired
0810 11:30:47.523587 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:47.523616 (+ 29us) write_op.cc:270] Start()
0810 11:30:47.523642 (+ 26us) write_op.cc:276] Timestamp: P: 1786361447523555 usec, L: 0
0810 11:30:47.523646 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.523782 (+ 136us) log.cc:842] Serialized 734 byte log entry
0810 11:30:47.564663 (+ 40881us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.566834 (+ 2171us) write_op.cc:301] APPLY: starting
0810 11:30:47.566861 (+ 27us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.566923 (+ 62us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.567063 (+ 140us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.567191 (+ 128us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.567259 (+ 68us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:47.567266 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:47.567421 (+ 155us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.567494 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.567517 (+ 23us) write_op.cc:454] Released schema lock
0810 11:30:47.567524 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.567598 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.567602 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1980,"apply.run_cpu_time_us":856,"apply.run_wall_time_us":857,"num_ops":2,"prepare.queue_time_us":4556,"prepare.run_cpu_time_us":547,"prepare.run_wall_time_us":547,"replication_time_us":40963}]]}
I20260810 11:30:47.576817 26578 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_fd64c13d7a514c7285b42e1c91a63cdf" } new_table_name: "default.Table_3818fdea177c4bb589ab0e9ab54f7f51" modify_external_catalogs: true
I20260810 11:30:47.578814 26581 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet e700aa4c0c45496db8a2b4f4d6d746a4
I20260810 11:30:47.579375 26581 catalog_manager.cc:6565] ReplaceTablet: tablet e700aa4c0c45496db8a2b4f4d6d746a4 deleted and replaced by tablet 9bf01841b9d4412789b05ce207f6eb02
I20260810 11:30:47.579520 26581 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 187) took 3338 ms. Trace:
I20260810 11:30:47.579734 26581 rpcz_store.cc:276] 0810 11:30:44.240974 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.428002 (+3187028us) service_pool.cc:227] Handling call
0810 11:30:47.579466 (+151464us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.524967 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.525076 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.525083 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:47.525087 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:47.525194 (+ 107us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.525205 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.525212 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.525318 (+ 106us) tablet.cc:699] Row locks acquired
0810 11:30:47.525322 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:47.525354 (+ 32us) write_op.cc:270] Start()
0810 11:30:47.525385 (+ 31us) write_op.cc:276] Timestamp: P: 1786361447525292 usec, L: 0
0810 11:30:47.525390 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.525582 (+ 192us) log.cc:842] Serialized 631 byte log entry
0810 11:30:47.564830 (+ 39248us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.568678 (+ 3848us) write_op.cc:301] APPLY: starting
0810 11:30:47.568691 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.568722 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.568966 (+ 244us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.569359 (+ 393us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.569424 (+ 65us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:47.569432 (+ 8us) write_op.cc:312] APPLY: finished
0810 11:30:47.569500 (+ 68us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.569550 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.569567 (+ 17us) write_op.cc:454] Released schema lock
0810 11:30:47.569573 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.569644 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.569648 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":3798,"apply.run_cpu_time_us":1032,"apply.run_wall_time_us":1032,"num_ops":2,"prepare.queue_time_us":3583,"prepare.run_cpu_time_us":677,"prepare.run_wall_time_us":676,"replication_time_us":39422}]]}
I20260810 11:30:47.580690 26581 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_c60b4d539f6a41fe9cdbb84740720a4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:47.581386 26581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c60b4d539f6a41fe9cdbb84740720a4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.581529 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd2fd79e6d584a8986843db3ac4a9225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:47.583009 26571 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 5a2e1b54043444989ac64c87f30ffc07
I20260810 11:30:47.583544 26571 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 190) took 2613 ms. Trace:
I20260810 11:30:47.583696 26571 rpcz_store.cc:276] 0810 11:30:44.970223 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.462553 (+2492330us) service_pool.cc:227] Handling call
0810 11:30:47.499890 (+ 37337us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa462e6 00007f9c61d39126 00007f9c61d38e55 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:47.502880 (+ 2990us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:47.503026 (+ 146us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:47.503085 (+ 59us) catalog_manager.cc:2761] Locking tablets
0810 11:30:47.521947 (+ 18862us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:47.582723 (+ 60776us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:47.582814 (+ 91us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:47.582859 (+ 45us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:47.583496 (+ 637us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.525686 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.525790 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.525797 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:47.525801 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:47.525911 (+ 110us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.525922 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.525930 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.526054 (+ 124us) tablet.cc:699] Row locks acquired
0810 11:30:47.526058 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:47.526090 (+ 32us) write_op.cc:270] Start()
0810 11:30:47.526121 (+ 31us) write_op.cc:276] Timestamp: P: 1786361447526027 usec, L: 0
0810 11:30:47.526126 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.526295 (+ 169us) log.cc:842] Serialized 734 byte log entry
0810 11:30:47.564876 (+ 38581us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.569750 (+ 4874us) write_op.cc:301] APPLY: starting
0810 11:30:47.569762 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.569795 (+ 33us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.569818 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.569865 (+ 47us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.569888 (+ 23us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:47.569894 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:47.569939 (+ 45us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.569972 (+ 33us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.569985 (+ 13us) write_op.cc:454] Released schema lock
0810 11:30:47.569989 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.570034 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.570037 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":85129472,"child_traces":[["op",{"apply.queue_time_us":4834,"apply.run_cpu_time_us":337,"apply.run_wall_time_us":336,"num_ops":2,"prepare.queue_time_us":3196,"prepare.run_cpu_time_us":668,"prepare.run_wall_time_us":667,"replication_time_us":38733}]]}
I20260810 11:30:47.585009 26574 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 25efcc18e8444b09ae2556345c36a710
I20260810 11:30:47.585462 26574 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 191) took 2615 ms. Trace:
I20260810 11:30:47.585605 26574 rpcz_store.cc:276] 0810 11:30:44.970317 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.464198 (+2493881us) service_pool.cc:227] Handling call
0810 11:30:47.499481 (+ 35283us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa462e6 00007f9c61d39126 00007f9c61d38e55 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:47.502279 (+ 2798us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:47.502435 (+ 156us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:47.502501 (+ 66us) catalog_manager.cc:2761] Locking tablets
0810 11:30:47.527019 (+ 24518us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:47.584770 (+ 57751us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:47.584883 (+ 113us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:47.584947 (+ 64us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:47.585402 (+ 455us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.533049 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.533204 (+ 155us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.533211 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:47.533216 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:47.533379 (+ 163us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.533395 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.533402 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.533566 (+ 164us) tablet.cc:699] Row locks acquired
0810 11:30:47.533571 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:47.534652 (+ 1081us) write_op.cc:270] Start()
0810 11:30:47.535881 (+ 1229us) write_op.cc:276] Timestamp: P: 1786361447534558 usec, L: 0
0810 11:30:47.535891 (+ 10us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.536160 (+ 269us) log.cc:842] Serialized 734 byte log entry
0810 11:30:47.564919 (+ 28759us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.570112 (+ 5193us) write_op.cc:301] APPLY: starting
0810 11:30:47.570122 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.570148 (+ 26us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.570181 (+ 33us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.570224 (+ 43us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.570371 (+ 147us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:47.570383 (+ 12us) write_op.cc:312] APPLY: finished
0810 11:30:47.570503 (+ 120us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.570600 (+ 97us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.570623 (+ 23us) write_op.cc:454] Released schema lock
0810 11:30:47.570634 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.570707 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.570711 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":80458624,"child_traces":[["op",{"apply.queue_time_us":5164,"apply.run_cpu_time_us":658,"apply.run_wall_time_us":656,"num_ops":2,"prepare.queue_time_us":5278,"prepare.run_cpu_time_us":1072,"prepare.run_wall_time_us":3204,"replication_time_us":29012}]]}
I20260810 11:30:47.591532 26573 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet d50a8bdb17fa4332b288d03658c6b9c2
I20260810 11:30:47.592039 26573 catalog_manager.cc:6565] ReplaceTablet: tablet d50a8bdb17fa4332b288d03658c6b9c2 deleted and replaced by tablet 72fd344dfcb84dfba89f7a9f446d814f
I20260810 11:30:47.592181 26573 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 184) took 4154 ms. Trace:
I20260810 11:30:47.592293 26573 rpcz_store.cc:276] 0810 11:30:43.437747 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.422174 (+3984427us) service_pool.cc:227] Handling call
0810 11:30:47.592121 (+169947us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.524337 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.524421 (+ 84us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.524426 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:47.524428 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:47.524504 (+ 76us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.524511 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.524515 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.524602 (+ 87us) tablet.cc:699] Row locks acquired
0810 11:30:47.524606 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:47.524641 (+ 35us) write_op.cc:270] Start()
0810 11:30:47.524673 (+ 32us) write_op.cc:276] Timestamp: P: 1786361447524577 usec, L: 0
0810 11:30:47.524678 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.524863 (+ 185us) log.cc:842] Serialized 631 byte log entry
0810 11:30:47.564784 (+ 39921us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.568216 (+ 3432us) write_op.cc:301] APPLY: starting
0810 11:30:47.568227 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.568258 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.568281 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.568370 (+ 89us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.568443 (+ 73us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:47.568451 (+ 8us) write_op.cc:312] APPLY: finished
0810 11:30:47.568501 (+ 50us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.568540 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.568553 (+ 13us) write_op.cc:454] Released schema lock
0810 11:30:47.591035 (+ 22482us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.591117 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.591125 (+ 8us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":3384,"apply.run_cpu_time_us":588,"apply.run_wall_time_us":22978,"num_ops":2,"prepare.queue_time_us":4005,"prepare.run_cpu_time_us":579,"prepare.run_wall_time_us":577,"replication_time_us":40089}]]}
W20260810 11:30:47.597589 26575 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c317ccebde05457d9e81c5c871638092 consensus state has no leader
I20260810 11:30:47.597909 26575 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 193) took 2496 ms. Trace:
I20260810 11:30:47.598044 26575 rpcz_store.cc:276] 0810 11:30:45.101593 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.476200 (+2374607us) service_pool.cc:227] Handling call
0810 11:30:47.498624 (+ 22424us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa47586 00007f9c61d3ade6 00007f9c61d3ab15 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:47.506288 (+ 7664us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:47.506525 (+ 237us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:47.506683 (+ 158us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:47.506759 (+ 76us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:47.597229 (+ 90470us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:47.597834 (+ 605us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.507422 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.507524 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.507530 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:47.507532 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:47.507685 (+ 153us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.507697 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.507701 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:47.507789 (+ 88us) tablet.cc:699] Row locks acquired
0810 11:30:47.507791 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:47.507826 (+ 35us) write_op.cc:270] Start()
0810 11:30:47.507860 (+ 34us) write_op.cc:276] Timestamp: P: 1786361447507766 usec, L: 0
0810 11:30:47.507864 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.508030 (+ 166us) log.cc:842] Serialized 405 byte log entry
0810 11:30:47.564457 (+ 56427us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.565069 (+ 612us) write_op.cc:301] APPLY: starting
0810 11:30:47.565089 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.565136 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.565168 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.565223 (+ 55us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.565263 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:47.565269 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:47.565372 (+ 103us) log.cc:842] Serialized 23 byte log entry
0810 11:30:47.565450 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.565469 (+ 19us) write_op.cc:454] Released schema lock
0810 11:30:47.565477 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.565567 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.565571 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":50844544,"child_traces":[["op",{"apply.queue_time_us":510,"apply.run_cpu_time_us":586,"apply.run_wall_time_us":586,"num_ops":1,"prepare.queue_time_us":49,"prepare.run_cpu_time_us":705,"prepare.run_wall_time_us":706,"replication_time_us":56536}]]}
I20260810 11:30:47.600693 26571 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_5ba00bd0ab7d4cdcb1494f9491c64291" } new_table_name: "default.Table_5256d55e5aee47ee88a92177e8df8577" modify_external_catalogs: true
W20260810 11:30:47.605517 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 120559us
I20260810 11:30:47.606283 27027 tablet_service.cc:1467] Processing CreateTablet for tablet cd2fd79e6d584a8986843db3ac4a9225 (DEFAULT_TABLE table=default.Table_4c872f1def0044fdb03a8901a227e7d1 [id=0b29f306903f4ab6a2ee38c6b1739f0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:47.606827 27027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd2fd79e6d584a8986843db3ac4a9225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:47.606863 29110 ts_tablet_manager.cc:1918] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:47.606961 29110 log.cc:1196] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/8228600e3f6b4f9993dd25e4ceb57e4d
I20260810 11:30:47.607336 29110 ts_tablet_manager.cc:1939] T 8228600e3f6b4f9993dd25e4ceb57e4d P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:47.610512 26576 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 7de2d60cf87c48459e6663a68ac96714
I20260810 11:30:47.611235 26576 catalog_manager.cc:6565] ReplaceTablet: tablet 7de2d60cf87c48459e6663a68ac96714 deleted and replaced by tablet aad22a5dfacf4fb88a5493376915a70f
I20260810 11:30:47.611532 26576 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 185) took 4098 ms. Trace:
I20260810 11:30:47.611729 26576 rpcz_store.cc:276] 0810 11:30:43.512722 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.422533 (+3909811us) service_pool.cc:227] Handling call
0810 11:30:47.611348 (+188815us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.523863 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.523946 (+ 83us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.523950 (+ 4us) write_op.cc:435] Acquired schema lock
0810 11:30:47.523952 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:47.524027 (+ 75us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.524034 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.524038 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.524094 (+ 56us) tablet.cc:699] Row locks acquired
0810 11:30:47.524096 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:47.524121 (+ 25us) write_op.cc:270] Start()
0810 11:30:47.524144 (+ 23us) write_op.cc:276] Timestamp: P: 1786361447524062 usec, L: 0
0810 11:30:47.524147 (+ 3us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.524262 (+ 115us) log.cc:842] Serialized 631 byte log entry
0810 11:30:47.564729 (+ 40467us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.567707 (+ 2978us) write_op.cc:301] APPLY: starting
0810 11:30:47.567720 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.567758 (+ 38us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.567783 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.567904 (+ 121us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.567989 (+ 85us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:47.567996 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:47.568055 (+ 59us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.568099 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.568113 (+ 14us) write_op.cc:454] Released schema lock
0810 11:30:47.568119 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.610220 (+ 42101us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.610231 (+ 11us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":2940,"apply.run_cpu_time_us":634,"apply.run_wall_time_us":42610,"num_ops":2,"prepare.queue_time_us":4290,"prepare.run_cpu_time_us":442,"prepare.run_wall_time_us":441,"replication_time_us":40562}]]}
I20260810 11:30:47.613193 26580 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 183) took 4252 ms. Trace:
I20260810 11:30:47.613438 26580 rpcz_store.cc:276] 0810 11:30:43.360361 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.420994 (+4060633us) service_pool.cc:227] Handling call
0810 11:30:47.613115 (+192121us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:47.614835 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet a3079a68c1c74b64bf13877bd0ee68c3 with delete_type TABLET_DATA_DELETED (replaced by tablet f10ac7e043c240d8a14b2b4f96b864b9) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.615520 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 145) took 2656 ms. Trace:
I20260810 11:30:47.616158 29110 rpcz_store.cc:276] 0810 11:30:44.959569 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.960754 (+ 1185us) service_pool.cc:227] Handling call
0810 11:30:47.569436 (+2608682us) ts_tablet_manager.cc:1145] Deleting tablet 8228600e3f6b4f9993dd25e4ceb57e4d
0810 11:30:47.569454 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.601991 (+ 32537us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.606764 (+ 4773us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.615502 (+ 8738us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2584791}
I20260810 11:30:47.616801 29110 tablet_replica.cc:330] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:47.617393 29110 raft_consensus.cc:2229] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:47.617410 29525 tablet.cc:1722] T 77ffda3325af4096bbec689397f7a324 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:47.618134 29110 raft_consensus.cc:2258] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:47.621587 29110 ts_tablet_manager.cc:1905] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:47.621340 26580 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_13da010706b445ef8049a259743a3c33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:47.622354 26580 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13da010706b445ef8049a259743a3c33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.625023 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cd4f555b5d840c182a31b3c94da9619 with delete_type TABLET_DATA_DELETED (replaced by tablet 7161d94d80b24eeaa357cc0922a874af) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.625615 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet d512c335e340437fa32f2dc16dca6812 with delete_type TABLET_DATA_DELETED (replaced by tablet 7abf8e1e7f2c4519902cf31c6e0e86e2) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.626587 26894 tablet_service.cc:1467] Processing CreateTablet for tablet 9e2d88379f594676a68ffb8c64827a90 (DEFAULT_TABLE table=default.Table_8e946ba2788e406fb7cd8f38ab542b95 [id=f418462e0b954ecea6c1f2a45d14a586]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:47.627095 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e2d88379f594676a68ffb8c64827a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:47.633610 26574 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_c2c7816a3119457c8c5fc9d76a404674"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:47.634332 26574 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2c7816a3119457c8c5fc9d76a404674 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.635483 29491 raft_consensus.cc:482] T ab2471d06e0841e7bebae4ca1865618c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:47.635689 29491 raft_consensus.cc:504] T ab2471d06e0841e7bebae4ca1865618c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.636369 29491 leader_election.cc:288] T ab2471d06e0841e7bebae4ca1865618c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:47.636472 26573 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_5fa102edf6ef4d4b966a0b16a0af0b55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:47.637748 26573 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fa102edf6ef4d4b966a0b16a0af0b55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.641001 26576 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_5774e37bc1934d62a2ace70c0fa925a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:47.641808 26576 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5774e37bc1934d62a2ace70c0fa925a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.643653 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 0edef936026743a896d5a73c134a8bca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.643664 27032 tablet_service.cc:1467] Processing CreateTablet for tablet 92d2113ddad5476fa8313b7fe3fbed36 (DEFAULT_TABLE table=default.Table_eb450e88c0f145e091452700b678075b [id=25584422ba0c4651905b312447f613b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:47.644066 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 4827800160e64883ba7bcadafeb13ead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.644112 27032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92d2113ddad5476fa8313b7fe3fbed36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:47.644368 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet e700aa4c0c45496db8a2b4f4d6d746a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 9bf01841b9d4412789b05ce207f6eb02) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.644903 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a2e1b54043444989ac64c87f30ffc07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.645229 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 25efcc18e8444b09ae2556345c36a710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.645478 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet d50a8bdb17fa4332b288d03658c6b9c2 with delete_type TABLET_DATA_DELETED (replaced by tablet 72fd344dfcb84dfba89f7a9f446d814f) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.645792 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 7de2d60cf87c48459e6663a68ac96714 with delete_type TABLET_DATA_DELETED (replaced by tablet aad22a5dfacf4fb88a5493376915a70f) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:47.646425 27027 tablet_service.cc:1467] Processing CreateTablet for tablet 4028398da54545e6bb5633226de77f9d (DEFAULT_TABLE table=default.Table_5143e6e4d3cc412e8f21d70c5307c3ea [id=19b9160d119c410c9a987d2f6eff298b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:47.646842 27027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4028398da54545e6bb5633226de77f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:47.652686 26889 tablet_service.cc:1467] Processing CreateTablet for tablet cd2fd79e6d584a8986843db3ac4a9225 (DEFAULT_TABLE table=default.Table_4c872f1def0044fdb03a8901a227e7d1 [id=0b29f306903f4ab6a2ee38c6b1739f0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:47.652889 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 4028398da54545e6bb5633226de77f9d (DEFAULT_TABLE table=default.Table_5143e6e4d3cc412e8f21d70c5307c3ea [id=19b9160d119c410c9a987d2f6eff298b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:47.653445 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd2fd79e6d584a8986843db3ac4a9225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:47.653827 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4028398da54545e6bb5633226de77f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:47.654376 26893 tablet_service.cc:1467] Processing CreateTablet for tablet 92d2113ddad5476fa8313b7fe3fbed36 (DEFAULT_TABLE table=default.Table_eb450e88c0f145e091452700b678075b [id=25584422ba0c4651905b312447f613b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:47.654963 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92d2113ddad5476fa8313b7fe3fbed36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:47.656708 29110 ts_tablet_manager.cc:1918] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:47.656833 29110 log.cc:1196] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/3ae27bf110114b70a3e3f6cf64f31b98
I20260810 11:30:47.656991 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 0edef936026743a896d5a73c134a8bca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.657207 29110 ts_tablet_manager.cc:1939] T 3ae27bf110114b70a3e3f6cf64f31b98 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:47.657414 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 4827800160e64883ba7bcadafeb13ead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.657549 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 146) took 2696 ms. Trace:
I20260810 11:30:47.657634 29110 rpcz_store.cc:276] 0810 11:30:44.961417 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.963250 (+ 1833us) service_pool.cc:227] Handling call
0810 11:30:47.616742 (+2653492us) ts_tablet_manager.cc:1145] Deleting tablet 3ae27bf110114b70a3e3f6cf64f31b98
0810 11:30:47.616757 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.636536 (+ 19779us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.656596 (+ 20060us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.657532 (+ 936us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2632074}
I20260810 11:30:47.657945 29110 tablet_replica.cc:330] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:47.658169 29110 raft_consensus.cc:2229] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:47.658314 29110 raft_consensus.cc:2258] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:47.658648 26881 tablet_service.cc:1514] Processing DeleteTablet for tablet e700aa4c0c45496db8a2b4f4d6d746a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 9bf01841b9d4412789b05ce207f6eb02) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.658857 29110 ts_tablet_manager.cc:1905] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:47.663169 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet a3079a68c1c74b64bf13877bd0ee68c3 with delete_type TABLET_DATA_DELETED (replaced by tablet f10ac7e043c240d8a14b2b4f96b864b9) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.638780 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab2471d06e0841e7bebae4ca1865618c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:47.679972 27048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "932ac2ae54324e6e830291ed449a31a8" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:47.680231 27048 raft_consensus.cc:2454] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:47.688701 26578 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_65a103c524ea4c9d826db90843b2309b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:47.689792 29110 ts_tablet_manager.cc:1918] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 11:30:47.691113 26578 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65a103c524ea4c9d826db90843b2309b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.693974 26571 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_a1f19ccbbd394c55ac00d3dcb8a4df54"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:47.694872 26571 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1f19ccbbd394c55ac00d3dcb8a4df54 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.695807 29110 log.cc:1196] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/2da86554bc51486e91f1ea5995a245b5
I20260810 11:30:47.695904 26702 leader_election.cc:302] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:47.696655 29110 ts_tablet_manager.cc:1939] T 2da86554bc51486e91f1ea5995a245b5 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:47.697978 26572 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 81b800247b4e4171b82dcde68e39fb00
I20260810 11:30:47.698698 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 147) took 2732 ms. Trace:
I20260810 11:30:47.699090 26572 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 195) took 1012 ms. Trace:
I20260810 11:30:47.700672 29110 rpcz_store.cc:276] 0810 11:30:44.965954 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.967478 (+ 1524us) service_pool.cc:227] Handling call
0810 11:30:47.657904 (+2690426us) ts_tablet_manager.cc:1145] Deleting tablet 2da86554bc51486e91f1ea5995a245b5
0810 11:30:47.657915 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.674578 (+ 16663us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.689603 (+ 15025us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.698679 (+ 9076us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2673157}
I20260810 11:30:47.702093 29110 tablet_replica.cc:330] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:47.702839 29110 raft_consensus.cc:2229] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:47.705132 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet e69916a35fba4714bbc565921738888f (table default.Table_c40dd8e327db40b59167de093a5c616d [id=10ebb746a2b343b08b5b13d1107a7cd8]) successfully deleted
W20260810 11:30:47.705549 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet d08250001e1542f9978bc6f89ace458b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d08250001e1542f9978bc6f89ace458b already in progress: creating tablet
I20260810 11:30:47.705849 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet b945038c03e343489af6ae7e50131d97 (table default.Table_9744be92699b40d1bae23bbb564db585 [id=f27ef087b00e469197a44c70d4bc979b]) successfully deleted
W20260810 11:30:47.706153 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet fc558690dce44e999e55e9bf1b6ca172 because the tablet was not found. No further retry: Not found: Tablet not found: fc558690dce44e999e55e9bf1b6ca172
W20260810 11:30:47.706493 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 1860e56467624dcdb288e13b004f78cc because the tablet was not found. No further retry: Not found: Tablet not found: 1860e56467624dcdb288e13b004f78cc
W20260810 11:30:47.706781 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 44d5e146eeec4fe0be33c1c169d32e68 because the tablet was not found. No further retry: Not found: Tablet not found: 44d5e146eeec4fe0be33c1c169d32e68
I20260810 11:30:47.709897 29110 raft_consensus.cc:2258] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:47.711179 29110 ts_tablet_manager.cc:1905] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:47.713369 26581 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_4261c2bc06f04178ba9e115ead9a1aa8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:47.714987 26581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4261c2bc06f04178ba9e115ead9a1aa8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.717491 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 92d2113ddad5476fa8313b7fe3fbed36 (DEFAULT_TABLE table=default.Table_eb450e88c0f145e091452700b678075b [id=25584422ba0c4651905b312447f613b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:47.717988 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92d2113ddad5476fa8313b7fe3fbed36. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:47.707085 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 10210204d5ff4e5e97c98fd255f674a5 because the tablet was not found. No further retry: Not found: Tablet not found: 10210204d5ff4e5e97c98fd255f674a5
W20260810 11:30:47.718583 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 55c8749861874eca9b63d3db97afa2b1 because the tablet was not found. No further retry: Not found: Tablet not found: 55c8749861874eca9b63d3db97afa2b1
W20260810 11:30:47.718983 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 1aa4562a2247405187d9dbd1baa48f39 because the tablet was not found. No further retry: Not found: Tablet not found: 1aa4562a2247405187d9dbd1baa48f39
I20260810 11:30:47.716516 26577 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 194) took 1180 ms. Trace:
I20260810 11:30:47.719173 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 4028398da54545e6bb5633226de77f9d (DEFAULT_TABLE table=default.Table_5143e6e4d3cc412e8f21d70c5307c3ea [id=19b9160d119c410c9a987d2f6eff298b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:47.719841 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4028398da54545e6bb5633226de77f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:47.699373 26572 rpcz_store.cc:276] 0810 11:30:46.686540 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.573036 (+886496us) service_pool.cc:227] Handling call
0810 11:30:47.573698 (+ 662us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:47.573949 (+ 251us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:47.574019 (+ 70us) catalog_manager.cc:2761] Locking tablets
0810 11:30:47.574212 (+ 193us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:47.697566 (+123354us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:47.697702 (+ 136us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:47.697771 (+ 69us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:47.698977 (+ 1206us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.602458 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.602568 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.602575 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:47.602578 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:47.602713 (+ 135us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.602726 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.602731 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:47.602893 (+ 162us) tablet.cc:699] Row locks acquired
0810 11:30:47.602896 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:47.602939 (+ 43us) write_op.cc:270] Start()
0810 11:30:47.602979 (+ 40us) write_op.cc:276] Timestamp: P: 1786361447602917 usec, L: 0
0810 11:30:47.602983 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.603178 (+ 195us) log.cc:842] Serialized 740 byte log entry
0810 11:30:47.681142 (+ 77964us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.682248 (+ 1106us) write_op.cc:301] APPLY: starting
0810 11:30:47.682262 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.682298 (+ 36us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.682324 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.682394 (+ 70us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.682431 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:47.682440 (+ 9us) write_op.cc:312] APPLY: finished
0810 11:30:47.682527 (+ 87us) log.cc:842] Serialized 29 byte log entry
0810 11:30:47.682585 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.682602 (+ 17us) write_op.cc:454] Released schema lock
0810 11:30:47.682610 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.682664 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.682669 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1069,"apply.run_cpu_time_us":473,"apply.run_wall_time_us":473,"num_ops":2,"prepare.queue_time_us":27491,"prepare.run_cpu_time_us":817,"prepare.run_wall_time_us":818,"replication_time_us":78139}]]}
I20260810 11:30:47.719376 26577 rpcz_store.cc:276] 0810 11:30:46.536118 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.537661 (+1001543us) service_pool.cc:227] Handling call
0810 11:30:47.539912 (+ 2251us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:47.540138 (+ 226us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:47.540350 (+ 212us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:47.540437 (+ 87us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:47.715962 (+175525us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:47.716418 (+ 456us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:47.548540 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:47.548842 (+ 302us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:47.548848 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:47.548851 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:47.549009 (+ 158us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:47.549040 (+ 31us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:47.549048 (+ 8us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:47.549141 (+ 93us) tablet.cc:699] Row locks acquired
0810 11:30:47.549146 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:47.549200 (+ 54us) write_op.cc:270] Start()
0810 11:30:47.549247 (+ 47us) write_op.cc:276] Timestamp: P: 1786361447549130 usec, L: 0
0810 11:30:47.549253 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:47.549504 (+ 251us) log.cc:842] Serialized 405 byte log entry
0810 11:30:47.681062 (+131558us) op_driver.cc:444] REPLICATION: finished
0810 11:30:47.681384 (+ 322us) write_op.cc:301] APPLY: starting
0810 11:30:47.681402 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:47.681642 (+ 240us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:47.681732 (+ 90us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:47.681795 (+ 63us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:47.681842 (+ 47us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:47.681848 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:47.681960 (+ 112us) log.cc:842] Serialized 23 byte log entry
0810 11:30:47.682036 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.682056 (+ 20us) write_op.cc:454] Released schema lock
0810 11:30:47.682064 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:47.682135 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:47.682142 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":265,"apply.run_cpu_time_us":697,"apply.run_wall_time_us":823,"num_ops":1,"prepare.queue_time_us":1729,"prepare.run_cpu_time_us":998,"prepare.run_wall_time_us":1054,"replication_time_us":131783}]]}
I20260810 11:30:47.735399 29110 ts_tablet_manager.cc:1918] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:47.740017 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a2e1b54043444989ac64c87f30ffc07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.740658 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 25efcc18e8444b09ae2556345c36a710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.741104 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet d50a8bdb17fa4332b288d03658c6b9c2 with delete_type TABLET_DATA_DELETED (replaced by tablet 72fd344dfcb84dfba89f7a9f446d814f) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.742801 27228 tablet_bootstrap.cc:492] T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:47.743048 27228 ts_tablet_manager.cc:1397] T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.231s user 0.018s sys 0.043s
I20260810 11:30:47.743502 29110 log.cc:1196] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/ee803ddf27594d2b9e19fe440fc269c7
I20260810 11:30:47.744028 29110 ts_tablet_manager.cc:1939] T ee803ddf27594d2b9e19fe440fc269c7 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:47.743961 27228 raft_consensus.cc:348] T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.744225 27228 raft_consensus.cc:374] T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:47.744310 27228 raft_consensus.cc:729] T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:47.745280 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 150) took 2772 ms. Trace:
I20260810 11:30:47.747057 26580 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_a48c8668e73f4919a9c32c9c3e95f485" } new_table_name: "default.Table_03d4151647a047a1b1ba29fdba43f80d" modify_external_catalogs: true
I20260810 11:30:47.747417 26577 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_11e70bfc5ca54f1a936d021d01489aab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:47.747057 26572 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_9ed8857b66f14b79bb46c9d6cfebf6d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:47.751240 26572 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ed8857b66f14b79bb46c9d6cfebf6d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:47.751358 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 54712.1us
W20260810 11:30:47.753291 26577 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11e70bfc5ca54f1a936d021d01489aab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:47.753777 26702 leader_election.cc:302] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:47.754004 29504 raft_consensus.cc:2781] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:47.754086 29504 raft_consensus.cc:482] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:47.754211 29504 raft_consensus.cc:3037] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:47.756971 29453 raft_consensus.cc:2781] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:47.757082 29453 raft_consensus.cc:482] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:47.757141 29453 raft_consensus.cc:3037] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:47.753132 27231 tablet_bootstrap.cc:492] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:47.758302 27231 ts_tablet_manager.cc:1397] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.347s user 0.029s sys 0.046s
I20260810 11:30:47.759462 27231 raft_consensus.cc:348] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:47.759725 27231 raft_consensus.cc:374] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:47.759893 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet 0edef936026743a896d5a73c134a8bca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.759788 27231 raft_consensus.cc:729] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:47.760452 27231 consensus_queue.cc:260] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:47.761237 27231 ts_tablet_manager.cc:1428] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:47.761566 27231 tablet_bootstrap.cc:492] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:47.764076 27231 tablet_bootstrap.cc:654] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:47.757833 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet d000f0ebaf0049a7bdaad93e307e16e2 (table default.Table_2c4f303b1d1c47c9a4c089efccdd1d37 [id=fe5337909463467788d24d76e379cb48]) successfully deleted
W20260810 11:30:47.764801 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 81f24c84cdd945b78f39f24015eb1e43 because the tablet was not found. No further retry: Not found: Tablet not found: 81f24c84cdd945b78f39f24015eb1e43
I20260810 11:30:47.765362 29110 rpcz_store.cc:276] 0810 11:30:44.972540 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.972627 (+ 87us) service_pool.cc:227] Handling call
0810 11:30:47.702024 (+2729397us) ts_tablet_manager.cc:1145] Deleting tablet ee803ddf27594d2b9e19fe440fc269c7
0810 11:30:47.702043 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.731711 (+ 29668us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.735269 (+ 3558us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.745260 (+ 9991us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2716752}
I20260810 11:30:47.765674 28987 ts_tablet_manager.cc:1918] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:47.765954 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 149) took 2793 ms. Trace:
I20260810 11:30:47.768625 29110 rpcz_store.cc:276] 0810 11:30:44.972434 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.972513 (+ 79us) service_pool.cc:227] Handling call
0810 11:30:47.765798 (+2793285us) ts_tablet_manager.cc:1145] Deleting tablet 4b5a7f67ec5b48c2b5a510add0282a76
0810 11:30:47.765822 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.765931 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2780524}
I20260810 11:30:47.772838 29110 tablet_replica.cc:330] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:47.773322 29110 raft_consensus.cc:2229] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:47.773717 29110 raft_consensus.cc:2258] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:47.774493 29110 ts_tablet_manager.cc:1905] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:47.778798 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 4827800160e64883ba7bcadafeb13ead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:47.783358 26991 consensus_peers.cc:487] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:47.784601 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 7de2d60cf87c48459e6663a68ac96714 with delete_type TABLET_DATA_DELETED (replaced by tablet aad22a5dfacf4fb88a5493376915a70f) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.785071 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 81b800247b4e4171b82dcde68e39fb00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:47.793807 26741 tablet_service.cc:1514] Processing DeleteTablet for tablet 7de2d60cf87c48459e6663a68ac96714 with delete_type TABLET_DATA_DELETED (replaced by tablet aad22a5dfacf4fb88a5493376915a70f) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.794916 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet e700aa4c0c45496db8a2b4f4d6d746a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 9bf01841b9d4412789b05ce207f6eb02) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.800422 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 25efcc18e8444b09ae2556345c36a710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.802042 28987 log.cc:1196] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/d512c335e340437fa32f2dc16dca6812
I20260810 11:30:47.802675 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a2e1b54043444989ac64c87f30ffc07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.802840 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet d50a8bdb17fa4332b288d03658c6b9c2 with delete_type TABLET_DATA_DELETED (replaced by tablet 72fd344dfcb84dfba89f7a9f446d814f) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.803046 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 8228600e3f6b4f9993dd25e4ceb57e4d (table default.Table_94097f0758264fc986fbe731111c6851 [id=223e521d377e4209943be22f5ab4b422]) successfully deleted
I20260810 11:30:47.813884 29453 raft_consensus.cc:504] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.813798 29110 ts_tablet_manager.cc:1918] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:47.814610 29110 log.cc:1196] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/e276b0fa124d42dfb3fe750d245e44d8
I20260810 11:30:47.814700 29453 leader_election.cc:288] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:47.815740 26573 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_b7da728f12ba46d1a9f8b99d6d837238" } modify_external_catalogs: true
I20260810 11:30:47.816041 26573 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_b7da728f12ba46d1a9f8b99d6d837238" } modify_external_catalogs: true
I20260810 11:30:47.816819 29504 raft_consensus.cc:504] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:47.817413 29504 leader_election.cc:288] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:47.820415 29291 raft_consensus.cc:482] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:47.820775 29291 raft_consensus.cc:504] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:47.821578 29291 leader_election.cc:288] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:47.822798 29110 ts_tablet_manager.cc:1939] T e276b0fa124d42dfb3fe750d245e44d8 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:47.823758 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 148) took 2851 ms. Trace:
I20260810 11:30:47.824242 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d52e5c77d94854b8ba0b38c63ad015" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:47.824393 29110 rpcz_store.cc:276] 0810 11:30:44.972308 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.972410 (+ 102us) service_pool.cc:227] Handling call
0810 11:30:47.772766 (+2800356us) ts_tablet_manager.cc:1145] Deleting tablet e276b0fa124d42dfb3fe750d245e44d8
0810 11:30:47.772785 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.778770 (+ 5985us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.813654 (+ 34884us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.823736 (+ 10082us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2787438}
W20260810 11:30:47.825004 26991 leader_election.cc:341] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:47.826009 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 151) took 2853 ms. Trace:
I20260810 11:30:47.826637 29110 rpcz_store.cc:276] 0810 11:30:44.972663 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.092105 (+119442us) service_pool.cc:227] Handling call
0810 11:30:47.825825 (+2733720us) ts_tablet_manager.cc:1145] Deleting tablet b6395bce17ee40c2822669246ce7eb42
0810 11:30:47.825843 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.825972 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2733273}
I20260810 11:30:47.828611 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 152) took 2735 ms. Trace:
I20260810 11:30:47.832887 29110 rpcz_store.cc:276] 0810 11:30:45.092971 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.093029 (+ 58us) service_pool.cc:227] Handling call
0810 11:30:47.828423 (+2735394us) ts_tablet_manager.cc:1145] Deleting tablet c60baf810a544a4a90dccd2337a39043
0810 11:30:47.828439 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.828551 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2734932}
I20260810 11:30:47.833770 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 153) took 2739 ms. Trace:
I20260810 11:30:47.834409 29110 rpcz_store.cc:276] 0810 11:30:45.093926 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.093976 (+ 50us) service_pool.cc:227] Handling call
0810 11:30:47.833650 (+2739674us) ts_tablet_manager.cc:1145] Deleting tablet 7e78fb1bf0534deca5cc5a603fd77592
0810 11:30:47.833664 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.833749 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2739151}
I20260810 11:30:47.834962 29110 tablet_replica.cc:330] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:47.835593 29110 raft_consensus.cc:2229] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:47.836331 29110 raft_consensus.cc:2258] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:47.837966 29110 ts_tablet_manager.cc:1905] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:47.842541 26576 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_dc83172ee2e44eccab63bccfa35523fe" } modify_external_catalogs: true
I20260810 11:30:47.843001 26576 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_dc83172ee2e44eccab63bccfa35523fe" } modify_external_catalogs: true
I20260810 11:30:47.843617 28987 ts_tablet_manager.cc:1939] T d512c335e340437fa32f2dc16dca6812 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:47.845328 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 151) took 4668 ms. Trace:
I20260810 11:30:47.846990 26571 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_70976acd83de4eb39143c5afa72d8ec4" } modify_external_catalogs: true
I20260810 11:30:47.847352 26571 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_70976acd83de4eb39143c5afa72d8ec4" } modify_external_catalogs: true
I20260810 11:30:47.846776 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet 81b800247b4e4171b82dcde68e39fb00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:47.847952 28987 rpcz_store.cc:276] 0810 11:30:43.176885 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.176958 (+ 73us) service_pool.cc:227] Handling call
0810 11:30:47.208715 (+4031757us) ts_tablet_manager.cc:1145] Deleting tablet d512c335e340437fa32f2dc16dca6812
0810 11:30:47.208731 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.258333 (+ 49602us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.715517 (+457184us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.845306 (+129789us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4031488}
I20260810 11:30:47.850145 28987 tablet_replica.cc:330] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:47.863736 29110 ts_tablet_manager.cc:1918] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:47.864856 29110 log.cc:1196] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/f6e264e8507446809f3c386fdb3c34ae
I20260810 11:30:47.865667 29110 ts_tablet_manager.cc:1939] T f6e264e8507446809f3c386fdb3c34ae P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:47.866708 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 154) took 2771 ms. Trace:
I20260810 11:30:47.867609 29525 tablet.cc:1722] T 88268e3571884ac88c1a617ce74499f3 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:47.867347 29110 rpcz_store.cc:276] 0810 11:30:45.094766 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.094813 (+ 47us) service_pool.cc:227] Handling call
0810 11:30:47.834912 (+2740099us) ts_tablet_manager.cc:1145] Deleting tablet f6e264e8507446809f3c386fdb3c34ae
0810 11:30:47.834923 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.849864 (+ 14941us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.863619 (+ 13755us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.866688 (+ 3069us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2739881}
I20260810 11:30:47.873783 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 155) took 2777 ms. Trace:
I20260810 11:30:47.879151 28987 raft_consensus.cc:2229] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:47.880432 28987 raft_consensus.cc:2258] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:47.880995 29110 rpcz_store.cc:276] 0810 11:30:45.095937 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.095989 (+ 52us) service_pool.cc:227] Handling call
0810 11:30:47.873606 (+2777617us) ts_tablet_manager.cc:1145] Deleting tablet b121c13e9241468aa224e17093eb38f4
0810 11:30:47.873624 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.873757 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2777338}
I20260810 11:30:47.881770 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 156) took 2785 ms. Trace:
I20260810 11:30:47.882269 29110 rpcz_store.cc:276] 0810 11:30:45.096503 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.096926 (+ 423us) service_pool.cc:227] Handling call
0810 11:30:47.881652 (+2784726us) ts_tablet_manager.cc:1145] Deleting tablet db59523b71224370bf5fce6b56592f71
0810 11:30:47.881665 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.881753 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2784341}
I20260810 11:30:47.882893 29110 tablet_replica.cc:330] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:47.883361 29110 raft_consensus.cc:2229] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:47.883919 29110 raft_consensus.cc:2258] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:47.885154 29110 ts_tablet_manager.cc:1905] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:47.887250 27231 tablet_bootstrap.cc:492] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:47.887437 27231 ts_tablet_manager.cc:1397] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.126s user 0.015s sys 0.015s
I20260810 11:30:47.888236 27231 raft_consensus.cc:348] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:47.888548 27231 raft_consensus.cc:374] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:47.888887 27231 raft_consensus.cc:729] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:47.889178 27231 consensus_queue.cc:260] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:47.889870 27231 ts_tablet_manager.cc:1428] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:47.890712 27231 tablet_bootstrap.cc:492] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:47.892338 27231 tablet_bootstrap.cc:654] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:47.897401 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1e46f80f7f4e3a84638421892e6236" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:47.901247 29110 ts_tablet_manager.cc:1918] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:47.901429 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "932ac2ae54324e6e830291ed449a31a8" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:47.885525 29516 tablet.cc:1722] T 88268e3571884ac88c1a617ce74499f3 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:47.907259 28987 ts_tablet_manager.cc:1905] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:47.907315 29110 log.cc:1196] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/34bd3c0edf6b49d1891c0ee9af344872
I20260810 11:30:47.907707 29110 ts_tablet_manager.cc:1939] T 34bd3c0edf6b49d1891c0ee9af344872 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:47.907133 27231 tablet_bootstrap.cc:492] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:47.912897 27231 ts_tablet_manager.cc:1397] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.001s
I20260810 11:30:47.912912 26578 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_09b119fffa254fd2a7062d12b8e9ca32" } modify_external_catalogs: true
I20260810 11:30:47.913280 26578 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_09b119fffa254fd2a7062d12b8e9ca32" } modify_external_catalogs: true
I20260810 11:30:47.914258 27231 raft_consensus.cc:348] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:47.914574 27231 raft_consensus.cc:374] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:47.914683 27231 raft_consensus.cc:729] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:47.915050 27231 consensus_queue.cc:260] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:47.916083 27231 ts_tablet_manager.cc:1428] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 11:30:47.916541 27231 tablet_bootstrap.cc:492] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:47.907682 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab2471d06e0841e7bebae4ca1865618c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:47.917675 27055 raft_consensus.cc:2379] T ab2471d06e0841e7bebae4ca1865618c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6079090b1124d84aa4477974bb53700 in current term 1: Already voted for candidate 443ec871f1ed4232b932ecfb0b18510d in this term.
I20260810 11:30:47.920157 27231 tablet_bootstrap.cc:654] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:47.920377 26581 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_1f48a9af47ad4e0c93ed4dd43ecd12a3" } new_table_name: "default.Table_1ec5963e30f5468cbde77670965bf92b" modify_external_catalogs: true
I20260810 11:30:47.920392 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 157) took 2822 ms. Trace:
I20260810 11:30:47.920634 29110 rpcz_store.cc:276] 0810 11:30:45.097587 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.097639 (+ 52us) service_pool.cc:227] Handling call
0810 11:30:47.882847 (+2785208us) ts_tablet_manager.cc:1145] Deleting tablet 34bd3c0edf6b49d1891c0ee9af344872
0810 11:30:47.882858 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.897397 (+ 14539us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.901130 (+ 3733us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.920372 (+ 19242us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2785041}
I20260810 11:30:47.921186 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 158) took 2823 ms. Trace:
I20260810 11:30:47.921329 29110 rpcz_store.cc:276] 0810 11:30:45.098011 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.098073 (+ 62us) service_pool.cc:227] Handling call
0810 11:30:47.921057 (+2822984us) ts_tablet_manager.cc:1145] Deleting tablet ea66da5bc20e4718901ffc473677421c
0810 11:30:47.921068 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.921170 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2822836}
I20260810 11:30:47.921765 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 160) took 2822 ms. Trace:
I20260810 11:30:47.921891 29110 rpcz_store.cc:276] 0810 11:30:45.099224 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.099279 (+ 55us) service_pool.cc:227] Handling call
0810 11:30:47.921604 (+2822325us) ts_tablet_manager.cc:1145] Deleting tablet 7d3406f12d9c492cbd0d86fa7a57de82
0810 11:30:47.921613 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.921749 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2822101}
I20260810 11:30:47.922247 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 161) took 2822 ms. Trace:
I20260810 11:30:47.922428 29110 rpcz_store.cc:276] 0810 11:30:45.099971 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.100029 (+ 58us) service_pool.cc:227] Handling call
0810 11:30:47.922181 (+2822152us) ts_tablet_manager.cc:1145] Deleting tablet 49db12565dbc4187b78a98ed35c40fed
0810 11:30:47.922190 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.922234 (+ 44us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2821984}
I20260810 11:30:47.922755 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 162) took 2822 ms. Trace:
I20260810 11:30:47.923741 29110 rpcz_store.cc:276] 0810 11:30:45.100483 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.100550 (+ 67us) service_pool.cc:227] Handling call
0810 11:30:47.922687 (+2822137us) ts_tablet_manager.cc:1145] Deleting tablet 809b5b6b65d244cd9186517e39494839
0810 11:30:47.922696 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.922742 (+ 46us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2821965}
I20260810 11:30:47.924183 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 163) took 2821 ms. Trace:
I20260810 11:30:47.924325 29110 rpcz_store.cc:276] 0810 11:30:45.102908 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.102959 (+ 51us) service_pool.cc:227] Handling call
0810 11:30:47.924069 (+2821110us) ts_tablet_manager.cc:1145] Deleting tablet 7c203cd90d2f472fa27cfabed5b87119
0810 11:30:47.924081 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.924167 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2820909}
I20260810 11:30:47.924743 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 164) took 2821 ms. Trace:
I20260810 11:30:47.924891 29110 rpcz_store.cc:276] 0810 11:30:45.103745 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.103824 (+ 79us) service_pool.cc:227] Handling call
0810 11:30:47.924641 (+2820817us) ts_tablet_manager.cc:1145] Deleting tablet 0cc17c55109b47eeb91920c3ed8178e0
0810 11:30:47.924650 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.924726 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2820544}
I20260810 11:30:47.925274 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 165) took 2821 ms. Trace:
I20260810 11:30:47.925413 29110 rpcz_store.cc:276] 0810 11:30:45.104300 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.104367 (+ 67us) service_pool.cc:227] Handling call
0810 11:30:47.925193 (+2820826us) ts_tablet_manager.cc:1145] Deleting tablet 110b5acc36bd4d6bba13735e5daec75f
0810 11:30:47.925204 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.925259 (+ 55us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2820635}
I20260810 11:30:47.925827 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 166) took 2800 ms. Trace:
I20260810 11:30:47.925978 29110 rpcz_store.cc:276] 0810 11:30:45.125477 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.126892 (+ 1415us) service_pool.cc:227] Handling call
0810 11:30:47.925709 (+2798817us) ts_tablet_manager.cc:1145] Deleting tablet 518c777e40ec40dcb3484c0374384959
0810 11:30:47.925722 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.925811 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2798558}
I20260810 11:30:47.926333 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 169) took 2796 ms. Trace:
I20260810 11:30:47.927280 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 3ae27bf110114b70a3e3f6cf64f31b98 (table default.Table_54efd7f2894348cf9dbf82586d44b6b5 [id=3b60ed35e72d41b58f176184a08303ad]) successfully deleted
I20260810 11:30:47.927589 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 2da86554bc51486e91f1ea5995a245b5 (table default.Table_a0630a37a4e44862b8947cd848615cdb [id=f7931f3f7e9c45fba1aff648c50250f2]) successfully deleted
I20260810 11:30:47.927886 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet ee803ddf27594d2b9e19fe440fc269c7 (table default.Table_67580ad3fe7a47d6a051e7da7005c171 [id=5ae9efa77fb54cf58ff2a1662eee03f7]) successfully deleted
W20260810 11:30:47.928164 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 4b5a7f67ec5b48c2b5a510add0282a76 because the tablet was not found. No further retry: Not found: Tablet not found: 4b5a7f67ec5b48c2b5a510add0282a76
I20260810 11:30:47.928275 29110 rpcz_store.cc:276] 0810 11:30:45.130321 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:45.130983 (+ 662us) service_pool.cc:227] Handling call
0810 11:30:47.926261 (+2795278us) ts_tablet_manager.cc:1145] Deleting tablet 7cd4f555b5d840c182a31b3c94da9619
0810 11:30:47.926271 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.926319 (+ 48us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2794990}
I20260810 11:30:47.928462 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet e276b0fa124d42dfb3fe750d245e44d8 (table default.Table_2d6c3a53213a458aaee6bd445240041c [id=097ff3abe81b415799933e50feab6c39]) successfully deleted
I20260810 11:30:47.928757 29110 tablet_replica.cc:330] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:47.928807 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet b6395bce17ee40c2822669246ce7eb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6395bce17ee40c2822669246ce7eb42 already in progress: creating tablet
I20260810 11:30:47.929037 29110 raft_consensus.cc:2229] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:47.929148 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet c60baf810a544a4a90dccd2337a39043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c60baf810a544a4a90dccd2337a39043 already in progress: creating tablet
I20260810 11:30:47.929363 29110 raft_consensus.cc:2258] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 11:30:47.929405 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7e78fb1bf0534deca5cc5a603fd77592 because the tablet was not found. No further retry: Not found: Tablet not found: 7e78fb1bf0534deca5cc5a603fd77592
I20260810 11:30:47.929617 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet f6e264e8507446809f3c386fdb3c34ae (table default.Table_ae66005f117b4fe9bd3fb52adb6efb32 [id=03cc701eb88641fa844ee3d192b321ab]) successfully deleted
W20260810 11:30:47.929831 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet b121c13e9241468aa224e17093eb38f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b121c13e9241468aa224e17093eb38f4 already in progress: creating tablet
W20260810 11:30:47.930065 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet db59523b71224370bf5fce6b56592f71 because the tablet was not found. No further retry: Not found: Tablet not found: db59523b71224370bf5fce6b56592f71
I20260810 11:30:47.933269 29110 ts_tablet_manager.cc:1905] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:47.898267 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 144503us
I20260810 11:30:47.929803 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d52e5c77d94854b8ba0b38c63ad015" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:47.935654 29316 consensus_queue.cc:1035] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:47.938313 27231 tablet_bootstrap.cc:492] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:47.938570 27231 ts_tablet_manager.cc:1397] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.005s
I20260810 11:30:47.940389 27231 raft_consensus.cc:348] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:47.940757 27231 raft_consensus.cc:374] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:47.940891 27231 raft_consensus.cc:729] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:47.941246 27231 consensus_queue.cc:260] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:47.941994 27231 ts_tablet_manager.cc:1428] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:47.942621 27231 tablet_bootstrap.cc:492] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:47.945549 27231 tablet_bootstrap.cc:654] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:47.958427 29110 ts_tablet_manager.cc:1918] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:47.958851 26577 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_45c04b6c4bae413795c491f49f2b4bcd" } new_table_name: "default.Table_883130a240194491bd23c14d9aff2e99" modify_external_catalogs: true
I20260810 11:30:47.959767 27049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1e46f80f7f4e3a84638421892e6236" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:47.963550 27049 raft_consensus.cc:3037] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:47.963850 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "932ac2ae54324e6e830291ed449a31a8" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:47.964039 27057 raft_consensus.cc:3037] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:47.963550 29110 log.cc:1196] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/4efa31ad2ce8436b9638e6759d9b5421
I20260810 11:30:47.964733 29110 ts_tablet_manager.cc:1939] T 4efa31ad2ce8436b9638e6759d9b5421 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:47.965101 29110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 170) took 1420 ms. Trace:
I20260810 11:30:47.965190 29110 rpcz_store.cc:276] 0810 11:30:46.545058 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.545129 (+ 71us) service_pool.cc:227] Handling call
0810 11:30:47.928707 (+1383578us) ts_tablet_manager.cc:1145] Deleting tablet 4efa31ad2ce8436b9638e6759d9b5421
0810 11:30:47.928718 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.947463 (+ 18745us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.958103 (+ 10640us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:47.965084 (+ 6981us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1378429}
I20260810 11:30:47.966915 27049 raft_consensus.cc:2454] T 3a1e46f80f7f4e3a84638421892e6236 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:47.973071 27231 tablet_bootstrap.cc:492] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:47.973807 27231 ts_tablet_manager.cc:1397] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.004s
I20260810 11:30:47.975539 27231 raft_consensus.cc:348] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:47.976284 27231 raft_consensus.cc:374] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:47.976452 27231 raft_consensus.cc:729] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:47.980116 27231 consensus_queue.cc:260] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:47.982530 27231 ts_tablet_manager.cc:1428] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260810 11:30:47.983785 29110 tablet_replica.cc:330] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:47.984266 29110 raft_consensus.cc:2229] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:47.984524 29110 raft_consensus.cc:2258] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:47.985179 29110 ts_tablet_manager.cc:1905] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:47.998610 26700 leader_election.cc:341] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:47.984036 27231 tablet_bootstrap.cc:492] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:48.004594 27231 tablet_bootstrap.cc:654] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.014581 29523 raft_consensus.cc:482] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.014916 29523 raft_consensus.cc:504] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.015760 29523 leader_election.cc:288] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:48.016862 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebaf046e524b485c8b3ebf419c8035bb" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:48.018573 26991 leader_election.cc:341] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:48.034723 27231 tablet_bootstrap.cc:492] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:48.034915 27231 ts_tablet_manager.cc:1397] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.051s user 0.005s sys 0.000s
I20260810 11:30:48.035949 27231 raft_consensus.cc:348] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.036166 27231 raft_consensus.cc:374] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.036229 27231 raft_consensus.cc:729] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.036453 27231 consensus_queue.cc:260] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.037125 27231 ts_tablet_manager.cc:1428] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 11:30:48.037460 27231 tablet_bootstrap.cc:492] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
W20260810 11:30:48.040575 26700 leader_election.cc:341] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:48.048221 29110 ts_tablet_manager.cc:1918] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:48.049645 29110 log.cc:1196] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/cc76d30f37094391b75076c92ccc277f
I20260810 11:30:48.050508 29110 ts_tablet_manager.cc:1939] T cc76d30f37094391b75076c92ccc277f P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:48.052752 29110 tablet_replica.cc:330] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:48.053110 29110 raft_consensus.cc:2229] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:48.054140 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet d512c335e340437fa32f2dc16dca6812 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]) successfully deleted
I20260810 11:30:48.056347 29110 raft_consensus.cc:2258] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:48.057049 29110 ts_tablet_manager.cc:1905] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:48.058727 29297 consensus_queue.cc:1035] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:48.057647 26574 catalog_manager.cc:5495] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:48.054131 29550 tablet.cc:1722] T 77ffda3325af4096bbec689397f7a324 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:48.051165 27231 tablet_bootstrap.cc:654] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.061208 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:48.071671 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:48.073119 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:48.076479 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f (table default.Table_11e3ca2d0589464586b01e41dcd46bbf [id=d63533f5d837481889b34a78d860e018]). Expected version 1 got 0
I20260810 11:30:48.079046 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 88268e3571884ac88c1a617ce74499f3 (table default.Table_cb8549bfe5344b95b2c81538365c371b [id=0f9e142b43214fa8b2e362c54fabcb42]). Expected version 1 got 0
I20260810 11:30:48.082438 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:48.085352 29110 ts_tablet_manager.cc:1918] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:48.087185 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:48.088871 29500 ts_tablet_manager.cc:1918] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:48.089200 29500 log.cc:1196] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/34bd3c0edf6b49d1891c0ee9af344872
I20260810 11:30:48.089663 29500 ts_tablet_manager.cc:1939] T 34bd3c0edf6b49d1891c0ee9af344872 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:48.090090 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 215) took 1047 ms. Trace:
I20260810 11:30:48.090276 29500 rpcz_store.cc:276] 0810 11:30:47.042219 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.043726 (+ 1507us) service_pool.cc:227] Handling call
0810 11:30:47.165073 (+121347us) ts_tablet_manager.cc:1145] Deleting tablet 34bd3c0edf6b49d1891c0ee9af344872
0810 11:30:47.165095 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.672387 (+507292us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:48.088755 (+416368us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:48.090069 (+ 1314us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":120783}
I20260810 11:30:48.090835 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 216) took 1046 ms. Trace:
I20260810 11:30:48.090977 29500 rpcz_store.cc:276] 0810 11:30:47.044669 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.045185 (+ 516us) service_pool.cc:227] Handling call
0810 11:30:48.090731 (+1045546us) ts_tablet_manager.cc:1145] Deleting tablet 809b5b6b65d244cd9186517e39494839
0810 11:30:48.090742 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:48.090818 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1045285}
I20260810 11:30:48.091063 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bcc69e8f87134d25a1329be52b08e794 (table default.Table_4e93c67b823f48028820e1e95415e455 [id=b4c0c92ef07f432cbb00a36ecd17d394]). Expected version 1 got 0
I20260810 11:30:48.091393 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 225) took 1021 ms. Trace:
I20260810 11:30:48.091567 29500 rpcz_store.cc:276] 0810 11:30:47.069894 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.071272 (+ 1378us) service_pool.cc:227] Handling call
0810 11:30:48.091286 (+1020014us) ts_tablet_manager.cc:1145] Deleting tablet 8b303be24f4e46d0b966e8191d76297b
0810 11:30:48.091294 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:48.091379 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1019535}
I20260810 11:30:48.091980 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 224) took 1028 ms. Trace:
I20260810 11:30:48.093665 26574 catalog_manager.cc:5495] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:48.097837 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:48.099804 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c317ccebde05457d9e81c5c871638092 (table default.Table_8c0c1ab3bbb944c888930a5d8116d888 [id=7b4e4650915f4c16bef68adf43618b89]). Expected version 1 got 0
I20260810 11:30:48.101610 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:48.102051 27231 tablet_bootstrap.cc:492] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:48.102592 27231 ts_tablet_manager.cc:1397] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.065s user 0.006s sys 0.005s
I20260810 11:30:48.103878 27231 raft_consensus.cc:348] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.104207 27231 raft_consensus.cc:374] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.104097 29453 consensus_queue.cc:1035] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:48.104305 27231 raft_consensus.cc:729] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.104543 27231 consensus_queue.cc:260] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.105309 27231 ts_tablet_manager.cc:1428] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 11:30:48.105636 27231 tablet_bootstrap.cc:492] T 77f0c916ccf24e86b0ec29de1ba54b84 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:48.105480 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:48.107214 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:48.108328 27231 tablet_bootstrap.cc:654] T 77f0c916ccf24e86b0ec29de1ba54b84 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.108978 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:48.108475 29110 log.cc:1196] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/a3079a68c1c74b64bf13877bd0ee68c3
I20260810 11:30:48.110786 29110 ts_tablet_manager.cc:1939] T a3079a68c1c74b64bf13877bd0ee68c3 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:48.111616 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:48.112239 29110 tablet_replica.cc:330] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:48.112488 29110 raft_consensus.cc:2229] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:48.112758 29110 raft_consensus.cc:2258] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:48.113396 29110 ts_tablet_manager.cc:1905] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:48.117897 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:48.119493 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:48.121797 26742 tablet_service.cc:1467] Processing CreateTablet for tablet acf778d6657c4071832ffeb5e0057aa6 (DEFAULT_TABLE table=default.Table_4d69a84b6d0a4ad787d4f64c289e1a03 [id=c8da88b7137b40c68037231d5810291e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.122309 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acf778d6657c4071832ffeb5e0057aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.122852 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:48.124969 27231 tablet_bootstrap.cc:492] T 77f0c916ccf24e86b0ec29de1ba54b84 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:48.125142 27231 ts_tablet_manager.cc:1397] T 77f0c916ccf24e86b0ec29de1ba54b84 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.001s
I20260810 11:30:48.125157 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:48.126168 27231 raft_consensus.cc:348] T 77f0c916ccf24e86b0ec29de1ba54b84 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.126415 27231 raft_consensus.cc:374] T 77f0c916ccf24e86b0ec29de1ba54b84 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.126500 27231 raft_consensus.cc:729] T 77f0c916ccf24e86b0ec29de1ba54b84 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.126729 27231 consensus_queue.cc:260] T 77f0c916ccf24e86b0ec29de1ba54b84 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.127336 27231 ts_tablet_manager.cc:1428] T 77f0c916ccf24e86b0ec29de1ba54b84 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 11:30:48.127673 27231 tablet_bootstrap.cc:492] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:48.128840 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:48.130203 27231 tablet_bootstrap.cc:654] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.130510 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bb078d7c0d0e4cf5aa841a802e78d8ff (table default.Table_eb5bb59579c043d7b1d98e60e42899af [id=65218ea1c77a4098a4f1145607695dbd]). Expected version 1 got 0
I20260810 11:30:48.133031 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:48.134284 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:48.136161 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:48.138863 27057 raft_consensus.cc:2454] T 932ac2ae54324e6e830291ed449a31a8 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:48.140368 29110 ts_tablet_manager.cc:1918] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:48.140746 29110 log.cc:1196] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/7de2d60cf87c48459e6663a68ac96714
I20260810 11:30:48.141484 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:48.142596 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:48.147006 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 34bd3c0edf6b49d1891c0ee9af344872 (table default.Table_92fc349e41184823a7fe2bab5c946f0c [id=18fc89ba8e7e4a97a04dd030c340a95f]) successfully deleted
I20260810 11:30:48.150655 26702 leader_election.cc:302] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:48.151088 29453 raft_consensus.cc:2781] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:48.151353 29453 raft_consensus.cc:686] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:48.151639 29453 consensus_queue.cc:237] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:48.154186 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 809b5b6b65d244cd9186517e39494839 because the tablet was not found. No further retry: Not found: Tablet not found: 809b5b6b65d244cd9186517e39494839
I20260810 11:30:48.154150 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_5256d55e5aee47ee88a92177e8df8577 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 3 got 2
W20260810 11:30:48.154692 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 8b303be24f4e46d0b966e8191d76297b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b303be24f4e46d0b966e8191d76297b already in progress: creating tablet
I20260810 11:30:48.156904 29110 ts_tablet_manager.cc:1939] T 7de2d60cf87c48459e6663a68ac96714 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:48.157285 26742 tablet_service.cc:1467] Processing CreateTablet for tablet dde20950e02e4d2aab61bfabb3f41047 (DEFAULT_TABLE table=default.Table_b2f434005a0c4715ba99f1f42e2d3eb0 [id=3302549286bf44fdb3e615ce85fd48e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.157879 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dde20950e02e4d2aab61bfabb3f41047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.158242 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:48.160609 27231 tablet_bootstrap.cc:492] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:48.160866 27231 ts_tablet_manager.cc:1397] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.000s
I20260810 11:30:48.161727 29504 consensus_queue.cc:1035] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:48.162057 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:48.164155 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:48.164861 26702 leader_election.cc:302] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:48.165285 29504 raft_consensus.cc:2781] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:48.165398 29504 raft_consensus.cc:686] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:48.165614 29504 consensus_queue.cc:237] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:48.169462 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 34ed8c9efa634fc7b091b1bb6bc6d452 (table default.Table_3818fdea177c4bb589ab0e9ab54f7f51 [id=7c8348b49b664bee8d8243efb2cdbb79]). Expected version 1 got 0
I20260810 11:30:48.170672 27231 raft_consensus.cc:348] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.170926 27231 raft_consensus.cc:374] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.171000 27231 raft_consensus.cc:729] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.171226 27231 consensus_queue.cc:260] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.171578 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 92de54060803403a9f0b2321a2493819 (DEFAULT_TABLE table=default.Table_088cb7f1722b4e86bea3634c8a1083a8 [id=3ee2b059007f4e7faca3056a50e7b2cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.172029 27231 ts_tablet_manager.cc:1428] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260810 11:30:48.172075 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92de54060803403a9f0b2321a2493819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.172302 27231 tablet_bootstrap.cc:492] T a4dde1d1eef74911b20498149e8c1785 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:48.174541 27231 tablet_bootstrap.cc:654] T a4dde1d1eef74911b20498149e8c1785 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.175127 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
I20260810 11:30:48.176718 29523 raft_consensus.cc:482] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.176843 29523 raft_consensus.cc:504] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.177531 29523 leader_election.cc:288] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:48.182382 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 9216ea2238bd4cc2b3ec08ae938e5b0e (DEFAULT_TABLE table=default.Table_22bcc2f6dd5a4c26ab5b87185d38c2a9 [id=cc47121d5ec24323885dfc1808506dc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.183135 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9216ea2238bd4cc2b3ec08ae938e5b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.192195 26737 tablet_service.cc:1467] Processing CreateTablet for tablet b644b76c8e704ceeaaa52fa4d73a2253 (DEFAULT_TABLE table=default.Table_9e670ff36955464297406906c99a67f1 [id=7b7f0b566d5145be87542ea1315211c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.192874 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b644b76c8e704ceeaaa52fa4d73a2253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.194036 27231 tablet_bootstrap.cc:492] T a4dde1d1eef74911b20498149e8c1785 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:48.194169 27231 ts_tablet_manager.cc:1397] T a4dde1d1eef74911b20498149e8c1785 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20260810 11:30:48.195115 27231 raft_consensus.cc:348] T a4dde1d1eef74911b20498149e8c1785 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.195369 27231 raft_consensus.cc:374] T a4dde1d1eef74911b20498149e8c1785 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.195431 27231 raft_consensus.cc:729] T a4dde1d1eef74911b20498149e8c1785 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.195641 27231 consensus_queue.cc:260] T a4dde1d1eef74911b20498149e8c1785 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.196348 27231 ts_tablet_manager.cc:1428] T a4dde1d1eef74911b20498149e8c1785 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:48.196866 27231 tablet_bootstrap.cc:492] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:48.199801 27231 tablet_bootstrap.cc:654] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.202883 26732 tablet_service.cc:1467] Processing CreateTablet for tablet 2831163cd84d4dc0aec65c27873f3ad8 (DEFAULT_TABLE table=default.Table_3707854eb7e84012a34d64e31fc10636 [id=d1223f75705243248d015e5195603824]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.203177 26737 tablet_service.cc:1467] Processing CreateTablet for tablet f10ac7e043c240d8a14b2b4f96b864b9 (DEFAULT_TABLE table=default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.203428 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2831163cd84d4dc0aec65c27873f3ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.203778 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f10ac7e043c240d8a14b2b4f96b864b9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:48.204686 26565 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3853603eac544d769cef8cff9a008784 consensus state has no leader
I20260810 11:30:48.094848 26886 tablet_service.cc:1467] Processing CreateTablet for tablet dde20950e02e4d2aab61bfabb3f41047 (DEFAULT_TABLE table=default.Table_b2f434005a0c4715ba99f1f42e2d3eb0 [id=3302549286bf44fdb3e615ce85fd48e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.213117 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dde20950e02e4d2aab61bfabb3f41047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.095340 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 92de54060803403a9f0b2321a2493819 (DEFAULT_TABLE table=default.Table_088cb7f1722b4e86bea3634c8a1083a8 [id=3ee2b059007f4e7faca3056a50e7b2cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.217152 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92de54060803403a9f0b2321a2493819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.095345 26894 tablet_service.cc:1467] Processing CreateTablet for tablet b644b76c8e704ceeaaa52fa4d73a2253 (DEFAULT_TABLE table=default.Table_9e670ff36955464297406906c99a67f1 [id=7b7f0b566d5145be87542ea1315211c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.222018 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b644b76c8e704ceeaaa52fa4d73a2253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.095716 26893 tablet_service.cc:1467] Processing CreateTablet for tablet 9216ea2238bd4cc2b3ec08ae938e5b0e (DEFAULT_TABLE table=default.Table_22bcc2f6dd5a4c26ab5b87185d38c2a9 [id=cc47121d5ec24323885dfc1808506dc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.225147 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9216ea2238bd4cc2b3ec08ae938e5b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.228025 27231 tablet_bootstrap.cc:492] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:48.228191 27231 ts_tablet_manager.cc:1397] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.002s
I20260810 11:30:48.096005 26881 tablet_service.cc:1467] Processing CreateTablet for tablet f10ac7e043c240d8a14b2b4f96b864b9 (DEFAULT_TABLE table=default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.096280 26885 tablet_service.cc:1467] Processing CreateTablet for tablet 2831163cd84d4dc0aec65c27873f3ad8 (DEFAULT_TABLE table=default.Table_3707854eb7e84012a34d64e31fc10636 [id=d1223f75705243248d015e5195603824]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.229162 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f10ac7e043c240d8a14b2b4f96b864b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.229452 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2831163cd84d4dc0aec65c27873f3ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.094486 26895 tablet_service.cc:1467] Processing CreateTablet for tablet acf778d6657c4071832ffeb5e0057aa6 (DEFAULT_TABLE table=default.Table_4d69a84b6d0a4ad787d4f64c289e1a03 [id=c8da88b7137b40c68037231d5810291e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.235002 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acf778d6657c4071832ffeb5e0057aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.115567 26913 raft_consensus.cc:3037] T ab2471d06e0841e7bebae4ca1865618c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:48.237068 27231 raft_consensus.cc:348] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.237293 27231 raft_consensus.cc:374] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.237411 27231 raft_consensus.cc:729] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.237591 27231 consensus_queue.cc:260] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.238549 27231 ts_tablet_manager.cc:1428] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260810 11:30:48.238818 27231 tablet_bootstrap.cc:492] T a74acd5078ec4a45987d68a1e4d138b9 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:48.170320 29491 raft_consensus.cc:482] T 65756c37fe514194bebe76921419653c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.239871 29491 raft_consensus.cc:504] T 65756c37fe514194bebe76921419653c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:48.240715 29491 leader_election.cc:288] T 65756c37fe514194bebe76921419653c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:48.178372 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d91cb30457a74d51885ad81c4ab89d71" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:48.241406 27231 tablet_bootstrap.cc:654] T a74acd5078ec4a45987d68a1e4d138b9 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:48.245604 26991 leader_election.cc:341] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:48.259240 27231 tablet_bootstrap.cc:492] T a74acd5078ec4a45987d68a1e4d138b9 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:48.259418 27231 ts_tablet_manager.cc:1397] T a74acd5078ec4a45987d68a1e4d138b9 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20260810 11:30:48.260371 27231 raft_consensus.cc:348] T a74acd5078ec4a45987d68a1e4d138b9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.260711 27231 raft_consensus.cc:374] T a74acd5078ec4a45987d68a1e4d138b9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.260785 27231 raft_consensus.cc:729] T a74acd5078ec4a45987d68a1e4d138b9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.260980 27231 consensus_queue.cc:260] T a74acd5078ec4a45987d68a1e4d138b9 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.261816 27231 ts_tablet_manager.cc:1428] T a74acd5078ec4a45987d68a1e4d138b9 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 11:30:48.262115 27231 tablet_bootstrap.cc:492] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:48.265638 27231 tablet_bootstrap.cc:654] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.268631 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65756c37fe514194bebe76921419653c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:48.283802 27231 tablet_bootstrap.cc:492] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:48.283973 27231 ts_tablet_manager.cc:1397] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.002s
I20260810 11:30:48.284914 27231 raft_consensus.cc:348] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.285269 27231 raft_consensus.cc:374] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.285336 27231 raft_consensus.cc:729] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.285593 27231 consensus_queue.cc:260] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.286293 27231 ts_tablet_manager.cc:1428] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 11:30:48.286592 27231 tablet_bootstrap.cc:492] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:48.092124 29500 rpcz_store.cc:276] 0810 11:30:47.063523 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.071846 (+ 8323us) service_pool.cc:227] Handling call
0810 11:30:48.091864 (+1020018us) ts_tablet_manager.cc:1145] Deleting tablet 7c203cd90d2f472fa27cfabed5b87119
0810 11:30:48.091873 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:48.091964 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1019513}
I20260810 11:30:48.291447 28987 ts_tablet_manager.cc:1918] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:48.292248 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 229) took 1187 ms. Trace:
I20260810 11:30:48.293722 27231 tablet_bootstrap.cc:654] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.296301 29455 raft_consensus.cc:482] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.296540 29455 raft_consensus.cc:504] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.297221 29455 leader_election.cc:288] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:48.293884 26849 consensus_peers.cc:487] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:48.305124 26914 raft_consensus.cc:3037] T 65756c37fe514194bebe76921419653c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:48.298097 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6395bce17ee40c2822669246ce7eb42" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:48.310844 26991 leader_election.cc:341] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:48.321735 29500 rpcz_store.cc:276] 0810 11:30:47.105312 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.105684 (+ 372us) service_pool.cc:227] Handling call
0810 11:30:48.292018 (+1186334us) ts_tablet_manager.cc:1145] Deleting tablet 0cc17c55109b47eeb91920c3ed8178e0
0810 11:30:48.292049 (+ 31us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:48.292224 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1143965}
I20260810 11:30:48.323379 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 230) took 1217 ms. Trace:
I20260810 11:30:48.323638 29500 rpcz_store.cc:276] 0810 11:30:47.105484 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.105980 (+ 496us) service_pool.cc:227] Handling call
0810 11:30:48.322391 (+1216411us) ts_tablet_manager.cc:1145] Deleting tablet b945cb22353f4d99a3836e3c0b8e26e3
0810 11:30:48.322411 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:48.323345 (+ 934us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1174117}
I20260810 11:30:48.324214 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 231) took 1218 ms. Trace:
I20260810 11:30:48.324525 29500 rpcz_store.cc:276] 0810 11:30:47.105626 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.106502 (+ 876us) service_pool.cc:227] Handling call
0810 11:30:48.324065 (+1217563us) ts_tablet_manager.cc:1145] Deleting tablet 78633fbe048b4534ae3277ce6b7c4313
0810 11:30:48.324080 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:48.324196 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1175740}
I20260810 11:30:48.324923 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 232) took 1217 ms. Trace:
I20260810 11:30:48.325044 29500 rpcz_store.cc:276] 0810 11:30:47.107014 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.107076 (+ 62us) service_pool.cc:227] Handling call
0810 11:30:48.324820 (+1217744us) ts_tablet_manager.cc:1145] Deleting tablet 518c777e40ec40dcb3484c0374384959
0810 11:30:48.324829 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:48.324910 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1176447}
I20260810 11:30:48.325362 29500 tablet_replica.cc:330] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:48.325699 29500 raft_consensus.cc:2229] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:48.327250 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7c203cd90d2f472fa27cfabed5b87119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c203cd90d2f472fa27cfabed5b87119 already in progress: creating tablet
W20260810 11:30:48.327986 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 0cc17c55109b47eeb91920c3ed8178e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0cc17c55109b47eeb91920c3ed8178e0 already in progress: creating tablet
W20260810 11:30:48.328639 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet b945cb22353f4d99a3836e3c0b8e26e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b945cb22353f4d99a3836e3c0b8e26e3 already in progress: creating tablet
W20260810 11:30:48.329262 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 78633fbe048b4534ae3277ce6b7c4313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78633fbe048b4534ae3277ce6b7c4313 already in progress: creating tablet
W20260810 11:30:48.329905 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 518c777e40ec40dcb3484c0374384959 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 518c777e40ec40dcb3484c0374384959 already in progress: creating tablet
I20260810 11:30:48.336009 29455 raft_consensus.cc:482] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.336159 29455 raft_consensus.cc:504] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.336815 29455 leader_election.cc:288] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:48.339625 28987 log.cc:1196] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/6dc4fd6ca8a541f99eed57a6f51c1f0a
I20260810 11:30:48.340283 28987 ts_tablet_manager.cc:1939] T 6dc4fd6ca8a541f99eed57a6f51c1f0a P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:48.341357 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 158) took 4407 ms. Trace:
I20260810 11:30:48.341557 28987 rpcz_store.cc:276] 0810 11:30:43.933874 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:43.933928 (+ 54us) service_pool.cc:227] Handling call
0810 11:30:47.850090 (+3916162us) ts_tablet_manager.cc:1145] Deleting tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a
0810 11:30:47.850103 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:47.945916 (+ 95813us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:48.291330 (+345414us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:48.341334 (+ 50004us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3915976}
I20260810 11:30:48.342080 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 168) took 3574 ms. Trace:
I20260810 11:30:48.342232 28987 rpcz_store.cc:276] 0810 11:30:44.767359 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.767434 (+ 75us) service_pool.cc:227] Handling call
0810 11:30:48.341951 (+3574517us) ts_tablet_manager.cc:1145] Deleting tablet e69916a35fba4714bbc565921738888f
0810 11:30:48.341962 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:48.342065 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3354657}
I20260810 11:30:48.345089 27231 tablet_bootstrap.cc:492] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:48.345257 27231 ts_tablet_manager.cc:1397] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.059s user 0.009s sys 0.012s
I20260810 11:30:48.346161 27231 raft_consensus.cc:348] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.346438 27231 raft_consensus.cc:374] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.346501 27231 raft_consensus.cc:729] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.346731 27231 consensus_queue.cc:260] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.347344 27231 ts_tablet_manager.cc:1428] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:48.347697 27231 tablet_bootstrap.cc:492] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:48.350929 27231 tablet_bootstrap.cc:654] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.366801 27231 tablet_bootstrap.cc:492] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:48.366957 27231 ts_tablet_manager.cc:1397] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.004s
I20260810 11:30:48.364894 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:48.367853 27231 raft_consensus.cc:348] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.368099 27231 raft_consensus.cc:374] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.368168 27231 raft_consensus.cc:729] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.368429 27231 consensus_queue.cc:260] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.369313 27231 ts_tablet_manager.cc:1428] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 11:30:48.369626 27231 tablet_bootstrap.cc:492] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:48.369766 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:48.371538 27231 tablet_bootstrap.cc:654] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.376034 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:48.380605 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f (table default.Table_11e3ca2d0589464586b01e41dcd46bbf [id=d63533f5d837481889b34a78d860e018]). Expected version 1 got 0
I20260810 11:30:48.383105 26575 catalog_manager.cc:5495] T e25557126afd4f51a31fba73cd7da219 P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482e605580be48cbbacce05a3e61c215 (127.25.195.195). New cstate: current_term: 1 leader_uuid: "482e605580be48cbbacce05a3e61c215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:48.389978 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 88268e3571884ac88c1a617ce74499f3 (table default.Table_cb8549bfe5344b95b2c81538365c371b [id=0f9e142b43214fa8b2e362c54fabcb42]). Expected version 1 got 0
I20260810 11:30:48.331256 26889 tablet_service.cc:1467] Processing CreateTablet for tablet c4893ce946234cabbef099a24188b271 (DEFAULT_TABLE table=default.Table_11e70bfc5ca54f1a936d021d01489aab [id=fa5b25ba3c0643b1824fedb370bb097d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.337457 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8400c601e9894ea9b68679f6d7927456" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:48.346082 26886 tablet_service.cc:1467] Processing CreateTablet for tablet 4d2b1f33d244485a8fa2a72990f55a4d (DEFAULT_TABLE table=default.Table_9ed8857b66f14b79bb46c9d6cfebf6d5 [id=a2420406bc2643b2b15d942ab766612d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.395493 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d2b1f33d244485a8fa2a72990f55a4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.394982 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
I20260810 11:30:48.396858 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:48.401024 26888 tablet_service.cc:1467] Processing CreateTablet for tablet 72fd344dfcb84dfba89f7a9f446d814f (DEFAULT_TABLE table=default.Table_bd5713e68e4a473a9fc231c709826f99 [id=8346a2ee684b4a269c682ccc63b695e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.401629 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72fd344dfcb84dfba89f7a9f446d814f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:48.402222 26991 leader_election.cc:341] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:48.348621 26885 tablet_service.cc:1467] Processing CreateTablet for tablet b98aeb11beb54cf0a9829b715ad96d0f (DEFAULT_TABLE table=default.Table_4261c2bc06f04178ba9e115ead9a1aa8 [id=9410dc6b3fbc49b4b4f87eec32c4f420]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.355697 29297 raft_consensus.cc:482] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.404783 29297 raft_consensus.cc:504] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:48.405433 29297 leader_election.cc:288] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:48.406107 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b98aeb11beb54cf0a9829b715ad96d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.408492 27231 tablet_bootstrap.cc:492] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:48.408732 27231 ts_tablet_manager.cc:1397] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.006s
I20260810 11:30:48.363906 26893 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb94533e1304d5aa231f43f97ea78ae (DEFAULT_TABLE table=default.Table_a1f19ccbbd394c55ac00d3dcb8a4df54 [id=ec29df767a7242c594d5312d06c491bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.366155 26894 tablet_service.cc:1467] Processing CreateTablet for tablet aee359a81e4a400ab595e3f4aff01017 (DEFAULT_TABLE table=default.Table_5774e37bc1934d62a2ace70c0fa925a5 [id=eac902612a8e42008cafbc05bb64a87d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.409653 27231 raft_consensus.cc:348] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.409901 27231 raft_consensus.cc:374] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.409972 27231 raft_consensus.cc:729] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.410027 26893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb94533e1304d5aa231f43f97ea78ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.410256 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aee359a81e4a400ab595e3f4aff01017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.410301 27231 consensus_queue.cc:260] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.411006 27231 ts_tablet_manager.cc:1428] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 11:30:48.411439 27231 tablet_bootstrap.cc:492] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:48.413552 27231 tablet_bootstrap.cc:654] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.415674 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4893ce946234cabbef099a24188b271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.372599 26895 tablet_service.cc:1467] Processing CreateTablet for tablet a06912f8f924490cbd59e735ac7f1b6e (DEFAULT_TABLE table=default.Table_65a103c524ea4c9d826db90843b2309b [id=c45fdcc5f34241e882533226dfd86ead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.374608 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 8552c16e0ca545cc85b41abdbf3b9da4 (DEFAULT_TABLE table=default.Table_5fa102edf6ef4d4b966a0b16a0af0b55 [id=471dd5e043034129bf889e3e978a3001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.417019 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8552c16e0ca545cc85b41abdbf3b9da4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.385154 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 9bf01841b9d4412789b05ce207f6eb02 (DEFAULT_TABLE table=default.Table_8936d38c9e8e4ba9a4be8cc491e080dd [id=da71b19216b54d50b0793300e4ecaed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.388921 26891 tablet_service.cc:1467] Processing CreateTablet for tablet aad22a5dfacf4fb88a5493376915a70f (DEFAULT_TABLE table=default.Table_53285a0af75e4705982c23850f7b27e2 [id=d58840daecc84b789f04a35ca6cd8393]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.394457 26878 tablet_service.cc:1467] Processing CreateTablet for tablet f00b7a79c72d4184a05e04f45a9a4d68 (DEFAULT_TABLE table=default.Table_c2c7816a3119457c8c5fc9d76a404674 [id=7943d9432e88470e88416adbcbc7d2f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.421303 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bf01841b9d4412789b05ce207f6eb02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.435830 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a06912f8f924490cbd59e735ac7f1b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.440763 29500 raft_consensus.cc:2258] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:48.441737 29500 ts_tablet_manager.cc:1905] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:48.445621 28987 tablet_replica.cc:330] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:48.446012 28987 raft_consensus.cc:2229] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:48.446321 28987 raft_consensus.cc:2258] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:48.385963 29545 consensus_queue.cc:1035] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:48.449066 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:48.451149 26883 tablet_service.cc:1467] Processing CreateTablet for tablet baf4482d8acf4a9fa0c1bf11c383c5d9 (DEFAULT_TABLE table=default.Table_13da010706b445ef8049a259743a3c33 [id=cbc9040862f44f9f95b01859ba56f099]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.452278 26575 catalog_manager.cc:5495] T 1549a26ba0f6427fae87b204c5d49eff P 482e605580be48cbbacce05a3e61c215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } }
I20260810 11:30:48.459909 26886 tablet_service.cc:1467] Processing CreateTablet for tablet 63876fd00f4e4b37b3be54751d18b5db (DEFAULT_TABLE table=default.Table_c60b4d539f6a41fe9cdbb84740720a4c [id=27b1c16b43684e3393990ff957116553]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.462438 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bcc69e8f87134d25a1329be52b08e794 (table default.Table_4e93c67b823f48028820e1e95415e455 [id=b4c0c92ef07f432cbb00a36ecd17d394]). Expected version 1 got 0
I20260810 11:30:48.464846 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:48.466538 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:48.467658 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:48.468736 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
W20260810 11:30:48.389140 26700 consensus_peers.cc:487] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:48.409402 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ae27bf110114b70a3e3f6cf64f31b98" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:48.469965 26849 leader_election.cc:341] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:48.334121 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 169286us
I20260810 11:30:48.470468 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:48.473805 27231 tablet_bootstrap.cc:492] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:48.474035 27231 ts_tablet_manager.cc:1397] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.063s user 0.002s sys 0.019s
I20260810 11:30:48.475118 27231 raft_consensus.cc:348] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.475430 27231 raft_consensus.cc:374] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.475564 27231 raft_consensus.cc:729] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.475848 27231 consensus_queue.cc:260] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.472478 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:48.478739 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:48.479640 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:48.480409 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:48.481482 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:48.481881 27231 ts_tablet_manager.cc:1428] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260810 11:30:48.482419 27231 tablet_bootstrap.cc:492] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:48.482515 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:48.483820 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:48.484810 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:48.485618 27231 tablet_bootstrap.cc:654] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.486683 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bb078d7c0d0e4cf5aa841a802e78d8ff (table default.Table_eb5bb59579c043d7b1d98e60e42899af [id=65218ea1c77a4098a4f1145607695dbd]). Expected version 1 got 0
I20260810 11:30:48.488206 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:48.489013 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:48.490201 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c317ccebde05457d9e81c5c871638092 (table default.Table_8c0c1ab3bbb944c888930a5d8116d888 [id=7b4e4650915f4c16bef68adf43618b89]). Expected version 1 got 0
I20260810 11:30:48.491454 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:48.493803 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:48.496734 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:48.498117 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:48.501498 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 34ed8c9efa634fc7b091b1bb6bc6d452 (table default.Table_3818fdea177c4bb589ab0e9ab54f7f51 [id=7c8348b49b664bee8d8243efb2cdbb79]). Expected version 1 got 0
I20260810 11:30:48.502347 26575 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_5256d55e5aee47ee88a92177e8df8577 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 3 got 2
I20260810 11:30:48.506726 27231 tablet_bootstrap.cc:492] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:48.506975 27231 ts_tablet_manager.cc:1397] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.005s
I20260810 11:30:48.508365 27231 raft_consensus.cc:348] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.508749 27231 raft_consensus.cc:374] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.508874 27231 raft_consensus.cc:729] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.510846 27231 consensus_queue.cc:260] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.511866 27231 ts_tablet_manager.cc:1428] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 11:30:48.512662 27231 tablet_bootstrap.cc:492] T 997cff3351724953bd9c792085a38364 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
W20260810 11:30:48.517694 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 128585us
I20260810 11:30:48.521775 28987 ts_tablet_manager.cc:1905] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:48.523226 27231 tablet_bootstrap.cc:654] T 997cff3351724953bd9c792085a38364 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.553781 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]) successfully deleted
I20260810 11:30:48.554627 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
W20260810 11:30:48.555549 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet e69916a35fba4714bbc565921738888f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e69916a35fba4714bbc565921738888f already in progress: creating tablet
I20260810 11:30:48.555886 26572 catalog_manager.cc:5495] T ab2471d06e0841e7bebae4ca1865618c P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:48.557891 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:48.558617 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:48.559968 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:48.562078 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:48.564067 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 77ffda3325af4096bbec689397f7a324 (table default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad]). Expected version 1 got 0
I20260810 11:30:48.565479 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:48.567144 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:48.571035 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bcc69e8f87134d25a1329be52b08e794 (table default.Table_4e93c67b823f48028820e1e95415e455 [id=b4c0c92ef07f432cbb00a36ecd17d394]). Expected version 1 got 0
I20260810 11:30:48.572978 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_45c04b6c4bae413795c491f49f2b4bcd [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 1 got 0
I20260810 11:30:48.573846 29291 raft_consensus.cc:482] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.574034 29291 raft_consensus.cc:504] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.574679 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:48.574810 29291 leader_election.cc:288] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:48.575088 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:48.575987 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:48.577324 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:48.578138 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:48.579566 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:48.580428 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:48.581457 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:48.582072 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bb078d7c0d0e4cf5aa841a802e78d8ff (table default.Table_eb5bb59579c043d7b1d98e60e42899af [id=65218ea1c77a4098a4f1145607695dbd]). Expected version 1 got 0
I20260810 11:30:48.583086 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_f5076fbee07d4333a6bcc12bf0e319e1 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 1 got 0
I20260810 11:30:48.584456 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:48.585711 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:48.587133 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_5256d55e5aee47ee88a92177e8df8577 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 3 got 2
I20260810 11:30:48.587809 26906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c317ccebde05457d9e81c5c871638092" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:48.587893 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:48.588832 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
W20260810 11:30:48.589720 26991 leader_election.cc:341] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:48.589933 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baf4482d8acf4a9fa0c1bf11c383c5d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.600975 26891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aad22a5dfacf4fb88a5493376915a70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.605302 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f00b7a79c72d4184a05e04f45a9a4d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.612759 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63876fd00f4e4b37b3be54751d18b5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.622298 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c317ccebde05457d9e81c5c871638092 (table default.Table_8c0c1ab3bbb944c888930a5d8116d888 [id=7b4e4650915f4c16bef68adf43618b89]). Expected version 1 got 0
I20260810 11:30:48.623756 26732 tablet_service.cc:1467] Processing CreateTablet for tablet b98aeb11beb54cf0a9829b715ad96d0f (DEFAULT_TABLE table=default.Table_4261c2bc06f04178ba9e115ead9a1aa8 [id=9410dc6b3fbc49b4b4f87eec32c4f420]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.624347 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b98aeb11beb54cf0a9829b715ad96d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.625192 26741 tablet_service.cc:1467] Processing CreateTablet for tablet 8552c16e0ca545cc85b41abdbf3b9da4 (DEFAULT_TABLE table=default.Table_5fa102edf6ef4d4b966a0b16a0af0b55 [id=471dd5e043034129bf889e3e978a3001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.625308 26745 tablet_service.cc:1467] Processing CreateTablet for tablet 72fd344dfcb84dfba89f7a9f446d814f (DEFAULT_TABLE table=default.Table_bd5713e68e4a473a9fc231c709826f99 [id=8346a2ee684b4a269c682ccc63b695e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.625609 26741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8552c16e0ca545cc85b41abdbf3b9da4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.625857 26745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72fd344dfcb84dfba89f7a9f446d814f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.626125 26748 tablet_service.cc:1467] Processing CreateTablet for tablet 9bf01841b9d4412789b05ce207f6eb02 (DEFAULT_TABLE table=default.Table_8936d38c9e8e4ba9a4be8cc491e080dd [id=da71b19216b54d50b0793300e4ecaed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.626437 26748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bf01841b9d4412789b05ce207f6eb02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.624099 26572 catalog_manager.cc:5495] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:48.628705 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb94533e1304d5aa231f43f97ea78ae (DEFAULT_TABLE table=default.Table_a1f19ccbbd394c55ac00d3dcb8a4df54 [id=ec29df767a7242c594d5312d06c491bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.628773 29291 raft_consensus.cc:482] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.628826 26738 tablet_service.cc:1467] Processing CreateTablet for tablet f00b7a79c72d4184a05e04f45a9a4d68 (DEFAULT_TABLE table=default.Table_c2c7816a3119457c8c5fc9d76a404674 [id=7943d9432e88470e88416adbcbc7d2f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.629106 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb94533e1304d5aa231f43f97ea78ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.628935 29291 raft_consensus.cc:504] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.629688 29291 leader_election.cc:288] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:48.630715 26738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f00b7a79c72d4184a05e04f45a9a4d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.632861 26730 tablet_service.cc:1467] Processing CreateTablet for tablet aee359a81e4a400ab595e3f4aff01017 (DEFAULT_TABLE table=default.Table_5774e37bc1934d62a2ace70c0fa925a5 [id=eac902612a8e42008cafbc05bb64a87d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.633260 26730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aee359a81e4a400ab595e3f4aff01017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.634220 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a2e1b54043444989ac64c87f30ffc07" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:48.635015 26991 leader_election.cc:341] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:48.636837 29291 raft_consensus.cc:482] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.636890 26746 tablet_service.cc:1467] Processing CreateTablet for tablet aad22a5dfacf4fb88a5493376915a70f (DEFAULT_TABLE table=default.Table_53285a0af75e4705982c23850f7b27e2 [id=d58840daecc84b789f04a35ca6cd8393]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.636979 29291 raft_consensus.cc:504] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.637288 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aad22a5dfacf4fb88a5493376915a70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.637669 29291 leader_election.cc:288] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:48.638414 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:48.638967 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa14fea852c24cd7bb3d57094af2e178" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:48.639747 26991 leader_election.cc:341] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:48.640348 26742 tablet_service.cc:1467] Processing CreateTablet for tablet c4893ce946234cabbef099a24188b271 (DEFAULT_TABLE table=default.Table_11e70bfc5ca54f1a936d021d01489aab [id=fa5b25ba3c0643b1824fedb370bb097d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.640889 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 4d2b1f33d244485a8fa2a72990f55a4d (DEFAULT_TABLE table=default.Table_9ed8857b66f14b79bb46c9d6cfebf6d5 [id=a2420406bc2643b2b15d942ab766612d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.641343 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d2b1f33d244485a8fa2a72990f55a4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.640668 26572 catalog_manager.cc:5495] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:48.623821 26743 tablet_service.cc:1467] Processing CreateTablet for tablet a06912f8f924490cbd59e735ac7f1b6e (DEFAULT_TABLE table=default.Table_65a103c524ea4c9d826db90843b2309b [id=c45fdcc5f34241e882533226dfd86ead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.643409 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a06912f8f924490cbd59e735ac7f1b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.642984 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:48.644767 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 34ed8c9efa634fc7b091b1bb6bc6d452 (table default.Table_3818fdea177c4bb589ab0e9ab54f7f51 [id=7c8348b49b664bee8d8243efb2cdbb79]). Expected version 1 got 0
I20260810 11:30:48.646062 29291 raft_consensus.cc:482] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.646237 29291 raft_consensus.cc:504] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.646842 29291 leader_election.cc:288] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:48.647723 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67364e1082184aad82a85c3fda850a26" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:48.648648 26991 leader_election.cc:341] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:48.649523 27110 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:48.650590 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f (table default.Table_11e3ca2d0589464586b01e41dcd46bbf [id=d63533f5d837481889b34a78d860e018]). Expected version 1 got 0
I20260810 11:30:48.651655 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 88268e3571884ac88c1a617ce74499f3 (table default.Table_cb8549bfe5344b95b2c81538365c371b [id=0f9e142b43214fa8b2e362c54fabcb42]). Expected version 1 got 0
I20260810 11:30:48.652822 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
I20260810 11:30:48.653808 26576 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 0f048b690d764c83a4a9ce4cbadc75b0
I20260810 11:30:48.654770 26576 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_f5076fbee07d4333a6bcc12bf0e319e1" } new_table_name: "default.Table_b472377e613b4475b7a0b58062d44535" modify_external_catalogs: true
I20260810 11:30:48.659169 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f048b690d764c83a4a9ce4cbadc75b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:48.659353 26573 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 7d3e78dcaa55491393f529ea33007786
I20260810 11:30:48.660339 26573 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_953e0e00bdb74f3f97940590ea5eb471"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:48.661238 26573 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_953e0e00bdb74f3f97940590ea5eb471 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:48.667070 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3e78dcaa55491393f529ea33007786 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:48.669544 26580 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 501defb075d142ec8b22e5e8236a009c consensus state has no leader
I20260810 11:30:48.670020 26580 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_53285a0af75e4705982c23850f7b27e2" } modify_external_catalogs: true
I20260810 11:30:48.670279 26580 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_53285a0af75e4705982c23850f7b27e2" } modify_external_catalogs: true
I20260810 11:30:48.576351 27228 consensus_queue.cc:260] T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:48.671041 29297 raft_consensus.cc:482] T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.671196 29297 raft_consensus.cc:504] T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:48.671559 27228 ts_tablet_manager.cc:1428] T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.928s user 0.018s sys 0.002s
W20260810 11:30:48.671655 27228 ts_tablet_manager.cc:1460] T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700: Tablet startup took 928ms
I20260810 11:30:48.671984 29297 leader_election.cc:288] T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:48.672451 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25557126afd4f51a31fba73cd7da219" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:48.673441 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4893ce946234cabbef099a24188b271. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:48.645931 26702 consensus_peers.cc:487] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4efa31ad2ce8436b9638e6759d9b5421. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:48.686094 26573 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_835cdd4f3794466d808449e2e17bb15a" } new_table_name: "default.Table_2f179aff28124223a1c8ae3280a497e7" modify_external_catalogs: true
I20260810 11:30:48.691773 26574 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_eb5718a38c5c40bb81705b1a1e420f90 [id=7d0dd215c30648438a460f730b0b7ba4] alter complete (version 1)
W20260810 11:30:48.696147 26577 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f756689d4c99489885a0cd59f84a6e8a consensus state has no leader
I20260810 11:30:48.696835 26577 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_72f950492bf04491b56e4f549a6fbc7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:48.697551 26577 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72f950492bf04491b56e4f549a6fbc7c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:48.671732 27228 ts_tablet_manager.cc:1462] T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700: Trace:
0810 11:30:20.477996 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:20.482136 (+ 4140us) service_pool.cc:227] Handling call
0810 11:30:20.483423 (+ 1287us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0810 11:30:20.483445 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0810 11:30:20.699745 (+216300us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:20.909933 (+210188us) tablet_replica.cc:205] Creating consensus instance
0810 11:30:20.914230 (+ 4297us) inbound_call.cc:173] Queueing success response
0810 11:30:47.511492 (+26597262us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0810 11:30:47.743213 (+231721us) ts_tablet_manager.cc:1429] Starting tablet replica
0810 11:30:47.743412 (+ 199us) tablet_replica.cc:259] Starting instrumentation
0810 11:30:47.743560 (+ 148us) tablet_replica.cc:278] Starting consensus
Metrics: {"raft.queue_time_us":48,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":50,"tablet-open.queue_time_us":26601409}
I20260810 11:30:48.710887 26577 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_469900e2defd4246b2377d3bbfde772b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:48.711513 27228 tablet_bootstrap.cc:492] T 932ac2ae54324e6e830291ed449a31a8 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
W20260810 11:30:48.713847 26577 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_469900e2defd4246b2377d3bbfde772b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:48.717839 26730 tablet_service.cc:1467] Processing CreateTablet for tablet 63876fd00f4e4b37b3be54751d18b5db (DEFAULT_TABLE table=default.Table_c60b4d539f6a41fe9cdbb84740720a4c [id=27b1c16b43684e3393990ff957116553]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.718340 26730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63876fd00f4e4b37b3be54751d18b5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.721985 26737 tablet_service.cc:1467] Processing CreateTablet for tablet baf4482d8acf4a9fa0c1bf11c383c5d9 (DEFAULT_TABLE table=default.Table_13da010706b445ef8049a259743a3c33 [id=cbc9040862f44f9f95b01859ba56f099]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.722424 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baf4482d8acf4a9fa0c1bf11c383c5d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.724704 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f048b690d764c83a4a9ce4cbadc75b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:48.724951 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3e78dcaa55491393f529ea33007786 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:48.733201 26577 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_5b3952f643634a688f9b0f31ace9abad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:48.734918 26577 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b3952f643634a688f9b0f31ace9abad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:48.735379 26573 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_4599bffe2f15468e91c9d72f1fe41664"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:48.739765 26573 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4599bffe2f15468e91c9d72f1fe41664 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:48.740954 26571 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 983916da755d4d14b7a3d43bb7cbc9c4
I20260810 11:30:48.741925 26571 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_0a206cdd3ffc4e8d9bb7a3c62448d021"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:48.742549 26571 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a206cdd3ffc4e8d9bb7a3c62448d021 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:48.745627 26541 master_runner.cc:186] Error getting master registration for 127.25.195.253:34547: OK, instance_id { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" instance_seqno: 1786361445417532 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 11:30:48.745945 26541 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 11:30:48.746345 26580 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet aad22a5dfacf4fb88a5493376915a70f
I20260810 11:30:48.747141 26580 master_service.cc:946] ReplaceTablet: received request to replace tablet 9079c8fec89043be9d0040a3728e93f4 from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:48.748693 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet aad22a5dfacf4fb88a5493376915a70f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:48 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:48.749236 26578 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet eed0e2bead85466ca99cfb34e155a391
I20260810 11:30:48.750085 26578 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_0f3a9b21c8a643ef9f75384b9bc32c0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:48.750680 26578 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f3a9b21c8a643ef9f75384b9bc32c0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:48.751698 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet eed0e2bead85466ca99cfb34e155a391 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:48.753885 26581 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d91cb30457a74d51885ad81c4ab89d71 consensus state has no leader
I20260810 11:30:48.754392 26581 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_a82af0b403284841a1f2697487809b6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:48.754863 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 983916da755d4d14b7a3d43bb7cbc9c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:48.755033 26581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a82af0b403284841a1f2697487809b6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:48.756950 27228 tablet_bootstrap.cc:654] T 932ac2ae54324e6e830291ed449a31a8 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.762815 27231 tablet_bootstrap.cc:492] T 997cff3351724953bd9c792085a38364 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:48.763412 27231 ts_tablet_manager.cc:1397] T 997cff3351724953bd9c792085a38364 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.251s user 0.021s sys 0.033s
I20260810 11:30:48.764200 27231 raft_consensus.cc:348] T 997cff3351724953bd9c792085a38364 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.764444 27231 raft_consensus.cc:374] T 997cff3351724953bd9c792085a38364 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.764508 27231 raft_consensus.cc:729] T 997cff3351724953bd9c792085a38364 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.764765 27231 consensus_queue.cc:260] T 997cff3351724953bd9c792085a38364 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.765448 27231 ts_tablet_manager.cc:1428] T 997cff3351724953bd9c792085a38364 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:48.769387 29291 raft_consensus.cc:482] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.769626 29291 raft_consensus.cc:504] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.770876 29291 leader_election.cc:288] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:48.771451 29504 consensus_queue.cc:1035] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:48.776473 29291 raft_consensus.cc:482] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.776788 29291 raft_consensus.cc:504] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.778252 29291 leader_election.cc:288] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:48.779151 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba9d15002e6a40f58a7be07f46e7c328" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:48.779870 26991 leader_election.cc:341] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:48.780457 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98de7ce411bb4b54ada2df3b78b72190" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:48.781268 26991 leader_election.cc:341] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:48.782133 26576 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c8c9267e2da64738b5f7550c83b7c4a3 consensus state has no leader
I20260810 11:30:48.784996 29500 ts_tablet_manager.cc:1918] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:48.785148 29500 log.cc:1196] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/43fee1a9a6f9482fbbe6ab6599c27fb9
I20260810 11:30:48.785593 29500 ts_tablet_manager.cc:1939] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:48.785956 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 234) took 1677 ms. Trace:
I20260810 11:30:48.789273 26963 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:48.789975 26581 master_service.cc:946] ReplaceTablet: received request to replace tablet 524c8d37d3964e368695d182883b0bd5 from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:48.815950 26912 raft_consensus.cc:3037] T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:48.818614 29291 raft_consensus.cc:482] T a4dde1d1eef74911b20498149e8c1785 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.818897 29291 raft_consensus.cc:504] T a4dde1d1eef74911b20498149e8c1785 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.820393 29291 leader_election.cc:288] T a4dde1d1eef74911b20498149e8c1785 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:48.820796 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4dde1d1eef74911b20498149e8c1785" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:48.821563 26991 leader_election.cc:341] T a4dde1d1eef74911b20498149e8c1785 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:48.829949 29588 tablet.cc:1722] T 9744f59d7e49430e91080f56f3342038 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:48.831388 26571 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_47ef7b42b8a14c619ad78d5defe4c1eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:48.832381 26571 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47ef7b42b8a14c619ad78d5defe4c1eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:48.834713 26578 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_1519414c16b6493f85660469d93e8871"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:48.835485 26578 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1519414c16b6493f85660469d93e8871 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:48.835536 27222 tablet_bootstrap.cc:492] T 859477ecf37240a4888542d2559f99cd P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:48.835737 27222 ts_tablet_manager.cc:1397] T 859477ecf37240a4888542d2559f99cd P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 1.576s user 0.028s sys 0.008s
I20260810 11:30:48.836702 27222 raft_consensus.cc:348] T 859477ecf37240a4888542d2559f99cd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:48.837071 27222 raft_consensus.cc:374] T 859477ecf37240a4888542d2559f99cd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.837168 27222 raft_consensus.cc:729] T 859477ecf37240a4888542d2559f99cd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.837435 27222 consensus_queue.cc:260] T 859477ecf37240a4888542d2559f99cd P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:48.838855 27222 ts_tablet_manager.cc:1428] T 859477ecf37240a4888542d2559f99cd P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:48.840119 27231 tablet_bootstrap.cc:492] T b6eb6dc4b6f34e598933853717b86866 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:48.845754 27228 tablet_bootstrap.cc:492] T 932ac2ae54324e6e830291ed449a31a8 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:48.845947 27228 ts_tablet_manager.cc:1397] T 932ac2ae54324e6e830291ed449a31a8 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.135s user 0.002s sys 0.001s
I20260810 11:30:48.846910 27228 raft_consensus.cc:348] T 932ac2ae54324e6e830291ed449a31a8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:48.847230 27228 raft_consensus.cc:374] T 932ac2ae54324e6e830291ed449a31a8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.847323 27228 raft_consensus.cc:729] T 932ac2ae54324e6e830291ed449a31a8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.847921 27228 consensus_queue.cc:260] T 932ac2ae54324e6e830291ed449a31a8 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:48.849534 27228 ts_tablet_manager.cc:1428] T 932ac2ae54324e6e830291ed449a31a8 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260810 11:30:48.850579 27231 tablet_bootstrap.cc:654] T b6eb6dc4b6f34e598933853717b86866 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.865176 29291 raft_consensus.cc:482] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.865384 29291 raft_consensus.cc:504] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.867344 27222 tablet_bootstrap.cc:492] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:48.869019 27222 tablet_bootstrap.cc:654] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.857056 29587 tablet.cc:1722] T 9744f59d7e49430e91080f56f3342038 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:48.870265 27228 tablet_bootstrap.cc:492] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:48.874106 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 34bd3c0edf6b49d1891c0ee9af344872 (table default.Table_92fc349e41184823a7fe2bab5c946f0c [id=18fc89ba8e7e4a97a04dd030c340a95f]) successfully deleted
I20260810 11:30:48.873905 26848 leader_election.cc:302] T ab2471d06e0841e7bebae4ca1865618c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
W20260810 11:30:48.874507 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet ea66da5bc20e4718901ffc473677421c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea66da5bc20e4718901ffc473677421c already in progress: creating tablet
I20260810 11:30:48.874634 29297 raft_consensus.cc:2726] T ab2471d06e0841e7bebae4ca1865618c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:48.874907 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7d3406f12d9c492cbd0d86fa7a57de82 because the tablet was not found. No further retry: Not found: Tablet not found: 7d3406f12d9c492cbd0d86fa7a57de82
W20260810 11:30:48.875217 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 49db12565dbc4187b78a98ed35c40fed because the tablet was not found. No further retry: Not found: Tablet not found: 49db12565dbc4187b78a98ed35c40fed
W20260810 11:30:48.875716 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 809b5b6b65d244cd9186517e39494839 because the tablet was not found. No further retry: Not found: Tablet not found: 809b5b6b65d244cd9186517e39494839
W20260810 11:30:48.876029 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7c203cd90d2f472fa27cfabed5b87119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c203cd90d2f472fa27cfabed5b87119 already in progress: creating tablet
W20260810 11:30:48.876379 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 0cc17c55109b47eeb91920c3ed8178e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0cc17c55109b47eeb91920c3ed8178e0 already in progress: creating tablet
W20260810 11:30:48.878507 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 110b5acc36bd4d6bba13735e5daec75f because the tablet was not found. No further retry: Not found: Tablet not found: 110b5acc36bd4d6bba13735e5daec75f
W20260810 11:30:48.878970 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 518c777e40ec40dcb3484c0374384959 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 518c777e40ec40dcb3484c0374384959 already in progress: creating tablet
I20260810 11:30:48.879590 27228 tablet_bootstrap.cc:654] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:48.839443 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 68061.9us
I20260810 11:30:48.847704 29504 raft_consensus.cc:482] T 859477ecf37240a4888542d2559f99cd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.882313 29504 raft_consensus.cc:504] T 859477ecf37240a4888542d2559f99cd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:48.888180 29504 leader_election.cc:288] T 859477ecf37240a4888542d2559f99cd P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:48.890499 27048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859477ecf37240a4888542d2559f99cd" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:48.891098 27048 raft_consensus.cc:2379] T 859477ecf37240a4888542d2559f99cd P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate b6079090b1124d84aa4477974bb53700 in this term.
I20260810 11:30:48.786044 29500 rpcz_store.cc:276] 0810 11:30:47.108154 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.108209 (+ 55us) service_pool.cc:227] Handling call
0810 11:30:48.325318 (+1217109us) ts_tablet_manager.cc:1145] Deleting tablet 43fee1a9a6f9482fbbe6ab6599c27fb9
0810 11:30:48.325328 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:48.712940 (+387612us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:48.784877 (+ 71937us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:48.785937 (+ 1060us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1176861}
I20260810 11:30:48.896436 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 (table default.Table_340e7b53369c44cda0cb60ddbb328ccc [id=7861512191c341b9a85c6a1885a52ca7]) successfully deleted
I20260810 11:30:48.897364 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 235) took 1788 ms. Trace:
I20260810 11:30:48.916781 29455 raft_consensus.cc:482] T 77f0c916ccf24e86b0ec29de1ba54b84 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.916991 29455 raft_consensus.cc:504] T 77f0c916ccf24e86b0ec29de1ba54b84 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.917624 29455 leader_election.cc:288] T 77f0c916ccf24e86b0ec29de1ba54b84 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:48.919126 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77f0c916ccf24e86b0ec29de1ba54b84" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:48.919945 26991 leader_election.cc:341] T 77f0c916ccf24e86b0ec29de1ba54b84 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:48.858879 28987 ts_tablet_manager.cc:1918] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:48.921227 28987 log.cc:1196] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/d4873fe8318040a2b7e021708a875f43
I20260810 11:30:48.922251 29291 leader_election.cc:288] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:48.922385 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859477ecf37240a4888542d2559f99cd" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:48.922660 29455 raft_consensus.cc:482] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:48.922806 29455 raft_consensus.cc:504] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.923105 27231 tablet_bootstrap.cc:492] T b6eb6dc4b6f34e598933853717b86866 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:48.923223 27231 ts_tablet_manager.cc:1397] T b6eb6dc4b6f34e598933853717b86866 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.083s user 0.007s sys 0.003s
I20260810 11:30:48.923424 29455 leader_election.cc:288] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:48.923874 27231 raft_consensus.cc:348] T b6eb6dc4b6f34e598933853717b86866 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.924074 27231 raft_consensus.cc:374] T b6eb6dc4b6f34e598933853717b86866 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.924127 27231 raft_consensus.cc:729] T b6eb6dc4b6f34e598933853717b86866 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.897645 29500 rpcz_store.cc:276] 0810 11:30:47.108447 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.108507 (+ 60us) service_pool.cc:227] Handling call
0810 11:30:48.897113 (+1788606us) ts_tablet_manager.cc:1145] Deleting tablet a63227e69df14a4ea935087fd31ece63
0810 11:30:48.897157 (+ 44us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:48.897312 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1748559}
I20260810 11:30:48.924305 27231 consensus_queue.cc:260] T b6eb6dc4b6f34e598933853717b86866 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:48.924855 27231 ts_tablet_manager.cc:1428] T b6eb6dc4b6f34e598933853717b86866 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:48.925151 27231 tablet_bootstrap.cc:492] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
W20260810 11:30:48.925118 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet a63227e69df14a4ea935087fd31ece63 because the tablet was not found. No further retry: Not found: Tablet not found: a63227e69df14a4ea935087fd31ece63
I20260810 11:30:48.926606 27231 tablet_bootstrap.cc:654] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.926846 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 236) took 1763 ms. Trace:
I20260810 11:30:48.930182 27222 tablet_bootstrap.cc:492] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:48.930387 27222 ts_tablet_manager.cc:1397] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.063s user 0.005s sys 0.001s
I20260810 11:30:48.932327 27228 tablet_bootstrap.cc:492] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:48.932598 27228 ts_tablet_manager.cc:1397] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.062s user 0.006s sys 0.006s
W20260810 11:30:48.933828 26993 leader_election.cc:341] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:48.934012 26993 leader_election.cc:302] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:48.934295 29455 raft_consensus.cc:2726] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:48.931205 29500 rpcz_store.cc:276] 0810 11:30:47.163721 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.163793 (+ 72us) service_pool.cc:227] Handling call
0810 11:30:48.925964 (+1762171us) ts_tablet_manager.cc:1145] Deleting tablet d08250001e1542f9978bc6f89ace458b
0810 11:30:48.926074 (+ 110us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:48.926816 (+ 742us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1761737}
I20260810 11:30:48.936323 26573 master_service.cc:946] ReplaceTablet: received request to replace tablet 8400c601e9894ea9b68679f6d7927456 from {username='slave'} at 127.0.0.1:51252
W20260810 11:30:48.936770 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet d08250001e1542f9978bc6f89ace458b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d08250001e1542f9978bc6f89ace458b already in progress: creating tablet
I20260810 11:30:48.938897 27228 raft_consensus.cc:348] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:48.940376 27228 raft_consensus.cc:374] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.940780 27228 raft_consensus.cc:729] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.944871 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "501defb075d142ec8b22e5e8236a009c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:48.948226 26991 leader_election.cc:341] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:48.955896 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet 81b800247b4e4171b82dcde68e39fb00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:48.968715 27026 tablet_service.cc:1467] Processing CreateTablet for tablet acf778d6657c4071832ffeb5e0057aa6 (DEFAULT_TABLE table=default.Table_4d69a84b6d0a4ad787d4f64c289e1a03 [id=c8da88b7137b40c68037231d5810291e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.969441 27026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acf778d6657c4071832ffeb5e0057aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.973260 28987 ts_tablet_manager.cc:1939] T d4873fe8318040a2b7e021708a875f43 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:48.974290 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 169) took 4206 ms. Trace:
I20260810 11:30:48.974478 28987 rpcz_store.cc:276] 0810 11:30:44.767513 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.767678 (+ 165us) service_pool.cc:227] Handling call
0810 11:30:48.445510 (+3677832us) ts_tablet_manager.cc:1145] Deleting tablet d4873fe8318040a2b7e021708a875f43
0810 11:30:48.445546 (+ 36us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:48.693872 (+248326us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:48.858729 (+164857us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:48.974262 (+115533us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3458109}
I20260810 11:30:48.975004 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 170) took 4207 ms. Trace:
I20260810 11:30:48.975127 28987 rpcz_store.cc:276] 0810 11:30:44.767626 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.767812 (+ 186us) service_pool.cc:227] Handling call
0810 11:30:48.974880 (+4207068us) ts_tablet_manager.cc:1145] Deleting tablet d08250001e1542f9978bc6f89ace458b
0810 11:30:48.974891 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:48.974988 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3987457}
I20260810 11:30:48.975437 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 171) took 4207 ms. Trace:
I20260810 11:30:48.975538 28987 rpcz_store.cc:276] 0810 11:30:44.767716 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:44.771691 (+ 3975us) service_pool.cc:227] Handling call
0810 11:30:48.975351 (+4203660us) ts_tablet_manager.cc:1145] Deleting tablet b945038c03e343489af6ae7e50131d97
0810 11:30:48.975360 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:48.975425 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3987903}
I20260810 11:30:48.975831 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 185) took 2277 ms. Trace:
I20260810 11:30:48.975926 28987 rpcz_store.cc:276] 0810 11:30:46.698518 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.698580 (+ 62us) service_pool.cc:227] Handling call
0810 11:30:48.975763 (+2277183us) ts_tablet_manager.cc:1145] Deleting tablet 256ad2e2d8e54a4caa1b5091bab60dd5
0810 11:30:48.975773 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:48.975817 (+ 44us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2276734}
I20260810 11:30:48.976260 28987 tablet_replica.cc:330] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:48.980984 27231 tablet_bootstrap.cc:492] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:48.985105 27023 tablet_service.cc:1467] Processing CreateTablet for tablet 92de54060803403a9f0b2321a2493819 (DEFAULT_TABLE table=default.Table_088cb7f1722b4e86bea3634c8a1083a8 [id=3ee2b059007f4e7faca3056a50e7b2cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.990687 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92de54060803403a9f0b2321a2493819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.985812 27030 tablet_service.cc:1467] Processing CreateTablet for tablet 9216ea2238bd4cc2b3ec08ae938e5b0e (DEFAULT_TABLE table=default.Table_22bcc2f6dd5a4c26ab5b87185d38c2a9 [id=cc47121d5ec24323885dfc1808506dc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.992902 27030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9216ea2238bd4cc2b3ec08ae938e5b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.993584 27222 raft_consensus.cc:348] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:48.993804 27222 raft_consensus.cc:374] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:48.993860 27222 raft_consensus.cc:729] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:48.994042 27222 consensus_queue.cc:260] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:48.994554 27222 ts_tablet_manager.cc:1428] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.064s user 0.000s sys 0.001s
I20260810 11:30:48.994820 27222 tablet_bootstrap.cc:492] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:48.996235 27222 tablet_bootstrap.cc:654] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:48.986295 27036 tablet_service.cc:1467] Processing CreateTablet for tablet b644b76c8e704ceeaaa52fa4d73a2253 (DEFAULT_TABLE table=default.Table_9e670ff36955464297406906c99a67f1 [id=7b7f0b566d5145be87542ea1315211c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.996742 26821 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:48.996991 27036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b644b76c8e704ceeaaa52fa4d73a2253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.986775 27029 tablet_service.cc:1467] Processing CreateTablet for tablet f10ac7e043c240d8a14b2b4f96b864b9 (DEFAULT_TABLE table=default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:49.002128 27029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f10ac7e043c240d8a14b2b4f96b864b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:48.987433 27020 tablet_service.cc:1467] Processing CreateTablet for tablet 2831163cd84d4dc0aec65c27873f3ad8 (DEFAULT_TABLE table=default.Table_3707854eb7e84012a34d64e31fc10636 [id=d1223f75705243248d015e5195603824]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:48.976795 28987 raft_consensus.cc:2229] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:49.005692 27020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2831163cd84d4dc0aec65c27873f3ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:49.005672 28987 raft_consensus.cc:2258] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.006369 28987 ts_tablet_manager.cc:1905] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:48.939162 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 237) took 1774 ms. Trace:
I20260810 11:30:49.010608 29500 rpcz_store.cc:276] 0810 11:30:47.164679 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.164730 (+ 51us) service_pool.cc:227] Handling call
0810 11:30:48.937945 (+1773215us) ts_tablet_manager.cc:1145] Deleting tablet b945038c03e343489af6ae7e50131d97
0810 11:30:48.937962 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:48.938966 (+ 1004us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1772737}
I20260810 11:30:49.011206 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 238) took 1845 ms. Trace:
I20260810 11:30:49.011298 29500 rpcz_store.cc:276] 0810 11:30:47.165362 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.165432 (+ 70us) service_pool.cc:227] Handling call
0810 11:30:49.011033 (+1845601us) ts_tablet_manager.cc:1145] Deleting tablet 4efa31ad2ce8436b9638e6759d9b5421
0810 11:30:49.011045 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.011164 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1845333}
I20260810 11:30:49.011623 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 239) took 1845 ms. Trace:
I20260810 11:30:49.011688 29500 rpcz_store.cc:276] 0810 11:30:47.166108 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.166165 (+ 57us) service_pool.cc:227] Handling call
0810 11:30:49.011520 (+1845355us) ts_tablet_manager.cc:1145] Deleting tablet 713663be70014b17b17056a865e7db63
0810 11:30:49.011534 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.011609 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1844997}
W20260810 11:30:49.012704 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet b945038c03e343489af6ae7e50131d97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b945038c03e343489af6ae7e50131d97 already in progress: creating tablet
W20260810 11:30:49.013126 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 4efa31ad2ce8436b9638e6759d9b5421 because the tablet was not found. No further retry: Not found: Tablet not found: 4efa31ad2ce8436b9638e6759d9b5421
W20260810 11:30:49.013490 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 713663be70014b17b17056a865e7db63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 713663be70014b17b17056a865e7db63 already in progress: creating tablet
I20260810 11:30:49.025031 26571 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_3efc57bdbafc46dfab4d324acb0d5f73" } modify_external_catalogs: true
I20260810 11:30:49.025429 26571 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_3efc57bdbafc46dfab4d324acb0d5f73" } modify_external_catalogs: true
I20260810 11:30:49.029066 26578 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_a164cd4bbc4344ae905f395ab1e6cffb" } modify_external_catalogs: true
I20260810 11:30:49.029345 26578 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_a164cd4bbc4344ae905f395ab1e6cffb" } modify_external_catalogs: true
I20260810 11:30:49.030752 29593 raft_consensus.cc:482] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:49.031029 29593 raft_consensus.cc:504] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.033409 29593 leader_election.cc:288] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:49.042805 27231 ts_tablet_manager.cc:1397] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.118s user 0.005s sys 0.010s
I20260810 11:30:49.043678 27231 raft_consensus.cc:348] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.043954 27231 raft_consensus.cc:374] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.044020 27231 raft_consensus.cc:729] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.044256 27231 consensus_queue.cc:260] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.044917 27231 ts_tablet_manager.cc:1428] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:49.045251 27231 tablet_bootstrap.cc:492] T f9c7ab7f075d459d8b1f1a0bb0e2e2d7 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:49.048527 27026 tablet_service.cc:1467] Processing CreateTablet for tablet dde20950e02e4d2aab61bfabb3f41047 (DEFAULT_TABLE table=default.Table_b2f434005a0c4715ba99f1f42e2d3eb0 [id=3302549286bf44fdb3e615ce85fd48e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:49.049125 27026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dde20950e02e4d2aab61bfabb3f41047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:49.055405 27022 tablet_service.cc:1467] Processing CreateTablet for tablet aee359a81e4a400ab595e3f4aff01017 (DEFAULT_TABLE table=default.Table_5774e37bc1934d62a2ace70c0fa925a5 [id=eac902612a8e42008cafbc05bb64a87d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:49.056041 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aee359a81e4a400ab595e3f4aff01017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:49.064708 27030 tablet_service.cc:1467] Processing CreateTablet for tablet 4d2b1f33d244485a8fa2a72990f55a4d (DEFAULT_TABLE table=default.Table_9ed8857b66f14b79bb46c9d6cfebf6d5 [id=a2420406bc2643b2b15d942ab766612d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:49.065352 27030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d2b1f33d244485a8fa2a72990f55a4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:49.068987 27036 tablet_service.cc:1467] Processing CreateTablet for tablet a06912f8f924490cbd59e735ac7f1b6e (DEFAULT_TABLE table=default.Table_65a103c524ea4c9d826db90843b2309b [id=c45fdcc5f34241e882533226dfd86ead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:49.069609 27036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a06912f8f924490cbd59e735ac7f1b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:49.077016 27020 tablet_service.cc:1467] Processing CreateTablet for tablet b98aeb11beb54cf0a9829b715ad96d0f (DEFAULT_TABLE table=default.Table_4261c2bc06f04178ba9e115ead9a1aa8 [id=9410dc6b3fbc49b4b4f87eec32c4f420]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:49.077673 27020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b98aeb11beb54cf0a9829b715ad96d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:49.084273 27039 tablet_service.cc:1467] Processing CreateTablet for tablet aad22a5dfacf4fb88a5493376915a70f (DEFAULT_TABLE table=default.Table_53285a0af75e4705982c23850f7b27e2 [id=d58840daecc84b789f04a35ca6cd8393]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:49.084857 27039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aad22a5dfacf4fb88a5493376915a70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:49.086448 27025 tablet_service.cc:1467] Processing CreateTablet for tablet 63876fd00f4e4b37b3be54751d18b5db (DEFAULT_TABLE table=default.Table_c60b4d539f6a41fe9cdbb84740720a4c [id=27b1c16b43684e3393990ff957116553]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:49.086541 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3e78dcaa55491393f529ea33007786 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:49.086833 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63876fd00f4e4b37b3be54751d18b5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:49.087020 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet 983916da755d4d14b7a3d43bb7cbc9c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:49.087404 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f048b690d764c83a4a9ce4cbadc75b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:49.096755 27028 tablet_service.cc:1514] Processing DeleteTablet for tablet aad22a5dfacf4fb88a5493376915a70f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:48 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:49.096925 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet eed0e2bead85466ca99cfb34e155a391 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:49.097407 29455 raft_consensus.cc:482] T b6eb6dc4b6f34e598933853717b86866 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:49.097630 29455 raft_consensus.cc:504] T b6eb6dc4b6f34e598933853717b86866 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.098474 29455 leader_election.cc:288] T b6eb6dc4b6f34e598933853717b86866 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:49.098658 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7cd4f555b5d840c182a31b3c94da9619 because the tablet was not found. No further retry: Not found: Tablet not found: 7cd4f555b5d840c182a31b3c94da9619
I20260810 11:30:49.099880 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 4efa31ad2ce8436b9638e6759d9b5421 (table default.Table_f3567f07068942e9a5d42f9877f39bb7 [id=c557d3488f464c5bbff89fd13e52b02a]) successfully deleted
W20260810 11:30:49.100329 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a because the tablet was not found. No further retry: Not found: Tablet not found: 6dc4fd6ca8a541f99eed57a6f51c1f0a
I20260810 11:30:49.100761 29455 raft_consensus.cc:482] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 11:30:49.100756 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c because the tablet was not found. No further retry: Not found: Tablet not found: 7ff5b980ce4e41d7a6e1ca0e740b739c
W20260810 11:30:49.101068 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 because the tablet was not found. No further retry: Not found: Tablet not found: 420ba6e9f74c4ae5bf450f369e7fbdb3
I20260810 11:30:49.101166 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 983916da755d4d14b7a3d43bb7cbc9c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:49.101428 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 2634beb347714fc7a2e05865adb34a22 because the tablet was not found. No further retry: Not found: Tablet not found: 2634beb347714fc7a2e05865adb34a22
I20260810 11:30:49.101373 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebaf046e524b485c8b3ebf419c8035bb" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.101514 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet aad22a5dfacf4fb88a5493376915a70f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:48 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:49.101827 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet eed0e2bead85466ca99cfb34e155a391 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:49.101989 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet e31b380f99854eb8b63e1f9eede1fc7c because the tablet was not found. No further retry: Not found: Tablet not found: e31b380f99854eb8b63e1f9eede1fc7c
W20260810 11:30:49.102442 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet b945cb22353f4d99a3836e3c0b8e26e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b945cb22353f4d99a3836e3c0b8e26e3 already in progress: creating tablet
W20260810 11:30:49.102782 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 8b303be24f4e46d0b966e8191d76297b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b303be24f4e46d0b966e8191d76297b already in progress: creating tablet
I20260810 11:30:49.102890 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet d4873fe8318040a2b7e021708a875f43 (table default.Table_065fc82a2823470b89b4cff36ca03027 [id=60ce1267de814f218c27ac084a08a26a]) successfully deleted
I20260810 11:30:49.103305 27037 tablet_service.cc:1467] Processing CreateTablet for tablet 9bf01841b9d4412789b05ce207f6eb02 (DEFAULT_TABLE table=default.Table_8936d38c9e8e4ba9a4be8cc491e080dd [id=da71b19216b54d50b0793300e4ecaed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:49.103783 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bf01841b9d4412789b05ce207f6eb02. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:49.103158 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 91b6078efadf496fb252f725bdf56b02 because the tablet was not found. No further retry: Not found: Tablet not found: 91b6078efadf496fb252f725bdf56b02
W20260810 11:30:49.105518 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 because the tablet was not found. No further retry: Not found: Tablet not found: 256ad2e2d8e54a4caa1b5091bab60dd5
W20260810 11:30:49.105579 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet d08250001e1542f9978bc6f89ace458b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d08250001e1542f9978bc6f89ace458b already in progress: creating tablet
W20260810 11:30:49.105918 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 because the tablet was not found. No further retry: Not found: Tablet not found: 43fee1a9a6f9482fbbe6ab6599c27fb9
W20260810 11:30:49.106113 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet b945038c03e343489af6ae7e50131d97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b945038c03e343489af6ae7e50131d97 already in progress: creating tablet
W20260810 11:30:49.106245 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 3851d39aeb3142938a5ac558ab438c21 because the tablet was not found. No further retry: Not found: Tablet not found: 3851d39aeb3142938a5ac558ab438c21
W20260810 11:30:49.106505 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 because the tablet was not found. No further retry: Not found: Tablet not found: 256ad2e2d8e54a4caa1b5091bab60dd5
I20260810 11:30:49.106841 27021 tablet_service.cc:1467] Processing CreateTablet for tablet f00b7a79c72d4184a05e04f45a9a4d68 (DEFAULT_TABLE table=default.Table_c2c7816a3119457c8c5fc9d76a404674 [id=7943d9432e88470e88416adbcbc7d2f9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:49.107014 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 78633fbe048b4534ae3277ce6b7c4313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78633fbe048b4534ae3277ce6b7c4313 already in progress: creating tablet
I20260810 11:30:49.107393 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f00b7a79c72d4184a05e04f45a9a4d68. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:49.107852 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet a835d30ef9fc474ab927bb119a95d83c because the tablet was not found. No further retry: Not found: Tablet not found: a835d30ef9fc474ab927bb119a95d83c
W20260810 11:30:49.108536 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet a63227e69df14a4ea935087fd31ece63 because the tablet was not found. No further retry: Not found: Tablet not found: a63227e69df14a4ea935087fd31ece63
W20260810 11:30:49.109148 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet a8a65a0e8b1f4e4b8d9a82059b766cda because the tablet was not found. No further retry: Not found: Tablet not found: a8a65a0e8b1f4e4b8d9a82059b766cda
I20260810 11:30:49.109212 27033 tablet_service.cc:1467] Processing CreateTablet for tablet baf4482d8acf4a9fa0c1bf11c383c5d9 (DEFAULT_TABLE table=default.Table_13da010706b445ef8049a259743a3c33 [id=cbc9040862f44f9f95b01859ba56f099]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:49.109632 27033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baf4482d8acf4a9fa0c1bf11c383c5d9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:49.110247 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet ff9b649e43a9456fa51cf3330290bb91 because the tablet was not found. No further retry: Not found: Tablet not found: ff9b649e43a9456fa51cf3330290bb91
W20260810 11:30:49.110849 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 10e6c41db71a4146840f06c5b7412d9c because the tablet was not found. No further retry: Not found: Tablet not found: 10e6c41db71a4146840f06c5b7412d9c
I20260810 11:30:49.111430 27034 tablet_service.cc:1467] Processing CreateTablet for tablet 72fd344dfcb84dfba89f7a9f446d814f (DEFAULT_TABLE table=default.Table_bd5713e68e4a473a9fc231c709826f99 [id=8346a2ee684b4a269c682ccc63b695e9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:49.111513 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet d512c335e340437fa32f2dc16dca6812 because the tablet was not found. No further retry: Not found: Tablet not found: d512c335e340437fa32f2dc16dca6812
I20260810 11:30:49.111951 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72fd344dfcb84dfba89f7a9f446d814f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:49.112386 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 603fe104b7ab485eab6b225a58bddc1c because the tablet was not found. No further retry: Not found: Tablet not found: 603fe104b7ab485eab6b225a58bddc1c
I20260810 11:30:49.114078 26581 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 524c8d37d3964e368695d182883b0bd5
I20260810 11:30:49.114555 29400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=604 overwritten=0 applied=603 ignored=0} inserts{seen=559 ignored=0} mutations{seen=688 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260810 11:30:49.114893 26581 catalog_manager.cc:6565] ReplaceTablet: tablet 524c8d37d3964e368695d182883b0bd5 deleted and replaced by tablet a09cf2b015414598b9e9b6e76eb0a9df
I20260810 11:30:49.115381 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 524c8d37d3964e368695d182883b0bd5 with delete_type TABLET_DATA_DELETED (replaced by tablet a09cf2b015414598b9e9b6e76eb0a9df) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:49.115646 27022 tablet_service.cc:1467] Processing CreateTablet for tablet 8552c16e0ca545cc85b41abdbf3b9da4 (DEFAULT_TABLE table=default.Table_5fa102edf6ef4d4b966a0b16a0af0b55 [id=471dd5e043034129bf889e3e978a3001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:49.116084 27029 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb94533e1304d5aa231f43f97ea78ae (DEFAULT_TABLE table=default.Table_a1f19ccbbd394c55ac00d3dcb8a4df54 [id=ec29df767a7242c594d5312d06c491bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:49.116389 29400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Bootstrap complete.
I20260810 11:30:49.100940 29455 raft_consensus.cc:504] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.116808 26580 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 9079c8fec89043be9d0040a3728e93f4
I20260810 11:30:49.117493 26580 catalog_manager.cc:6565] ReplaceTablet: tablet 9079c8fec89043be9d0040a3728e93f4 deleted and replaced by tablet e95537eb35194e8fa014a765d693bf18
I20260810 11:30:49.117429 29455 leader_election.cc:288] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:49.117702 26580 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 224) took 1051 ms. Trace:
I20260810 11:30:49.117738 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 9079c8fec89043be9d0040a3728e93f4 with delete_type TABLET_DATA_DELETED (replaced by tablet e95537eb35194e8fa014a765d693bf18) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:49.117830 27023 tablet_service.cc:1467] Processing CreateTablet for tablet c4893ce946234cabbef099a24188b271 (DEFAULT_TABLE table=default.Table_11e70bfc5ca54f1a936d021d01489aab [id=fa5b25ba3c0643b1824fedb370bb097d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:49.118625 26581 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_65da57b4be754a5b9cbc73361a4f1b93" } new_table_name: "default.Table_613e12f4afb54939af925475cab64f0e" modify_external_catalogs: true
I20260810 11:30:49.117939 26580 rpcz_store.cc:276] 0810 11:30:48.066195 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:48.747043 (+680848us) service_pool.cc:227] Handling call
0810 11:30:49.117597 (+370554us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:49.032029 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:49.032109 (+ 80us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:49.032114 (+ 5us) write_op.cc:435] Acquired schema lock
0810 11:30:49.032116 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:49.032193 (+ 77us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:49.032202 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:49.032206 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:49.032265 (+ 59us) tablet.cc:699] Row locks acquired
0810 11:30:49.032268 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:49.032296 (+ 28us) write_op.cc:270] Start()
0810 11:30:49.032322 (+ 26us) write_op.cc:276] Timestamp: P: 1786361449032237 usec, L: 0
0810 11:30:49.032328 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:49.035807 (+ 3479us) log.cc:842] Serialized 665 byte log entry
0810 11:30:49.046926 (+ 11119us) op_driver.cc:444] REPLICATION: finished
0810 11:30:49.115781 (+ 68855us) write_op.cc:301] APPLY: starting
0810 11:30:49.115796 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:49.115844 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:49.116023 (+ 179us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:49.116147 (+ 124us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:49.116211 (+ 64us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:49.116216 (+ 5us) write_op.cc:312] APPLY: finished
0810 11:30:49.116298 (+ 82us) log.cc:842] Serialized 29 byte log entry
0810 11:30:49.116391 (+ 93us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.116410 (+ 19us) write_op.cc:454] Released schema lock
0810 11:30:49.116417 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:49.116479 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.116483 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":68812,"apply.run_cpu_time_us":750,"apply.run_wall_time_us":749,"num_ops":2,"prepare.queue_time_us":4007,"prepare.run_cpu_time_us":661,"prepare.run_wall_time_us":3857,"replication_time_us":14581}]]}
I20260810 11:30:49.119674 26580 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_eeb8c0846bb541c5a6a16c5a3d1c310d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:49.123835 26580 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eeb8c0846bb541c5a6a16c5a3d1c310d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:49.140025 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8552c16e0ca545cc85b41abdbf3b9da4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:49.141213 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4893ce946234cabbef099a24188b271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:49.147182 27029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb94533e1304d5aa231f43f97ea78ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:49.152923 27222 tablet_bootstrap.cc:492] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:49.153108 27222 ts_tablet_manager.cc:1397] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.158s user 0.003s sys 0.005s
I20260810 11:30:49.156039 27222 raft_consensus.cc:348] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.156373 27222 raft_consensus.cc:374] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.156478 27222 raft_consensus.cc:729] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.157383 27222 consensus_queue.cc:260] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.158367 27222 ts_tablet_manager.cc:1428] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260810 11:30:49.159456 27222 tablet_bootstrap.cc:492] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:49.161142 27222 tablet_bootstrap.cc:654] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.163581 27231 tablet_bootstrap.cc:654] T f9c7ab7f075d459d8b1f1a0bb0e2e2d7 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.011950 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 240) took 1845 ms. Trace:
I20260810 11:30:49.164485 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet cc76d30f37094391b75076c92ccc277f (table default.Table_03a616a243fc4350b4a01d7f5bb86949 [id=4e2dc56dde3346a0917e58c6c7e921eb]) successfully deleted
I20260810 11:30:49.010640 26909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3853603eac544d769cef8cff9a008784" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:49.033022 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c60baf810a544a4a90dccd2337a39043" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:49.165256 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 713663be70014b17b17056a865e7db63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 713663be70014b17b17056a865e7db63 already in progress: creating tablet
I20260810 11:30:49.099229 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6eb6dc4b6f34e598933853717b86866" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:49.122506 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 9079c8fec89043be9d0040a3728e93f4 with delete_type TABLET_DATA_DELETED (replaced by tablet e95537eb35194e8fa014a765d693bf18) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:49.165896 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet f7ada1df82eb44ecb9a6c615b5410e6f because the tablet was not found. No further retry: Not found: Tablet not found: f7ada1df82eb44ecb9a6c615b5410e6f
W20260810 11:30:49.166394 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 318d5b8453fe4c438d0fa32cb91c409e because the tablet was not found. No further retry: Not found: Tablet not found: 318d5b8453fe4c438d0fa32cb91c409e
W20260810 11:30:49.166939 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 64818ca5827e41d99428903ddb8688d9 because the tablet was not found. No further retry: Not found: Tablet not found: 64818ca5827e41d99428903ddb8688d9
W20260810 11:30:49.167400 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 64818ca5827e41d99428903ddb8688d9 because the tablet was not found. No further retry: Not found: Tablet not found: 64818ca5827e41d99428903ddb8688d9
I20260810 11:30:49.168967 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]) successfully deleted
I20260810 11:30:49.156432 27228 consensus_queue.cc:260] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:49.169394 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 0edef936026743a896d5a73c134a8bca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0edef936026743a896d5a73c134a8bca already in progress: creating tablet
I20260810 11:30:49.169519 29297 raft_consensus.cc:482] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:49.169726 26904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb01711769f457aa0696bb59582166d" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:49.169785 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 4827800160e64883ba7bcadafeb13ead because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4827800160e64883ba7bcadafeb13ead already in progress: creating tablet
W20260810 11:30:49.162559 29591 log.cc:924] Time spent T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700: Append to log took a long time: real 0.242s user 0.000s sys 0.000s
W20260810 11:30:49.170207 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet e700aa4c0c45496db8a2b4f4d6d746a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e700aa4c0c45496db8a2b4f4d6d746a4 already in progress: creating tablet
I20260810 11:30:49.116175 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 524c8d37d3964e368695d182883b0bd5 with delete_type TABLET_DATA_DELETED (replaced by tablet a09cf2b015414598b9e9b6e76eb0a9df) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:49.170691 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 5a2e1b54043444989ac64c87f30ffc07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a2e1b54043444989ac64c87f30ffc07 already in progress: creating tablet
W20260810 11:30:49.171130 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 25efcc18e8444b09ae2556345c36a710 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25efcc18e8444b09ae2556345c36a710 already in progress: creating tablet
I20260810 11:30:49.164368 29500 rpcz_store.cc:276] 0810 11:30:47.166915 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.166981 (+ 66us) service_pool.cc:227] Handling call
0810 11:30:49.011880 (+1844899us) ts_tablet_manager.cc:1145] Deleting tablet d4873fe8318040a2b7e021708a875f43
0810 11:30:49.011889 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.011936 (+ 47us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1844607}
I20260810 11:30:49.171826 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 241) took 1927 ms. Trace:
W20260810 11:30:49.171959 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet d4873fe8318040a2b7e021708a875f43 because the tablet was not found. No further retry: Not found: Tablet not found: d4873fe8318040a2b7e021708a875f43
I20260810 11:30:49.162917 26700 leader_election.cc:302] T 859477ecf37240a4888542d2559f99cd P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.173192 29316 raft_consensus.cc:3037] T 859477ecf37240a4888542d2559f99cd P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:49.175460 26991 leader_election.cc:341] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:49.175697 26991 leader_election.cc:341] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:49.175832 26991 leader_election.cc:341] T b6eb6dc4b6f34e598933853717b86866 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.176646 29316 raft_consensus.cc:2726] T 859477ecf37240a4888542d2559f99cd P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:49.171926 29500 rpcz_store.cc:276] 0810 11:30:47.244229 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.244315 (+ 86us) service_pool.cc:227] Handling call
0810 11:30:49.171712 (+1927397us) ts_tablet_manager.cc:1145] Deleting tablet 256ad2e2d8e54a4caa1b5091bab60dd5
0810 11:30:49.171728 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.171805 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1927153}
I20260810 11:30:49.179026 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 242) took 1933 ms. Trace:
W20260810 11:30:49.179572 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 256ad2e2d8e54a4caa1b5091bab60dd5 because the tablet was not found. No further retry: Not found: Tablet not found: 256ad2e2d8e54a4caa1b5091bab60dd5
I20260810 11:30:49.179119 29500 rpcz_store.cc:276] 0810 11:30:47.245700 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.245746 (+ 46us) service_pool.cc:227] Handling call
0810 11:30:49.178924 (+1933178us) ts_tablet_manager.cc:1145] Deleting tablet fc558690dce44e999e55e9bf1b6ca172
0810 11:30:49.178936 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.179006 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1921290}
I20260810 11:30:49.180704 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 243) took 1904 ms. Trace:
I20260810 11:30:49.180800 29500 rpcz_store.cc:276] 0810 11:30:47.277174 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.277260 (+ 86us) service_pool.cc:227] Handling call
0810 11:30:49.180605 (+1903345us) ts_tablet_manager.cc:1145] Deleting tablet 1860e56467624dcdb288e13b004f78cc
0810 11:30:49.180616 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.180684 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1903031}
I20260810 11:30:49.181097 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 244) took 1893 ms. Trace:
I20260810 11:30:49.181173 29500 rpcz_store.cc:276] 0810 11:30:47.288021 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.288096 (+ 75us) service_pool.cc:227] Handling call
0810 11:30:49.181015 (+1892919us) ts_tablet_manager.cc:1145] Deleting tablet 1aa4562a2247405187d9dbd1baa48f39
0810 11:30:49.181025 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.181081 (+ 56us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1891374}
I20260810 11:30:49.181501 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 245) took 1891 ms. Trace:
W20260810 11:30:49.182376 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet fc558690dce44e999e55e9bf1b6ca172 because the tablet was not found. No further retry: Not found: Tablet not found: fc558690dce44e999e55e9bf1b6ca172
W20260810 11:30:49.182739 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 1860e56467624dcdb288e13b004f78cc because the tablet was not found. No further retry: Not found: Tablet not found: 1860e56467624dcdb288e13b004f78cc
W20260810 11:30:49.182986 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 1aa4562a2247405187d9dbd1baa48f39 because the tablet was not found. No further retry: Not found: Tablet not found: 1aa4562a2247405187d9dbd1baa48f39
I20260810 11:30:49.169654 29297 raft_consensus.cc:504] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:49.186765 26991 leader_election.cc:341] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.181576 29500 rpcz_store.cc:276] 0810 11:30:47.290221 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.290273 (+ 52us) service_pool.cc:227] Handling call
0810 11:30:49.181373 (+1891100us) ts_tablet_manager.cc:1145] Deleting tablet 8228600e3f6b4f9993dd25e4ceb57e4d
0810 11:30:49.181385 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.181485 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1890590}
W20260810 11:30:49.193374 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 8228600e3f6b4f9993dd25e4ceb57e4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8228600e3f6b4f9993dd25e4ceb57e4d already in progress: creating tablet
I20260810 11:30:49.193774 29500 tablet_replica.cc:330] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:49.194020 29500 raft_consensus.cc:2229] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:49.194211 29500 raft_consensus.cc:2258] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.195341 29297 leader_election.cc:288] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:49.196552 29500 ts_tablet_manager.cc:1905] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:49.203774 26573 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 8400c601e9894ea9b68679f6d7927456
I20260810 11:30:49.205145 26573 catalog_manager.cc:6565] ReplaceTablet: tablet 8400c601e9894ea9b68679f6d7927456 deleted and replaced by tablet 323c8344408b456398526cec03708f4e
I20260810 11:30:49.206640 26580 master_service.cc:946] ReplaceTablet: received request to replace tablet a45422addab84e9083df8665a0cf9322 from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:49.206364 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 8400c601e9894ea9b68679f6d7927456 with delete_type TABLET_DATA_DELETED (replaced by tablet 323c8344408b456398526cec03708f4e) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:49.209092 27291 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8083fa130cd04dae9d61aeed977c1c63 consensus state has no leader
I20260810 11:30:49.210222 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 8400c601e9894ea9b68679f6d7927456 with delete_type TABLET_DATA_DELETED (replaced by tablet 323c8344408b456398526cec03708f4e) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:49.210688 26573 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_4261c2bc06f04178ba9e115ead9a1aa8" } new_table_name: "default.Table_c0f2f67fac3147edb223918339295177" modify_external_catalogs: true
W20260810 11:30:49.217420 26564 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_b472377e613b4475b7a0b58062d44535 [id=eafb437d77e14e42a0cb38d6ec1fd5b4], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet c8c9267e2da64738b5f7550c83b7c4a3 consensus state has no leader
I20260810 11:30:49.224637 29316 consensus_queue.cc:1035] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:49.225385 29297 raft_consensus.cc:482] T 932ac2ae54324e6e830291ed449a31a8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:49.225564 29593 raft_consensus.cc:482] T 997cff3351724953bd9c792085a38364 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:49.225744 29593 raft_consensus.cc:504] T 997cff3351724953bd9c792085a38364 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.227339 29593 leader_election.cc:288] T 997cff3351724953bd9c792085a38364 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:49.236267 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:49.239712 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:49.242391 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:49.244546 29593 raft_consensus.cc:482] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:49.244781 29593 raft_consensus.cc:504] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.245416 29593 leader_election.cc:288] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:49.249826 28987 ts_tablet_manager.cc:1918] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:49.250016 28987 log.cc:1196] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/4efa31ad2ce8436b9638e6759d9b5421
W20260810 11:30:49.250088 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet d50a8bdb17fa4332b288d03658c6b9c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d50a8bdb17fa4332b288d03658c6b9c2 already in progress: creating tablet
I20260810 11:30:49.250488 28987 ts_tablet_manager.cc:1939] T 4efa31ad2ce8436b9638e6759d9b5421 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:49.251829 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:49.252529 26906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17ff4152fc6a449db3a172c5d948168f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:49.252604 29297 raft_consensus.cc:504] T 932ac2ae54324e6e830291ed449a31a8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:49.253358 26991 leader_election.cc:341] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.254469 29297 leader_election.cc:288] T 932ac2ae54324e6e830291ed449a31a8 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:49.253746 26901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "997cff3351724953bd9c792085a38364" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:49.256083 26991 leader_election.cc:341] T 997cff3351724953bd9c792085a38364 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.254761 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:49.260169 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bcc69e8f87134d25a1329be52b08e794 (table default.Table_4e93c67b823f48028820e1e95415e455 [id=b4c0c92ef07f432cbb00a36ecd17d394]). Expected version 1 got 0
I20260810 11:30:49.262408 29603 tablet_replica.cc:330] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:49.262739 29603 raft_consensus.cc:2229] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:49.263103 29603 raft_consensus.cc:2258] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.263710 29603 ts_tablet_manager.cc:1905] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:49.265296 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:49.265854 29587 tablet.cc:1722] T 34ed8c9efa634fc7b091b1bb6bc6d452 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:49.267388 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:49.268496 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_883130a240194491bd23c14d9aff2e99 [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 2 got 0
I20260810 11:30:49.269856 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:49.270618 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 501defb075d142ec8b22e5e8236a009c (table default.Table_03d4151647a047a1b1ba29fdba43f80d [id=46bda36574e1430dbada751ccf16703c]). Expected version 1 got 0
I20260810 11:30:49.271502 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:49.272300 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_b472377e613b4475b7a0b58062d44535 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 2 got 0
I20260810 11:30:49.273366 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9744f59d7e49430e91080f56f3342038 (table default.Table_2f179aff28124223a1c8ae3280a497e7 [id=a483de6ef1fc453b93e3f183e9c15dd1]). Expected version 1 got 0
I20260810 11:30:49.274582 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bb078d7c0d0e4cf5aa841a802e78d8ff (table default.Table_eb5bb59579c043d7b1d98e60e42899af [id=65218ea1c77a4098a4f1145607695dbd]). Expected version 1 got 0
I20260810 11:30:49.275319 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:49.276849 29593 raft_consensus.cc:482] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:49.277458 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:49.277590 26764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c317ccebde05457d9e81c5c871638092" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.278930 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6395bce17ee40c2822669246ce7eb42" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.279284 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d91cb30457a74d51885ad81c4ab89d71" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.279361 26760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8400c601e9894ea9b68679f6d7927456" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.279992 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:49.280702 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:49.281602 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:49.282271 29316 raft_consensus.cc:482] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:49.282227 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:49.282411 29316 raft_consensus.cc:504] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.283099 29316 leader_election.cc:288] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:49.283619 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:49.284548 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:49.286928 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d91cb30457a74d51885ad81c4ab89d71 (table default.Table_1ec5963e30f5468cbde77670965bf92b [id=e985b1ae60d94bfa998e1986bdf3fcd9]). Expected version 1 got 0
I20260810 11:30:49.287500 27112 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:49.288079 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c317ccebde05457d9e81c5c871638092 (table default.Table_8c0c1ab3bbb944c888930a5d8116d888 [id=7b4e4650915f4c16bef68adf43618b89]). Expected version 1 got 0
I20260810 11:30:49.289140 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:49.289713 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:49.292074 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:49.293231 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:49.294736 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 34ed8c9efa634fc7b091b1bb6bc6d452 (table default.Table_3818fdea177c4bb589ab0e9ab54f7f51 [id=7c8348b49b664bee8d8243efb2cdbb79]). Expected version 1 got 0
I20260810 11:30:49.295706 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_5256d55e5aee47ee88a92177e8df8577 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 3 got 2
I20260810 11:30:49.298445 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
I20260810 11:30:49.299314 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 88268e3571884ac88c1a617ce74499f3 (table default.Table_cb8549bfe5344b95b2c81538365c371b [id=0f9e142b43214fa8b2e362c54fabcb42]). Expected version 1 got 0
I20260810 11:30:49.300225 26576 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f (table default.Table_11e3ca2d0589464586b01e41dcd46bbf [id=d63533f5d837481889b34a78d860e018]). Expected version 1 got 0
W20260810 11:30:49.300729 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 113504us
I20260810 11:30:49.277041 29593 raft_consensus.cc:504] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.303151 29593 leader_election.cc:288] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:49.303498 27228 ts_tablet_manager.cc:1428] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.371s user 0.008s sys 0.006s
I20260810 11:30:49.303831 27228 tablet_bootstrap.cc:492] T 3a1e46f80f7f4e3a84638421892e6236 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:49.307035 27228 tablet_bootstrap.cc:654] T 3a1e46f80f7f4e3a84638421892e6236 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.171700 29400 raft_consensus.cc:348] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 5 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:49.310014 29400 raft_consensus.cc:729] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: c40c76e125b44de181b88b7f63a566f7, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.311050 29400 consensus_queue.cc:260] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 603, Last appended: 5.604, Last appended by leader: 604, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:49.312347 27222 tablet_bootstrap.cc:492] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:49.312602 27222 ts_tablet_manager.cc:1397] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.153s user 0.006s sys 0.001s
I20260810 11:30:49.313331 27222 raft_consensus.cc:348] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.313571 27222 raft_consensus.cc:374] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.313640 27222 raft_consensus.cc:729] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.313968 27222 consensus_queue.cc:260] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.314695 27222 ts_tablet_manager.cc:1428] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260810 11:30:49.320720 26700 consensus_peers.cc:487] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:49.307807 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00e63f994ff84941852b0cfee763c303" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:49.318034 26901 raft_consensus.cc:3037] T 932ac2ae54324e6e830291ed449a31a8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:49.334267 26991 leader_election.cc:341] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.319103 26906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ae27bf110114b70a3e3f6cf64f31b98" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:49.331837 26702 leader_election.cc:341] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 3ae27bf110114b70a3e3f6cf64f31b98
I20260810 11:30:49.325497 29500 ts_tablet_manager.cc:1918] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:49.329221 29587 tablet.cc:1722] T c62ae41d2dd74eedbe252c4de70fbe1e P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 11:30:49.338536 29500 log.cc:1196] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/3ae27bf110114b70a3e3f6cf64f31b98
I20260810 11:30:49.339013 29500 ts_tablet_manager.cc:1939] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:49.339386 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 246) took 2045 ms. Trace:
I20260810 11:30:49.339478 29500 rpcz_store.cc:276] 0810 11:30:47.294350 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.294395 (+ 45us) service_pool.cc:227] Handling call
0810 11:30:49.193723 (+1899328us) ts_tablet_manager.cc:1145] Deleting tablet 3ae27bf110114b70a3e3f6cf64f31b98
0810 11:30:49.193734 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.215038 (+ 21304us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.325373 (+110335us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.339370 (+ 13997us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1899031}
I20260810 11:30:49.340046 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 3ae27bf110114b70a3e3f6cf64f31b98 (table default.Table_54efd7f2894348cf9dbf82586d44b6b5 [id=3b60ed35e72d41b58f176184a08303ad]) successfully deleted
I20260810 11:30:49.340492 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 247) took 2045 ms. Trace:
I20260810 11:30:49.340595 29500 rpcz_store.cc:276] 0810 11:30:47.294837 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.294878 (+ 41us) service_pool.cc:227] Handling call
0810 11:30:49.340352 (+2045474us) ts_tablet_manager.cc:1145] Deleting tablet e69916a35fba4714bbc565921738888f
0810 11:30:49.340365 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.340475 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2045201}
W20260810 11:30:49.341202 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet e69916a35fba4714bbc565921738888f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e69916a35fba4714bbc565921738888f already in progress: creating tablet
I20260810 11:30:49.341594 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 248) took 2046 ms. Trace:
I20260810 11:30:49.341681 29500 rpcz_store.cc:276] 0810 11:30:47.295302 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.295369 (+ 67us) service_pool.cc:227] Handling call
0810 11:30:49.341485 (+2046116us) ts_tablet_manager.cc:1145] Deleting tablet d000f0ebaf0049a7bdaad93e307e16e2
0810 11:30:49.341495 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.341577 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2045868}
W20260810 11:30:49.342234 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet d000f0ebaf0049a7bdaad93e307e16e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d000f0ebaf0049a7bdaad93e307e16e2 already in progress: creating tablet
I20260810 11:30:49.342621 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 249) took 2046 ms. Trace:
W20260810 11:30:49.348524 26700 leader_election.cc:341] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: Tablet not RUNNING: STOPPED
I20260810 11:30:49.348714 26700 leader_election.cc:302] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.349160 29316 raft_consensus.cc:2726] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:49.349699 29316 consensus_queue.cc:1035] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:49.358173 29316 consensus_queue.cc:1035] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:49.369639 26759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a2e1b54043444989ac64c87f30ffc07" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.370133 26760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa14fea852c24cd7bb3d57094af2e178" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.370185 26763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c60baf810a544a4a90dccd2337a39043" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.370381 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67364e1082184aad82a85c3fda850a26" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.370596 26762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98de7ce411bb4b54ada2df3b78b72190" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.370807 26768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba9d15002e6a40f58a7be07f46e7c328" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.370927 26580 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet a45422addab84e9083df8665a0cf9322
I20260810 11:30:49.371083 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77f0c916ccf24e86b0ec29de1ba54b84" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.371194 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4dde1d1eef74911b20498149e8c1785" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.371454 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b95f3ec8ff34c89a68cd1edf8391f9b" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.371611 26580 catalog_manager.cc:6565] ReplaceTablet: tablet a45422addab84e9083df8665a0cf9322 deleted and replaced by tablet 8920061626614b219424eaba8f19e368
I20260810 11:30:49.371558 26754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "501defb075d142ec8b22e5e8236a009c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.371711 26764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "932ac2ae54324e6e830291ed449a31a8" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.371865 26753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3853603eac544d769cef8cff9a008784" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.375254 29618 tablet.cc:1722] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:49.376916 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet a45422addab84e9083df8665a0cf9322 with delete_type TABLET_DATA_DELETED (replaced by tablet 8920061626614b219424eaba8f19e368) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:49.380627 29619 tablet.cc:1722] T c62ae41d2dd74eedbe252c4de70fbe1e P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 11:30:49.385510 29500 rpcz_store.cc:276] 0810 11:30:47.295994 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.296048 (+ 54us) service_pool.cc:227] Handling call
0810 11:30:49.342522 (+2046474us) ts_tablet_manager.cc:1145] Deleting tablet e276b0fa124d42dfb3fe750d245e44d8
0810 11:30:49.342532 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.342605 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2046226}
W20260810 11:30:49.386391 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet e276b0fa124d42dfb3fe750d245e44d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e276b0fa124d42dfb3fe750d245e44d8 already in progress: creating tablet
I20260810 11:30:49.386994 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 250) took 2090 ms. Trace:
I20260810 11:30:49.387151 29500 rpcz_store.cc:276] 0810 11:30:47.296672 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.296928 (+ 256us) service_pool.cc:227] Handling call
0810 11:30:49.386818 (+2089890us) ts_tablet_manager.cc:1145] Deleting tablet c60baf810a544a4a90dccd2337a39043
0810 11:30:49.386832 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.386964 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2089607}
W20260810 11:30:49.388147 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet c60baf810a544a4a90dccd2337a39043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c60baf810a544a4a90dccd2337a39043 already in progress: creating tablet
I20260810 11:30:49.388793 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 251) took 2091 ms. Trace:
I20260810 11:30:49.376168 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet a45422addab84e9083df8665a0cf9322 with delete_type TABLET_DATA_DELETED (replaced by tablet 8920061626614b219424eaba8f19e368) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:49.374181 26849 leader_election.cc:341] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.389429 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 184) took 2691 ms. Trace:
I20260810 11:30:49.390640 28987 rpcz_store.cc:276] 0810 11:30:46.698378 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.698435 (+ 57us) service_pool.cc:227] Handling call
0810 11:30:48.976222 (+2277787us) ts_tablet_manager.cc:1145] Deleting tablet 4efa31ad2ce8436b9638e6759d9b5421
0810 11:30:48.976230 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.135816 (+159586us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.249704 (+113888us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.389405 (+139701us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":248,"tablet-delete.queue_time_us":2277195}
I20260810 11:30:49.393011 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 4efa31ad2ce8436b9638e6759d9b5421 (table default.Table_f3567f07068942e9a5d42f9877f39bb7 [id=c557d3488f464c5bbff89fd13e52b02a]) successfully deleted
I20260810 11:30:49.400892 27222 tablet_bootstrap.cc:492] T e69916a35fba4714bbc565921738888f P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:49.403934 27222 tablet_bootstrap.cc:654] T e69916a35fba4714bbc565921738888f P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.404223 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 187) took 2703 ms. Trace:
I20260810 11:30:49.404469 28987 rpcz_store.cc:276] 0810 11:30:46.700348 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.700423 (+ 75us) service_pool.cc:227] Handling call
0810 11:30:49.393488 (+2693065us) ts_tablet_manager.cc:1145] Deleting tablet 1860e56467624dcdb288e13b004f78cc
0810 11:30:49.404083 (+ 10595us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.404198 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2692752}
I20260810 11:30:49.405167 27048 raft_consensus.cc:3037] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:49.405237 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 1860e56467624dcdb288e13b004f78cc because the tablet was not found. No further retry: Not found: Tablet not found: 1860e56467624dcdb288e13b004f78cc
I20260810 11:30:49.405725 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 186) took 2705 ms. Trace:
I20260810 11:30:49.405808 28987 rpcz_store.cc:276] 0810 11:30:46.700222 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.700599 (+ 377us) service_pool.cc:227] Handling call
0810 11:30:49.405628 (+2705029us) ts_tablet_manager.cc:1145] Deleting tablet 34bd3c0edf6b49d1891c0ee9af344872
0810 11:30:49.405640 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.405704 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2704676}
W20260810 11:30:49.406333 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 34bd3c0edf6b49d1891c0ee9af344872 because the tablet was not found. No further retry: Not found: Tablet not found: 34bd3c0edf6b49d1891c0ee9af344872
I20260810 11:30:49.406695 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 188) took 2705 ms. Trace:
I20260810 11:30:49.406773 28987 rpcz_store.cc:276] 0810 11:30:46.700862 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.700907 (+ 45us) service_pool.cc:227] Handling call
0810 11:30:49.406613 (+2705706us) ts_tablet_manager.cc:1145] Deleting tablet 44d5e146eeec4fe0be33c1c169d32e68
0810 11:30:49.406624 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.406679 (+ 55us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2705542}
W20260810 11:30:49.407246 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 44d5e146eeec4fe0be33c1c169d32e68 because the tablet was not found. No further retry: Not found: Tablet not found: 44d5e146eeec4fe0be33c1c169d32e68
I20260810 11:30:49.407580 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 189) took 2706 ms. Trace:
I20260810 11:30:49.407684 28987 rpcz_store.cc:276] 0810 11:30:46.701206 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.701253 (+ 47us) service_pool.cc:227] Handling call
0810 11:30:49.407486 (+2706233us) ts_tablet_manager.cc:1145] Deleting tablet 55c8749861874eca9b63d3db97afa2b1
0810 11:30:49.407496 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.407557 (+ 61us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2706072}
I20260810 11:30:49.411989 26965 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
W20260810 11:30:49.412786 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 55c8749861874eca9b63d3db97afa2b1 because the tablet was not found. No further retry: Not found: Tablet not found: 55c8749861874eca9b63d3db97afa2b1
I20260810 11:30:49.414093 29603 ts_tablet_manager.cc:1918] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:49.422081 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 191) took 2720 ms. Trace:
I20260810 11:30:49.422585 28987 rpcz_store.cc:276] 0810 11:30:46.702084 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.702130 (+ 46us) service_pool.cc:227] Handling call
0810 11:30:49.421940 (+2719810us) ts_tablet_manager.cc:1145] Deleting tablet 834c9c99ec424bb39e8a003e9204b2bc
0810 11:30:49.421957 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.422051 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2719623}
W20260810 11:30:49.423239 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 834c9c99ec424bb39e8a003e9204b2bc because the tablet was not found. No further retry: Not found: Tablet not found: 834c9c99ec424bb39e8a003e9204b2bc
I20260810 11:30:49.423729 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 192) took 2721 ms. Trace:
I20260810 11:30:49.423861 28987 rpcz_store.cc:276] 0810 11:30:46.702427 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.702465 (+ 38us) service_pool.cc:227] Handling call
0810 11:30:49.423596 (+2721131us) ts_tablet_manager.cc:1145] Deleting tablet 10210204d5ff4e5e97c98fd255f674a5
0810 11:30:49.423609 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.423713 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2720981}
W20260810 11:30:49.424387 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 10210204d5ff4e5e97c98fd255f674a5 because the tablet was not found. No further retry: Not found: Tablet not found: 10210204d5ff4e5e97c98fd255f674a5
I20260810 11:30:49.426092 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 196) took 2722 ms. Trace:
I20260810 11:30:49.426280 28987 rpcz_store.cc:276] 0810 11:30:46.703502 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.703594 (+ 92us) service_pool.cc:227] Handling call
0810 11:30:49.425988 (+2722394us) ts_tablet_manager.cc:1145] Deleting tablet cb6805a5dd264939850ea2cd9a850a1f
0810 11:30:49.426001 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.426073 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2699130}
W20260810 11:30:49.426900 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet cb6805a5dd264939850ea2cd9a850a1f because the tablet was not found. No further retry: Not found: Tablet not found: cb6805a5dd264939850ea2cd9a850a1f
I20260810 11:30:49.432098 29626 sys_catalog.cc:455] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:49.432904 29626 sys_catalog.cc:458] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:49.416153 27048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65756c37fe514194bebe76921419653c" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:49.423877 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25557126afd4f51a31fba73cd7da219" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:49.435050 29603 log.cc:1196] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/7d3e78dcaa55491393f529ea33007786
I20260810 11:30:49.435664 29400 sys_catalog.cc:564] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 11:30:49.436314 29603 ts_tablet_manager.cc:1939] T 7d3e78dcaa55491393f529ea33007786 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:49.441495 29453 raft_consensus.cc:482] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:49.441671 29453 raft_consensus.cc:504] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.442510 29453 leader_election.cc:288] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:49.443835 26702 leader_election.cc:341] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 8228600e3f6b4f9993dd25e4ceb57e4d
I20260810 11:30:49.444578 29587 tablet.cc:1722] T f8e6fc49f5e54f6c8fb710220a6cbf0f P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:49.447443 28987 tablet_replica.cc:330] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:49.447808 28987 raft_consensus.cc:2229] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:49.448295 28987 raft_consensus.cc:2258] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.448500 29318 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 5 FOLLOWER]: Advancing to term 6
I20260810 11:30:49.449066 28987 ts_tablet_manager.cc:1905] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:49.449568 29603 tablet_replica.cc:330] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:49.454103 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8228600e3f6b4f9993dd25e4ceb57e4d" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:49.455539 26700 leader_election.cc:341] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.455713 26700 leader_election.cc:302] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.456238 29453 raft_consensus.cc:2726] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:49.457566 27228 tablet_bootstrap.cc:492] T 3a1e46f80f7f4e3a84638421892e6236 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:49.457777 27228 ts_tablet_manager.cc:1397] T 3a1e46f80f7f4e3a84638421892e6236 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.154s user 0.006s sys 0.000s
I20260810 11:30:49.434029 27231 tablet_bootstrap.cc:492] T f9c7ab7f075d459d8b1f1a0bb0e2e2d7 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:49.450409 29618 tablet.cc:1722] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:49.458762 27228 raft_consensus.cc:348] T 3a1e46f80f7f4e3a84638421892e6236 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.459156 27228 raft_consensus.cc:374] T 3a1e46f80f7f4e3a84638421892e6236 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.459287 27228 raft_consensus.cc:729] T 3a1e46f80f7f4e3a84638421892e6236 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.459571 27228 consensus_queue.cc:260] T 3a1e46f80f7f4e3a84638421892e6236 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.457782 29603 raft_consensus.cc:2229] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:49.463449 29603 raft_consensus.cc:2258] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.464254 29603 ts_tablet_manager.cc:1905] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:49.458130 27231 ts_tablet_manager.cc:1397] T f9c7ab7f075d459d8b1f1a0bb0e2e2d7 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.413s user 0.006s sys 0.005s
I20260810 11:30:49.469638 27231 raft_consensus.cc:348] T f9c7ab7f075d459d8b1f1a0bb0e2e2d7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.469988 27231 raft_consensus.cc:374] T f9c7ab7f075d459d8b1f1a0bb0e2e2d7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.470129 27231 raft_consensus.cc:729] T f9c7ab7f075d459d8b1f1a0bb0e2e2d7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.470434 27231 consensus_queue.cc:260] T f9c7ab7f075d459d8b1f1a0bb0e2e2d7 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.471306 27231 ts_tablet_manager.cc:1428] T f9c7ab7f075d459d8b1f1a0bb0e2e2d7 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:49.471717 27231 tablet_bootstrap.cc:492] T 9bfed03f765f4c5aa77604ebf2e211b0 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:49.472985 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:49.473507 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:49.474435 27231 tablet_bootstrap.cc:654] T 9bfed03f765f4c5aa77604ebf2e211b0 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.474918 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:49.475700 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f (table default.Table_11e3ca2d0589464586b01e41dcd46bbf [id=d63533f5d837481889b34a78d860e018]). Expected version 1 got 0
I20260810 11:30:49.480501 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b95f3ec8ff34c89a68cd1edf8391f9b" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:49.480764 27059 raft_consensus.cc:2454] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:49.481199 27059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "932ac2ae54324e6e830291ed449a31a8" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:49.460238 29500 rpcz_store.cc:276] 0810 11:30:47.298016 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.298074 (+ 58us) service_pool.cc:227] Handling call
0810 11:30:49.388645 (+2090571us) ts_tablet_manager.cc:1145] Deleting tablet 2da86554bc51486e91f1ea5995a245b5
0810 11:30:49.388661 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.388774 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2090307}
W20260810 11:30:49.485286 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 2da86554bc51486e91f1ea5995a245b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2da86554bc51486e91f1ea5995a245b5 already in progress: creating tablet
I20260810 11:30:49.486212 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9744f59d7e49430e91080f56f3342038 (table default.Table_2f179aff28124223a1c8ae3280a497e7 [id=a483de6ef1fc453b93e3f183e9c15dd1]). Expected version 1 got 0
I20260810 11:30:49.486217 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 252) took 2187 ms. Trace:
I20260810 11:30:49.486495 29500 rpcz_store.cc:276] 0810 11:30:47.298961 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.299098 (+ 137us) service_pool.cc:227] Handling call
0810 11:30:49.485993 (+2186895us) ts_tablet_manager.cc:1145] Deleting tablet ce73798a721b4a6d892f0c24b6b40e2c
0810 11:30:49.486017 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.486181 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2185906}
W20260810 11:30:49.487391 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 81b800247b4e4171b82dcde68e39fb00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81b800247b4e4171b82dcde68e39fb00 already in progress: creating tablet
I20260810 11:30:49.487596 26753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00e63f994ff84941852b0cfee763c303" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.487679 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 253) took 2187 ms. Trace:
I20260810 11:30:49.487779 29500 rpcz_store.cc:276] 0810 11:30:47.300803 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.300959 (+ 156us) service_pool.cc:227] Handling call
0810 11:30:49.487429 (+2186470us) ts_tablet_manager.cc:1145] Deleting tablet cc76d30f37094391b75076c92ccc277f
0810 11:30:49.487443 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.487656 (+ 213us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2186053}
I20260810 11:30:49.488332 29619 tablet.cc:1722] T 9744f59d7e49430e91080f56f3342038 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 11:30:49.488492 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet cc76d30f37094391b75076c92ccc277f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc76d30f37094391b75076c92ccc277f already in progress: creating tablet
I20260810 11:30:49.489091 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
I20260810 11:30:49.489127 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 254) took 2186 ms. Trace:
I20260810 11:30:49.489281 29631 tablet.cc:1722] T 88268e3571884ac88c1a617ce74499f3 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:49.489387 29500 rpcz_store.cc:276] 0810 11:30:47.302613 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.302678 (+ 65us) service_pool.cc:227] Handling call
0810 11:30:49.488972 (+2186294us) ts_tablet_manager.cc:1145] Deleting tablet ea66da5bc20e4718901ffc473677421c
0810 11:30:49.488986 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.489105 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2185938}
I20260810 11:30:49.489866 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:49.490084 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
W20260810 11:30:49.490139 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ea66da5bc20e4718901ffc473677421c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea66da5bc20e4718901ffc473677421c already in progress: creating tablet
I20260810 11:30:49.490681 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 255) took 2186 ms. Trace:
I20260810 11:30:49.490773 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d91cb30457a74d51885ad81c4ab89d71 (table default.Table_1ec5963e30f5468cbde77670965bf92b [id=e985b1ae60d94bfa998e1986bdf3fcd9]). Expected version 1 got 0
I20260810 11:30:49.491021 29500 rpcz_store.cc:276] 0810 11:30:47.304121 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.304283 (+ 162us) service_pool.cc:227] Handling call
0810 11:30:49.490555 (+2186272us) ts_tablet_manager.cc:1145] Deleting tablet 81f24c84cdd945b78f39f24015eb1e43
0810 11:30:49.490571 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.490642 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2185863}
I20260810 11:30:49.491382 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:49.491830 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:49.492287 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_883130a240194491bd23c14d9aff2e99 [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 2 got 0
W20260810 11:30:49.492805 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 81f24c84cdd945b78f39f24015eb1e43 because the tablet was not found. No further retry: Not found: Tablet not found: 81f24c84cdd945b78f39f24015eb1e43
I20260810 11:30:49.493561 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 256) took 2184 ms. Trace:
I20260810 11:30:49.493889 29500 rpcz_store.cc:276] 0810 11:30:47.309879 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.310406 (+ 527us) service_pool.cc:227] Handling call
0810 11:30:49.493443 (+2183037us) ts_tablet_manager.cc:1145] Deleting tablet 7e78fb1bf0534deca5cc5a603fd77592
0810 11:30:49.493459 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.493538 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2182286}
W20260810 11:30:49.494681 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7e78fb1bf0534deca5cc5a603fd77592 because the tablet was not found. No further retry: Not found: Tablet not found: 7e78fb1bf0534deca5cc5a603fd77592
I20260810 11:30:49.495186 29318 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 6 FOLLOWER]: Refusing update from remote peer ac259bcf213a4aa297d1d8e73b262361: Log matching property violated. Preceding OpId in replica: term: 5 index: 604. Preceding OpId from leader: term: 4 index: 604. (term mismatch)
I20260810 11:30:49.495302 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 257) took 2181 ms. Trace:
I20260810 11:30:49.495536 29500 rpcz_store.cc:276] 0810 11:30:47.314246 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.315219 (+ 973us) service_pool.cc:227] Handling call
0810 11:30:49.495067 (+2179848us) ts_tablet_manager.cc:1145] Deleting tablet ac4b1821ac30452cbe7a8f844d9b37e5
0810 11:30:49.495082 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.495280 (+ 198us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2179389}
I20260810 11:30:49.500710 29318 pending_rounds.cc:76] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Aborting all ops after (but not including) 603
I20260810 11:30:49.501204 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]) successfully deleted
I20260810 11:30:49.501784 29318 pending_rounds.cc:97] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: Aborting uncommitted NO_OP operation due to leader change: 5.604
I20260810 11:30:49.502319 29318 raft_consensus.cc:2866] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260810 11:30:49.503665 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:49.504105 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 501defb075d142ec8b22e5e8236a009c (table default.Table_03d4151647a047a1b1ba29fdba43f80d [id=46bda36574e1430dbada751ccf16703c]). Expected version 1 got 0
I20260810 11:30:49.504479 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:49.506839 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:49.498788 29611 consensus_queue.cc:1035] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:49.512794 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet 524c8d37d3964e368695d182883b0bd5 with delete_type TABLET_DATA_DELETED (replaced by tablet a09cf2b015414598b9e9b6e76eb0a9df) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:49.500108 29491 consensus_queue.cc:1035] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:49.500509 26848 consensus_peers.cc:487] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a3079a68c1c74b64bf13877bd0ee68c3. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:49.513777 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 262) took 2182 ms. Trace:
I20260810 11:30:49.513912 29500 rpcz_store.cc:276] 0810 11:30:47.331236 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.331411 (+ 175us) service_pool.cc:227] Handling call
0810 11:30:49.513611 (+2182200us) ts_tablet_manager.cc:1145] Deleting tablet b200bdb394d3439b86fff48494be8e3d
0810 11:30:49.513628 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.513753 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2181898}
W20260810 11:30:49.514178 26848 leader_election.cc:341] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 3ae27bf110114b70a3e3f6cf64f31b98
I20260810 11:30:49.514319 26848 leader_election.cc:302] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
W20260810 11:30:49.514490 26848 raft_consensus.cc:2670] T 3ae27bf110114b70a3e3f6cf64f31b98 P b6079090b1124d84aa4477974bb53700: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 11:30:49.514997 26848 leader_election.cc:302] T 65756c37fe514194bebe76921419653c P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:49.516471 29612 raft_consensus.cc:2726] T 65756c37fe514194bebe76921419653c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:49.506523 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41120 (request call id 0) took 3375 ms. Trace:
W20260810 11:30:49.517001 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ac4b1821ac30452cbe7a8f844d9b37e5 because the tablet was not found. No further retry: Not found: Tablet not found: ac4b1821ac30452cbe7a8f844d9b37e5
W20260810 11:30:49.517405 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet b200bdb394d3439b86fff48494be8e3d because the tablet was not found. No further retry: Not found: Tablet not found: b200bdb394d3439b86fff48494be8e3d
I20260810 11:30:49.517706 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:49.518438 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bb078d7c0d0e4cf5aa841a802e78d8ff (table default.Table_eb5bb59579c043d7b1d98e60e42899af [id=65218ea1c77a4098a4f1145607695dbd]). Expected version 1 got 0
I20260810 11:30:49.482635 26749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6eb6dc4b6f34e598933853717b86866" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.519843 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:49.517038 29318 rpcz_store.cc:276] 0810 11:30:46.130937 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.131302 (+ 365us) service_pool.cc:227] Handling call
0810 11:30:49.437635 (+3306333us) raft_consensus.cc:1457] Updating replica for 107 ops
0810 11:30:49.503053 (+ 65418us) raft_consensus.cc:1683] Filling consensus response to leader.
0810 11:30:49.506318 (+ 3265us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:49.501921 27228 ts_tablet_manager.cc:1428] T 3a1e46f80f7f4e3a84638421892e6236 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.044s user 0.002s sys 0.000s
I20260810 11:30:49.521793 27228 tablet_bootstrap.cc:492] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:49.523908 29606 consensus_queue.cc:1037] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 605, Last known committed idx: 603, Time since last communication: 0.000s
I20260810 11:30:49.525840 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet 9079c8fec89043be9d0040a3728e93f4 with delete_type TABLET_DATA_DELETED (replaced by tablet e95537eb35194e8fa014a765d693bf18) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:49.525938 27228 tablet_bootstrap.cc:654] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.527172 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet 8400c601e9894ea9b68679f6d7927456 with delete_type TABLET_DATA_DELETED (replaced by tablet 323c8344408b456398526cec03708f4e) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:49.529112 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet a45422addab84e9083df8665a0cf9322 with delete_type TABLET_DATA_DELETED (replaced by tablet 8920061626614b219424eaba8f19e368) from {username='slave'} at 127.0.0.1:58800
W20260810 11:30:49.529492 26993 leader_election.cc:341] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.530825 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bcc69e8f87134d25a1329be52b08e794 (table default.Table_4e93c67b823f48028820e1e95415e455 [id=b4c0c92ef07f432cbb00a36ecd17d394]). Expected version 1 got 0
I20260810 11:30:49.531587 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f10ac7e043c240d8a14b2b4f96b864b9 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:49.532231 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:49.532763 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_b472377e613b4475b7a0b58062d44535 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 2 got 0
I20260810 11:30:49.533068 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:49.535920 26993 leader_election.cc:302] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.484874 26750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb01711769f457aa0696bb59582166d" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.539894 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:49.542531 27231 tablet_bootstrap.cc:492] T 9bfed03f765f4c5aa77604ebf2e211b0 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:49.543407 29593 raft_consensus.cc:2726] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:49.486831 26758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17ff4152fc6a449db3a172c5d948168f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.544708 27231 ts_tablet_manager.cc:1397] T 9bfed03f765f4c5aa77604ebf2e211b0 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.073s user 0.005s sys 0.000s
I20260810 11:30:49.545452 27231 raft_consensus.cc:348] T 9bfed03f765f4c5aa77604ebf2e211b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.486186 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "997cff3351724953bd9c792085a38364" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.548645 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:49.548979 26848 leader_election.cc:302] T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:49.549677 29491 raft_consensus.cc:2726] T e25557126afd4f51a31fba73cd7da219 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:49.551016 26848 leader_election.cc:302] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:49.551326 29491 raft_consensus.cc:2781] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:49.551401 29491 raft_consensus.cc:482] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:49.551455 29491 raft_consensus.cc:3037] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:49.554557 26577 catalog_manager.cc:5495] T 859477ecf37240a4888542d2559f99cd P b6079090b1124d84aa4477974bb53700 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:49.555341 29491 raft_consensus.cc:504] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.555662 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c317ccebde05457d9e81c5c871638092 (table default.Table_8c0c1ab3bbb944c888930a5d8116d888 [id=7b4e4650915f4c16bef68adf43618b89]). Expected version 1 got 0
I20260810 11:30:49.556074 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:49.556092 29491 leader_election.cc:288] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:49.556783 26848 leader_election.cc:302] T 932ac2ae54324e6e830291ed449a31a8 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:49.557467 29491 raft_consensus.cc:2726] T 932ac2ae54324e6e830291ed449a31a8 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:49.562769 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:49.562711 26751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b95f3ec8ff34c89a68cd1edf8391f9b" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:49.563563 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:49.514333 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 259) took 2196 ms. Trace:
I20260810 11:30:49.564303 29500 rpcz_store.cc:276] 0810 11:30:47.329141 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.330395 (+ 1254us) service_pool.cc:227] Handling call
0810 11:30:49.514209 (+2183814us) ts_tablet_manager.cc:1145] Deleting tablet db59523b71224370bf5fce6b56592f71
0810 11:30:49.514220 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.514316 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2177886}
I20260810 11:30:49.564699 27231 raft_consensus.cc:374] T 9bfed03f765f4c5aa77604ebf2e211b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.564899 27231 raft_consensus.cc:729] T 9bfed03f765f4c5aa77604ebf2e211b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.565425 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_5256d55e5aee47ee88a92177e8df8577 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 3 got 2
I20260810 11:30:49.565305 27231 consensus_queue.cc:260] T 9bfed03f765f4c5aa77604ebf2e211b0 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.566165 29455 raft_consensus.cc:482] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:49.566288 29455 raft_consensus.cc:504] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.566972 29455 leader_election.cc:288] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:49.568300 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:49.568522 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:49.569770 26577 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 34ed8c9efa634fc7b091b1bb6bc6d452 (table default.Table_3818fdea177c4bb589ab0e9ab54f7f51 [id=7c8348b49b664bee8d8243efb2cdbb79]). Expected version 1 got 0
W20260810 11:30:49.543701 26993 leader_election.cc:341] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.580814 26993 leader_election.cc:302] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.581205 29593 raft_consensus.cc:2726] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:49.583385 26993 leader_election.cc:341] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.583709 26993 leader_election.cc:302] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.584076 29593 raft_consensus.cc:2726] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:49.585114 26993 leader_election.cc:341] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.585361 26993 leader_election.cc:302] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.585685 29593 raft_consensus.cc:2726] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:49.585680 28987 ts_tablet_manager.cc:1918] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:49.585824 28987 log.cc:1196] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/43fee1a9a6f9482fbbe6ab6599c27fb9
I20260810 11:30:49.586217 28987 ts_tablet_manager.cc:1939] T 43fee1a9a6f9482fbbe6ab6599c27fb9 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
W20260810 11:30:49.586423 26993 leader_election.cc:341] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.586666 26993 leader_election.cc:302] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.587000 29593 raft_consensus.cc:2726] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:49.587189 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 197) took 2883 ms. Trace:
I20260810 11:30:49.587882 28987 rpcz_store.cc:276] 0810 11:30:46.703681 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.703792 (+ 111us) service_pool.cc:227] Handling call
0810 11:30:49.447383 (+2743591us) ts_tablet_manager.cc:1145] Deleting tablet 43fee1a9a6f9482fbbe6ab6599c27fb9
0810 11:30:49.447398 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.511871 (+ 64473us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.585461 (+ 73590us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.587165 (+ 1704us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2720443}
I20260810 11:30:49.589151 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 (table default.Table_340e7b53369c44cda0cb60ddbb328ccc [id=7861512191c341b9a85c6a1885a52ca7]) successfully deleted
I20260810 11:30:49.589812 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 198) took 2886 ms. Trace:
I20260810 11:30:49.590617 28987 rpcz_store.cc:276] 0810 11:30:46.703776 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.703955 (+ 179us) service_pool.cc:227] Handling call
0810 11:30:49.589662 (+2885707us) ts_tablet_manager.cc:1145] Deleting tablet 91b6078efadf496fb252f725bdf56b02
0810 11:30:49.589676 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.589761 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2862675}
W20260810 11:30:49.591708 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 91b6078efadf496fb252f725bdf56b02 because the tablet was not found. No further retry: Not found: Tablet not found: 91b6078efadf496fb252f725bdf56b02
I20260810 11:30:49.592309 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 208) took 2865 ms. Trace:
I20260810 11:30:49.588033 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518c777e40ec40dcb3484c0374384959" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:49.597115 26991 leader_election.cc:341] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.597693 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 260) took 2266 ms. Trace:
W20260810 11:30:49.598024 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet db59523b71224370bf5fce6b56592f71 because the tablet was not found. No further retry: Not found: Tablet not found: db59523b71224370bf5fce6b56592f71
I20260810 11:30:49.598201 29500 rpcz_store.cc:276] 0810 11:30:47.330772 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.330853 (+ 81us) service_pool.cc:227] Handling call
0810 11:30:49.597572 (+2266719us) ts_tablet_manager.cc:1145] Deleting tablet 0713f4f14a284050a7774a70ab974f30
0810 11:30:49.597586 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.597676 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2261223}
I20260810 11:30:49.598896 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 261) took 2267 ms. Trace:
W20260810 11:30:49.598996 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 0713f4f14a284050a7774a70ab974f30 because the tablet was not found. No further retry: Not found: Tablet not found: 0713f4f14a284050a7774a70ab974f30
W20260810 11:30:49.596318 26849 leader_election.cc:341] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.601511 27228 tablet_bootstrap.cc:492] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:49.601722 27231 ts_tablet_manager.cc:1428] T 9bfed03f765f4c5aa77604ebf2e211b0 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.057s user 0.001s sys 0.001s
I20260810 11:30:49.599381 29500 rpcz_store.cc:276] 0810 11:30:47.331017 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.331139 (+ 122us) service_pool.cc:227] Handling call
0810 11:30:49.598798 (+2267659us) ts_tablet_manager.cc:1145] Deleting tablet e31b380f99854eb8b63e1f9eede1fc7c
0810 11:30:49.598808 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.598878 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2262387}
W20260810 11:30:49.602735 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet e31b380f99854eb8b63e1f9eede1fc7c because the tablet was not found. No further retry: Not found: Tablet not found: e31b380f99854eb8b63e1f9eede1fc7c
I20260810 11:30:49.604079 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 263) took 2272 ms. Trace:
I20260810 11:30:49.604200 29500 rpcz_store.cc:276] 0810 11:30:47.331335 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.357785 (+ 26450us) service_pool.cc:227] Handling call
0810 11:30:49.603916 (+2246131us) ts_tablet_manager.cc:1145] Deleting tablet 49db12565dbc4187b78a98ed35c40fed
0810 11:30:49.603932 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.604053 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2245816}
W20260810 11:30:49.604887 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 49db12565dbc4187b78a98ed35c40fed because the tablet was not found. No further retry: Not found: Tablet not found: 49db12565dbc4187b78a98ed35c40fed
I20260810 11:30:49.607630 27228 ts_tablet_manager.cc:1397] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.086s user 0.001s sys 0.005s
I20260810 11:30:49.608481 27228 raft_consensus.cc:348] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.608886 27228 raft_consensus.cc:374] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.609012 27228 raft_consensus.cc:729] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.609303 27228 consensus_queue.cc:260] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.609696 27231 tablet_bootstrap.cc:492] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:49.610107 27228 ts_tablet_manager.cc:1428] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:49.610461 27228 tablet_bootstrap.cc:492] T 1549a26ba0f6427fae87b204c5d49eff P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:49.534556 29603 ts_tablet_manager.cc:1918] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:49.611152 29603 log.cc:1196] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/983916da755d4d14b7a3d43bb7cbc9c4
I20260810 11:30:49.612800 29603 ts_tablet_manager.cc:1939] T 983916da755d4d14b7a3d43bb7cbc9c4 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:49.623858 29603 tablet_replica.cc:330] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:49.611893 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 264) took 2253 ms. Trace:
I20260810 11:30:49.624771 29500 rpcz_store.cc:276] 0810 11:30:47.358608 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.358694 (+ 86us) service_pool.cc:227] Handling call
0810 11:30:49.611703 (+2253009us) ts_tablet_manager.cc:1145] Deleting tablet 110b5acc36bd4d6bba13735e5daec75f
0810 11:30:49.611720 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.611868 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2252758}
W20260810 11:30:49.625907 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 110b5acc36bd4d6bba13735e5daec75f because the tablet was not found. No further retry: Not found: Tablet not found: 110b5acc36bd4d6bba13735e5daec75f
I20260810 11:30:49.626652 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 267) took 2001 ms. Trace:
I20260810 11:30:49.626842 29500 rpcz_store.cc:276] 0810 11:30:47.624821 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.624878 (+ 57us) service_pool.cc:227] Handling call
0810 11:30:49.626488 (+2001610us) ts_tablet_manager.cc:1145] Deleting tablet 7cd4f555b5d840c182a31b3c94da9619
0810 11:30:49.626503 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.626629 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2001277}
W20260810 11:30:49.627478 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 7cd4f555b5d840c182a31b3c94da9619 because the tablet was not found. No further retry: Not found: Tablet not found: 7cd4f555b5d840c182a31b3c94da9619
I20260810 11:30:49.627996 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 268) took 2002 ms. Trace:
I20260810 11:30:49.629022 29491 raft_consensus.cc:482] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:49.629215 29491 raft_consensus.cc:504] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.629529 29603 raft_consensus.cc:2229] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:49.629778 29603 raft_consensus.cc:2258] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.629827 29491 leader_election.cc:288] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:49.630352 29603 ts_tablet_manager.cc:1905] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:49.630748 29500 rpcz_store.cc:276] 0810 11:30:47.625489 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.625534 (+ 45us) service_pool.cc:227] Handling call
0810 11:30:49.627854 (+2002320us) ts_tablet_manager.cc:1145] Deleting tablet d512c335e340437fa32f2dc16dca6812
0810 11:30:49.627865 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.627977 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2002097}
W20260810 11:30:49.631387 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet d512c335e340437fa32f2dc16dca6812 because the tablet was not found. No further retry: Not found: Tablet not found: d512c335e340437fa32f2dc16dca6812
I20260810 11:30:49.631824 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 275) took 1975 ms. Trace:
I20260810 11:30:49.629297 27231 tablet_bootstrap.cc:654] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.631937 29500 rpcz_store.cc:276] 0810 11:30:47.656806 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.656865 (+ 59us) service_pool.cc:227] Handling call
0810 11:30:49.631671 (+1974806us) ts_tablet_manager.cc:1145] Deleting tablet 0edef936026743a896d5a73c134a8bca
0810 11:30:49.631682 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.631807 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1974539}
W20260810 11:30:49.622134 26993 leader_election.cc:341] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.632266 26993 leader_election.cc:302] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
W20260810 11:30:49.632457 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 0edef936026743a896d5a73c134a8bca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0edef936026743a896d5a73c134a8bca already in progress: creating tablet
I20260810 11:30:49.632712 29291 raft_consensus.cc:2726] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:49.633656 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 276) took 1976 ms. Trace:
I20260810 11:30:49.633749 29500 rpcz_store.cc:276] 0810 11:30:47.657287 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.657337 (+ 50us) service_pool.cc:227] Handling call
0810 11:30:49.633476 (+1976139us) ts_tablet_manager.cc:1145] Deleting tablet 4827800160e64883ba7bcadafeb13ead
0810 11:30:49.633487 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.633639 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1975958}
W20260810 11:30:49.634351 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 4827800160e64883ba7bcadafeb13ead because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4827800160e64883ba7bcadafeb13ead already in progress: creating tablet
I20260810 11:30:49.634779 27228 tablet_bootstrap.cc:654] T 1549a26ba0f6427fae87b204c5d49eff P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.635133 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 277) took 1977 ms. Trace:
I20260810 11:30:49.635538 29500 rpcz_store.cc:276] 0810 11:30:47.657692 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.658504 (+ 812us) service_pool.cc:227] Handling call
0810 11:30:49.634948 (+1976444us) ts_tablet_manager.cc:1145] Deleting tablet e700aa4c0c45496db8a2b4f4d6d746a4
0810 11:30:49.634959 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.635117 (+ 158us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1976133}
I20260810 11:30:49.601413 27222 tablet_bootstrap.cc:492] T e69916a35fba4714bbc565921738888f P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:49.630930 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6926d0dc68fa48ae8ffabf5b5272b3d0" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.636675 27222 ts_tablet_manager.cc:1397] T e69916a35fba4714bbc565921738888f P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.236s user 0.004s sys 0.005s
W20260810 11:30:49.636785 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet e700aa4c0c45496db8a2b4f4d6d746a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e700aa4c0c45496db8a2b4f4d6d746a4 already in progress: creating tablet
I20260810 11:30:49.637161 29500 tablet_replica.cc:330] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:49.637370 29500 raft_consensus.cc:2229] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:49.637643 29500 raft_consensus.cc:2258] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.637821 27222 raft_consensus.cc:348] T e69916a35fba4714bbc565921738888f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.638062 27222 raft_consensus.cc:374] T e69916a35fba4714bbc565921738888f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.638131 27222 raft_consensus.cc:729] T e69916a35fba4714bbc565921738888f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.638398 27222 consensus_queue.cc:260] T e69916a35fba4714bbc565921738888f P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.639067 27222 ts_tablet_manager.cc:1428] T e69916a35fba4714bbc565921738888f P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:49.639425 27222 tablet_bootstrap.cc:492] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:49.641275 27222 tablet_bootstrap.cc:654] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.641136 26580 catalog_manager.cc:5495] T 3a1e46f80f7f4e3a84638421892e6236 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:49.642591 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:49.642791 28987 rpcz_store.cc:276] 0810 11:30:46.726906 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.727006 (+ 100us) service_pool.cc:227] Handling call
0810 11:30:49.592175 (+2865169us) ts_tablet_manager.cc:1145] Deleting tablet 7ff5b980ce4e41d7a6e1ca0e740b739c
0810 11:30:49.592188 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.592272 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2864966}
I20260810 11:30:49.643486 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 200) took 2939 ms. Trace:
I20260810 11:30:49.643512 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:49.643647 28987 rpcz_store.cc:276] 0810 11:30:46.704208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.704279 (+ 71us) service_pool.cc:227] Handling call
0810 11:30:49.643355 (+2939076us) ts_tablet_manager.cc:1145] Deleting tablet a8a65a0e8b1f4e4b8d9a82059b766cda
0810 11:30:49.643369 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.643451 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2915970}
I20260810 11:30:49.644124 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 202) took 2939 ms. Trace:
I20260810 11:30:49.644258 28987 rpcz_store.cc:276] 0810 11:30:46.704760 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.704809 (+ 49us) service_pool.cc:227] Handling call
0810 11:30:49.644028 (+2939219us) ts_tablet_manager.cc:1145] Deleting tablet a63227e69df14a4ea935087fd31ece63
0810 11:30:49.644038 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.644091 (+ 53us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2916610}
W20260810 11:30:49.644786 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7ff5b980ce4e41d7a6e1ca0e740b739c because the tablet was not found. No further retry: Not found: Tablet not found: 7ff5b980ce4e41d7a6e1ca0e740b739c
I20260810 11:30:49.645020 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 201) took 2940 ms. Trace:
W20260810 11:30:49.645193 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet a8a65a0e8b1f4e4b8d9a82059b766cda because the tablet was not found. No further retry: Not found: Tablet not found: a8a65a0e8b1f4e4b8d9a82059b766cda
I20260810 11:30:49.645126 28987 rpcz_store.cc:276] 0810 11:30:46.704355 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.704417 (+ 62us) service_pool.cc:227] Handling call
0810 11:30:49.644885 (+2940468us) ts_tablet_manager.cc:1145] Deleting tablet a835d30ef9fc474ab927bb119a95d83c
0810 11:30:49.644899 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.644974 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":62,"tablet-delete.queue_time_us":2917497}
W20260810 11:30:49.645443 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet a63227e69df14a4ea935087fd31ece63 because the tablet was not found. No further retry: Not found: Tablet not found: a63227e69df14a4ea935087fd31ece63
I20260810 11:30:49.645762 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 209) took 2918 ms. Trace:
W20260810 11:30:49.645732 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet a835d30ef9fc474ab927bb119a95d83c because the tablet was not found. No further retry: Not found: Tablet not found: a835d30ef9fc474ab927bb119a95d83c
I20260810 11:30:49.645866 28987 rpcz_store.cc:276] 0810 11:30:46.727016 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.727238 (+ 222us) service_pool.cc:227] Handling call
0810 11:30:49.645651 (+2918413us) ts_tablet_manager.cc:1145] Deleting tablet 2634beb347714fc7a2e05865adb34a22
0810 11:30:49.645662 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.645723 (+ 61us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2918123}
I20260810 11:30:49.646196 29500 ts_tablet_manager.cc:1905] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:49.633368 26993 leader_election.cc:341] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.647495 26993 leader_election.cc:302] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.647778 29291 raft_consensus.cc:2726] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:49.648182 26993 leader_election.cc:341] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.648293 26993 leader_election.cc:302] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.648497 29291 raft_consensus.cc:2726] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:49.648890 26993 leader_election.cc:341] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.649005 26993 leader_election.cc:302] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.649206 29291 raft_consensus.cc:2726] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:49.649652 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
W20260810 11:30:49.649523 26993 leader_election.cc:341] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.649968 26993 leader_election.cc:302] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.650233 29291 raft_consensus.cc:2726] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:49.651057 26993 leader_election.cc:341] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.651237 26993 leader_election.cc:302] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.651546 29593 raft_consensus.cc:2726] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:49.651744 26993 leader_election.cc:341] T a4dde1d1eef74911b20498149e8c1785 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.651950 26993 leader_election.cc:302] T a4dde1d1eef74911b20498149e8c1785 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.650601 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
W20260810 11:30:49.652385 26993 leader_election.cc:341] T 77f0c916ccf24e86b0ec29de1ba54b84 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.652489 29593 raft_consensus.cc:2726] T a4dde1d1eef74911b20498149e8c1785 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:49.652683 26993 leader_election.cc:302] T 77f0c916ccf24e86b0ec29de1ba54b84 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.652907 29593 raft_consensus.cc:2726] T 77f0c916ccf24e86b0ec29de1ba54b84 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:49.653287 26993 leader_election.cc:341] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.653458 26993 leader_election.cc:302] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.653772 29593 raft_consensus.cc:2726] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:49.654114 26993 leader_election.cc:341] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.654808 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:49.655486 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
I20260810 11:30:49.656201 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f (table default.Table_11e3ca2d0589464586b01e41dcd46bbf [id=d63533f5d837481889b34a78d860e018]). Expected version 1 got 0
I20260810 11:30:49.657080 26993 leader_election.cc:302] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.657335 29593 raft_consensus.cc:2726] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:49.657943 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:49.658440 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:49.659091 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_883130a240194491bd23c14d9aff2e99 [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 2 got 0
W20260810 11:30:49.659129 26993 leader_election.cc:341] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.659261 26993 leader_election.cc:302] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.659498 29593 raft_consensus.cc:2726] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:49.659938 26993 leader_election.cc:341] T b6eb6dc4b6f34e598933853717b86866 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.660056 26993 leader_election.cc:302] T b6eb6dc4b6f34e598933853717b86866 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.660303 29593 raft_consensus.cc:2726] T b6eb6dc4b6f34e598933853717b86866 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:49.660276 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:49.660667 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:49.661139 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
W20260810 11:30:49.661190 26993 leader_election.cc:341] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.661294 26993 leader_election.cc:302] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.661495 29593 raft_consensus.cc:2726] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:49.662159 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bb078d7c0d0e4cf5aa841a802e78d8ff (table default.Table_eb5bb59579c043d7b1d98e60e42899af [id=65218ea1c77a4098a4f1145607695dbd]). Expected version 1 got 0
W20260810 11:30:49.662326 26993 leader_election.cc:341] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.662441 26993 leader_election.cc:302] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.662673 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_b472377e613b4475b7a0b58062d44535 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 2 got 0
I20260810 11:30:49.662693 29593 raft_consensus.cc:2726] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:49.663079 26993 leader_election.cc:341] T 997cff3351724953bd9c792085a38364 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.663198 26993 leader_election.cc:302] T 997cff3351724953bd9c792085a38364 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:49.663432 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6]). Expected version 1 got 0
I20260810 11:30:49.663962 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bcc69e8f87134d25a1329be52b08e794 (table default.Table_4e93c67b823f48028820e1e95415e455 [id=b4c0c92ef07f432cbb00a36ecd17d394]). Expected version 1 got 0
I20260810 11:30:49.664256 27231 tablet_bootstrap.cc:492] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:49.664413 27231 ts_tablet_manager.cc:1397] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.002s
I20260810 11:30:49.664691 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:49.665112 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:49.665375 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f10ac7e043c240d8a14b2b4f96b864b9 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:49.665716 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d91cb30457a74d51885ad81c4ab89d71 (table default.Table_1ec5963e30f5468cbde77670965bf92b [id=e985b1ae60d94bfa998e1986bdf3fcd9]). Expected version 1 got 0
I20260810 11:30:49.666090 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:49.667762 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:49.668169 29491 raft_consensus.cc:482] T 3a1e46f80f7f4e3a84638421892e6236 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:49.668366 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 501defb075d142ec8b22e5e8236a009c (table default.Table_03d4151647a047a1b1ba29fdba43f80d [id=46bda36574e1430dbada751ccf16703c]). Expected version 1 got 0
I20260810 11:30:49.668322 29491 raft_consensus.cc:504] T 3a1e46f80f7f4e3a84638421892e6236 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.669028 29491 leader_election.cc:288] T 3a1e46f80f7f4e3a84638421892e6236 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:49.670084 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:49.670423 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:49.670936 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c62ae41d2dd74eedbe252c4de70fbe1e (table default.Table_5256d55e5aee47ee88a92177e8df8577 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 3 got 2
I20260810 11:30:49.671221 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:49.671600 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:49.671921 26580 catalog_manager.cc:5495] T 932ac2ae54324e6e830291ed449a31a8 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:49.672632 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c317ccebde05457d9e81c5c871638092 (table default.Table_8c0c1ab3bbb944c888930a5d8116d888 [id=7b4e4650915f4c16bef68adf43618b89]). Expected version 1 got 0
I20260810 11:30:49.673547 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:49.673959 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:49.674312 26580 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 34ed8c9efa634fc7b091b1bb6bc6d452 (table default.Table_3818fdea177c4bb589ab0e9ab54f7f51 [id=7c8348b49b664bee8d8243efb2cdbb79]). Expected version 1 got 0
I20260810 11:30:49.675057 26575 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_f83bc0d49a5446278b9f4394d96e900c [id=610cb6c79be54cf3a757b9eefa3cb94b] alter complete (version 2)
I20260810 11:30:49.677714 29500 ts_tablet_manager.cc:1918] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:49.677846 29500 log.cc:1196] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/a3079a68c1c74b64bf13877bd0ee68c3
W20260810 11:30:49.678260 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2634beb347714fc7a2e05865adb34a22 because the tablet was not found. No further retry: Not found: Tablet not found: 2634beb347714fc7a2e05865adb34a22
I20260810 11:30:49.678372 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 204) took 2961 ms. Trace:
I20260810 11:30:49.678475 28987 rpcz_store.cc:276] 0810 11:30:46.716914 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.718003 (+ 1089us) service_pool.cc:227] Handling call
0810 11:30:49.678232 (+2960229us) ts_tablet_manager.cc:1145] Deleting tablet f7ada1df82eb44ecb9a6c615b5410e6f
0810 11:30:49.678248 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.678329 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2950654}
W20260810 11:30:49.679075 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet f7ada1df82eb44ecb9a6c615b5410e6f because the tablet was not found. No further retry: Not found: Tablet not found: f7ada1df82eb44ecb9a6c615b5410e6f
I20260810 11:30:49.679613 29500 ts_tablet_manager.cc:1939] T a3079a68c1c74b64bf13877bd0ee68c3 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:49.679600 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 199) took 2975 ms. Trace:
I20260810 11:30:49.655689 29453 raft_consensus.cc:482] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:49.679713 28987 rpcz_store.cc:276] 0810 11:30:46.703880 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.703927 (+ 47us) service_pool.cc:227] Handling call
0810 11:30:49.679432 (+2975505us) ts_tablet_manager.cc:1145] Deleting tablet 10e6c41db71a4146840f06c5b7412d9c
0810 11:30:49.679446 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.679508 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2951821}
I20260810 11:30:49.679813 29453 raft_consensus.cc:504] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.679996 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 270) took 2028 ms. Trace:
W20260810 11:30:49.680150 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 10e6c41db71a4146840f06c5b7412d9c because the tablet was not found. No further retry: Not found: Tablet not found: 10e6c41db71a4146840f06c5b7412d9c
I20260810 11:30:49.680086 29500 rpcz_store.cc:276] 0810 11:30:47.652017 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.662955 (+ 10938us) service_pool.cc:227] Handling call
0810 11:30:49.637114 (+1974159us) ts_tablet_manager.cc:1145] Deleting tablet a3079a68c1c74b64bf13877bd0ee68c3
0810 11:30:49.637125 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.659334 (+ 22209us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.677588 (+ 18254us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.679977 (+ 2389us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1973744}
I20260810 11:30:49.680540 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]) successfully deleted
I20260810 11:30:49.681954 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 278) took 2024 ms. Trace:
I20260810 11:30:49.682402 29500 rpcz_store.cc:276] 0810 11:30:47.657790 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.739859 (+ 82069us) service_pool.cc:227] Handling call
0810 11:30:49.681826 (+1941967us) ts_tablet_manager.cc:1145] Deleting tablet 5a2e1b54043444989ac64c87f30ffc07
0810 11:30:49.681838 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.681933 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1941571}
I20260810 11:30:49.682789 29593 raft_consensus.cc:2726] T 997cff3351724953bd9c792085a38364 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:49.682879 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 5a2e1b54043444989ac64c87f30ffc07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a2e1b54043444989ac64c87f30ffc07 already in progress: creating tablet
I20260810 11:30:49.683346 27231 raft_consensus.cc:348] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.683563 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 279) took 1943 ms. Trace:
I20260810 11:30:49.683604 27231 raft_consensus.cc:374] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.683658 27231 raft_consensus.cc:729] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.683967 27231 consensus_queue.cc:260] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.684010 29500 rpcz_store.cc:276] 0810 11:30:47.740489 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.740541 (+ 52us) service_pool.cc:227] Handling call
0810 11:30:49.683436 (+1942895us) ts_tablet_manager.cc:1145] Deleting tablet 25efcc18e8444b09ae2556345c36a710
0810 11:30:49.683447 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.683545 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1942627}
I20260810 11:30:49.684826 27231 ts_tablet_manager.cc:1428] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.020s user 0.003s sys 0.000s
W20260810 11:30:49.684870 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 25efcc18e8444b09ae2556345c36a710 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25efcc18e8444b09ae2556345c36a710 already in progress: creating tablet
I20260810 11:30:49.685235 27231 tablet_bootstrap.cc:492] T dc10f61181794e2bba099ca46881e94d P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:49.685570 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 280) took 1944 ms. Trace:
I20260810 11:30:49.686933 27231 tablet_bootstrap.cc:654] T dc10f61181794e2bba099ca46881e94d P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.686794 27228 tablet_bootstrap.cc:492] T 1549a26ba0f6427fae87b204c5d49eff P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:49.687074 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d000f0ebaf0049a7bdaad93e307e16e2" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:49.687359 27228 ts_tablet_manager.cc:1397] T 1549a26ba0f6427fae87b204c5d49eff P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.077s user 0.009s sys 0.003s
I20260810 11:30:49.688208 27228 raft_consensus.cc:348] T 1549a26ba0f6427fae87b204c5d49eff P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.688613 27228 raft_consensus.cc:374] T 1549a26ba0f6427fae87b204c5d49eff P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.688756 27228 raft_consensus.cc:729] T 1549a26ba0f6427fae87b204c5d49eff P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.689069 27228 consensus_queue.cc:260] T 1549a26ba0f6427fae87b204c5d49eff P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.689563 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]) successfully deleted
I20260810 11:30:49.680531 29453 leader_election.cc:288] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:49.663070 27222 tablet_bootstrap.cc:492] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:49.669624 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1e46f80f7f4e3a84638421892e6236" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.697510 27222 ts_tablet_manager.cc:1397] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.000s
I20260810 11:30:49.698553 27222 raft_consensus.cc:348] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.698858 27222 raft_consensus.cc:374] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.698959 27222 raft_consensus.cc:729] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.699206 27222 consensus_queue.cc:260] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.699908 27222 ts_tablet_manager.cc:1428] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:49.700263 27222 tablet_bootstrap.cc:492] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:49.701951 27228 ts_tablet_manager.cc:1428] T 1549a26ba0f6427fae87b204c5d49eff P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260810 11:30:49.703996 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.704449 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.705135 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet e69916a35fba4714bbc565921738888f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.706727 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a2e1b54043444989ac64c87f30ffc07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.707446 27228 tablet_bootstrap.cc:492] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:49.708220 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.708381 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7acf847a1fd74ccc89b5bffe1bbb76f3) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.708479 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet c60baf810a544a4a90dccd2337a39043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.708633 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da86554bc51486e91f1ea5995a245b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.686859 29500 rpcz_store.cc:276] 0810 11:30:47.740963 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.741012 (+ 49us) service_pool.cc:227] Handling call
0810 11:30:49.685410 (+1944398us) ts_tablet_manager.cc:1145] Deleting tablet d50a8bdb17fa4332b288d03658c6b9c2
0810 11:30:49.685422 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.685542 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1944059}
I20260810 11:30:49.709178 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 281) took 1967 ms. Trace:
W20260810 11:30:49.709487 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet d50a8bdb17fa4332b288d03658c6b9c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d50a8bdb17fa4332b288d03658c6b9c2 already in progress: creating tablet
I20260810 11:30:49.709278 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet ce73798a721b4a6d892f0c24b6b40e2c with delete_type TABLET_DATA_DELETED (replaced by tablet 81b800247b4e4171b82dcde68e39fb00) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.710356 27222 tablet_bootstrap.cc:654] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.710163 29500 rpcz_store.cc:276] 0810 11:30:47.741393 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.784483 (+ 43090us) service_pool.cc:227] Handling call
0810 11:30:49.709001 (+1924518us) ts_tablet_manager.cc:1145] Deleting tablet 7de2d60cf87c48459e6663a68ac96714
0810 11:30:49.709022 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.709158 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1924217}
I20260810 11:30:49.712374 27228 tablet_bootstrap.cc:654] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.713464 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet cc76d30f37094391b75076c92ccc277f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.713765 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 282) took 1928 ms. Trace:
I20260810 11:30:49.714032 29500 rpcz_store.cc:276] 0810 11:30:47.784967 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.785011 (+ 44us) service_pool.cc:227] Handling call
0810 11:30:49.710989 (+1925978us) ts_tablet_manager.cc:1145] Deleting tablet 81b800247b4e4171b82dcde68e39fb00
0810 11:30:49.711009 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.713369 (+ 2360us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1925787}
W20260810 11:30:49.714502 26575 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.195:32877 (request call id 348) took 2107 ms (client timeout 1000 ms). Trace:
I20260810 11:30:49.715111 29500 tablet_replica.cc:330] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
W20260810 11:30:49.714670 26575 rpcz_store.cc:269] 0810 11:30:47.607245 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.615344 (+ 8099us) service_pool.cc:227] Handling call
0810 11:30:48.515677 (+900333us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:48.515683 (+ 6us) write_op.cc:454] Released schema lock
0810 11:30:49.714451 (+1198768us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:48.506334 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:48.506445 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:48.506453 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:48.506458 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:48.506578 (+ 120us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:48.506591 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:48.506596 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:48.506721 (+ 125us) tablet.cc:699] Row locks acquired
0810 11:30:48.506724 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:48.506770 (+ 46us) write_op.cc:270] Start()
0810 11:30:48.506805 (+ 35us) write_op.cc:276] Timestamp: P: 1786361448506710 usec, L: 0
0810 11:30:48.506810 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:48.507038 (+ 228us) log.cc:842] Serialized 919 byte log entry
0810 11:30:48.511989 (+ 4951us) op_driver.cc:444] REPLICATION: finished
0810 11:30:48.512184 (+ 195us) write_op.cc:301] APPLY: starting
0810 11:30:48.512201 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:48.512251 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:48.512293 (+ 42us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:48.512367 (+ 74us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:48.512408 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:48.512425 (+ 17us) write_op.cc:312] APPLY: finished
0810 11:30:48.512507 (+ 82us) log.cc:842] Serialized 29 byte log entry
0810 11:30:48.512609 (+ 102us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:48.512631 (+ 22us) write_op.cc:454] Released schema lock
0810 11:30:48.512639 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0810 11:30:48.838114 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:48.838255 (+ 141us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:48.838264 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:48.838268 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:48.838401 (+ 133us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:48.838416 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:48.838423 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:48.838570 (+ 147us) tablet.cc:699] Row locks acquired
0810 11:30:48.838575 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:48.838624 (+ 49us) write_op.cc:270] Start()
0810 11:30:48.838668 (+ 44us) write_op.cc:276] Timestamp: P: 1786361448838580 usec, L: 0
0810 11:30:48.838674 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:48.839042 (+ 368us) log.cc:842] Serialized 356 byte log entry
0810 11:30:48.924251 (+ 85209us) op_driver.cc:444] REPLICATION: finished
0810 11:30:48.929743 (+ 5492us) write_op.cc:301] APPLY: starting
0810 11:30:48.929753 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:48.929779 (+ 26us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:48.929823 (+ 44us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:48.929865 (+ 42us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:48.929887 (+ 22us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:48.929893 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:48.929941 (+ 48us) log.cc:842] Serialized 23 byte log entry
0810 11:30:48.929997 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:48.930008 (+ 11us) write_op.cc:454] Released schema lock
0810 11:30:48.930012 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:48.930058 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:48.930062 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":390,"reported_tablets":189,"child_traces":[["op",{"apply.queue_time_us":134,"apply.run_cpu_time_us":548,"apply.run_wall_time_us":548,"num_ops":2,"prepare.queue_time_us":109,"prepare.run_cpu_time_us":858,"prepare.run_wall_time_us":859,"raft.queue_time_us":579,"raft.run_cpu_time_us":528,"raft.run_wall_time_us":528,"replication_time_us":5148}],["op",{"apply.queue_time_us":5462,"apply.run_cpu_time_us":358,"apply.run_wall_time_us":357,"num_ops":1,"prepare.queue_time_us":30754,"prepare.run_cpu_time_us":908,"prepare.run_wall_time_us":1017,"replication_time_us":85489}]]}
I20260810 11:30:49.715993 29500 raft_consensus.cc:2229] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:49.716485 29500 raft_consensus.cc:2258] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.717458 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet ea66da5bc20e4718901ffc473677421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.717628 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet b6395bce17ee40c2822669246ce7eb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.720142 29500 ts_tablet_manager.cc:1905] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:49.720283 29603 ts_tablet_manager.cc:1918] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:49.720453 29603 log.cc:1196] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/0f048b690d764c83a4a9ce4cbadc75b0
I20260810 11:30:49.721024 29603 ts_tablet_manager.cc:1939] T 0f048b690d764c83a4a9ce4cbadc75b0 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:49.721495 29658 tablet.cc:1722] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:49.722386 29603 tablet_replica.cc:330] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:49.722628 29603 raft_consensus.cc:2229] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:49.722815 29603 raft_consensus.cc:2258] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.723253 27231 tablet_bootstrap.cc:492] T dc10f61181794e2bba099ca46881e94d P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:49.727085 27231 ts_tablet_manager.cc:1397] T dc10f61181794e2bba099ca46881e94d P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.000s
W20260810 11:30:49.716928 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 81b800247b4e4171b82dcde68e39fb00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81b800247b4e4171b82dcde68e39fb00 already in progress: creating tablet
I20260810 11:30:49.733407 27228 tablet_bootstrap.cc:492] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:49.717788 26578 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet d1d0d55b526749059470504a27887b22
I20260810 11:30:49.733583 27228 ts_tablet_manager.cc:1397] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260810 11:30:49.734319 27228 raft_consensus.cc:348] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.734558 27228 raft_consensus.cc:374] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.734617 27228 raft_consensus.cc:729] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.734581 26578 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_14f7e10124574ccdb41f7b14117603c6" } new_table_name: "default.Table_a4ae13338d184321b7cd7de27296ba58" modify_external_catalogs: true
I20260810 11:30:49.734802 27228 consensus_queue.cc:260] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
W20260810 11:30:49.717993 26573 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b98aeb11beb54cf0a9829b715ad96d0f consensus state has no leader
I20260810 11:30:49.736474 26573 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_b88e63a675fd460389f84a6f935346af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:49.737248 26573 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b88e63a675fd460389f84a6f935346af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:49.737696 27231 raft_consensus.cc:348] T dc10f61181794e2bba099ca46881e94d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.737950 27231 raft_consensus.cc:374] T dc10f61181794e2bba099ca46881e94d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.738003 27231 raft_consensus.cc:729] T dc10f61181794e2bba099ca46881e94d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.738214 27231 consensus_queue.cc:260] T dc10f61181794e2bba099ca46881e94d P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.718995 26581 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_3de73bd3d7014055bd94d7d5865463fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:49.722586 26571 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 40f5eecfc66a4711aef60c1a2bff6b97
I20260810 11:30:49.738806 27231 ts_tablet_manager.cc:1428] T dc10f61181794e2bba099ca46881e94d P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
W20260810 11:30:49.738834 26581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3de73bd3d7014055bd94d7d5865463fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:49.739095 27231 tablet_bootstrap.cc:492] T 16101a5784394d3aa570f4ecd8f2ac56 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:49.739282 26571 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_e26ee7fd08774003a73e09650378c808" } modify_external_catalogs: true
I20260810 11:30:49.739514 26571 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_e26ee7fd08774003a73e09650378c808" } modify_external_catalogs: true
I20260810 11:30:49.740043 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 4827800160e64883ba7bcadafeb13ead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.740274 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet b121c13e9241468aa224e17093eb38f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b607279006c4baeae79325926088014) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.740428 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet e700aa4c0c45496db8a2b4f4d6d746a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 9bf01841b9d4412789b05ce207f6eb02) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.740840 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet ee803ddf27594d2b9e19fe440fc269c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 82de53efa73447fe84e70dbb11a16a5f) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.741333 27228 ts_tablet_manager.cc:1428] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 11:30:49.741607 27228 tablet_bootstrap.cc:492] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:49.747519 26577 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_cb8549bfe5344b95b2c81538365c371b [id=0f9e142b43214fa8b2e362c54fabcb42] alter complete (version 1)
I20260810 11:30:49.685191 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 205) took 2966 ms. Trace:
I20260810 11:30:49.759328 27228 tablet_bootstrap.cc:654] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.759730 28987 rpcz_store.cc:276] 0810 11:30:46.718374 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.720483 (+ 2109us) service_pool.cc:227] Handling call
0810 11:30:49.684986 (+2964503us) ts_tablet_manager.cc:1145] Deleting tablet 713663be70014b17b17056a865e7db63
0810 11:30:49.685005 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.685133 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2957346}
I20260810 11:30:49.760232 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 206) took 3037 ms. Trace:
I20260810 11:30:49.760326 28987 rpcz_store.cc:276] 0810 11:30:46.722664 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.726015 (+ 3351us) service_pool.cc:227] Handling call
0810 11:30:49.760073 (+3034058us) ts_tablet_manager.cc:1145] Deleting tablet cc76d30f37094391b75076c92ccc277f
0810 11:30:49.760087 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.760211 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3032390}
I20260810 11:30:49.760648 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 203) took 3055 ms. Trace:
I20260810 11:30:49.760686 27231 tablet_bootstrap.cc:654] T 16101a5784394d3aa570f4ecd8f2ac56 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.760747 28987 rpcz_store.cc:276] 0810 11:30:46.705082 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.715769 (+ 10687us) service_pool.cc:227] Handling call
0810 11:30:49.760533 (+3044764us) ts_tablet_manager.cc:1145] Deleting tablet 318d5b8453fe4c438d0fa32cb91c409e
0810 11:30:49.760543 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.760631 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":166,"tablet-delete.queue_time_us":3033002}
I20260810 11:30:49.761032 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 210) took 3033 ms. Trace:
I20260810 11:30:49.761207 28987 rpcz_store.cc:276] 0810 11:30:46.727115 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.727578 (+ 463us) service_pool.cc:227] Handling call
0810 11:30:49.760960 (+3033382us) ts_tablet_manager.cc:1145] Deleting tablet 420ba6e9f74c4ae5bf450f369e7fbdb3
0810 11:30:49.760970 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.761019 (+ 49us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3033243}
I20260810 11:30:49.761626 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 194) took 3058 ms. Trace:
I20260810 11:30:49.723361 29603 ts_tablet_manager.cc:1905] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:49.689878 26749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518c777e40ec40dcb3484c0374384959" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.761685 29658 tablet.cc:1722] T c62ae41d2dd74eedbe252c4de70fbe1e P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260810 11:30:49.690730 26700 leader_election.cc:341] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:49.765100 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 74388.7us
I20260810 11:30:49.766062 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet d1d0d55b526749059470504a27887b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:49 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:49.766965 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet 40f5eecfc66a4711aef60c1a2bff6b97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:49 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:49.767125 29500 ts_tablet_manager.cc:1918] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:49.767320 29500 log.cc:1196] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/0f048b690d764c83a4a9ce4cbadc75b0
W20260810 11:30:49.767688 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 713663be70014b17b17056a865e7db63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 713663be70014b17b17056a865e7db63 already in progress: creating tablet
I20260810 11:30:49.767756 29500 ts_tablet_manager.cc:1939] T 0f048b690d764c83a4a9ce4cbadc75b0 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
W20260810 11:30:49.768018 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet cc76d30f37094391b75076c92ccc277f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc76d30f37094391b75076c92ccc277f already in progress: creating tablet
W20260810 11:30:49.768309 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 318d5b8453fe4c438d0fa32cb91c409e because the tablet was not found. No further retry: Not found: Tablet not found: 318d5b8453fe4c438d0fa32cb91c409e
W20260810 11:30:49.768618 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 420ba6e9f74c4ae5bf450f369e7fbdb3 because the tablet was not found. No further retry: Not found: Tablet not found: 420ba6e9f74c4ae5bf450f369e7fbdb3
W20260810 11:30:49.769315 26702 leader_election.cc:341] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: d000f0ebaf0049a7bdaad93e307e16e2
I20260810 11:30:49.769703 26702 leader_election.cc:302] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
W20260810 11:30:49.770077 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 78574.9us
I20260810 11:30:49.770565 29504 raft_consensus.cc:2726] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:49.779847 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet d50a8bdb17fa4332b288d03658c6b9c2 with delete_type TABLET_DATA_DELETED (replaced by tablet 72fd344dfcb84dfba89f7a9f446d814f) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.780524 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet d1d0d55b526749059470504a27887b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:49 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.781035 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 40f5eecfc66a4711aef60c1a2bff6b97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:49 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.784988 27110 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:49.785342 27231 tablet_bootstrap.cc:492] T 16101a5784394d3aa570f4ecd8f2ac56 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:49.785480 27231 ts_tablet_manager.cc:1397] T 16101a5784394d3aa570f4ecd8f2ac56 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.046s user 0.001s sys 0.004s
I20260810 11:30:49.786233 27231 raft_consensus.cc:348] T 16101a5784394d3aa570f4ecd8f2ac56 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.786448 27231 raft_consensus.cc:374] T 16101a5784394d3aa570f4ecd8f2ac56 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.786541 27231 raft_consensus.cc:729] T 16101a5784394d3aa570f4ecd8f2ac56 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.786753 27231 consensus_queue.cc:260] T 16101a5784394d3aa570f4ecd8f2ac56 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.787513 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 303) took 1128 ms. Trace:
I20260810 11:30:49.787627 29500 rpcz_store.cc:276] 0810 11:30:48.659025 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:48.659088 (+ 63us) service_pool.cc:227] Handling call
0810 11:30:49.715039 (+1055951us) ts_tablet_manager.cc:1145] Deleting tablet 0f048b690d764c83a4a9ce4cbadc75b0
0810 11:30:49.715054 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.730898 (+ 15844us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.767011 (+ 36113us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.787477 (+ 20466us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1055699}
I20260810 11:30:49.787971 29500 tablet_replica.cc:330] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:49.788205 29500 raft_consensus.cc:2229] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:49.788401 29500 raft_consensus.cc:2258] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.789666 27231 ts_tablet_manager.cc:1428] T 16101a5784394d3aa570f4ecd8f2ac56 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260810 11:30:49.799230 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 0f048b690d764c83a4a9ce4cbadc75b0 (table default.Table_dc83172ee2e44eccab63bccfa35523fe [id=19ea42a81c4f471592628b27a3404c4b]) successfully deleted
I20260810 11:30:49.800940 27231 tablet_bootstrap.cc:492] T f756689d4c99489885a0cd59f84a6e8a P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:49.761716 28987 rpcz_store.cc:276] 0810 11:30:46.703119 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.703161 (+ 42us) service_pool.cc:227] Handling call
0810 11:30:49.761523 (+3058362us) ts_tablet_manager.cc:1145] Deleting tablet 78633fbe048b4534ae3277ce6b7c4313
0810 11:30:49.761533 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.761611 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3033772}
I20260810 11:30:49.802343 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.802521 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f048b690d764c83a4a9ce4cbadc75b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.763057 27222 tablet_bootstrap.cc:492] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
W20260810 11:30:49.803200 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 78633fbe048b4534ae3277ce6b7c4313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78633fbe048b4534ae3277ce6b7c4313 already in progress: creating tablet
I20260810 11:30:49.804773 27222 ts_tablet_manager.cc:1397] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.105s user 0.005s sys 0.001s
I20260810 11:30:49.804809 27228 tablet_bootstrap.cc:492] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:49.805039 27228 ts_tablet_manager.cc:1397] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.002s
I20260810 11:30:49.805969 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c203cd90d2f472fa27cfabed5b87119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.805711 27228 raft_consensus.cc:348] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.806281 27228 raft_consensus.cc:374] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.806423 27228 raft_consensus.cc:729] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.806630 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet b945038c03e343489af6ae7e50131d97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.806771 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 0edef936026743a896d5a73c134a8bca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.806850 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b303be24f4e46d0b966e8191d76297b with delete_type TABLET_DATA_DELETED (replaced by tablet ccdf2bb9f3b347ceb970a0d3115816df) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.807201 27228 consensus_queue.cc:260] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.807988 27228 ts_tablet_manager.cc:1428] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260810 11:30:49.808382 29500 ts_tablet_manager.cc:1905] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:49.812666 27231 tablet_bootstrap.cc:654] T f756689d4c99489885a0cd59f84a6e8a P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.813035 29603 ts_tablet_manager.cc:1918] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:49.813890 29603 log.cc:1196] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/eed0e2bead85466ca99cfb34e155a391
I20260810 11:30:49.814320 29603 ts_tablet_manager.cc:1939] T eed0e2bead85466ca99cfb34e155a391 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
W20260810 11:30:49.814949 26574 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.194:35117 (request call id 273) took 2026 ms (client timeout 1000 ms). Trace:
I20260810 11:30:49.815301 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet a3079a68c1c74b64bf13877bd0ee68c3 with delete_type TABLET_DATA_DELETED (replaced by tablet f10ac7e043c240d8a14b2b4f96b864b9) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.815402 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cc17c55109b47eeb91920c3ed8178e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6179cb2be2c442ee97161fe1f4661b64) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.815526 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet b945cb22353f4d99a3836e3c0b8e26e3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ee50a7da224437baed913995e6587dd) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.815666 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 518c777e40ec40dcb3484c0374384959 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.815842 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 25efcc18e8444b09ae2556345c36a710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.815887 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 78633fbe048b4534ae3277ce6b7c4313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:39 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.815948 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.815824 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 7de2d60cf87c48459e6663a68ac96714 with delete_type TABLET_DATA_DELETED (replaced by tablet aad22a5dfacf4fb88a5493376915a70f) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.816123 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet d08250001e1542f9978bc6f89ace458b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.816293 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet 713663be70014b17b17056a865e7db63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:49.816493 29603 tablet_replica.cc:330] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:49.816778 29603 raft_consensus.cc:2229] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:49.817268 27222 raft_consensus.cc:348] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.817523 27222 raft_consensus.cc:374] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.817576 27222 raft_consensus.cc:729] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.818439 27222 consensus_queue.cc:260] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.818985 29603 raft_consensus.cc:2258] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.819628 29603 ts_tablet_manager.cc:1905] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:49.821312 27222 ts_tablet_manager.cc:1428] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260810 11:30:49.821662 27222 tablet_bootstrap.cc:492] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:49.823518 27222 tablet_bootstrap.cc:654] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.824317 27228 tablet_bootstrap.cc:492] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:49.828094 29593 raft_consensus.cc:482] T f9c7ab7f075d459d8b1f1a0bb0e2e2d7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:49.828253 29593 raft_consensus.cc:504] T f9c7ab7f075d459d8b1f1a0bb0e2e2d7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.828732 27231 tablet_bootstrap.cc:492] T f756689d4c99489885a0cd59f84a6e8a P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:49.828863 27231 ts_tablet_manager.cc:1397] T f756689d4c99489885a0cd59f84a6e8a P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.002s
I20260810 11:30:49.828920 29593 leader_election.cc:288] T f9c7ab7f075d459d8b1f1a0bb0e2e2d7 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:49.829698 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9c7ab7f075d459d8b1f1a0bb0e2e2d7" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:49.829909 27228 tablet_bootstrap.cc:654] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.829761 27231 raft_consensus.cc:348] T f756689d4c99489885a0cd59f84a6e8a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.829957 27231 raft_consensus.cc:374] T f756689d4c99489885a0cd59f84a6e8a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.830008 27231 raft_consensus.cc:729] T f756689d4c99489885a0cd59f84a6e8a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.830185 27231 consensus_queue.cc:260] T f756689d4c99489885a0cd59f84a6e8a P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:49.830408 26991 leader_election.cc:341] T f9c7ab7f075d459d8b1f1a0bb0e2e2d7 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.831890 27048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b95f3ec8ff34c89a68cd1edf8391f9b" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:49.832098 27048 raft_consensus.cc:3037] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:49.815205 26574 rpcz_store.cc:269] 0810 11:30:47.788290 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.788356 (+ 66us) service_pool.cc:227] Handling call
0810 11:30:47.854136 (+ 65780us) spinlock_profiling.cc:243] Waited 54.5 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa3fd8f 00007f9c61d34946 00007f9c61d34675 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:48.190758 (+336622us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:48.190770 (+ 12us) write_op.cc:454] Released schema lock
0810 11:30:48.257525 (+ 66755us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:48.257536 (+ 11us) write_op.cc:454] Released schema lock
0810 11:30:49.814866 (+1557330us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:48.180012 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:48.180118 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:48.180124 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:48.180127 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:48.180246 (+ 119us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:48.180259 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:48.180265 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:48.180379 (+ 114us) tablet.cc:699] Row locks acquired
0810 11:30:48.180382 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:48.180427 (+ 45us) write_op.cc:270] Start()
0810 11:30:48.180460 (+ 33us) write_op.cc:276] Timestamp: P: 1786361448180401 usec, L: 0
0810 11:30:48.180464 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:48.180801 (+ 337us) log.cc:842] Serialized 919 byte log entry
0810 11:30:48.186630 (+ 5829us) op_driver.cc:444] REPLICATION: finished
0810 11:30:48.186822 (+ 192us) write_op.cc:301] APPLY: starting
0810 11:30:48.186841 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:48.186900 (+ 59us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:48.186931 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:48.187070 (+ 139us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:48.187116 (+ 46us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:48.187138 (+ 22us) write_op.cc:312] APPLY: finished
0810 11:30:48.187224 (+ 86us) log.cc:842] Serialized 29 byte log entry
0810 11:30:48.187301 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:48.187325 (+ 24us) write_op.cc:454] Released schema lock
0810 11:30:48.187333 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0810 11:30:48.248855 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:48.248963 (+ 108us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:48.248970 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:48.248972 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:48.249098 (+ 126us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:48.249111 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:48.249118 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:48.249192 (+ 74us) tablet.cc:699] Row locks acquired
0810 11:30:48.249195 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:48.249235 (+ 40us) write_op.cc:270] Start()
0810 11:30:48.249278 (+ 43us) write_op.cc:276] Timestamp: P: 1786361448249203 usec, L: 0
0810 11:30:48.249282 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:48.249564 (+ 282us) log.cc:842] Serialized 356 byte log entry
0810 11:30:48.254255 (+ 4691us) op_driver.cc:444] REPLICATION: finished
0810 11:30:48.254415 (+ 160us) write_op.cc:301] APPLY: starting
0810 11:30:48.254431 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:48.254492 (+ 61us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:48.254534 (+ 42us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:48.254590 (+ 56us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:48.254630 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:48.254637 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:48.254717 (+ 80us) log.cc:842] Serialized 23 byte log entry
0810 11:30:48.254785 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:48.254804 (+ 19us) write_op.cc:454] Released schema lock
0810 11:30:48.254812 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":22590,"reported_tablets":186,"spinlock_wait_cycles":125365632,"child_traces":[["op",{"apply.queue_time_us":90,"apply.run_cpu_time_us":588,"apply.run_wall_time_us":587,"num_ops":2,"prepare.queue_time_us":241,"prepare.run_cpu_time_us":944,"prepare.run_wall_time_us":944,"raft.queue_time_us":520,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":341,"replication_time_us":5143}],["op",{"apply.queue_time_us":102,"apply.run_cpu_time_us":467,"apply.run_wall_time_us":466,"num_ops":1,"prepare.queue_time_us":159,"prepare.run_cpu_time_us":831,"prepare.run_wall_time_us":833,"raft.queue_time_us":523,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":263,"replication_time_us":4944}]]}
I20260810 11:30:49.832707 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6926d0dc68fa48ae8ffabf5b5272b3d0" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:49.835953 27048 raft_consensus.cc:2454] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:49.837162 27231 ts_tablet_manager.cc:1428] T f756689d4c99489885a0cd59f84a6e8a P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260810 11:30:49.837953 27231 tablet_bootstrap.cc:492] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:49.843150 27231 tablet_bootstrap.cc:654] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.803745 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 207) took 3077 ms. Trace:
I20260810 11:30:49.844767 28987 rpcz_store.cc:276] 0810 11:30:46.726386 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:46.726445 (+ 59us) service_pool.cc:227] Handling call
0810 11:30:49.803622 (+3077177us) ts_tablet_manager.cc:1145] Deleting tablet 64818ca5827e41d99428903ddb8688d9
0810 11:30:49.803636 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.803724 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3075827}
I20260810 11:30:49.856474 29500 ts_tablet_manager.cc:1918] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:49.856775 29500 log.cc:1196] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/7d3e78dcaa55491393f529ea33007786
I20260810 11:30:49.858639 29500 ts_tablet_manager.cc:1939] T 7d3e78dcaa55491393f529ea33007786 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:49.859594 27228 tablet_bootstrap.cc:492] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:49.859829 27228 ts_tablet_manager.cc:1397] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.002s
I20260810 11:30:49.860355 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 304) took 1193 ms. Trace:
I20260810 11:30:49.860764 27228 raft_consensus.cc:348] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.861598 27228 raft_consensus.cc:374] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.861722 27228 raft_consensus.cc:729] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.861511 29500 rpcz_store.cc:276] 0810 11:30:48.666871 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:48.666982 (+ 111us) service_pool.cc:227] Handling call
0810 11:30:49.787910 (+1120928us) ts_tablet_manager.cc:1145] Deleting tablet 7d3e78dcaa55491393f529ea33007786
0810 11:30:49.787924 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.820009 (+ 32085us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.856339 (+ 36330us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.860324 (+ 3985us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1120650}
I20260810 11:30:49.862162 27228 consensus_queue.cc:260] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.863059 27228 ts_tablet_manager.cc:1428] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:49.866248 29603 ts_tablet_manager.cc:1918] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:49.867563 29603 log.cc:1196] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/524c8d37d3964e368695d182883b0bd5
I20260810 11:30:49.868418 29603 ts_tablet_manager.cc:1939] T 524c8d37d3964e368695d182883b0bd5 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:49.870714 29603 tablet_replica.cc:330] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:49.869571 27231 tablet_bootstrap.cc:492] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:49.871003 27231 ts_tablet_manager.cc:1397] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.000s
I20260810 11:30:49.871806 27231 raft_consensus.cc:348] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.872519 27231 raft_consensus.cc:374] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.872761 27231 raft_consensus.cc:729] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.873893 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 307) took 1125 ms. Trace:
I20260810 11:30:49.874063 29500 rpcz_store.cc:276] 0810 11:30:48.747821 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:48.748634 (+ 813us) service_pool.cc:227] Handling call
0810 11:30:49.863310 (+1114676us) ts_tablet_manager.cc:1145] Deleting tablet aad22a5dfacf4fb88a5493376915a70f
0810 11:30:49.873027 (+ 9717us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.873179 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1114447}
I20260810 11:30:49.874819 29500 tablet_replica.cc:330] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:49.875015 27231 consensus_queue.cc:260] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.875128 29500 raft_consensus.cc:2229] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:49.875458 29500 raft_consensus.cc:2258] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.876076 29500 ts_tablet_manager.cc:1905] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:49.876799 27231 ts_tablet_manager.cc:1428] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260810 11:30:49.882717 27231 tablet_bootstrap.cc:492] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:49.884619 27231 tablet_bootstrap.cc:654] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.884918 29603 raft_consensus.cc:2229] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:49.886368 29603 raft_consensus.cc:2258] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.887058 29603 ts_tablet_manager.cc:1905] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:49.889271 27228 tablet_bootstrap.cc:492] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:49.891232 27228 tablet_bootstrap.cc:654] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.893626 29593 raft_consensus.cc:482] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:49.893788 29593 raft_consensus.cc:504] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.894541 29593 leader_election.cc:288] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:49.895409 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4124999339e4133b2bd47b3739da373" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:49.896209 26991 leader_election.cc:341] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.896276 29500 ts_tablet_manager.cc:1918] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:49.896394 29500 log.cc:1196] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/eed0e2bead85466ca99cfb34e155a391
I20260810 11:30:49.899525 27231 tablet_bootstrap.cc:492] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:49.899757 27231 ts_tablet_manager.cc:1397] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.003s
I20260810 11:30:49.900534 27231 raft_consensus.cc:348] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.900878 27231 raft_consensus.cc:374] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.900993 27231 raft_consensus.cc:729] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.901294 27231 consensus_queue.cc:260] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.902077 27231 ts_tablet_manager.cc:1428] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 11:30:49.902480 27231 tablet_bootstrap.cc:492] T fdeba015c2364ec385e8b06c18a2a9d2 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:49.905359 29500 ts_tablet_manager.cc:1939] T eed0e2bead85466ca99cfb34e155a391 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:49.907402 27231 tablet_bootstrap.cc:654] T fdeba015c2364ec385e8b06c18a2a9d2 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.907876 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 308) took 1156 ms. Trace:
I20260810 11:30:49.908092 29500 rpcz_store.cc:276] 0810 11:30:48.751562 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:48.751634 (+ 72us) service_pool.cc:227] Handling call
0810 11:30:49.874769 (+1123135us) ts_tablet_manager.cc:1145] Deleting tablet eed0e2bead85466ca99cfb34e155a391
0810 11:30:49.874780 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.879826 (+ 5046us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.896170 (+ 16344us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.907727 (+ 11557us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1122924}
I20260810 11:30:49.908417 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 225) took 2715 ms. Trace:
I20260810 11:30:49.908690 28987 rpcz_store.cc:276] 0810 11:30:47.192524 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.193257 (+ 733us) service_pool.cc:227] Handling call
0810 11:30:49.908155 (+2714898us) ts_tablet_manager.cc:1145] Deleting tablet e276b0fa124d42dfb3fe750d245e44d8
0810 11:30:49.908171 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.908369 (+ 198us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2712895}
I20260810 11:30:49.909063 29500 tablet_replica.cc:330] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:49.909442 28987 tablet_replica.cc:330] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:49.910315 27228 tablet_bootstrap.cc:492] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:49.910466 27228 ts_tablet_manager.cc:1397] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.003s
W20260810 11:30:49.910863 26702 consensus_peers.cc:487] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eed0e2bead85466ca99cfb34e155a391. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:49.912470 27228 raft_consensus.cc:348] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.912734 27228 raft_consensus.cc:374] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.912918 27228 raft_consensus.cc:729] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.913254 28987 raft_consensus.cc:2229] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:49.913228 27228 consensus_queue.cc:260] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.913511 28987 raft_consensus.cc:2258] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.914108 28987 ts_tablet_manager.cc:1905] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:49.917156 27228 ts_tablet_manager.cc:1428] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260810 11:30:49.917527 27228 tablet_bootstrap.cc:492] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:49.921739 27228 tablet_bootstrap.cc:654] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.909981 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1e46f80f7f4e3a84638421892e6236" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:49.911643 29593 raft_consensus.cc:482] T 16101a5784394d3aa570f4ecd8f2ac56 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:49.922192 29593 raft_consensus.cc:504] T 16101a5784394d3aa570f4ecd8f2ac56 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.922777 29593 leader_election.cc:288] T 16101a5784394d3aa570f4ecd8f2ac56 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:49.924335 28987 ts_tablet_manager.cc:1918] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:49.924613 28987 log.cc:1196] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/d000f0ebaf0049a7bdaad93e307e16e2
I20260810 11:30:49.925015 28987 ts_tablet_manager.cc:1939] T d000f0ebaf0049a7bdaad93e307e16e2 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:49.926031 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 222) took 2733 ms. Trace:
I20260810 11:30:49.926163 28987 rpcz_store.cc:276] 0810 11:30:47.192254 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.192304 (+ 50us) service_pool.cc:227] Handling call
0810 11:30:49.909365 (+2717061us) ts_tablet_manager.cc:1145] Deleting tablet d000f0ebaf0049a7bdaad93e307e16e2
0810 11:30:49.909380 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.917855 (+ 8475us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.924024 (+ 6169us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.926009 (+ 1985us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2710169}
I20260810 11:30:49.926754 26963 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:49.926932 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 220) took 2734 ms. Trace:
I20260810 11:30:49.927033 28987 rpcz_store.cc:276] 0810 11:30:47.191962 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.192008 (+ 46us) service_pool.cc:227] Handling call
0810 11:30:49.926731 (+2734723us) ts_tablet_manager.cc:1145] Deleting tablet fc558690dce44e999e55e9bf1b6ca172
0810 11:30:49.926800 (+ 69us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.926914 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2727401}
I20260810 11:30:49.928752 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16101a5784394d3aa570f4ecd8f2ac56" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:49.929777 26991 leader_election.cc:341] T 16101a5784394d3aa570f4ecd8f2ac56 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:49.930512 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 229) took 2730 ms. Trace:
I20260810 11:30:49.930652 28987 rpcz_store.cc:276] 0810 11:30:47.200267 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.200483 (+ 216us) service_pool.cc:227] Handling call
0810 11:30:49.930371 (+2729888us) ts_tablet_manager.cc:1145] Deleting tablet ea66da5bc20e4718901ffc473677421c
0810 11:30:49.930383 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.930495 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2729688}
I20260810 11:30:49.931078 28987 tablet_replica.cc:330] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:49.931320 28987 raft_consensus.cc:2229] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:49.931308 29500 raft_consensus.cc:2229] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:49.931550 28987 raft_consensus.cc:2258] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.931867 29500 raft_consensus.cc:2258] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.932231 28987 ts_tablet_manager.cc:1905] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:49.932518 29500 ts_tablet_manager.cc:1905] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:49.937924 29603 ts_tablet_manager.cc:1918] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:49.940768 29658 tablet.cc:1722] T 34ed8c9efa634fc7b091b1bb6bc6d452 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:49.942713 28987 ts_tablet_manager.cc:1918] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:49.942936 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9c7ab7f075d459d8b1f1a0bb0e2e2d7" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:49.943639 26848 leader_election.cc:302] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:49.944099 29491 raft_consensus.cc:2726] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:49.944496 26848 leader_election.cc:302] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d
I20260810 11:30:49.944916 29491 raft_consensus.cc:2781] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:49.945047 29491 raft_consensus.cc:686] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:49.945307 29491 consensus_queue.cc:237] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:49.943013 28987 log.cc:1196] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/8228600e3f6b4f9993dd25e4ceb57e4d
I20260810 11:30:49.950122 28987 ts_tablet_manager.cc:1939] T 8228600e3f6b4f9993dd25e4ceb57e4d P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:49.951336 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 223) took 2758 ms. Trace:
I20260810 11:30:49.837275 26575 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_11e3ca2d0589464586b01e41dcd46bbf" } modify_external_catalogs: true
I20260810 11:30:49.951588 29603 log.cc:1196] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/9079c8fec89043be9d0040a3728e93f4
I20260810 11:30:49.951758 26575 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_11e3ca2d0589464586b01e41dcd46bbf" } modify_external_catalogs: true
I20260810 11:30:49.952069 29603 ts_tablet_manager.cc:1939] T 9079c8fec89043be9d0040a3728e93f4 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
W20260810 11:30:49.848126 26578 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c3a5d7b8b0a14134ac55fa17a7dac21e consensus state has no leader
I20260810 11:30:49.952409 28987 rpcz_store.cc:276] 0810 11:30:47.192358 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.193235 (+ 877us) service_pool.cc:227] Handling call
0810 11:30:49.931035 (+2737800us) ts_tablet_manager.cc:1145] Deleting tablet 8228600e3f6b4f9993dd25e4ceb57e4d
0810 11:30:49.931045 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.936750 (+ 5705us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.942603 (+ 5853us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:49.951307 (+ 8704us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2728544}
I20260810 11:30:49.863842 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]) successfully deleted
W20260810 11:30:49.952914 26564 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 89171us
I20260810 11:30:49.953083 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 221) took 2761 ms. Trace:
I20260810 11:30:49.953157 28987 rpcz_store.cc:276] 0810 11:30:47.192051 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.193211 (+ 1160us) service_pool.cc:227] Handling call
0810 11:30:49.952970 (+2759759us) ts_tablet_manager.cc:1145] Deleting tablet 1aa4562a2247405187d9dbd1baa48f39
0810 11:30:49.952983 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.953065 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2750270}
I20260810 11:30:49.953313 29603 tablet_replica.cc:330] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:49.953558 29603 raft_consensus.cc:2229] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:49.953589 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet aad22a5dfacf4fb88a5493376915a70f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aad22a5dfacf4fb88a5493376915a70f already in progress: creating tablet
I20260810 11:30:49.953688 29603 raft_consensus.cc:2258] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.953871 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]) successfully deleted
I20260810 11:30:49.876828 26571 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet bd34a4de1b93402c8a4bce1215660e77
I20260810 11:30:49.954195 29603 ts_tablet_manager.cc:1905] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:49.954540 26571 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 240) took 1008 ms. Trace:
I20260810 11:30:49.954779 26571 rpcz_store.cc:276] 0810 11:30:48.945876 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.739111 (+793235us) service_pool.cc:227] Handling call
0810 11:30:49.739632 (+ 521us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:49.739784 (+ 152us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:49.739847 (+ 63us) catalog_manager.cc:2761] Locking tablets
0810 11:30:49.751063 (+ 11216us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:49.876463 (+125400us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:49.876612 (+ 149us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:49.876674 (+ 62us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:49.954454 (+ 77780us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:49.842392 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:49.842474 (+ 82us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:49.842478 (+ 4us) write_op.cc:435] Acquired schema lock
0810 11:30:49.842480 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:49.842576 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:49.842585 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:49.842589 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:49.842688 (+ 99us) tablet.cc:699] Row locks acquired
0810 11:30:49.842690 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:49.842721 (+ 31us) write_op.cc:270] Start()
0810 11:30:49.842748 (+ 27us) write_op.cc:276] Timestamp: P: 1786361449842682 usec, L: 0
0810 11:30:49.842752 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:49.842904 (+ 152us) log.cc:842] Serialized 765 byte log entry
0810 11:30:49.875866 (+ 32962us) op_driver.cc:444] REPLICATION: finished
0810 11:30:49.875954 (+ 88us) write_op.cc:301] APPLY: starting
0810 11:30:49.875971 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:49.876013 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:49.876069 (+ 56us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:49.876163 (+ 94us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:49.876203 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:49.876208 (+ 5us) write_op.cc:312] APPLY: finished
0810 11:30:49.876290 (+ 82us) log.cc:842] Serialized 29 byte log entry
0810 11:30:49.876352 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.876372 (+ 20us) write_op.cc:454] Released schema lock
0810 11:30:49.876379 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:49.876950 (+ 571us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.876956 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":40,"apply.run_cpu_time_us":559,"apply.run_wall_time_us":1052,"num_ops":2,"prepare.queue_time_us":90283,"prepare.run_cpu_time_us":566,"prepare.run_wall_time_us":565,"replication_time_us":33088}]]}
I20260810 11:30:49.955790 26571 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_52c39be8057948a49dfd7394b4152265" } new_table_name: "default.Table_9756c2fbd13b45b9ab96cc4997e3377b" modify_external_catalogs: true
I20260810 11:30:49.955907 28987 tablet_replica.cc:330] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:49.890056 26580 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_2f179aff28124223a1c8ae3280a497e7 [id=a483de6ef1fc453b93e3f183e9c15dd1] alter complete (version 1)
I20260810 11:30:49.956249 28987 raft_consensus.cc:2229] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:49.956449 28987 raft_consensus.cc:2258] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:49.956719 27228 tablet_bootstrap.cc:492] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:49.956856 27228 ts_tablet_manager.cc:1397] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.001s
I20260810 11:30:49.957267 28987 ts_tablet_manager.cc:1905] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:49.957751 27228 raft_consensus.cc:348] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.957973 27228 raft_consensus.cc:374] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.958022 27228 raft_consensus.cc:729] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.958253 27228 consensus_queue.cc:260] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.958779 27228 ts_tablet_manager.cc:1428] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:49.959089 27228 tablet_bootstrap.cc:492] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:49.890918 26581 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_5b3952f643634a688f9b0f31ace9abad" } modify_external_catalogs: true
I20260810 11:30:49.900596 26576 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: default.Table_4a2c6a140b7b448c91b9da7043c93c05 [id=6a421de2b28a46088fd0bad429a52bad] alter complete (version 1)
I20260810 11:30:49.962994 27231 tablet_bootstrap.cc:492] T fdeba015c2364ec385e8b06c18a2a9d2 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:49.963179 27231 ts_tablet_manager.cc:1397] T fdeba015c2364ec385e8b06c18a2a9d2 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.061s user 0.000s sys 0.005s
I20260810 11:30:49.963987 27231 raft_consensus.cc:348] T fdeba015c2364ec385e8b06c18a2a9d2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.964221 27231 raft_consensus.cc:374] T fdeba015c2364ec385e8b06c18a2a9d2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:49.964277 27231 raft_consensus.cc:729] T fdeba015c2364ec385e8b06c18a2a9d2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:49.964551 27231 consensus_queue.cc:260] T fdeba015c2364ec385e8b06c18a2a9d2 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:49.907820 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 64818ca5827e41d99428903ddb8688d9 because the tablet was not found. No further retry: Not found: Tablet not found: 64818ca5827e41d99428903ddb8688d9
I20260810 11:30:49.965179 27228 tablet_bootstrap.cc:654] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:49.965176 27231 ts_tablet_manager.cc:1428] T fdeba015c2364ec385e8b06c18a2a9d2 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 11:30:49.965153 29593 raft_consensus.cc:482] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 11:30:49.965329 26566 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 57383.6us
I20260810 11:30:49.965483 27231 tablet_bootstrap.cc:492] T 262656cbd3944702ac0ce04222cda500 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:49.965366 29593 raft_consensus.cc:504] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:49.966001 29593 leader_election.cc:288] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:49.966132 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet e276b0fa124d42dfb3fe750d245e44d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e276b0fa124d42dfb3fe750d245e44d8 already in progress: creating tablet
I20260810 11:30:49.966405 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet d000f0ebaf0049a7bdaad93e307e16e2 (table default.Table_2c4f303b1d1c47c9a4c089efccdd1d37 [id=fe5337909463467788d24d76e379cb48]) successfully deleted
W20260810 11:30:49.966660 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet fc558690dce44e999e55e9bf1b6ca172 because the tablet was not found. No further retry: Not found: Tablet not found: fc558690dce44e999e55e9bf1b6ca172
I20260810 11:30:49.966773 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd34a4de1b93402c8a4bce1215660e77" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:49.967005 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ea66da5bc20e4718901ffc473677421c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea66da5bc20e4718901ffc473677421c already in progress: creating tablet
I20260810 11:30:49.967308 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 8228600e3f6b4f9993dd25e4ceb57e4d (table default.Table_94097f0758264fc986fbe731111c6851 [id=223e521d377e4209943be22f5ab4b422]) successfully deleted
W20260810 11:30:49.967383 26991 leader_election.cc:341] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:49.967631 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 1aa4562a2247405187d9dbd1baa48f39 because the tablet was not found. No further retry: Not found: Tablet not found: 1aa4562a2247405187d9dbd1baa48f39
I20260810 11:30:49.941948 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 0f048b690d764c83a4a9ce4cbadc75b0 (table default.Table_dc83172ee2e44eccab63bccfa35523fe [id=19ea42a81c4f471592628b27a3404c4b]) successfully deleted
W20260810 11:30:49.968217 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet aad22a5dfacf4fb88a5493376915a70f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aad22a5dfacf4fb88a5493376915a70f already in progress: creating tablet
I20260810 11:30:49.968547 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]) successfully deleted
I20260810 11:30:49.969193 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet bd34a4de1b93402c8a4bce1215660e77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:49 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:49.975137 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet bd34a4de1b93402c8a4bce1215660e77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:49 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:50.004344 27231 tablet_bootstrap.cc:654] T 262656cbd3944702ac0ce04222cda500 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:50.023614 27228 tablet_bootstrap.cc:492] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:50.024194 27228 ts_tablet_manager.cc:1397] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.065s user 0.005s sys 0.007s
I20260810 11:30:50.025786 27228 raft_consensus.cc:348] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.026157 27228 raft_consensus.cc:374] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:50.026263 27228 raft_consensus.cc:729] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:50.026571 27228 consensus_queue.cc:260] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.027827 27228 ts_tablet_manager.cc:1428] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:50.028607 27228 tablet_bootstrap.cc:492] T ee803ddf27594d2b9e19fe440fc269c7 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:50.031502 27228 tablet_bootstrap.cc:654] T ee803ddf27594d2b9e19fe440fc269c7 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:50.045709 29603 ts_tablet_manager.cc:1918] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:50.048270 28987 ts_tablet_manager.cc:1918] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:50.048127 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]) successfully deleted
I20260810 11:30:50.053609 29658 tablet.cc:1722] T 65756c37fe514194bebe76921419653c P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:50.056531 28987 log.cc:1196] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/3ae27bf110114b70a3e3f6cf64f31b98
I20260810 11:30:50.058090 27222 tablet_bootstrap.cc:492] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:50.059432 27222 ts_tablet_manager.cc:1397] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.238s user 0.002s sys 0.003s
I20260810 11:30:50.059422 29603 log.cc:1196] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/8400c601e9894ea9b68679f6d7927456
I20260810 11:30:50.060406 27222 raft_consensus.cc:348] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.060962 27222 raft_consensus.cc:374] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:50.061218 27222 raft_consensus.cc:729] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:50.060531 29603 ts_tablet_manager.cc:1939] T 8400c601e9894ea9b68679f6d7927456 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:50.062294 27222 consensus_queue.cc:260] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.063081 26823 heartbeater.cc:347] Connected to a master server at 127.25.195.253:34547
I20260810 11:30:50.058010 28987 ts_tablet_manager.cc:1939] T 3ae27bf110114b70a3e3f6cf64f31b98 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:50.066954 26906 raft_consensus.cc:3037] T 3a1e46f80f7f4e3a84638421892e6236 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:50.069725 29694 tablet.cc:1722] T 65756c37fe514194bebe76921419653c P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:50.072992 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 224) took 2880 ms. Trace:
I20260810 11:30:50.072467 27222 ts_tablet_manager.cc:1428] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260810 11:30:50.073169 28987 rpcz_store.cc:276] 0810 11:30:47.192441 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.192492 (+ 51us) service_pool.cc:227] Handling call
0810 11:30:49.954853 (+2762361us) ts_tablet_manager.cc:1145] Deleting tablet 3ae27bf110114b70a3e3f6cf64f31b98
0810 11:30:49.955864 (+ 1011us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.968046 (+ 12182us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:50.048004 (+ 79958us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:50.072972 (+ 24968us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2750404}
I20260810 11:30:50.075981 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 3ae27bf110114b70a3e3f6cf64f31b98 (table default.Table_54efd7f2894348cf9dbf82586d44b6b5 [id=3b60ed35e72d41b58f176184a08303ad]) successfully deleted
I20260810 11:30:50.071756 27231 tablet_bootstrap.cc:492] T 262656cbd3944702ac0ce04222cda500 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:50.077724 27231 ts_tablet_manager.cc:1397] T 262656cbd3944702ac0ce04222cda500 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.112s user 0.000s sys 0.011s
I20260810 11:30:50.079520 27231 raft_consensus.cc:348] T 262656cbd3944702ac0ce04222cda500 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.079814 27231 raft_consensus.cc:374] T 262656cbd3944702ac0ce04222cda500 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:50.079952 27231 raft_consensus.cc:729] T 262656cbd3944702ac0ce04222cda500 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:50.080262 27231 consensus_queue.cc:260] T 262656cbd3944702ac0ce04222cda500 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.081712 27231 ts_tablet_manager.cc:1428] T 262656cbd3944702ac0ce04222cda500 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 11:30:50.082026 27222 tablet_bootstrap.cc:492] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:50.083842 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 232) took 2880 ms. Trace:
I20260810 11:30:50.085485 28987 rpcz_store.cc:276] 0810 11:30:47.202940 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.203486 (+ 546us) service_pool.cc:227] Handling call
0810 11:30:50.082967 (+2879481us) ts_tablet_manager.cc:1145] Deleting tablet ee803ddf27594d2b9e19fe440fc269c7
0810 11:30:50.083240 (+ 273us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:50.083816 (+ 576us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2865537}
W20260810 11:30:50.088138 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ee803ddf27594d2b9e19fe440fc269c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee803ddf27594d2b9e19fe440fc269c7 already in progress: creating tablet
I20260810 11:30:50.091600 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4124999339e4133b2bd47b3739da373" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:50.092482 26848 leader_election.cc:302] T 3a1e46f80f7f4e3a84638421892e6236 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:50.093802 29316 raft_consensus.cc:482] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.094012 29316 raft_consensus.cc:504] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.094476 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16101a5784394d3aa570f4ecd8f2ac56" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:50.094794 29316 leader_election.cc:288] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:50.095271 29593 raft_consensus.cc:482] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.095425 29593 raft_consensus.cc:504] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.095608 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 233) took 2892 ms. Trace:
I20260810 11:30:50.095692 28987 rpcz_store.cc:276] 0810 11:30:47.203042 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.203512 (+ 470us) service_pool.cc:227] Handling call
0810 11:30:50.095463 (+2891951us) ts_tablet_manager.cc:1145] Deleting tablet b121c13e9241468aa224e17093eb38f4
0810 11:30:50.095476 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:50.095590 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2877854}
W20260810 11:30:50.096017 26702 leader_election.cc:341] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 7de2d60cf87c48459e6663a68ac96714
I20260810 11:30:50.096012 29593 leader_election.cc:288] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:50.097064 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet b121c13e9241468aa224e17093eb38f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b121c13e9241468aa224e17093eb38f4 already in progress: creating tablet
I20260810 11:30:50.097378 29455 raft_consensus.cc:482] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.097532 29455 raft_consensus.cc:504] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.098045 29455 leader_election.cc:288] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:50.097687 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea66da5bc20e4718901ffc473677421c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:50.101786 26901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7de2d60cf87c48459e6663a68ac96714" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:50.103166 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c203cd90d2f472fa27cfabed5b87119" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:50.103631 26991 leader_election.cc:341] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:50.104023 26700 leader_election.cc:341] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.104163 26700 leader_election.cc:302] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
W20260810 11:30:50.104214 26991 leader_election.cc:341] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.104437 29316 raft_consensus.cc:2726] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:50.107831 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 239) took 2885 ms. Trace:
I20260810 11:30:50.108620 28987 rpcz_store.cc:276] 0810 11:30:47.222465 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.222558 (+ 93us) service_pool.cc:227] Handling call
0810 11:30:50.106775 (+2884217us) ts_tablet_manager.cc:1145] Deleting tablet 0cc17c55109b47eeb91920c3ed8178e0
0810 11:30:50.106791 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:50.107626 (+ 835us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2883677}
W20260810 11:30:50.111671 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 0cc17c55109b47eeb91920c3ed8178e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0cc17c55109b47eeb91920c3ed8178e0 already in progress: creating tablet
I20260810 11:30:50.114125 27222 tablet_bootstrap.cc:654] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:50.114043 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 230) took 2913 ms. Trace:
I20260810 11:30:50.120652 29603 tablet_replica.cc:330] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:50.120916 29603 raft_consensus.cc:2229] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:50.121157 29603 raft_consensus.cc:2258] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:50.114918 28987 rpcz_store.cc:276] 0810 11:30:47.200358 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.200440 (+ 82us) service_pool.cc:227] Handling call
0810 11:30:50.113043 (+2912603us) ts_tablet_manager.cc:1145] Deleting tablet b200bdb394d3439b86fff48494be8e3d
0810 11:30:50.113070 (+ 27us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:50.113769 (+ 699us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2883154}
I20260810 11:30:50.121883 29603 ts_tablet_manager.cc:1905] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:50.122762 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet b200bdb394d3439b86fff48494be8e3d because the tablet was not found. No further retry: Not found: Tablet not found: b200bdb394d3439b86fff48494be8e3d
I20260810 11:30:50.127473 27231 tablet_bootstrap.cc:492] T faff8489499e4e318b127d9c1b19d2e4 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:50.127121 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 228) took 2926 ms. Trace:
I20260810 11:30:50.130437 27231 tablet_bootstrap.cc:654] T faff8489499e4e318b127d9c1b19d2e4 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:50.134794 29603 ts_tablet_manager.cc:1918] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:50.135097 29603 log.cc:1196] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/a45422addab84e9083df8665a0cf9322
I20260810 11:30:50.135625 29603 ts_tablet_manager.cc:1939] T a45422addab84e9083df8665a0cf9322 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:50.136219 29455 raft_consensus.cc:482] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.136364 29455 raft_consensus.cc:504] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.136993 29455 leader_election.cc:288] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:50.138224 26904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a0284718f694a0591888e81357721b0" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:50.138891 26991 leader_election.cc:341] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:50.144351 26993 leader_election.cc:341] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.144850 26993 leader_election.cc:302] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:50.128914 28987 rpcz_store.cc:276] 0810 11:30:47.200161 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.200463 (+ 302us) service_pool.cc:227] Handling call
0810 11:30:50.124690 (+2924227us) ts_tablet_manager.cc:1145] Deleting tablet c60baf810a544a4a90dccd2337a39043
0810 11:30:50.124905 (+ 215us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:50.126706 (+ 1801us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2890664}
W20260810 11:30:50.156843 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet c60baf810a544a4a90dccd2337a39043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c60baf810a544a4a90dccd2337a39043 already in progress: creating tablet
I20260810 11:30:50.157565 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 231) took 2956 ms. Trace:
I20260810 11:30:50.157756 28987 rpcz_store.cc:276] 0810 11:30:47.201117 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.201234 (+ 117us) service_pool.cc:227] Handling call
0810 11:30:50.157375 (+2956141us) ts_tablet_manager.cc:1145] Deleting tablet 7c203cd90d2f472fa27cfabed5b87119
0810 11:30:50.157393 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:50.157535 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2910164}
W20260810 11:30:50.158767 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 7c203cd90d2f472fa27cfabed5b87119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c203cd90d2f472fa27cfabed5b87119 already in progress: creating tablet
I20260810 11:30:50.159382 29626 sys_catalog.cc:455] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac259bcf213a4aa297d1d8e73b262361. Latest consensus state: current_term: 6 leader_uuid: "ac259bcf213a4aa297d1d8e73b262361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:50.159924 29626 sys_catalog.cc:458] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:50.159652 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 235) took 2956 ms. Trace:
I20260810 11:30:50.161449 29291 raft_consensus.cc:2726] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:50.164405 29695 raft_consensus.cc:482] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac259bcf213a4aa297d1d8e73b262361)
I20260810 11:30:50.165642 29695 raft_consensus.cc:504] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:50.170006 27231 tablet_bootstrap.cc:492] T faff8489499e4e318b127d9c1b19d2e4 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:50.170207 27231 ts_tablet_manager.cc:1397] T faff8489499e4e318b127d9c1b19d2e4 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.002s
I20260810 11:30:50.170142 29681 sys_catalog.cc:455] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "ac259bcf213a4aa297d1d8e73b262361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:50.170934 29681 sys_catalog.cc:458] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 11:30:50.171693 26700 consensus_peers.cc:487] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eed0e2bead85466ca99cfb34e155a391. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:50.171892 26578 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 238) took 1248 ms. Trace:
I20260810 11:30:50.171941 27231 raft_consensus.cc:348] T faff8489499e4e318b127d9c1b19d2e4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.172637 27231 raft_consensus.cc:374] T faff8489499e4e318b127d9c1b19d2e4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:50.172755 27231 raft_consensus.cc:729] T faff8489499e4e318b127d9c1b19d2e4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:50.173349 26575 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet f8e6fc49f5e54f6c8fb710220a6cbf0f
I20260810 11:30:50.174333 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:49 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:50.175217 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:49 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.176286 29638 raft_consensus.cc:482] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.177830 26575 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 241) took 1227 ms. Trace:
I20260810 11:30:50.182542 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a with delete_type TABLET_DATA_DELETED (replaced by tablet c8c9267e2da64738b5f7550c83b7c4a3) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.182807 28987 rpcz_store.cc:276] 0810 11:30:47.203415 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.203460 (+ 45us) service_pool.cc:227] Handling call
0810 11:30:50.159268 (+2955808us) ts_tablet_manager.cc:1145] Deleting tablet f6e264e8507446809f3c386fdb3c34ae
0810 11:30:50.159288 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:50.159442 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2909411}
I20260810 11:30:50.183717 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 227) took 2983 ms. Trace:
I20260810 11:30:50.183956 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:50.184319 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet f6e264e8507446809f3c386fdb3c34ae because the tablet was not found. No further retry: Not found: Tablet not found: f6e264e8507446809f3c386fdb3c34ae
I20260810 11:30:50.183867 28987 rpcz_store.cc:276] 0810 11:30:47.200036 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.200413 (+ 377us) service_pool.cc:227] Handling call
0810 11:30:50.183577 (+2983164us) ts_tablet_manager.cc:1145] Deleting tablet 2da86554bc51486e91f1ea5995a245b5
0810 11:30:50.183592 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:50.183699 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2931630}
W20260810 11:30:50.185568 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 2da86554bc51486e91f1ea5995a245b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2da86554bc51486e91f1ea5995a245b5 already in progress: creating tablet
I20260810 11:30:50.178067 26575 rpcz_store.cc:276] 0810 11:30:48.949620 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.746894 (+797274us) service_pool.cc:227] Handling call
0810 11:30:49.837158 (+ 90264us) spinlock_profiling.cc:243] Waited 89.9 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa462e6 00007f9c61d39126 00007f9c61d38e55 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:49.952040 (+114882us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:49.952216 (+ 176us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:49.952297 (+ 81us) catalog_manager.cc:2761] Locking tablets
0810 11:30:49.952451 (+ 154us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:49.984312 (+ 31861us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:50.172360 (+188048us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:50.172451 (+ 91us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:50.177253 (+ 4802us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:49.971861 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:49.971972 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:49.971978 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:49.971980 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:49.972110 (+ 130us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:49.972124 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:49.972129 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:49.972258 (+ 129us) tablet.cc:699] Row locks acquired
0810 11:30:49.972261 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:49.972302 (+ 41us) write_op.cc:270] Start()
0810 11:30:49.972338 (+ 36us) write_op.cc:276] Timestamp: P: 1786361449972250 usec, L: 0
0810 11:30:49.972342 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:49.972526 (+ 184us) log.cc:842] Serialized 799 byte log entry
0810 11:30:49.982563 (+ 10037us) op_driver.cc:444] REPLICATION: finished
0810 11:30:49.982714 (+ 151us) write_op.cc:301] APPLY: starting
0810 11:30:49.982734 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:49.982784 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:49.982811 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:49.982897 (+ 86us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:49.982943 (+ 46us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:49.982954 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:49.983067 (+ 113us) log.cc:842] Serialized 29 byte log entry
0810 11:30:49.983143 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.983171 (+ 28us) write_op.cc:454] Released schema lock
0810 11:30:49.983181 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:49.983250 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.983253 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":206870784,"child_traces":[["op",{"apply.queue_time_us":90,"apply.run_cpu_time_us":604,"apply.run_wall_time_us":603,"num_ops":2,"prepare.queue_time_us":55,"prepare.run_cpu_time_us":817,"prepare.run_wall_time_us":817,"raft.queue_time_us":548,"raft.run_cpu_time_us":443,"raft.run_wall_time_us":442,"replication_time_us":10188}]]}
I20260810 11:30:50.178471 26581 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_5b3952f643634a688f9b0f31ace9abad" } modify_external_catalogs: true
I20260810 11:30:50.187597 27231 consensus_queue.cc:260] T faff8489499e4e318b127d9c1b19d2e4 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.188023 26575 master_service.cc:946] ReplaceTablet: received request to replace tablet d24726d0214947beab0bb31b1597c1c3 from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:50.176419 29638 raft_consensus.cc:504] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:50.188783 29638 leader_election.cc:288] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:50.188817 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 238) took 2967 ms. Trace:
I20260810 11:30:50.189873 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 81b800247b4e4171b82dcde68e39fb00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:50.189996 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e69916a35fba4714bbc565921738888f" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:50.190286 26757 raft_consensus.cc:2454] T e69916a35fba4714bbc565921738888f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:50.190833 26849 leader_election.cc:302] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
W20260810 11:30:50.190901 26993 leader_election.cc:341] T f9c7ab7f075d459d8b1f1a0bb0e2e2d7 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.191020 26993 leader_election.cc:302] T f9c7ab7f075d459d8b1f1a0bb0e2e2d7 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:50.191223 29291 raft_consensus.cc:2726] T f9c7ab7f075d459d8b1f1a0bb0e2e2d7 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:50.191496 26993 leader_election.cc:341] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.191609 26993 leader_election.cc:302] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:50.191780 29291 raft_consensus.cc:2726] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:50.191920 26993 leader_election.cc:341] T 16101a5784394d3aa570f4ecd8f2ac56 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.192021 26993 leader_election.cc:302] T 16101a5784394d3aa570f4ecd8f2ac56 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:50.192214 29291 raft_consensus.cc:2726] T 16101a5784394d3aa570f4ecd8f2ac56 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:50.194749 27231 ts_tablet_manager.cc:1428] T faff8489499e4e318b127d9c1b19d2e4 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.024s user 0.003s sys 0.001s
I20260810 11:30:50.195380 27228 tablet_bootstrap.cc:492] T ee803ddf27594d2b9e19fe440fc269c7 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:50.188948 28987 rpcz_store.cc:276] 0810 11:30:47.221004 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.221072 (+ 68us) service_pool.cc:227] Handling call
0810 11:30:50.188665 (+2967593us) ts_tablet_manager.cc:1145] Deleting tablet 809b5b6b65d244cd9186517e39494839
0810 11:30:50.188680 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:50.188790 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2936643}
I20260810 11:30:50.195533 27228 ts_tablet_manager.cc:1397] T ee803ddf27594d2b9e19fe440fc269c7 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.167s user 0.010s sys 0.005s
W20260810 11:30:50.196211 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 809b5b6b65d244cd9186517e39494839 because the tablet was not found. No further retry: Not found: Tablet not found: 809b5b6b65d244cd9186517e39494839
I20260810 11:30:50.197240 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.197242 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.199268 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da86554bc51486e91f1ea5995a245b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.199572 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet ce73798a721b4a6d892f0c24b6b40e2c with delete_type TABLET_DATA_DELETED (replaced by tablet 81b800247b4e4171b82dcde68e39fb00) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.199779 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet c60baf810a544a4a90dccd2337a39043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.199947 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet ea66da5bc20e4718901ffc473677421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.200114 26738 tablet_service.cc:1514] Processing DeleteTablet for tablet b121c13e9241468aa224e17093eb38f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b607279006c4baeae79325926088014) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.200161 26744 tablet_service.cc:1514] Processing DeleteTablet for tablet ee803ddf27594d2b9e19fe440fc269c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 82de53efa73447fe84e70dbb11a16a5f) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.200217 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7acf847a1fd74ccc89b5bffe1bbb76f3) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.200328 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet d512c335e340437fa32f2dc16dca6812 with delete_type TABLET_DATA_DELETED (replaced by tablet 7abf8e1e7f2c4519902cf31c6e0e86e2) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.200484 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c203cd90d2f472fa27cfabed5b87119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.200800 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet cc76d30f37094391b75076c92ccc277f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.200169 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet e69916a35fba4714bbc565921738888f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.201020 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 234) took 2997 ms. Trace:
I20260810 11:30:50.201803 29686 sys_catalog.cc:455] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "ac259bcf213a4aa297d1d8e73b262361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:50.202520 29686 sys_catalog.cc:458] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 11:30:50.202332 28987 rpcz_store.cc:276] 0810 11:30:47.203305 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.203380 (+ 75us) service_pool.cc:227] Handling call
0810 11:30:50.200863 (+2997483us) ts_tablet_manager.cc:1145] Deleting tablet b6395bce17ee40c2822669246ce7eb42
0810 11:30:50.200877 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:50.201001 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2948791}
I20260810 11:30:50.203687 27222 tablet_bootstrap.cc:492] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:50.203899 27222 ts_tablet_manager.cc:1397] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.129s user 0.004s sys 0.003s
I20260810 11:30:50.204880 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 240) took 2982 ms. Trace:
I20260810 11:30:50.204839 27222 raft_consensus.cc:348] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.205130 27222 raft_consensus.cc:374] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:50.205236 27222 raft_consensus.cc:729] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:50.205683 27231 tablet_bootstrap.cc:492] T 046fede13acf44e294fde386f78446a5 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:50.205564 27222 consensus_queue.cc:260] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.206123 27222 ts_tablet_manager.cc:1428] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 11:30:50.206401 27222 tablet_bootstrap.cc:492] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:50.206807 29504 raft_consensus.cc:482] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.206993 29504 raft_consensus.cc:504] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.207615 29504 leader_election.cc:288] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:50.205034 28987 rpcz_store.cc:276] 0810 11:30:47.222721 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.222797 (+ 76us) service_pool.cc:227] Handling call
0810 11:30:50.204702 (+2981905us) ts_tablet_manager.cc:1145] Deleting tablet 518c777e40ec40dcb3484c0374384959
0810 11:30:50.204716 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:50.204860 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2951090}
I20260810 11:30:50.208802 28987 tablet_replica.cc:330] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:50.209008 28987 raft_consensus.cc:2229] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:50.209206 28987 raft_consensus.cc:2258] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:50.209825 28987 ts_tablet_manager.cc:1905] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:50.210276 26702 leader_election.cc:341] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: b945038c03e343489af6ae7e50131d97
I20260810 11:30:50.212841 27231 tablet_bootstrap.cc:654] T 046fede13acf44e294fde386f78446a5 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:50.212975 27222 tablet_bootstrap.cc:654] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:50.218427 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet d4873fe8318040a2b7e021708a875f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.224925 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet 81b800247b4e4171b82dcde68e39fb00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.227133 27222 tablet_bootstrap.cc:492] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:50.227309 27222 ts_tablet_manager.cc:1397] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260810 11:30:50.228461 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet d000f0ebaf0049a7bdaad93e307e16e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.232383 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet 8228600e3f6b4f9993dd25e4ceb57e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.232822 29638 raft_consensus.cc:2781] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:50.232925 29638 raft_consensus.cc:482] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:50.232986 29638 raft_consensus.cc:3037] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:50.238327 29695 leader_election.cc:288] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 83cc8e39a3b9455f8242a6da6a54c38a (127.25.195.254:41125), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
W20260810 11:30:50.240218 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet b6395bce17ee40c2822669246ce7eb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6395bce17ee40c2822669246ce7eb42 already in progress: creating tablet
I20260810 11:30:50.242461 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet e69916a35fba4714bbc565921738888f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.243448 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a2e1b54043444989ac64c87f30ffc07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.243778 29603 tablet_replica.cc:330] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:50.244210 29603 raft_consensus.cc:2229] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:50.244633 29603 raft_consensus.cc:2258] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:50.245760 29603 ts_tablet_manager.cc:1905] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:50.246037 29706 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 11:30:50.249625 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae27bf110114b70a3e3f6cf64f31b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:23 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.250483 27222 raft_consensus.cc:348] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.251030 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da86554bc51486e91f1ea5995a245b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:26 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.253036 27222 raft_consensus.cc:374] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:50.253389 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet ce73798a721b4a6d892f0c24b6b40e2c with delete_type TABLET_DATA_DELETED (replaced by tablet 81b800247b4e4171b82dcde68e39fb00) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.254009 27222 raft_consensus.cc:729] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:50.254432 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet e276b0fa124d42dfb3fe750d245e44d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7acf847a1fd74ccc89b5bffe1bbb76f3) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.255604 27222 consensus_queue.cc:260] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.256194 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet c60baf810a544a4a90dccd2337a39043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:58800
W20260810 11:30:50.256587 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 518c777e40ec40dcb3484c0374384959 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 518c777e40ec40dcb3484c0374384959 already in progress: creating tablet
W20260810 11:30:50.256664 26567 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0bb01711769f457aa0696bb59582166d consensus state has no leader
I20260810 11:30:50.258040 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet cc76d30f37094391b75076c92ccc277f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.259601 29694 tablet.cc:1722] T 372b49dc083d46538442fcbfdfeb3545 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:50.257481 29658 tablet.cc:1722] T 372b49dc083d46538442fcbfdfeb3545 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:50.261559 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet ea66da5bc20e4718901ffc473677421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.172286 26578 rpcz_store.cc:276] 0810 11:30:48.923692 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.734330 (+810638us) service_pool.cc:227] Handling call
0810 11:30:49.734845 (+ 515us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:49.735098 (+ 253us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:49.735275 (+ 177us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:49.735357 (+ 82us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:49.847554 (+112197us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:50.171776 (+324222us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:49.742268 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:49.742371 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:49.742374 (+ 3us) write_op.cc:435] Acquired schema lock
0810 11:30:49.742376 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:49.742503 (+ 127us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:49.742513 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:49.742518 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:49.742580 (+ 62us) tablet.cc:699] Row locks acquired
0810 11:30:49.742582 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:49.742616 (+ 34us) write_op.cc:270] Start()
0810 11:30:49.742642 (+ 26us) write_op.cc:276] Timestamp: P: 1786361449742588 usec, L: 0
0810 11:30:49.742646 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:49.835567 (+ 92921us) log.cc:842] Serialized 405 byte log entry
0810 11:30:49.835896 (+ 329us) spinlock_profiling.cc:243] Waited 92.7 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f9c62f1dd02 00007f9c642507f1 00007f9c6424f359 00007f9c642571bb 00007f9c64257038 00000000009edb7c 00007f9c57a55344 00007f9c57a5891b 00007f9c57a58798 00000000009edb7c
0810 11:30:49.845238 (+ 9342us) op_driver.cc:444] REPLICATION: finished
0810 11:30:49.845387 (+ 149us) write_op.cc:301] APPLY: starting
0810 11:30:49.845418 (+ 31us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:49.845457 (+ 39us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:49.845459 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:49.845576 (+ 117us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:49.845609 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:49.845615 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:49.845954 (+ 339us) log.cc:842] Serialized 23 byte log entry
0810 11:30:49.846095 (+ 141us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.846122 (+ 27us) write_op.cc:454] Released schema lock
0810 11:30:49.846133 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:49.846246 (+ 113us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.846390 (+ 144us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":102,"apply.run_cpu_time_us":1091,"apply.run_wall_time_us":1089,"num_ops":1,"prepare.queue_time_us":6321,"prepare.run_cpu_time_us":2009,"prepare.run_wall_time_us":93728,"raft.queue_time_us":1542,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":253,"replication_time_us":102569,"spinlock_wait_cycles":213109504}]]}
I20260810 11:30:50.266665 26578 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_061b7dfbcc074ad6a0d99d49113a354f" } new_table_name: "default.Table_14a68d6fff274195aac026309faee0fc" modify_external_catalogs: true
I20260810 11:30:50.267259 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet 4827800160e64883ba7bcadafeb13ead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.275590 26743 tablet_service.cc:1467] Processing CreateTablet for tablet ca2cd002bf78436db070d1eb1630c2a3 (DEFAULT_TABLE table=default.Table_953e0e00bdb74f3f97940590ea5eb471 [id=d25f3ac7818d4fd388bf490221d883b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.276134 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca2cd002bf78436db070d1eb1630c2a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.278345 26581 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet bba33b04fdf84ee4a2b8aac5423022c8
I20260810 11:30:50.279058 26581 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 242) took 1325 ms. Trace:
I20260810 11:30:50.279146 26736 tablet_service.cc:1467] Processing CreateTablet for tablet e95537eb35194e8fa014a765d693bf18 (DEFAULT_TABLE table=default.Table_fabd7780b9224b7993ad4321be6f92e2 [id=c9c81bc9d6dc48c89ba4cc51ca4f8bd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.279603 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e95537eb35194e8fa014a765d693bf18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.279261 26581 rpcz_store.cc:276] 0810 11:30:48.953506 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.874694 (+921188us) service_pool.cc:227] Handling call
0810 11:30:49.890797 (+ 16103us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa462e6 00007f9c61d39126 00007f9c61d38e55 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:50.187469 (+296672us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:50.192788 (+ 5319us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:50.192872 (+ 84us) catalog_manager.cc:2761] Locking tablets
0810 11:30:50.193043 (+ 171us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:50.264420 (+ 71377us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:50.278175 (+ 13755us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:50.278226 (+ 51us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:50.278916 (+ 690us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:50.193973 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:50.194124 (+ 151us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:50.194132 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:50.194147 (+ 15us) tablet.cc:660] Decoding operations
0810 11:30:50.194292 (+ 145us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:50.194308 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:50.194312 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:50.237615 (+ 43303us) tablet.cc:699] Row locks acquired
0810 11:30:50.237619 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:50.237682 (+ 63us) write_op.cc:270] Start()
0810 11:30:50.237732 (+ 50us) write_op.cc:276] Timestamp: P: 1786361450237649 usec, L: 0
0810 11:30:50.237736 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:50.237994 (+ 258us) log.cc:842] Serialized 734 byte log entry
0810 11:30:50.257617 (+ 19623us) op_driver.cc:444] REPLICATION: finished
0810 11:30:50.257807 (+ 190us) write_op.cc:301] APPLY: starting
0810 11:30:50.257846 (+ 39us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:50.257904 (+ 58us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:50.257983 (+ 79us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:50.258069 (+ 86us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:50.258107 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:50.258114 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:50.258213 (+ 99us) log.cc:842] Serialized 29 byte log entry
0810 11:30:50.258282 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.258305 (+ 23us) write_op.cc:454] Released schema lock
0810 11:30:50.258314 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:50.258379 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.258383 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":36413824,"child_traces":[["op",{"apply.queue_time_us":132,"apply.run_cpu_time_us":638,"apply.run_wall_time_us":637,"num_ops":2,"prepare.queue_time_us":61,"prepare.run_cpu_time_us":1148,"prepare.run_wall_time_us":44147,"raft.queue_time_us":1471,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":297,"replication_time_us":19848}]]}
I20260810 11:30:50.280221 29658 tablet.cc:1722] T 5deec04c1be64473accf8b9df14bd22e P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 11:30:50.281272 26581 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_84b09f8712134781a968568083e2d72d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:50.282119 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet bba33b04fdf84ee4a2b8aac5423022c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:50 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.282377 26730 tablet_service.cc:1467] Processing CreateTablet for tablet fd54ea77be114ca3b67d9dd40988dd74 (DEFAULT_TABLE table=default.Table_a82af0b403284841a1f2697487809b6a [id=a5958ce5e8894eb584183cde2335266e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.282856 26730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd54ea77be114ca3b67d9dd40988dd74. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:50.303432 26581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84b09f8712134781a968568083e2d72d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:50.275471 26737 tablet_service.cc:1467] Processing CreateTablet for tablet deecb3f76bc942978ee1d5caf0d841a9 (DEFAULT_TABLE table=default.Table_72f950492bf04491b56e4f549a6fbc7c [id=97d34e6266124fbc8c22cedddf5a05f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.306247 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet deecb3f76bc942978ee1d5caf0d841a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.306174 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 713663be70014b17b17056a865e7db63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.306655 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 4efa31ad2ce8436b9638e6759d9b5421 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:44 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.306561 29724 tablet.cc:1722] T 5deec04c1be64473accf8b9df14bd22e P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 11:30:50.307021 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet b945038c03e343489af6ae7e50131d97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.283289 26575 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet d24726d0214947beab0bb31b1597c1c3
I20260810 11:30:50.313198 26575 catalog_manager.cc:6565] ReplaceTablet: tablet d24726d0214947beab0bb31b1597c1c3 deleted and replaced by tablet caf5ed278bd648068d0d8a3b0bdfd642
I20260810 11:30:50.313779 27377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c40c76e125b44de181b88b7f63a566f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 797 } } ignore_live_leader: false dest_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" is_pre_election: true
I20260810 11:30:50.314752 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet d24726d0214947beab0bb31b1597c1c3 with delete_type TABLET_DATA_DELETED (replaced by tablet caf5ed278bd648068d0d8a3b0bdfd642) from {username='slave'} at 127.0.0.1:52750
W20260810 11:30:50.282894 26571 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ebaf046e524b485c8b3ebf419c8035bb consensus state has no leader
W20260810 11:30:50.304379 26576 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.195:32877 (request call id 349) took 1523 ms (client timeout 1000 ms). Trace:
I20260810 11:30:50.316356 26571 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 243) took 1354 ms. Trace:
I20260810 11:30:50.317193 26571 rpcz_store.cc:276] 0810 11:30:48.961550 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.955509 (+993959us) service_pool.cc:227] Handling call
0810 11:30:50.176836 (+221327us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:50.177076 (+ 240us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:50.177282 (+ 206us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:50.177377 (+ 95us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:50.282399 (+105022us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:50.316232 (+ 33833us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:50.264927 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:50.265068 (+ 141us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:50.265077 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:50.265081 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:50.265214 (+ 133us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:50.265228 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:50.265232 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:50.265296 (+ 64us) tablet.cc:699] Row locks acquired
0810 11:30:50.265298 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:50.265336 (+ 38us) write_op.cc:270] Start()
0810 11:30:50.265365 (+ 29us) write_op.cc:276] Timestamp: P: 1786361450265306 usec, L: 0
0810 11:30:50.265369 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:50.265583 (+ 214us) log.cc:842] Serialized 405 byte log entry
0810 11:30:50.270707 (+ 5124us) op_driver.cc:444] REPLICATION: finished
0810 11:30:50.271597 (+ 890us) write_op.cc:301] APPLY: starting
0810 11:30:50.271612 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:50.271655 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:50.271679 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:50.271730 (+ 51us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:50.271767 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:50.271776 (+ 9us) write_op.cc:312] APPLY: finished
0810 11:30:50.271843 (+ 67us) log.cc:842] Serialized 23 byte log entry
0810 11:30:50.271888 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.271903 (+ 15us) write_op.cc:454] Released schema lock
0810 11:30:50.271909 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:50.271969 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.271975 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":830,"apply.run_cpu_time_us":431,"apply.run_wall_time_us":431,"num_ops":1,"prepare.queue_time_us":47,"prepare.run_cpu_time_us":757,"prepare.run_wall_time_us":757,"raft.queue_time_us":546,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":304,"replication_time_us":5301}]]}
I20260810 11:30:50.319308 26571 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_e845854916d84c01bc7d0efb85bd7328"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:50.320533 26571 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e845854916d84c01bc7d0efb85bd7328 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:50.324671 26904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b945038c03e343489af6ae7e50131d97" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:50.316287 26576 rpcz_store.cc:269] 0810 11:30:48.780360 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:48.782466 (+ 2106us) service_pool.cc:227] Handling call
0810 11:30:48.843268 (+ 60802us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa3fd8f 00007f9c61d34946 00007f9c61d34675 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:50.304266 (+1460998us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:49.882473 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:49.882606 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:49.882612 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:49.882615 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:49.882874 (+ 259us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:49.882887 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:49.882893 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:49.882968 (+ 75us) tablet.cc:699] Row locks acquired
0810 11:30:49.882970 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:49.883012 (+ 42us) write_op.cc:270] Start()
0810 11:30:49.883045 (+ 33us) write_op.cc:276] Timestamp: P: 1786361449882968 usec, L: 0
0810 11:30:49.883050 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:49.891310 (+ 8260us) log.cc:842] Serialized 356 byte log entry
0810 11:30:49.891691 (+ 381us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f9c62f1dd02 00007f9c642507f1 00007f9c6424f359 00007f9c642571bb 00007f9c64257038 00000000009edb7c 00007f9c57a55344 00007f9c57a5891b 00007f9c57a58798 00000000009edb7c
0810 11:30:49.898922 (+ 7231us) op_driver.cc:444] REPLICATION: finished
0810 11:30:49.899583 (+ 661us) write_op.cc:301] APPLY: starting
0810 11:30:49.899604 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:49.899652 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:49.899655 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:49.899718 (+ 63us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:49.899756 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:49.899767 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:49.899871 (+ 104us) log.cc:842] Serialized 23 byte log entry
0810 11:30:49.899954 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.899980 (+ 26us) write_op.cc:454] Released schema lock
0810 11:30:49.899987 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:49.900051 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.900054 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":135418,"reported_tablets":177,"spinlock_wait_cycles":71017600,"child_traces":[["op",{"apply.queue_time_us":572,"apply.run_cpu_time_us":534,"apply.run_wall_time_us":533,"num_ops":1,"prepare.queue_time_us":60,"prepare.run_cpu_time_us":1669,"prepare.run_wall_time_us":9315,"raft.queue_time_us":2999,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":3583,"replication_time_us":15843,"spinlock_wait_cycles":18454784}]]}
I20260810 11:30:50.328204 26576 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_e510bc69fa8a4595b1080535403c3828"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:50.329005 26821 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
W20260810 11:30:50.329452 26576 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e510bc69fa8a4595b1080535403c3828 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:50.320706 26575 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 244) took 1349 ms. Trace:
I20260810 11:30:50.331692 26575 rpcz_store.cc:276] 0810 11:30:48.963947 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.187155 (+1223208us) service_pool.cc:227] Handling call
0810 11:30:50.313398 (+126243us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:50.238172 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:50.238303 (+ 131us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:50.238310 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:50.238312 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:50.238449 (+ 137us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:50.238461 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:50.238465 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:50.238542 (+ 77us) tablet.cc:699] Row locks acquired
0810 11:30:50.238544 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:50.238587 (+ 43us) write_op.cc:270] Start()
0810 11:30:50.238616 (+ 29us) write_op.cc:276] Timestamp: P: 1786361450238560 usec, L: 0
0810 11:30:50.238619 (+ 3us) op_driver.cc:331] REPLICATION: starting
0810 11:30:50.238806 (+ 187us) log.cc:842] Serialized 665 byte log entry
0810 11:30:50.257695 (+ 18889us) op_driver.cc:444] REPLICATION: finished
0810 11:30:50.258485 (+ 790us) write_op.cc:301] APPLY: starting
0810 11:30:50.258500 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:50.258543 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:50.258618 (+ 75us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:50.258711 (+ 93us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:50.258755 (+ 44us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:50.258762 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:50.258815 (+ 53us) log.cc:842] Serialized 29 byte log entry
0810 11:30:50.258862 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.258878 (+ 16us) write_op.cc:454] Released schema lock
0810 11:30:50.258883 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:50.258947 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.258951 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":753,"apply.run_cpu_time_us":513,"apply.run_wall_time_us":512,"num_ops":2,"prepare.queue_time_us":23603,"prepare.run_cpu_time_us":739,"prepare.run_wall_time_us":739,"raft.queue_time_us":1034,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":19058}]]}
I20260810 11:30:50.333411 29267 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" instance_seqno: 1786361407549230) as {username='slave'} at 127.25.195.193:54621; Asking this server to re-register.
W20260810 11:30:50.333614 29680 log.cc:924] Time spent T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700: Append to log took a long time: real 0.157s user 0.000s sys 0.000s
I20260810 11:30:50.340224 26576 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 248) took 1346 ms. Trace:
I20260810 11:30:50.342067 29658 tablet.cc:1722] T 72209a805e3e4b4ea1bf99508e0f75db P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:50.342752 29694 tablet.cc:1722] T 72209a805e3e4b4ea1bf99508e0f75db P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:50.349026 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b303be24f4e46d0b966e8191d76297b with delete_type TABLET_DATA_DELETED (replaced by tablet ccdf2bb9f3b347ceb970a0d3115816df) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.349591 26746 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cc17c55109b47eeb91920c3ed8178e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6179cb2be2c442ee97161fe1f4661b64) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.349822 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 78633fbe048b4534ae3277ce6b7c4313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:39 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.350037 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet b945cb22353f4d99a3836e3c0b8e26e3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ee50a7da224437baed913995e6587dd) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.350490 26823 heartbeater.cc:464] Registering TS with master...
W20260810 11:30:50.324188 26577 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet f10ac7e043c240d8a14b2b4f96b864b9 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet f10ac7e043c240d8a14b2b4f96b864b9 consensus state has no leader
I20260810 11:30:50.353492 26575 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_0f779427a62c484bab2cc50e9b46a8e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 11:30:50.360503 26889 tablet_service.cc:1467] Processing CreateTablet for tablet deecb3f76bc942978ee1d5caf0d841a9 (DEFAULT_TABLE table=default.Table_72f950492bf04491b56e4f549a6fbc7c [id=97d34e6266124fbc8c22cedddf5a05f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.363651 26885 tablet_service.cc:1467] Processing CreateTablet for tablet e95537eb35194e8fa014a765d693bf18 (DEFAULT_TABLE table=default.Table_fabd7780b9224b7993ad4321be6f92e2 [id=c9c81bc9d6dc48c89ba4cc51ca4f8bd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.371846 29267 ts_manager.cc:194] Registered new tserver with Master: 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885)
I20260810 11:30:50.375075 27231 tablet_bootstrap.cc:492] T 046fede13acf44e294fde386f78446a5 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:50.375348 27231 ts_tablet_manager.cc:1397] T 046fede13acf44e294fde386f78446a5 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.170s user 0.003s sys 0.003s
I20260810 11:30:50.376294 27231 raft_consensus.cc:348] T 046fede13acf44e294fde386f78446a5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.376551 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fee1a9a6f9482fbbe6ab6599c27fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:25 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.376767 27231 raft_consensus.cc:374] T 046fede13acf44e294fde386f78446a5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:50.376827 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 518c777e40ec40dcb3484c0374384959 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.376890 27231 raft_consensus.cc:729] T 046fede13acf44e294fde386f78446a5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:50.377337 27231 consensus_queue.cc:260] T 046fede13acf44e294fde386f78446a5 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:50.378644 26575 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f779427a62c484bab2cc50e9b46a8e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:50.341104 26576 rpcz_store.cc:276] 0810 11:30:48.993416 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.327698 (+1334282us) service_pool.cc:227] Handling call
0810 11:30:50.329750 (+ 2052us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:50.330507 (+ 757us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:50.339886 (+ 9379us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:50.340007 (+ 121us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:50.340100 (+ 93us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:50.331434 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:50.331568 (+ 134us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:50.331589 (+ 21us) write_op.cc:435] Acquired schema lock
0810 11:30:50.331592 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:50.331748 (+ 156us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:50.331764 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:50.331769 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:50.331875 (+ 106us) tablet.cc:699] Row locks acquired
0810 11:30:50.331878 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:50.331922 (+ 44us) write_op.cc:270] Start()
0810 11:30:50.331959 (+ 37us) write_op.cc:276] Timestamp: P: 1786361450331884 usec, L: 0
0810 11:30:50.331963 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:50.332298 (+ 335us) log.cc:842] Serialized 433 byte log entry
0810 11:30:50.337796 (+ 5498us) op_driver.cc:444] REPLICATION: finished
0810 11:30:50.337928 (+ 132us) write_op.cc:301] APPLY: starting
0810 11:30:50.337945 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:50.337990 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:50.338030 (+ 40us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:50.338212 (+ 182us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:50.338266 (+ 54us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:50.338278 (+ 12us) write_op.cc:312] APPLY: finished
0810 11:30:50.338423 (+ 145us) log.cc:842] Serialized 29 byte log entry
0810 11:30:50.338498 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.338522 (+ 24us) write_op.cc:454] Released schema lock
0810 11:30:50.338530 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:50.338603 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.338606 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":79,"apply.run_cpu_time_us":733,"apply.run_wall_time_us":732,"num_ops":2,"prepare.queue_time_us":64,"prepare.run_cpu_time_us":992,"prepare.run_wall_time_us":1384,"raft.queue_time_us":47,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":314,"replication_time_us":5798}]]}
I20260810 11:30:50.366518 29097 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "ac259bcf213a4aa297d1d8e73b262361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } } }
I20260810 11:30:50.380472 29097 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361 [sys.catalog]: This master's current role is: LEADER
I20260810 11:30:50.385618 26886 tablet_service.cc:1467] Processing CreateTablet for tablet fd54ea77be114ca3b67d9dd40988dd74 (DEFAULT_TABLE table=default.Table_a82af0b403284841a1f2697487809b6a [id=a5958ce5e8894eb584183cde2335266e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.386428 26891 tablet_service.cc:1514] Processing DeleteTablet for tablet aad22a5dfacf4fb88a5493376915a70f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:48 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:50.387460 26883 tablet_service.cc:1467] Processing CreateTablet for tablet ca2cd002bf78436db070d1eb1630c2a3 (DEFAULT_TABLE table=default.Table_953e0e00bdb74f3f97940590ea5eb471 [id=d25f3ac7818d4fd388bf490221d883b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.388767 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet deecb3f76bc942978ee1d5caf0d841a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.390858 26576 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_7ab2a0eaec2b43f6bd0a082bd2f089c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:50.391544 26576 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ab2a0eaec2b43f6bd0a082bd2f089c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:50.386428 26894 tablet_service.cc:1514] Processing DeleteTablet for tablet d24726d0214947beab0bb31b1597c1c3 with delete_type TABLET_DATA_DELETED (replaced by tablet caf5ed278bd648068d0d8a3b0bdfd642) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:50.393143 29453 raft_consensus.cc:482] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.393237 26581 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 246) took 1402 ms. Trace:
I20260810 11:30:50.393329 29453 raft_consensus.cc:504] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.393339 26581 rpcz_store.cc:276] 0810 11:30:48.990508 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.280725 (+1290217us) service_pool.cc:227] Handling call
0810 11:30:50.310604 (+ 29879us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:50.311393 (+ 789us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:50.392962 (+ 81569us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:50.393080 (+ 118us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:50.393172 (+ 92us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:50.312204 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:50.312310 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:50.312316 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:50.312318 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:50.312403 (+ 85us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:50.312415 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:50.312419 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:50.312495 (+ 76us) tablet.cc:699] Row locks acquired
0810 11:30:50.312497 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:50.312539 (+ 42us) write_op.cc:270] Start()
0810 11:30:50.312603 (+ 64us) write_op.cc:276] Timestamp: P: 1786361450312503 usec, L: 0
0810 11:30:50.312607 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:50.312843 (+ 236us) log.cc:842] Serialized 433 byte log entry
0810 11:30:50.317597 (+ 4754us) op_driver.cc:444] REPLICATION: finished
0810 11:30:50.317722 (+ 125us) write_op.cc:301] APPLY: starting
0810 11:30:50.317737 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:50.317780 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:50.317865 (+ 85us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:50.318018 (+ 153us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:50.318052 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:50.318059 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:50.318135 (+ 76us) log.cc:842] Serialized 29 byte log entry
0810 11:30:50.318201 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.318223 (+ 22us) write_op.cc:454] Released schema lock
0810 11:30:50.318233 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:50.318298 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.318302 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":77,"apply.run_cpu_time_us":631,"apply.run_wall_time_us":630,"num_ops":2,"prepare.queue_time_us":60,"prepare.run_cpu_time_us":753,"prepare.run_wall_time_us":753,"raft.queue_time_us":569,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":238,"replication_time_us":4962}]]}
I20260810 11:30:50.394126 29453 leader_election.cc:288] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:50.394922 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d52e5c77d94854b8ba0b38c63ad015" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:50.395165 27061 raft_consensus.cc:2454] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:50.395910 26702 leader_election.cc:302] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:50.396219 29453 raft_consensus.cc:2781] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:50.396303 29453 raft_consensus.cc:482] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:50.396381 29453 raft_consensus.cc:3037] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:50.399757 29453 raft_consensus.cc:504] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.400954 29453 leader_election.cc:288] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:50.401108 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d52e5c77d94854b8ba0b38c63ad015" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:50.401399 27061 raft_consensus.cc:3037] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:50.363083 27228 raft_consensus.cc:348] T ee803ddf27594d2b9e19fe440fc269c7 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.402765 27228 raft_consensus.cc:374] T ee803ddf27594d2b9e19fe440fc269c7 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:50.403048 27228 raft_consensus.cc:729] T ee803ddf27594d2b9e19fe440fc269c7 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:50.403551 26730 tablet_service.cc:1514] Processing DeleteTablet for tablet d4873fe8318040a2b7e021708a875f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.404668 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet d08250001e1542f9978bc6f89ace458b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.405902 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3e78dcaa55491393f529ea33007786 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:50.406126 26878 tablet_service.cc:1514] Processing DeleteTablet for tablet bba33b04fdf84ee4a2b8aac5423022c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:50 UTC) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:50.409307 29684 log.cc:924] Time spent T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700: Append to log took a long time: real 0.084s user 0.000s sys 0.000s
I20260810 11:30:50.409307 27061 raft_consensus.cc:2454] T 00d52e5c77d94854b8ba0b38c63ad015 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:50.409854 26702 leader_election.cc:302] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:50.410173 29453 raft_consensus.cc:2781] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:50.410383 29453 raft_consensus.cc:686] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:50.410619 29453 consensus_queue.cc:237] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.411674 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e95537eb35194e8fa014a765d693bf18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.412925 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca2cd002bf78436db070d1eb1630c2a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.403930 27228 consensus_queue.cc:260] T ee803ddf27594d2b9e19fe440fc269c7 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:50.415710 26577 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.194:35117 (request call id 274) took 1499 ms (client timeout 1000 ms). Trace:
I20260810 11:30:50.416347 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd54ea77be114ca3b67d9dd40988dd74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.417379 26878 tablet_service.cc:1514] Processing DeleteTablet for tablet eed0e2bead85466ca99cfb34e155a391 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:50.420322 29491 raft_consensus.cc:482] T 1549a26ba0f6427fae87b204c5d49eff P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.420643 29491 raft_consensus.cc:504] T 1549a26ba0f6427fae87b204c5d49eff P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:50.420913 26581 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_48393021647145c3b0a8e5ad71ff11e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:50.421662 26581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48393021647145c3b0a8e5ad71ff11e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:50.422084 29491 leader_election.cc:288] T 1549a26ba0f6427fae87b204c5d49eff P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:50.408445 29267 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "482e605580be48cbbacce05a3e61c215" instance_seqno: 1786361409040091) as {username='slave'} at 127.25.195.195:39163; Asking this server to re-register.
I20260810 11:30:50.424585 27228 ts_tablet_manager.cc:1428] T ee803ddf27594d2b9e19fe440fc269c7 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.229s user 0.004s sys 0.000s
I20260810 11:30:50.425186 27228 tablet_bootstrap.cc:492] T 00d52e5c77d94854b8ba0b38c63ad015 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:50.430949 27231 ts_tablet_manager.cc:1428] T 046fede13acf44e294fde386f78446a5 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.055s user 0.001s sys 0.001s
I20260810 11:30:50.432399 26571 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 247) took 1439 ms. Trace:
I20260810 11:30:50.435053 29615 raft_consensus.cc:2726] T 3a1e46f80f7f4e3a84638421892e6236 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:50.435863 27231 tablet_bootstrap.cc:492] T 72e0b69e7c7e4343b309d16c030d4306 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
W20260810 11:30:50.437778 26572 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.193:48791 (request call id 307) took 2497 ms (client timeout 1000 ms). Trace:
W20260810 11:30:50.437911 26572 rpcz_store.cc:269] 0810 11:30:47.939835 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.942605 (+ 2770us) service_pool.cc:227] Handling call
0810 11:30:50.437708 (+2495103us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:48.840215 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:48.840316 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:48.840323 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:48.840327 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:48.840634 (+ 307us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:48.840647 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:48.840655 (+ 8us) tablet.cc:683] Acquiring locks for 3 operations
0810 11:30:48.840996 (+ 341us) tablet.cc:699] Row locks acquired
0810 11:30:48.840999 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:48.841039 (+ 40us) write_op.cc:270] Start()
0810 11:30:48.841077 (+ 38us) write_op.cc:276] Timestamp: P: 1786361448840995 usec, L: 0
0810 11:30:48.841083 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:48.842734 (+ 1651us) log.cc:842] Serialized 1302 byte log entry
0810 11:30:49.020735 (+178001us) op_driver.cc:444] REPLICATION: finished
0810 11:30:49.020936 (+ 201us) write_op.cc:301] APPLY: starting
0810 11:30:49.020964 (+ 28us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:49.021108 (+ 144us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:49.021185 (+ 77us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:49.021348 (+ 163us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:49.021406 (+ 58us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0810 11:30:49.021416 (+ 10us) write_op.cc:312] APPLY: finished
0810 11:30:49.021561 (+ 145us) log.cc:842] Serialized 35 byte log entry
0810 11:30:49.021679 (+ 118us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.021706 (+ 27us) write_op.cc:454] Released schema lock
0810 11:30:49.021713 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:49.021788 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.021791 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":178185,"reported_tablets":189,"child_traces":[["op",{"apply.queue_time_us":126,"apply.run_cpu_time_us":920,"apply.run_wall_time_us":920,"num_ops":3,"prepare.queue_time_us":11678,"prepare.run_cpu_time_us":1258,"prepare.run_wall_time_us":2872,"replication_time_us":179615}]]}
I20260810 11:30:50.436299 26571 rpcz_store.cc:276] 0810 11:30:48.992353 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.318881 (+1326528us) service_pool.cc:227] Handling call
0810 11:30:50.352818 (+ 33937us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:50.355916 (+ 3098us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:50.432022 (+ 76106us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:50.432162 (+ 140us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:50.432275 (+ 113us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:50.418116 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:50.418227 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:50.418233 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:50.418235 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:50.418329 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:50.418342 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:50.418350 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:50.418492 (+ 142us) tablet.cc:699] Row locks acquired
0810 11:30:50.418494 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:50.418611 (+ 117us) write_op.cc:270] Start()
0810 11:30:50.418650 (+ 39us) write_op.cc:276] Timestamp: P: 1786361450418494 usec, L: 0
0810 11:30:50.418654 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:50.418926 (+ 272us) log.cc:842] Serialized 433 byte log entry
0810 11:30:50.426182 (+ 7256us) op_driver.cc:444] REPLICATION: finished
0810 11:30:50.426402 (+ 220us) write_op.cc:301] APPLY: starting
0810 11:30:50.426421 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:50.426482 (+ 61us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:50.426523 (+ 41us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:50.426644 (+ 121us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:50.426685 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:50.426693 (+ 8us) write_op.cc:312] APPLY: finished
0810 11:30:50.426783 (+ 90us) log.cc:842] Serialized 29 byte log entry
0810 11:30:50.426863 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.426890 (+ 27us) write_op.cc:454] Released schema lock
0810 11:30:50.426899 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:50.426960 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.426963 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":166,"apply.run_cpu_time_us":618,"apply.run_wall_time_us":618,"num_ops":2,"prepare.queue_time_us":61376,"prepare.run_cpu_time_us":904,"prepare.run_wall_time_us":954,"raft.queue_time_us":476,"raft.run_cpu_time_us":718,"raft.run_wall_time_us":845,"replication_time_us":7501,"spinlock_wait_cycles":517504}]]}
I20260810 11:30:50.443904 27222 ts_tablet_manager.cc:1428] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.216s user 0.003s sys 0.000s
I20260810 11:30:50.444391 27222 tablet_bootstrap.cc:492] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:50.448498 26571 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_97f1301f1c104946a668d06aecfc8687"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:50.416010 26577 rpcz_store.cc:269] 0810 11:30:48.916630 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:48.931089 (+ 14459us) service_pool.cc:227] Handling call
0810 11:30:49.027372 (+ 96283us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa3fd8f 00007f9c61d34946 00007f9c61d34675 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:50.415556 (+1388184us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:49.581478 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:49.581627 (+ 149us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:49.581636 (+ 9us) write_op.cc:435] Acquired schema lock
0810 11:30:49.581639 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:49.581775 (+ 136us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:49.581791 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:49.581798 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:49.581880 (+ 82us) tablet.cc:699] Row locks acquired
0810 11:30:49.581883 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:49.581926 (+ 43us) write_op.cc:270] Start()
0810 11:30:49.581963 (+ 37us) write_op.cc:276] Timestamp: P: 1786361449581861 usec, L: 0
0810 11:30:49.581967 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:49.582203 (+ 236us) log.cc:842] Serialized 536 byte log entry
0810 11:30:49.593622 (+ 11419us) op_driver.cc:444] REPLICATION: finished
0810 11:30:49.593747 (+ 125us) write_op.cc:301] APPLY: starting
0810 11:30:49.593767 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:49.593812 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:49.593851 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:49.593910 (+ 59us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:49.593944 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:49.593950 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:49.594072 (+ 122us) log.cc:842] Serialized 23 byte log entry
0810 11:30:49.594155 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.594179 (+ 24us) write_op.cc:454] Released schema lock
0810 11:30:49.594186 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:49.594252 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.594256 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:49.723645 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:49.723768 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:49.723776 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:49.723780 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:49.723959 (+ 179us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:49.723967 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:49.723972 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:49.724018 (+ 46us) tablet.cc:699] Row locks acquired
0810 11:30:49.724020 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:49.724047 (+ 27us) write_op.cc:270] Start()
0810 11:30:49.724073 (+ 26us) write_op.cc:276] Timestamp: P: 1786361449724022 usec, L: 0
0810 11:30:49.724076 (+ 3us) op_driver.cc:331] REPLICATION: starting
0810 11:30:49.724207 (+ 131us) log.cc:842] Serialized 356 byte log entry
0810 11:30:49.741547 (+ 17340us) op_driver.cc:444] REPLICATION: finished
0810 11:30:49.742526 (+ 979us) write_op.cc:301] APPLY: starting
0810 11:30:49.742537 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:49.742568 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:49.742590 (+ 22us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:49.742626 (+ 36us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:49.742651 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:49.742656 (+ 5us) write_op.cc:312] APPLY: finished
0810 11:30:49.742705 (+ 49us) log.cc:842] Serialized 23 byte log entry
0810 11:30:49.742740 (+ 35us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.742753 (+ 13us) write_op.cc:454] Released schema lock
0810 11:30:49.742759 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:49.742807 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.742810 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":125550,"reported_tablets":208,"spinlock_wait_cycles":17728256,"child_traces":[["op",{"apply.queue_time_us":76,"apply.run_cpu_time_us":564,"apply.run_wall_time_us":563,"num_ops":1,"prepare.queue_time_us":2616,"prepare.run_cpu_time_us":862,"prepare.run_wall_time_us":863,"raft.queue_time_us":44,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":330,"replication_time_us":11626}],["op",{"apply.queue_time_us":950,"apply.run_cpu_time_us":322,"apply.run_wall_time_us":321,"num_ops":1,"prepare.queue_time_us":1180,"prepare.run_cpu_time_us":644,"prepare.run_wall_time_us":644,"raft.queue_time_us":1061,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"replication_time_us":17454,"thread_start_us":93497,"threads_started":1}]]}
W20260810 11:30:50.453456 26571 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97f1301f1c104946a668d06aecfc8687 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 11:30:50.443101 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet b945cb22353f4d99a3836e3c0b8e26e3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ee50a7da224437baed913995e6587dd) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.455482 26888 tablet_service.cc:1467] Processing CreateTablet for tablet 15b86b9d76564acdb5c96caeec54d344 (DEFAULT_TABLE table=default.Table_0a206cdd3ffc4e8d9bb7a3c62448d021 [id=2cb88d46620d460da959e1983b65cd27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.443996 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet b121c13e9241468aa224e17093eb38f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b607279006c4baeae79325926088014) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.444165 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet b6395bce17ee40c2822669246ce7eb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.444288 27020 tablet_service.cc:1514] Processing DeleteTablet for tablet ee803ddf27594d2b9e19fe440fc269c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 82de53efa73447fe84e70dbb11a16a5f) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.444427 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet e700aa4c0c45496db8a2b4f4d6d746a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 9bf01841b9d4412789b05ce207f6eb02) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.455860 29455 raft_consensus.cc:482] T dc10f61181794e2bba099ca46881e94d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.455950 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15b86b9d76564acdb5c96caeec54d344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.455992 29455 raft_consensus.cc:504] T dc10f61181794e2bba099ca46881e94d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.444545 27026 tablet_service.cc:1514] Processing DeleteTablet for tablet f6e264e8507446809f3c386fdb3c34ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:20 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.444669 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet d50a8bdb17fa4332b288d03658c6b9c2 with delete_type TABLET_DATA_DELETED (replaced by tablet 72fd344dfcb84dfba89f7a9f446d814f) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.444761 27036 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3e78dcaa55491393f529ea33007786 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.444864 27037 tablet_service.cc:1514] Processing DeleteTablet for tablet 983916da755d4d14b7a3d43bb7cbc9c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.444980 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet 34bd3c0edf6b49d1891c0ee9af344872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:19 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.456653 29455 leader_election.cc:288] T dc10f61181794e2bba099ca46881e94d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:50.445108 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet 78633fbe048b4534ae3277ce6b7c4313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:39 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.445197 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c203cd90d2f472fa27cfabed5b87119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.445312 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet a3079a68c1c74b64bf13877bd0ee68c3 with delete_type TABLET_DATA_DELETED (replaced by tablet f10ac7e043c240d8a14b2b4f96b864b9) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.445438 27033 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cc17c55109b47eeb91920c3ed8178e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 6179cb2be2c442ee97161fe1f4661b64) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.445574 27027 tablet_service.cc:1514] Processing DeleteTablet for tablet 0edef936026743a896d5a73c134a8bca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.447618 29291 raft_consensus.cc:482] T 9bfed03f765f4c5aa77604ebf2e211b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.451797 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b303be24f4e46d0b966e8191d76297b with delete_type TABLET_DATA_DELETED (replaced by tablet ccdf2bb9f3b347ceb970a0d3115816df) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.452214 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet 518c777e40ec40dcb3484c0374384959 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:27 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.457046 29291 raft_consensus.cc:504] T 9bfed03f765f4c5aa77604ebf2e211b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.457561 29291 leader_election.cc:288] T 9bfed03f765f4c5aa77604ebf2e211b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:50.443722 29638 raft_consensus.cc:504] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:50.459679 29638 leader_election.cc:288] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:50.462841 26901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bfed03f765f4c5aa77604ebf2e211b0" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:50.461262 26878 tablet_service.cc:1467] Processing CreateTablet for tablet 523ddab512dc4ca7951ab03ee0018c4f (DEFAULT_TABLE table=default.Table_eeb8c0846bb541c5a6a16c5a3d1c310d [id=e67d6af755ed4f758e733bfe7023db4d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:50.463491 26991 leader_election.cc:341] T 9bfed03f765f4c5aa77604ebf2e211b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.464985 26581 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 251) took 1230 ms. Trace:
I20260810 11:30:50.433537 27112 heartbeater.cc:464] Registering TS with master...
I20260810 11:30:50.470466 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet 7de2d60cf87c48459e6663a68ac96714 with delete_type TABLET_DATA_DELETED (replaced by tablet aad22a5dfacf4fb88a5493376915a70f) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.457263 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc10f61181794e2bba099ca46881e94d" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:50.473471 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 798d89a6dddb4550b476542ff4b7f3bd (DEFAULT_TABLE table=default.Table_47ef7b42b8a14c619ad78d5defe4c1eb [id=67c7e15dd4cc48eea1e682ffe9cea3a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.473913 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 798d89a6dddb4550b476542ff4b7f3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.474926 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 523ddab512dc4ca7951ab03ee0018c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.475062 27222 tablet_bootstrap.cc:654] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:50.482278 26991 leader_election.cc:341] T dc10f61181794e2bba099ca46881e94d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.469380 26575 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 249) took 1329 ms. Trace:
I20260810 11:30:50.483577 26575 rpcz_store.cc:276] 0810 11:30:49.140090 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.353106 (+1213016us) service_pool.cc:227] Handling call
0810 11:30:50.378843 (+ 25737us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:50.379444 (+ 601us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:50.469079 (+ 89635us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:50.469193 (+ 114us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:50.469285 (+ 92us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:50.462151 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:50.462263 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:50.462270 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:50.462272 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:50.462367 (+ 95us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:50.462377 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:50.462381 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:50.462647 (+ 266us) tablet.cc:699] Row locks acquired
0810 11:30:50.462649 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:50.462694 (+ 45us) write_op.cc:270] Start()
0810 11:30:50.462733 (+ 39us) write_op.cc:276] Timestamp: P: 1786361450462644 usec, L: 0
0810 11:30:50.462737 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:50.462938 (+ 201us) log.cc:842] Serialized 433 byte log entry
0810 11:30:50.467962 (+ 5024us) op_driver.cc:444] REPLICATION: finished
0810 11:30:50.468116 (+ 154us) write_op.cc:301] APPLY: starting
0810 11:30:50.468133 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:50.468180 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:50.468250 (+ 70us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:50.468428 (+ 178us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:50.468461 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:50.468467 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:50.468540 (+ 73us) log.cc:842] Serialized 29 byte log entry
0810 11:30:50.468652 (+ 112us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.468673 (+ 21us) write_op.cc:454] Released schema lock
0810 11:30:50.468681 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:50.468736 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.468740 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":87,"apply.run_cpu_time_us":681,"apply.run_wall_time_us":681,"mutex_wait_us":81956,"num_ops":2,"prepare.queue_time_us":82046,"prepare.run_cpu_time_us":804,"prepare.run_wall_time_us":930,"replication_time_us":5144}]]}
I20260810 11:30:50.485694 26575 master_service.cc:946] ReplaceTablet: received request to replace tablet 524c8d37d3964e368695d182883b0bd5 from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:50.469798 26576 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 250) took 1329 ms. Trace:
I20260810 11:30:50.479410 26571 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 252) took 1244 ms. Trace:
I20260810 11:30:50.486164 26576 rpcz_store.cc:276] 0810 11:30:49.140325 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.390552 (+1250227us) service_pool.cc:227] Handling call
0810 11:30:50.391662 (+ 1110us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:50.392195 (+ 533us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:50.469530 (+ 77335us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:50.469615 (+ 85us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:50.469687 (+ 72us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:50.463052 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:50.463246 (+ 194us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:50.463254 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:50.463258 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:50.463334 (+ 76us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:50.463344 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:50.463348 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:50.463424 (+ 76us) tablet.cc:699] Row locks acquired
0810 11:30:50.463427 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:50.463458 (+ 31us) write_op.cc:270] Start()
0810 11:30:50.463485 (+ 27us) write_op.cc:276] Timestamp: P: 1786361450463412 usec, L: 0
0810 11:30:50.463490 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:50.463637 (+ 147us) log.cc:842] Serialized 433 byte log entry
0810 11:30:50.468035 (+ 4398us) op_driver.cc:444] REPLICATION: finished
0810 11:30:50.468142 (+ 107us) write_op.cc:301] APPLY: starting
0810 11:30:50.468156 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:50.468197 (+ 41us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:50.468273 (+ 76us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:50.468415 (+ 142us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:50.468454 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:50.468462 (+ 8us) write_op.cc:312] APPLY: finished
0810 11:30:50.468546 (+ 84us) log.cc:842] Serialized 29 byte log entry
0810 11:30:50.468677 (+ 131us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.468698 (+ 21us) write_op.cc:454] Released schema lock
0810 11:30:50.468705 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:50.468757 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.468762 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":73,"apply.run_cpu_time_us":666,"apply.run_wall_time_us":666,"mutex_wait_us":33772,"num_ops":2,"prepare.queue_time_us":34773,"prepare.run_cpu_time_us":639,"prepare.run_wall_time_us":638,"replication_time_us":4530,"spinlock_wait_cycles":30592}]]}
I20260810 11:30:50.486677 26571 rpcz_store.cc:276] 0810 11:30:49.235011 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.442761 (+1207750us) service_pool.cc:227] Handling call
0810 11:30:50.456985 (+ 14224us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:50.457540 (+ 555us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:50.478486 (+ 20946us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:50.478808 (+ 322us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:50.479314 (+ 506us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:50.470831 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:50.470952 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:50.470958 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:50.470961 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:50.471066 (+ 105us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:50.471081 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:50.471085 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:50.471221 (+ 136us) tablet.cc:699] Row locks acquired
0810 11:30:50.471224 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:50.471262 (+ 38us) write_op.cc:270] Start()
0810 11:30:50.471401 (+ 139us) write_op.cc:276] Timestamp: P: 1786361450471214 usec, L: 0
0810 11:30:50.471407 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:50.471584 (+ 177us) log.cc:842] Serialized 433 byte log entry
0810 11:30:50.475724 (+ 4140us) op_driver.cc:444] REPLICATION: finished
0810 11:30:50.475836 (+ 112us) write_op.cc:301] APPLY: starting
0810 11:30:50.475853 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:50.475923 (+ 70us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:50.476003 (+ 80us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:50.476127 (+ 124us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:50.476163 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:50.476170 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:50.476251 (+ 81us) log.cc:842] Serialized 29 byte log entry
0810 11:30:50.476319 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.476340 (+ 21us) write_op.cc:454] Released schema lock
0810 11:30:50.476347 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:50.476399 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.476402 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":59,"apply.run_cpu_time_us":635,"apply.run_wall_time_us":635,"num_ops":2,"prepare.queue_time_us":222,"prepare.run_cpu_time_us":792,"prepare.run_wall_time_us":848,"raft.queue_time_us":513,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":1750,"replication_time_us":4288}]]}
I20260810 11:30:50.488154 26571 master_service.cc:946] ReplaceTablet: received request to replace tablet 490ada0a918d48c3a07e12eed58bda19 from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:50.487769 26576 master_service.cc:946] ReplaceTablet: received request to replace tablet 2b95f3ec8ff34c89a68cd1edf8391f9b from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:50.490127 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet 25efcc18e8444b09ae2556345c36a710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.490955 26581 rpcz_store.cc:276] 0810 11:30:49.234577 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.393916 (+1159339us) service_pool.cc:227] Handling call
0810 11:30:50.421784 (+ 27868us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:50.422369 (+ 585us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:50.464481 (+ 42112us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.464488 (+ 7us) write_op.cc:454] Released schema lock
0810 11:30:50.464621 (+ 133us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:50.464741 (+ 120us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:50.464835 (+ 94us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:50.457805 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:50.457910 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:50.457916 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:50.457918 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:50.458011 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:50.458024 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:50.458029 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:50.458111 (+ 82us) tablet.cc:699] Row locks acquired
0810 11:30:50.458114 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:50.458164 (+ 50us) write_op.cc:270] Start()
0810 11:30:50.458203 (+ 39us) write_op.cc:276] Timestamp: P: 1786361450458115 usec, L: 0
0810 11:30:50.458207 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:50.458429 (+ 222us) log.cc:842] Serialized 433 byte log entry
0810 11:30:50.462598 (+ 4169us) op_driver.cc:444] REPLICATION: finished
0810 11:30:50.462838 (+ 240us) write_op.cc:301] APPLY: starting
0810 11:30:50.462855 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:50.462903 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:50.462993 (+ 90us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:50.463131 (+ 138us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:50.463171 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:50.463178 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:50.463261 (+ 83us) log.cc:842] Serialized 29 byte log entry
0810 11:30:50.463312 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.463331 (+ 19us) write_op.cc:454] Released schema lock
0810 11:30:50.463338 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":179,"apply.run_cpu_time_us":564,"apply.run_wall_time_us":564,"num_ops":2,"prepare.queue_time_us":34747,"prepare.run_cpu_time_us":759,"prepare.run_wall_time_us":759,"raft.queue_time_us":592,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":2785,"replication_time_us":4365}]]}
I20260810 11:30:50.494962 29603 ts_tablet_manager.cc:1918] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:50.499724 26894 tablet_service.cc:1467] Processing CreateTablet for tablet c851cbc60c3948b696c9e7ffe525b80f (DEFAULT_TABLE table=default.Table_1519414c16b6493f85660469d93e8871 [id=fef79ff3bba54b719b348dcac2708ff8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.500233 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c851cbc60c3948b696c9e7ffe525b80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.455134 26577 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51252:
name: "default.Table_7030d6d0f57d4968bc6fa7a1b8dabbba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 11:30:50.503168 26577 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7030d6d0f57d4968bc6fa7a1b8dabbba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 11:30:50.496140 26580 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet bd34a4de1b93402c8a4bce1215660e77 (table default.Table_e26ee7fd08774003a73e09650378c808 [id=eef14446a15e42b495e191bce11574a6], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet bd34a4de1b93402c8a4bce1215660e77 consensus state has no leader
W20260810 11:30:50.508143 26580 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.193:48791 (request call id 308) took 1169 ms (client timeout 1000 ms). Trace:
I20260810 11:30:50.508713 29504 raft_consensus.cc:482] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.508876 29504 raft_consensus.cc:504] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:50.509574 29504 leader_election.cc:288] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:50.515939 28987 ts_tablet_manager.cc:1918] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:50.526716 29267 ts_manager.cc:194] Registered new tserver with Master: 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:50.530745 28987 log.cc:1196] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/a3079a68c1c74b64bf13877bd0ee68c3
I20260810 11:30:50.535061 28987 ts_tablet_manager.cc:1939] T a3079a68c1c74b64bf13877bd0ee68c3 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:50.548478 29638 raft_consensus.cc:482] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.548949 29638 raft_consensus.cc:504] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:50.549825 29638 leader_election.cc:288] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:50.498018 27038 tablet_service.cc:1514] Processing DeleteTablet for tablet d08250001e1542f9978bc6f89ace458b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.500209 27035 tablet_service.cc:1514] Processing DeleteTablet for tablet b945038c03e343489af6ae7e50131d97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:42 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.505344 27027 tablet_service.cc:1514] Processing DeleteTablet for tablet 4efa31ad2ce8436b9638e6759d9b5421 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:44 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.505540 27033 tablet_service.cc:1514] Processing DeleteTablet for tablet 713663be70014b17b17056a865e7db63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:38 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.506171 27034 tablet_service.cc:1514] Processing DeleteTablet for tablet d1d0d55b526749059470504a27887b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:49 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.506304 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet 40f5eecfc66a4711aef60c1a2bff6b97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:49 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.506464 27021 tablet_service.cc:1514] Processing DeleteTablet for tablet bd34a4de1b93402c8a4bce1215660e77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:49 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.506877 27036 tablet_service.cc:1514] Processing DeleteTablet for tablet f8e6fc49f5e54f6c8fb710220a6cbf0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:49 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.507030 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f048b690d764c83a4a9ce4cbadc75b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.507349 27026 tablet_service.cc:1467] Processing CreateTablet for tablet deecb3f76bc942978ee1d5caf0d841a9 (DEFAULT_TABLE table=default.Table_72f950492bf04491b56e4f549a6fbc7c [id=97d34e6266124fbc8c22cedddf5a05f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.565140 29603 log.cc:1196] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/5a2e1b54043444989ac64c87f30ffc07
I20260810 11:30:50.565292 27026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet deecb3f76bc942978ee1d5caf0d841a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.565925 29603 ts_tablet_manager.cc:1939] T 5a2e1b54043444989ac64c87f30ffc07 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:50.569031 27031 tablet_service.cc:1467] Processing CreateTablet for tablet 523ddab512dc4ca7951ab03ee0018c4f (DEFAULT_TABLE table=default.Table_eeb8c0846bb541c5a6a16c5a3d1c310d [id=e67d6af755ed4f758e733bfe7023db4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.569525 27031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 523ddab512dc4ca7951ab03ee0018c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.571175 29603 tablet_replica.cc:330] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:50.571391 29603 raft_consensus.cc:2229] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:50.571553 29603 raft_consensus.cc:2258] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:50.572965 27025 tablet_service.cc:1467] Processing CreateTablet for tablet 93ddf4ca704e4699b73427a8d6cd48a3 (DEFAULT_TABLE table=default.Table_4599bffe2f15468e91c9d72f1fe41664 [id=34c855d702bc43eeab32aa30cd6ab7fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.573361 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93ddf4ca704e4699b73427a8d6cd48a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.573472 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 247) took 3062 ms. Trace:
I20260810 11:30:50.573592 28987 rpcz_store.cc:276] 0810 11:30:47.510975 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.532964 (+ 21989us) service_pool.cc:227] Handling call
0810 11:30:50.208751 (+2675787us) ts_tablet_manager.cc:1145] Deleting tablet a3079a68c1c74b64bf13877bd0ee68c3
0810 11:30:50.208765 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:50.231676 (+ 22911us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:50.515804 (+284128us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:50.573440 (+ 57636us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2675529}
I20260810 11:30:50.574193 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 251) took 2876 ms. Trace:
I20260810 11:30:50.574272 28987 rpcz_store.cc:276] 0810 11:30:47.698012 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.698058 (+ 46us) service_pool.cc:227] Handling call
0810 11:30:50.574035 (+2875977us) ts_tablet_manager.cc:1145] Deleting tablet 0edef936026743a896d5a73c134a8bca
0810 11:30:50.574067 (+ 32us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:50.574174 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2813934}
I20260810 11:30:50.576762 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 252) took 2839 ms. Trace:
I20260810 11:30:50.576851 28987 rpcz_store.cc:276] 0810 11:30:47.736899 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.736977 (+ 78us) service_pool.cc:227] Handling call
0810 11:30:50.576628 (+2839651us) ts_tablet_manager.cc:1145] Deleting tablet 4827800160e64883ba7bcadafeb13ead
0810 11:30:50.576643 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:50.576743 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2797608}
I20260810 11:30:50.576882 27021 tablet_service.cc:1467] Processing CreateTablet for tablet c851cbc60c3948b696c9e7ffe525b80f (DEFAULT_TABLE table=default.Table_1519414c16b6493f85660469d93e8871 [id=fef79ff3bba54b719b348dcac2708ff8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.517237 27222 tablet_bootstrap.cc:492] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:50.577297 27222 ts_tablet_manager.cc:1397] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.133s user 0.004s sys 0.000s
I20260810 11:30:50.577323 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c851cbc60c3948b696c9e7ffe525b80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.578027 27222 raft_consensus.cc:348] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.578277 27222 raft_consensus.cc:374] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:50.578332 27222 raft_consensus.cc:729] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:50.578523 27222 consensus_queue.cc:260] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.579094 27222 ts_tablet_manager.cc:1428] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 11:30:50.579367 27222 tablet_bootstrap.cc:492] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:50.579499 29291 raft_consensus.cc:482] T a74acd5078ec4a45987d68a1e4d138b9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.579614 29291 raft_consensus.cc:504] T a74acd5078ec4a45987d68a1e4d138b9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.580375 29291 leader_election.cc:288] T a74acd5078ec4a45987d68a1e4d138b9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:50.580493 29291 raft_consensus.cc:482] T f756689d4c99489885a0cd59f84a6e8a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.580941 27036 tablet_service.cc:1467] Processing CreateTablet for tablet 798d89a6dddb4550b476542ff4b7f3bd (DEFAULT_TABLE table=default.Table_47ef7b42b8a14c619ad78d5defe4c1eb [id=67c7e15dd4cc48eea1e682ffe9cea3a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.581555 27036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 798d89a6dddb4550b476542ff4b7f3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.582450 26901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a74acd5078ec4a45987d68a1e4d138b9" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:50.583293 26991 leader_election.cc:341] T a74acd5078ec4a45987d68a1e4d138b9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.580577 29291 raft_consensus.cc:504] T f756689d4c99489885a0cd59f84a6e8a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.584393 29291 leader_election.cc:288] T f756689d4c99489885a0cd59f84a6e8a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:50.585005 27030 tablet_service.cc:1467] Processing CreateTablet for tablet 15b86b9d76564acdb5c96caeec54d344 (DEFAULT_TABLE table=default.Table_0a206cdd3ffc4e8d9bb7a3c62448d021 [id=2cb88d46620d460da959e1983b65cd27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.585170 26901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f756689d4c99489885a0cd59f84a6e8a" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:50.585438 27030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15b86b9d76564acdb5c96caeec54d344. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 11:30:50.585779 26991 leader_election.cc:341] T f756689d4c99489885a0cd59f84a6e8a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.508854 26581 master_service.cc:946] ReplaceTablet: received request to replace tablet c62ae41d2dd74eedbe252c4de70fbe1e from {username='slave'} at 127.0.0.1:51252
I20260810 11:30:50.591995 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd34a4de1b93402c8a4bce1215660e77" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:50.592690 26751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea66da5bc20e4718901ffc473677421c" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:50.593405 26758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c203cd90d2f472fa27cfabed5b87119" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:50.557812 26577 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51252 (request call id 253) took 1148 ms. Trace:
I20260810 11:30:50.567337 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 9079c8fec89043be9d0040a3728e93f4 (table default.Table_fabd7780b9224b7993ad4321be6f92e2 [id=c9c81bc9d6dc48c89ba4cc51ca4f8bd9]) successfully deleted
I20260810 11:30:50.594112 26753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a0284718f694a0591888e81357721b0" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:50.594237 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 8400c601e9894ea9b68679f6d7927456 (table default.Table_ce10a5f4bedc411da7e7089a730e9cc8 [id=807b3a26a49f446797962bb532b4c58e]) successfully deleted
I20260810 11:30:50.594606 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]) successfully deleted
W20260810 11:30:50.595000 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet d4873fe8318040a2b7e021708a875f43 because the tablet was not found. No further retry: Not found: Tablet not found: d4873fe8318040a2b7e021708a875f43
I20260810 11:30:50.595166 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc10f61181794e2bba099ca46881e94d" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:50.595384 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 81b800247b4e4171b82dcde68e39fb00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81b800247b4e4171b82dcde68e39fb00 already in progress: creating tablet
W20260810 11:30:50.595691 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet d000f0ebaf0049a7bdaad93e307e16e2 because the tablet was not found. No further retry: Not found: Tablet not found: d000f0ebaf0049a7bdaad93e307e16e2
W20260810 11:30:50.596064 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 8228600e3f6b4f9993dd25e4ceb57e4d because the tablet was not found. No further retry: Not found: Tablet not found: 8228600e3f6b4f9993dd25e4ceb57e4d
W20260810 11:30:50.596359 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet e69916a35fba4714bbc565921738888f because the tablet was not found. No further retry: Not found: Tablet not found: e69916a35fba4714bbc565921738888f
I20260810 11:30:50.597162 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bfed03f765f4c5aa77604ebf2e211b0" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:50.510614 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b95f3ec8ff34c89a68cd1edf8391f9b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:50.598012 27061 raft_consensus.cc:2379] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 443ec871f1ed4232b932ecfb0b18510d in current term 1: Already voted for candidate b6079090b1124d84aa4477974bb53700 in this term.
I20260810 11:30:50.599472 29644 mvcc.cc:205] Tried to move back new op lower bound from 7316936496388706304 to 7316936424937656320. Current Snapshot: MvccSnapshot[applied={T|T < 7316936496388706304 or (T in {7316936496388706304})}]
I20260810 11:30:50.599246 26577 rpcz_store.cc:276] 0810 11:30:49.409006 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.454815 (+1045809us) service_pool.cc:227] Handling call
0810 11:30:50.503368 (+ 48553us) catalog_manager.cc:2075] Acquired catalog manager lock
0810 11:30:50.504202 (+ 834us) catalog_manager.cc:2121] Created new table and tablet info
0810 11:30:50.557427 (+ 53225us) catalog_manager.cc:2181] Wrote table and tablets to system table
0810 11:30:50.557565 (+ 138us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0810 11:30:50.557689 (+ 124us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:50.531367 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:50.531501 (+ 134us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:50.531508 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:50.531511 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:50.531634 (+ 123us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:50.531650 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:50.531659 (+ 9us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:50.531832 (+ 173us) tablet.cc:699] Row locks acquired
0810 11:30:50.531835 (+ 3us) write_op.cc:260] PREPARE: finished
0810 11:30:50.531891 (+ 56us) write_op.cc:270] Start()
0810 11:30:50.531937 (+ 46us) write_op.cc:276] Timestamp: P: 1786361450531830 usec, L: 0
0810 11:30:50.531943 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:50.532196 (+ 253us) log.cc:842] Serialized 433 byte log entry
0810 11:30:50.536705 (+ 4509us) op_driver.cc:444] REPLICATION: finished
0810 11:30:50.536832 (+ 127us) write_op.cc:301] APPLY: starting
0810 11:30:50.536849 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:50.536895 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:50.536942 (+ 47us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:50.537098 (+ 156us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:50.537140 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 11:30:50.537146 (+ 6us) write_op.cc:312] APPLY: finished
0810 11:30:50.537233 (+ 87us) log.cc:842] Serialized 29 byte log entry
0810 11:30:50.537303 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.537326 (+ 23us) write_op.cc:454] Released schema lock
0810 11:30:50.537335 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:50.537403 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.537406 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":73,"apply.run_cpu_time_us":628,"apply.run_wall_time_us":627,"num_ops":2,"prepare.queue_time_us":26488,"prepare.run_cpu_time_us":1010,"prepare.run_wall_time_us":1010,"raft.queue_time_us":64,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":384,"replication_time_us":4729}]]}
I20260810 11:30:50.517915 27231 tablet_bootstrap.cc:654] T 72e0b69e7c7e4343b309d16c030d4306 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:50.529230 27023 tablet_service.cc:1467] Processing CreateTablet for tablet ca2cd002bf78436db070d1eb1630c2a3 (DEFAULT_TABLE table=default.Table_953e0e00bdb74f3f97940590ea5eb471 [id=d25f3ac7818d4fd388bf490221d883b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.601169 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca2cd002bf78436db070d1eb1630c2a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.530475 27039 tablet_service.cc:1514] Processing DeleteTablet for tablet bba33b04fdf84ee4a2b8aac5423022c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:50 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.531215 27037 tablet_service.cc:1467] Processing CreateTablet for tablet e95537eb35194e8fa014a765d693bf18 (DEFAULT_TABLE table=default.Table_fabd7780b9224b7993ad4321be6f92e2 [id=c9c81bc9d6dc48c89ba4cc51ca4f8bd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.603916 27037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e95537eb35194e8fa014a765d693bf18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.562178 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet eed0e2bead85466ca99cfb34e155a391 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:47 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.562661 27028 tablet_service.cc:1467] Processing CreateTablet for tablet fd54ea77be114ca3b67d9dd40988dd74 (DEFAULT_TABLE table=default.Table_a82af0b403284841a1f2697487809b6a [id=a5958ce5e8894eb584183cde2335266e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.563299 27032 tablet_service.cc:1514] Processing DeleteTablet for tablet d24726d0214947beab0bb31b1597c1c3 with delete_type TABLET_DATA_DELETED (replaced by tablet caf5ed278bd648068d0d8a3b0bdfd642) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.562398 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet 524c8d37d3964e368695d182883b0bd5 with delete_type TABLET_DATA_DELETED (replaced by tablet a09cf2b015414598b9e9b6e76eb0a9df) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.605046 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd54ea77be114ca3b67d9dd40988dd74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.610472 26891 tablet_service.cc:1467] Processing CreateTablet for tablet bba33b04fdf84ee4a2b8aac5423022c8 (DEFAULT_TABLE table=default.Table_5b3952f643634a688f9b0f31ace9abad [id=28d49fc04a46464a939e91b48e54e459]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.611032 26891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bba33b04fdf84ee4a2b8aac5423022c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.613649 26577 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_ce10a5f4bedc411da7e7089a730e9cc8" } new_table_name: "default.Table_3fd9b9c5f4c0404b97fbd7d75c7697bb" modify_external_catalogs: true
I20260810 11:30:50.614285 27049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1549a26ba0f6427fae87b204c5d49eff" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:50.616700 26848 leader_election.cc:341] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: e69916a35fba4714bbc565921738888f
W20260810 11:30:50.618847 26993 leader_election.cc:341] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.619010 26993 leader_election.cc:302] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:50.619005 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 5a2e1b54043444989ac64c87f30ffc07 (table default.Table_341bf544f7b94ef2ba94afc342f8bc1f [id=193e8263e8a54ee798e1d4406074a52f]) successfully deleted
I20260810 11:30:50.619249 29291 raft_consensus.cc:2726] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:50.619405 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 3ae27bf110114b70a3e3f6cf64f31b98 because the tablet was not found. No further retry: Not found: Tablet not found: 3ae27bf110114b70a3e3f6cf64f31b98
W20260810 11:30:50.619705 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 2da86554bc51486e91f1ea5995a245b5 because the tablet was not found. No further retry: Not found: Tablet not found: 2da86554bc51486e91f1ea5995a245b5
W20260810 11:30:50.619943 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet ce73798a721b4a6d892f0c24b6b40e2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce73798a721b4a6d892f0c24b6b40e2c already in progress: creating tablet
W20260810 11:30:50.620100 26993 leader_election.cc:341] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.620213 26993 leader_election.cc:302] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
W20260810 11:30:50.620314 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet e276b0fa124d42dfb3fe750d245e44d8 because the tablet was not found. No further retry: Not found: Tablet not found: e276b0fa124d42dfb3fe750d245e44d8
I20260810 11:30:50.620836 29291 raft_consensus.cc:2726] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:50.621994 26993 leader_election.cc:341] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.622126 26993 leader_election.cc:302] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:50.623785 29291 raft_consensus.cc:2726] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:50.625377 26993 leader_election.cc:341] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.625519 26993 leader_election.cc:302] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:50.626183 29291 raft_consensus.cc:2726] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:50.628362 26581 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet c62ae41d2dd74eedbe252c4de70fbe1e
I20260810 11:30:50.633261 26581 catalog_manager.cc:6565] ReplaceTablet: tablet c62ae41d2dd74eedbe252c4de70fbe1e deleted and replaced by tablet 91225dc1f7664fd7a79e2d62f33401cd
W20260810 11:30:50.633430 26993 leader_election.cc:341] T dc10f61181794e2bba099ca46881e94d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.633643 26993 leader_election.cc:302] T dc10f61181794e2bba099ca46881e94d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:50.635929 29291 raft_consensus.cc:2726] T dc10f61181794e2bba099ca46881e94d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:50.637406 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a74acd5078ec4a45987d68a1e4d138b9" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:50.638168 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f756689d4c99489885a0cd59f84a6e8a" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:50.638461 27029 tablet_service.cc:1467] Processing CreateTablet for tablet 323c8344408b456398526cec03708f4e (DEFAULT_TABLE table=default.Table_ce10a5f4bedc411da7e7089a730e9cc8 [id=807b3a26a49f446797962bb532b4c58e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.638962 27032 tablet_service.cc:1467] Processing CreateTablet for tablet bba33b04fdf84ee4a2b8aac5423022c8 (DEFAULT_TABLE table=default.Table_5b3952f643634a688f9b0f31ace9abad [id=28d49fc04a46464a939e91b48e54e459]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.639302 27022 tablet_service.cc:1514] Processing DeleteTablet for tablet c62ae41d2dd74eedbe252c4de70fbe1e with delete_type TABLET_DATA_DELETED (replaced by tablet 91225dc1f7664fd7a79e2d62f33401cd) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:50.638051 27023 tablet_service.cc:1467] Processing CreateTablet for tablet 425cc29edcc448b9aef8565c808f1dbe (DEFAULT_TABLE table=default.Table_0f3a9b21c8a643ef9f75384b9bc32c0b [id=0c1411953c174e36882cab0d714319d9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:50.641132 26993 leader_election.cc:341] T 9bfed03f765f4c5aa77604ebf2e211b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.641887 26993 leader_election.cc:302] T 9bfed03f765f4c5aa77604ebf2e211b0 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:50.646081 26581 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_44f89aa654e84f22a77580060f057750" } modify_external_catalogs: true
I20260810 11:30:50.646508 26581 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_44f89aa654e84f22a77580060f057750" } modify_external_catalogs: true
I20260810 11:30:50.652980 29291 raft_consensus.cc:2726] T 9bfed03f765f4c5aa77604ebf2e211b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:50.653604 26993 leader_election.cc:341] T a74acd5078ec4a45987d68a1e4d138b9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.653735 26993 leader_election.cc:302] T a74acd5078ec4a45987d68a1e4d138b9 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:50.653993 29291 raft_consensus.cc:2726] T a74acd5078ec4a45987d68a1e4d138b9 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:50.654134 26993 leader_election.cc:341] T f756689d4c99489885a0cd59f84a6e8a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.654250 26993 leader_election.cc:302] T f756689d4c99489885a0cd59f84a6e8a P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:50.655483 29593 raft_consensus.cc:2726] T f756689d4c99489885a0cd59f84a6e8a P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:50.665342 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 323c8344408b456398526cec03708f4e (DEFAULT_TABLE table=default.Table_ce10a5f4bedc411da7e7089a730e9cc8 [id=807b3a26a49f446797962bb532b4c58e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.665843 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 323c8344408b456398526cec03708f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.672020 26878 tablet_service.cc:1467] Processing CreateTablet for tablet 93ddf4ca704e4699b73427a8d6cd48a3 (DEFAULT_TABLE table=default.Table_4599bffe2f15468e91c9d72f1fe41664 [id=34c855d702bc43eeab32aa30cd6ab7fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.677579 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93ddf4ca704e4699b73427a8d6cd48a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.689790 29491 raft_consensus.cc:482] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.690115 29491 raft_consensus.cc:504] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.690938 29491 leader_election.cc:288] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:50.691164 29491 raft_consensus.cc:482] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.691346 29491 raft_consensus.cc:504] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.692039 29491 leader_election.cc:288] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:50.684335 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 425cc29edcc448b9aef8565c808f1dbe (DEFAULT_TABLE table=default.Table_0f3a9b21c8a643ef9f75384b9bc32c0b [id=0c1411953c174e36882cab0d714319d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.709203 29316 raft_consensus.cc:482] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.709558 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 425cc29edcc448b9aef8565c808f1dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.709501 29316 raft_consensus.cc:504] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.710376 29316 leader_election.cc:288] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:50.711613 27049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d91cb30457a74d51885ad81c4ab89d71" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:50.711917 27049 raft_consensus.cc:2454] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:50.712625 26702 leader_election.cc:302] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:50.713130 29316 raft_consensus.cc:2781] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:50.713215 29316 raft_consensus.cc:482] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:50.713300 29316 raft_consensus.cc:3037] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:50.588714 26580 rpcz_store.cc:269] 0810 11:30:49.338197 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.371832 (+ 33635us) service_pool.cc:227] Handling call
0810 11:30:50.508064 (+1136232us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:49.722719 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:49.722848 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:49.722855 (+ 7us) write_op.cc:435] Acquired schema lock
0810 11:30:49.722858 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:49.723008 (+ 150us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:49.723024 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:49.723028 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:49.723142 (+ 114us) tablet.cc:699] Row locks acquired
0810 11:30:49.723147 (+ 5us) write_op.cc:260] PREPARE: finished
0810 11:30:49.723191 (+ 44us) write_op.cc:270] Start()
0810 11:30:49.723227 (+ 36us) write_op.cc:276] Timestamp: P: 1786361449723162 usec, L: 0
0810 11:30:49.723231 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:49.723458 (+ 227us) log.cc:842] Serialized 919 byte log entry
0810 11:30:49.741476 (+ 18018us) op_driver.cc:444] REPLICATION: finished
0810 11:30:49.741784 (+ 308us) write_op.cc:301] APPLY: starting
0810 11:30:49.741802 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:49.741849 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:49.742013 (+ 164us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:49.742107 (+ 94us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:49.742153 (+ 46us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:49.742161 (+ 8us) write_op.cc:312] APPLY: finished
0810 11:30:49.742269 (+ 108us) log.cc:842] Serialized 29 byte log entry
0810 11:30:49.742338 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.742360 (+ 22us) write_op.cc:454] Released schema lock
0810 11:30:49.742367 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:49.742438 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.742441 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 11:30:49.842988 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:49.843079 (+ 91us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:49.843083 (+ 4us) write_op.cc:435] Acquired schema lock
0810 11:30:49.843085 (+ 2us) tablet.cc:660] Decoding operations
0810 11:30:49.843161 (+ 76us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:49.843168 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:49.843171 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:49.843219 (+ 48us) tablet.cc:699] Row locks acquired
0810 11:30:49.843221 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:49.843249 (+ 28us) write_op.cc:270] Start()
0810 11:30:49.843272 (+ 23us) write_op.cc:276] Timestamp: P: 1786361449843211 usec, L: 0
0810 11:30:49.843275 (+ 3us) op_driver.cc:331] REPLICATION: starting
0810 11:30:49.843437 (+ 162us) log.cc:842] Serialized 356 byte log entry
0810 11:30:49.888940 (+ 45503us) op_driver.cc:444] REPLICATION: finished
0810 11:30:49.889082 (+ 142us) write_op.cc:301] APPLY: starting
0810 11:30:49.889101 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:49.889147 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:49.889222 (+ 75us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:49.889285 (+ 63us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:49.889326 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:49.889337 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:49.889456 (+ 119us) log.cc:842] Serialized 23 byte log entry
0810 11:30:49.889810 (+ 354us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.889831 (+ 21us) write_op.cc:454] Released schema lock
0810 11:30:49.889839 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:49.890214 (+ 375us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:49.890219 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31514,"reported_tablets":210,"child_traces":[["op",{"apply.queue_time_us":248,"apply.run_cpu_time_us":715,"apply.run_wall_time_us":715,"num_ops":2,"prepare.queue_time_us":3984,"prepare.run_cpu_time_us":872,"prepare.run_wall_time_us":872,"raft.queue_time_us":1371,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":350,"replication_time_us":18220}],["op",{"apply.queue_time_us":55,"apply.run_cpu_time_us":663,"apply.run_wall_time_us":1233,"num_ops":1,"prepare.queue_time_us":71806,"prepare.run_cpu_time_us":498,"prepare.run_wall_time_us":497,"replication_time_us":45629}]]}
I20260810 11:30:50.716485 29316 raft_consensus.cc:504] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.728690 26580 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_f55e75edcec14683a44d60250c42dbc7" } new_table_name: "default.Table_754264686aa94e998d044e459b4de783" modify_external_catalogs: true
I20260810 11:30:50.728483 29316 leader_election.cc:288] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:50.728986 27049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d91cb30457a74d51885ad81c4ab89d71" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:50.729241 27049 raft_consensus.cc:3037] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:50.733789 28987 tablet_replica.cc:330] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:50.733839 27049 raft_consensus.cc:2454] T d91cb30457a74d51885ad81c4ab89d71 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:50.734208 28987 raft_consensus.cc:2229] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 11:30:50.734313 29125 kernel_stack_watchdog.cc:198] Thread 29214 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 270ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f4544aa0980 (unknown) at ??:0
@ 0x8a5e57 __sanitizer::internal_sched_yield() at ??:?
@ 0x81ec1d __interceptor_pthread_create at ??:?
@ 0x7f45417babfb kudu::Thread::StartThread() at ??:0
@ 0x9da5bc kudu::Thread::Create() at ??:?
@ 0x7f45417dafd8 kudu::ThreadPool::CreateThread() at ??:0
@ 0x7f45417d6beb kudu::ThreadPool::DoSubmit() at ??:0
@ 0x7f45417dbcef kudu::ThreadPool::Submit() at ??:0
@ 0x7f454824ae4b kudu::rpc::ReactorThread::StartConnectionNegotiation() at ??:0
@ 0x7f454824a378 kudu::rpc::ReactorThread::RegisterConnection() at ??:0
@ 0x7f454825b32e kudu::rpc::RegisterConnectionTask::Run() at ??:0
@ 0x7f4548249e8d kudu::rpc::ReactorThread::AsyncHandler() at ??:0
@ 0x7f454825c075 ev::base<>::method_thunk<>() at ??:0
@ 0x7f4540035443 ev_invoke_pending at ??:0
@ 0x7f4548247365 kudu::rpc::ReactorThread::InvokePendingCb() at ??:0
@ 0x7f454003632b ev_run at ??:0
I20260810 11:30:50.734381 26702 leader_election.cc:302] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:50.734489 28987 raft_consensus.cc:2258] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:50.734802 29724 tablet.cc:1722] T fccc21cfc1ce4eb586f03276ec6e987f P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:50.735437 29500 ts_tablet_manager.cc:1918] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:50.735570 29500 log.cc:1196] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/983916da755d4d14b7a3d43bb7cbc9c4
I20260810 11:30:50.735972 29500 ts_tablet_manager.cc:1939] T 983916da755d4d14b7a3d43bb7cbc9c4 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:50.736124 29658 tablet.cc:1722] T fccc21cfc1ce4eb586f03276ec6e987f P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 11:30:50.736320 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 306) took 1993 ms. Trace:
I20260810 11:30:50.736423 29500 rpcz_store.cc:276] 0810 11:30:48.743195 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:48.743269 (+ 74us) service_pool.cc:227] Handling call
0810 11:30:49.908974 (+1165705us) ts_tablet_manager.cc:1145] Deleting tablet 983916da755d4d14b7a3d43bb7cbc9c4
0810 11:30:49.908990 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:49.931604 (+ 22614us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x615000145b24. stack: 00007f7f891ce66e 00007f7f891ce430 00007f7f882555ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f7f9470604d 00007f7f959aa5ec 00007f7f983392e6 00007f7f9836b404 00007f7f9834c870 00007f7f9834c5fd 00000000009edb7c 00007f7f89214344 00007f7f8921791b 00007f7f89217798
0810 11:30:50.348716 (+417112us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:50.735303 (+386587us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:50.736300 (+ 997us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":50022272,"tablet-delete.queue_time_us":1153943}
I20260810 11:30:50.736848 29500 tablet_replica.cc:330] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:50.739632 27028 tablet_service.cc:1467] Processing CreateTablet for tablet a09cf2b015414598b9e9b6e76eb0a9df (DEFAULT_TABLE table=default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.739732 29316 raft_consensus.cc:2781] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:50.739679 27022 tablet_service.cc:1467] Processing CreateTablet for tablet 20aa380dcff446f3893d7ad4538d2894 (DEFAULT_TABLE table=default.Table_469900e2defd4246b2377d3bbfde772b [id=b9fdb84c0da5451ca7d7c2cc962e7def]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.739953 29316 raft_consensus.cc:686] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:50.740237 29316 consensus_queue.cc:237] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.742587 26895 tablet_service.cc:1467] Processing CreateTablet for tablet 20aa380dcff446f3893d7ad4538d2894 (DEFAULT_TABLE table=default.Table_469900e2defd4246b2377d3bbfde772b [id=b9fdb84c0da5451ca7d7c2cc962e7def]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.743095 26895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20aa380dcff446f3893d7ad4538d2894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.749815 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]) successfully deleted
I20260810 11:30:50.757289 26886 tablet_service.cc:1467] Processing CreateTablet for tablet a09cf2b015414598b9e9b6e76eb0a9df (DEFAULT_TABLE table=default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.764710 29291 raft_consensus.cc:482] T 262656cbd3944702ac0ce04222cda500 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.764987 29291 raft_consensus.cc:504] T 262656cbd3944702ac0ce04222cda500 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.765264 27029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 323c8344408b456398526cec03708f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.765501 27032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bba33b04fdf84ee4a2b8aac5423022c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.765730 29291 leader_election.cc:288] T 262656cbd3944702ac0ce04222cda500 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:50.767328 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a09cf2b015414598b9e9b6e76eb0a9df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.768118 26754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "262656cbd3944702ac0ce04222cda500" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:50.768699 26993 leader_election.cc:341] T 262656cbd3944702ac0ce04222cda500 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.775154 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 425cc29edcc448b9aef8565c808f1dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.779302 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20aa380dcff446f3893d7ad4538d2894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.783886 29603 ts_tablet_manager.cc:1905] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:50.789031 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet c62ae41d2dd74eedbe252c4de70fbe1e with delete_type TABLET_DATA_DELETED (replaced by tablet 91225dc1f7664fd7a79e2d62f33401cd) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:50.797497 28987 ts_tablet_manager.cc:1905] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:50.805183 27231 tablet_bootstrap.cc:492] T 72e0b69e7c7e4343b309d16c030d4306 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:50.805373 27231 ts_tablet_manager.cc:1397] T 72e0b69e7c7e4343b309d16c030d4306 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.370s user 0.004s sys 0.003s
I20260810 11:30:50.806516 27231 raft_consensus.cc:348] T 72e0b69e7c7e4343b309d16c030d4306 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.806744 27231 raft_consensus.cc:374] T 72e0b69e7c7e4343b309d16c030d4306 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:50.806789 27231 raft_consensus.cc:729] T 72e0b69e7c7e4343b309d16c030d4306 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:50.809438 26589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c40c76e125b44de181b88b7f63a566f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 797 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361" is_pre_election: true
W20260810 11:30:50.814652 26700 leader_election.cc:341] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.814803 26700 leader_election.cc:302] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:50.815016 29316 raft_consensus.cc:2726] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:50.724548 27222 tablet_bootstrap.cc:654] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:50.818806 29500 raft_consensus.cc:2229] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:50.819057 29500 raft_consensus.cc:2258] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:50.819720 29500 ts_tablet_manager.cc:1905] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:50.828485 27228 tablet_bootstrap.cc:654] T 00d52e5c77d94854b8ba0b38c63ad015 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:50.834280 29214 leader_election.cc:302] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c40c76e125b44de181b88b7f63a566f7; no voters: 83cc8e39a3b9455f8242a6da6a54c38a, ac259bcf213a4aa297d1d8e73b262361
I20260810 11:30:50.839262 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1549a26ba0f6427fae87b204c5d49eff" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:50.842649 26750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e69916a35fba4714bbc565921738888f" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:50.842983 26750 raft_consensus.cc:3037] T e69916a35fba4714bbc565921738888f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:50.847222 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa14fea852c24cd7bb3d57094af2e178" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:50.853914 26750 raft_consensus.cc:2454] T e69916a35fba4714bbc565921738888f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:50.858755 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 15b86b9d76564acdb5c96caeec54d344 (DEFAULT_TABLE table=default.Table_0a206cdd3ffc4e8d9bb7a3c62448d021 [id=2cb88d46620d460da959e1983b65cd27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.859411 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15b86b9d76564acdb5c96caeec54d344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.876137 26730 tablet_service.cc:1467] Processing CreateTablet for tablet 798d89a6dddb4550b476542ff4b7f3bd (DEFAULT_TABLE table=default.Table_47ef7b42b8a14c619ad78d5defe4c1eb [id=67c7e15dd4cc48eea1e682ffe9cea3a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.876832 26730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 798d89a6dddb4550b476542ff4b7f3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.880076 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 523ddab512dc4ca7951ab03ee0018c4f (DEFAULT_TABLE table=default.Table_eeb8c0846bb541c5a6a16c5a3d1c310d [id=e67d6af755ed4f758e733bfe7023db4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.885331 27231 consensus_queue.cc:260] T 72e0b69e7c7e4343b309d16c030d4306 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.886988 27231 ts_tablet_manager.cc:1428] T 72e0b69e7c7e4343b309d16c030d4306 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.082s user 0.003s sys 0.000s
I20260810 11:30:50.887732 27231 tablet_bootstrap.cc:492] T 5eff8ccaa3ad4187aa00c33abd7131ae P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:50.888410 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet b6395bce17ee40c2822669246ce7eb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:29 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.903432 27222 tablet_bootstrap.cc:492] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:50.903609 27222 ts_tablet_manager.cc:1397] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.324s user 0.007s sys 0.001s
I20260810 11:30:50.904650 27222 raft_consensus.cc:348] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.904906 27222 raft_consensus.cc:374] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:50.904963 27222 raft_consensus.cc:729] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:50.905149 27222 consensus_queue.cc:260] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.905932 27222 ts_tablet_manager.cc:1428] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 11:30:50.906219 27222 tablet_bootstrap.cc:492] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:50.907126 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 523ddab512dc4ca7951ab03ee0018c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.908337 26736 tablet_service.cc:1467] Processing CreateTablet for tablet c851cbc60c3948b696c9e7ffe525b80f (DEFAULT_TABLE table=default.Table_1519414c16b6493f85660469d93e8871 [id=fef79ff3bba54b719b348dcac2708ff8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.908828 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c851cbc60c3948b696c9e7ffe525b80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.909338 29291 raft_consensus.cc:482] T fdeba015c2364ec385e8b06c18a2a9d2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.916639 26746 tablet_service.cc:1467] Processing CreateTablet for tablet 93ddf4ca704e4699b73427a8d6cd48a3 (DEFAULT_TABLE table=default.Table_4599bffe2f15468e91c9d72f1fe41664 [id=34c855d702bc43eeab32aa30cd6ab7fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.917641 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 323c8344408b456398526cec03708f4e (DEFAULT_TABLE table=default.Table_ce10a5f4bedc411da7e7089a730e9cc8 [id=807b3a26a49f446797962bb532b4c58e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.917641 26742 tablet_service.cc:1467] Processing CreateTablet for tablet 425cc29edcc448b9aef8565c808f1dbe (DEFAULT_TABLE table=default.Table_0f3a9b21c8a643ef9f75384b9bc32c0b [id=0c1411953c174e36882cab0d714319d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.918223 26738 tablet_service.cc:1467] Processing CreateTablet for tablet bba33b04fdf84ee4a2b8aac5423022c8 (DEFAULT_TABLE table=default.Table_5b3952f643634a688f9b0f31ace9abad [id=28d49fc04a46464a939e91b48e54e459]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.909477 29291 raft_consensus.cc:504] T fdeba015c2364ec385e8b06c18a2a9d2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.918416 26732 tablet_service.cc:1467] Processing CreateTablet for tablet a09cf2b015414598b9e9b6e76eb0a9df (DEFAULT_TABLE table=default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.918797 26748 tablet_service.cc:1514] Processing DeleteTablet for tablet c62ae41d2dd74eedbe252c4de70fbe1e with delete_type TABLET_DATA_DELETED (replaced by tablet 91225dc1f7664fd7a79e2d62f33401cd) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:50.918978 29291 leader_election.cc:288] T fdeba015c2364ec385e8b06c18a2a9d2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:50.919168 26741 tablet_service.cc:1467] Processing CreateTablet for tablet 20aa380dcff446f3893d7ad4538d2894 (DEFAULT_TABLE table=default.Table_469900e2defd4246b2377d3bbfde772b [id=b9fdb84c0da5451ca7d7c2cc962e7def]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:50.919886 26753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdeba015c2364ec385e8b06c18a2a9d2" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:50.924355 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 323c8344408b456398526cec03708f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.936918 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a09cf2b015414598b9e9b6e76eb0a9df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.942344 26746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93ddf4ca704e4699b73427a8d6cd48a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.942790 26741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20aa380dcff446f3893d7ad4538d2894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.949108 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 425cc29edcc448b9aef8565c808f1dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.952818 26738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bba33b04fdf84ee4a2b8aac5423022c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.956758 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a09cf2b015414598b9e9b6e76eb0a9df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:50.958819 29291 raft_consensus.cc:482] T 046fede13acf44e294fde386f78446a5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.964242 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet a3079a68c1c74b64bf13877bd0ee68c3 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]) successfully deleted
I20260810 11:30:50.981525 29712 raft_consensus.cc:482] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:50.981849 26753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc76d30f37094391b75076c92ccc277f" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:50.984483 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d52e5c77d94854b8ba0b38c63ad015" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:50.986334 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d52e5c77d94854b8ba0b38c63ad015" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:50.981705 29712 raft_consensus.cc:504] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.987362 29291 raft_consensus.cc:504] T 046fede13acf44e294fde386f78446a5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:50.988261 29291 leader_election.cc:288] T 046fede13acf44e294fde386f78446a5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:50.920410 26993 leader_election.cc:341] T fdeba015c2364ec385e8b06c18a2a9d2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:50.988451 26993 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 68048.4us
I20260810 11:30:50.989804 26753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "046fede13acf44e294fde386f78446a5" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:50.989944 29751 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260810 11:30:50.990872 26993 leader_election.cc:341] T 046fede13acf44e294fde386f78446a5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:50.992863 26915 raft_consensus.cc:3037] T 6926d0dc68fa48ae8ffabf5b5272b3d0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:50.993606 29712 leader_election.cc:288] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:51.003643 28987 ts_tablet_manager.cc:1918] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:51.003813 28987 log.cc:1196] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/7de2d60cf87c48459e6663a68ac96714
I20260810 11:30:51.004287 28987 ts_tablet_manager.cc:1939] T 7de2d60cf87c48459e6663a68ac96714 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
W20260810 11:30:51.006773 26700 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.25.195.253:34547, user_credentials={real_user=slave}} blocked reactor thread for 87869.6us
I20260810 11:30:51.020218 29724 tablet.cc:1722] T afbe6ce99f7c4f7cb939bea086cd90be P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:51.022382 29316 raft_consensus.cc:482] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:51.022428 29658 tablet.cc:1722] T afbe6ce99f7c4f7cb939bea086cd90be P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:51.022552 29316 raft_consensus.cc:504] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.023440 29316 leader_election.cc:288] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:51.026265 27222 tablet_bootstrap.cc:654] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:51.027217 29746 tablet.cc:1722] T 52a9367b7a8345739b5b9acf9ea1e6d8 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 11:30:51.028909 26702 leader_election.cc:341] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: ee803ddf27594d2b9e19fe440fc269c7
W20260810 11:30:51.029175 26702 consensus_peers.cc:487] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a45422addab84e9083df8665a0cf9322. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:51.030493 27231 tablet_bootstrap.cc:654] T 5eff8ccaa3ad4187aa00c33abd7131ae P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:51.042510 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 257) took 3262 ms. Trace:
I20260810 11:30:51.042650 28987 rpcz_store.cc:276] 0810 11:30:47.780309 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.780360 (+ 51us) service_pool.cc:227] Handling call
0810 11:30:50.733721 (+2953361us) ts_tablet_manager.cc:1145] Deleting tablet 7de2d60cf87c48459e6663a68ac96714
0810 11:30:50.733739 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:50.870238 (+136499us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.003302 (+133064us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.042475 (+ 39173us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":31248,"tablet-delete.queue_time_us":2783041}
I20260810 11:30:51.042940 26904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b95f3ec8ff34c89a68cd1edf8391f9b" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:51.050727 29746 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:51686 (request call id 350) took 1080 ms. Trace:
I20260810 11:30:51.043115 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 253) took 3285 ms. Trace:
W20260810 11:30:51.062965 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 445743us
I20260810 11:30:51.065713 28987 rpcz_store.cc:276] 0810 11:30:47.757911 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.757969 (+ 58us) service_pool.cc:227] Handling call
0810 11:30:51.042954 (+3284985us) ts_tablet_manager.cc:1145] Deleting tablet e700aa4c0c45496db8a2b4f4d6d746a4
0810 11:30:51.042985 (+ 31us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.043097 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3247850}
I20260810 11:30:51.066725 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 255) took 3308 ms. Trace:
I20260810 11:30:51.066839 28987 rpcz_store.cc:276] 0810 11:30:47.758128 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.758208 (+ 80us) service_pool.cc:227] Handling call
0810 11:30:51.066572 (+3308364us) ts_tablet_manager.cc:1145] Deleting tablet 25efcc18e8444b09ae2556345c36a710
0810 11:30:51.066587 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.066701 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3265892}
I20260810 11:30:51.067198 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 254) took 3309 ms. Trace:
I20260810 11:30:51.067276 28987 rpcz_store.cc:276] 0810 11:30:47.758040 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.758128 (+ 88us) service_pool.cc:227] Handling call
0810 11:30:51.067089 (+3308961us) ts_tablet_manager.cc:1145] Deleting tablet 5a2e1b54043444989ac64c87f30ffc07
0810 11:30:51.067099 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.067180 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3264195}
I20260810 11:30:51.067574 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 256) took 3287 ms. Trace:
I20260810 11:30:51.067644 28987 rpcz_store.cc:276] 0810 11:30:47.780154 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.780233 (+ 79us) service_pool.cc:227] Handling call
0810 11:30:51.067458 (+3287225us) ts_tablet_manager.cc:1145] Deleting tablet d50a8bdb17fa4332b288d03658c6b9c2
0810 11:30:51.067467 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.067556 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3264442}
I20260810 11:30:51.067904 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 258) took 3221 ms. Trace:
I20260810 11:30:51.067971 28987 rpcz_store.cc:276] 0810 11:30:47.846284 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:47.846694 (+ 410us) service_pool.cc:227] Handling call
0810 11:30:51.067814 (+3221120us) ts_tablet_manager.cc:1145] Deleting tablet 81b800247b4e4171b82dcde68e39fb00
0810 11:30:51.067823 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.067890 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3219918}
I20260810 11:30:51.068198 28987 tablet_replica.cc:330] T 0f048b690d764c83a4a9ce4cbadc75b0 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
W20260810 11:30:51.068372 26848 leader_election.cc:341] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 8228600e3f6b4f9993dd25e4ceb57e4d
W20260810 11:30:51.068598 26848 leader_election.cc:341] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: e69916a35fba4714bbc565921738888f
I20260810 11:30:51.069514 28987 raft_consensus.cc:2229] T 0f048b690d764c83a4a9ce4cbadc75b0 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:51.069748 28987 raft_consensus.cc:2258] T 0f048b690d764c83a4a9ce4cbadc75b0 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.070607 28987 ts_tablet_manager.cc:1905] T 0f048b690d764c83a4a9ce4cbadc75b0 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:51.074154 29214 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.195.252:34489, user_credentials={real_user=slave}} blocked reactor thread for 225693us
I20260810 11:30:51.083832 27222 tablet_bootstrap.cc:492] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:51.084112 27222 ts_tablet_manager.cc:1397] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.178s user 0.004s sys 0.003s
I20260810 11:30:51.085837 26904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d91cb30457a74d51885ad81c4ab89d71" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:51.085745 27222 raft_consensus.cc:348] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.086257 27222 raft_consensus.cc:374] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.086354 27222 raft_consensus.cc:729] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:51.083282 26916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d91cb30457a74d51885ad81c4ab89d71" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:51.086620 27222 consensus_queue.cc:260] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.099850 26916 raft_consensus.cc:3037] T 1549a26ba0f6427fae87b204c5d49eff P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:51.050864 29746 rpcz_store.cc:276] 0810 11:30:49.970128 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.970183 (+ 55us) service_pool.cc:227] Handling call
0810 11:30:51.050699 (+1080516us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:49.970639 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0810 11:30:49.970745 (+ 106us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 11:30:49.970757 (+ 12us) alter_schema_op.cc:65] Acquired schema lock
0810 11:30:49.970763 (+ 6us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0810 11:30:49.970797 (+ 34us) alter_schema_op.cc:126] START. Timestamp: 1786361449970444
0810 11:30:49.970800 (+ 3us) op_driver.cc:331] REPLICATION: starting
0810 11:30:49.970979 (+ 179us) log.cc:842] Serialized 173 byte log entry
0810 11:30:50.665092 (+694113us) op_driver.cc:444] REPLICATION: finished
0810 11:30:51.027186 (+362094us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0810 11:30:51.027833 (+ 647us) log.cc:842] Serialized 5 byte log entry
0810 11:30:51.031909 (+ 4076us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.032301 (+ 392us) log.cc:842] Serialized 14 byte log entry
0810 11:30:51.050643 (+ 18342us) alter_schema_op.cc:71] Released schema lock
0810 11:30:51.050648 (+ 5us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":362015,"prepare.queue_time_us":68,"prepare.run_cpu_time_us":36933,"prepare.run_wall_time_us":587660,"raft.queue_time_us":644,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":43802,"replication_time_us":694255,"thread_start_us":917220,"threads_started":3,"wal-append.queue_time_us":261058}]]}
I20260810 11:30:51.106269 28987 ts_tablet_manager.cc:1918] T 0f048b690d764c83a4a9ce4cbadc75b0 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:51.106407 28987 log.cc:1196] T 0f048b690d764c83a4a9ce4cbadc75b0 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/0f048b690d764c83a4a9ce4cbadc75b0
I20260810 11:30:51.106875 28987 ts_tablet_manager.cc:1939] T 0f048b690d764c83a4a9ce4cbadc75b0 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:51.107717 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 279) took 2391 ms. Trace:
I20260810 11:30:51.107812 28987 rpcz_store.cc:276] 0810 11:30:48.715883 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:48.724633 (+ 8750us) service_pool.cc:227] Handling call
0810 11:30:51.068157 (+2343524us) ts_tablet_manager.cc:1145] Deleting tablet 0f048b690d764c83a4a9ce4cbadc75b0
0810 11:30:51.068166 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.101494 (+ 33328us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.106151 (+ 4657us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.107695 (+ 1544us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2343290}
I20260810 11:30:51.108875 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:51.110276 29746 tablet.cc:1722] T a22cdf7d273d427cb32b811aa5caa3a3 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:51.111603 29500 ts_tablet_manager.cc:1918] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:51.111748 29500 log.cc:1196] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/9079c8fec89043be9d0040a3728e93f4
I20260810 11:30:51.112231 29500 ts_tablet_manager.cc:1939] T 9079c8fec89043be9d0040a3728e93f4 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:51.113685 29603 ts_tablet_manager.cc:1918] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:51.113819 29603 log.cc:1196] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/c60baf810a544a4a90dccd2337a39043
I20260810 11:30:51.123733 29267 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "b6079090b1124d84aa4477974bb53700" instance_seqno: 1786361408276910) as {username='slave'} at 127.25.195.194:38883; Asking this server to re-register.
I20260810 11:30:51.126444 27231 tablet_bootstrap.cc:492] T 5eff8ccaa3ad4187aa00c33abd7131ae P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:51.126633 27231 ts_tablet_manager.cc:1397] T 5eff8ccaa3ad4187aa00c33abd7131ae P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.239s user 0.019s sys 0.002s
I20260810 11:30:51.127388 26965 heartbeater.cc:464] Registering TS with master...
I20260810 11:30:51.127701 27231 raft_consensus.cc:348] T 5eff8ccaa3ad4187aa00c33abd7131ae P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.128062 27231 raft_consensus.cc:374] T 5eff8ccaa3ad4187aa00c33abd7131ae P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.128134 27231 raft_consensus.cc:729] T 5eff8ccaa3ad4187aa00c33abd7131ae P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:51.128371 27231 consensus_queue.cc:260] T 5eff8ccaa3ad4187aa00c33abd7131ae P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.132167 27231 ts_tablet_manager.cc:1428] T 5eff8ccaa3ad4187aa00c33abd7131ae P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 11:30:51.136967 29732 raft_consensus.cc:482] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:51.137156 29732 raft_consensus.cc:504] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.137756 27231 tablet_bootstrap.cc:492] T 0cc17c55109b47eeb91920c3ed8178e0 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:51.137823 29732 leader_election.cc:288] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:51.139022 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3853603eac544d769cef8cff9a008784" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:51.139247 27055 raft_consensus.cc:2454] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:51.139734 27231 tablet_bootstrap.cc:654] T 0cc17c55109b47eeb91920c3ed8178e0 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:51.139705 26702 leader_election.cc:302] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:51.140057 29316 raft_consensus.cc:2781] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:51.140143 29316 raft_consensus.cc:482] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:51.140216 29316 raft_consensus.cc:3037] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:51.137595 27228 tablet_bootstrap.cc:492] T 00d52e5c77d94854b8ba0b38c63ad015 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:51.142618 27228 ts_tablet_manager.cc:1397] T 00d52e5c77d94854b8ba0b38c63ad015 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.718s user 0.008s sys 0.011s
I20260810 11:30:51.143447 29316 raft_consensus.cc:504] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.143877 27228 raft_consensus.cc:348] T 00d52e5c77d94854b8ba0b38c63ad015 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.144295 27228 raft_consensus.cc:374] T 00d52e5c77d94854b8ba0b38c63ad015 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.144384 27228 raft_consensus.cc:729] T 00d52e5c77d94854b8ba0b38c63ad015 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:51.144721 27228 consensus_queue.cc:260] T 00d52e5c77d94854b8ba0b38c63ad015 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.145190 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3853603eac544d769cef8cff9a008784" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:51.145457 27055 raft_consensus.cc:3037] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:51.145612 29316 leader_election.cc:288] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:51.145895 27228 ts_tablet_manager.cc:1428] T 00d52e5c77d94854b8ba0b38c63ad015 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260810 11:30:51.146377 26700 leader_election.cc:341] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.147347 28987 tablet_replica.cc:330] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:51.148653 27055 raft_consensus.cc:2454] T 3853603eac544d769cef8cff9a008784 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:51.149302 26702 leader_election.cc:302] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:51.149817 29316 raft_consensus.cc:2781] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:51.150152 29316 raft_consensus.cc:686] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:51.150480 29316 consensus_queue.cc:237] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:51.154944 26700 leader_election.cc:341] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.160952 29603 ts_tablet_manager.cc:1939] T c60baf810a544a4a90dccd2337a39043 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:51.162565 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet c60baf810a544a4a90dccd2337a39043 (table default.Table_e58ae45f9ea949a2a0d7bf7f0e862647 [id=76b87112ac8e4024965d44a9b62b8c1a]) successfully deleted
I20260810 11:30:51.162500 26753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e276b0fa124d42dfb3fe750d245e44d8" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:51.162949 29603 tablet_replica.cc:330] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:51.164779 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet cc76d30f37094391b75076c92ccc277f because the tablet was not found. No further retry: Not found: Tablet not found: cc76d30f37094391b75076c92ccc277f
I20260810 11:30:51.166110 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:51.167073 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
W20260810 11:30:51.166020 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 0edef936026743a896d5a73c134a8bca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0edef936026743a896d5a73c134a8bca already in progress: creating tablet
W20260810 11:30:51.167749 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 4827800160e64883ba7bcadafeb13ead because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4827800160e64883ba7bcadafeb13ead already in progress: creating tablet
W20260810 11:30:51.169420 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet e700aa4c0c45496db8a2b4f4d6d746a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e700aa4c0c45496db8a2b4f4d6d746a4 already in progress: creating tablet
W20260810 11:30:51.169670 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 25efcc18e8444b09ae2556345c36a710 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25efcc18e8444b09ae2556345c36a710 already in progress: creating tablet
W20260810 11:30:51.169901 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 5a2e1b54043444989ac64c87f30ffc07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a2e1b54043444989ac64c87f30ffc07 already in progress: creating tablet
W20260810 11:30:51.170100 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet d50a8bdb17fa4332b288d03658c6b9c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d50a8bdb17fa4332b288d03658c6b9c2 already in progress: creating tablet
W20260810 11:30:51.170567 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 81b800247b4e4171b82dcde68e39fb00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81b800247b4e4171b82dcde68e39fb00 already in progress: creating tablet
I20260810 11:30:51.170810 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 0f048b690d764c83a4a9ce4cbadc75b0 (table default.Table_dc83172ee2e44eccab63bccfa35523fe [id=19ea42a81c4f471592628b27a3404c4b]) successfully deleted
I20260810 11:30:51.173697 26700 leader_election.cc:302] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:51.174243 29732 raft_consensus.cc:3037] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:51.179209 28987 raft_consensus.cc:2229] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:51.179570 28987 raft_consensus.cc:2258] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.179844 29732 raft_consensus.cc:2726] T 2b95f3ec8ff34c89a68cd1edf8391f9b P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:51.180388 28987 ts_tablet_manager.cc:1905] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:51.181813 26700 leader_election.cc:341] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:51.182453 26700 leader_election.cc:341] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.185793 29455 raft_consensus.cc:482] T faff8489499e4e318b127d9c1b19d2e4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:51.186033 29455 raft_consensus.cc:504] T faff8489499e4e318b127d9c1b19d2e4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.186983 29455 leader_election.cc:288] T faff8489499e4e318b127d9c1b19d2e4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:51.187873 26753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff8489499e4e318b127d9c1b19d2e4" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:51.188751 26993 leader_election.cc:341] T faff8489499e4e318b127d9c1b19d2e4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.192966 27222 ts_tablet_manager.cc:1428] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.109s user 0.000s sys 0.003s
I20260810 11:30:51.193499 27222 tablet_bootstrap.cc:492] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:51.195705 27222 tablet_bootstrap.cc:654] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:51.203254 28987 ts_tablet_manager.cc:1918] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:51.204397 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
W20260810 11:30:51.206178 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 137387us
I20260810 11:30:51.206773 29603 raft_consensus.cc:2229] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:51.207026 29603 raft_consensus.cc:2258] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.214519 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:51.215971 29603 ts_tablet_manager.cc:1905] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:51.219240 26849 leader_election.cc:302] T 1549a26ba0f6427fae87b204c5d49eff P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:51.220275 29744 raft_consensus.cc:2726] T 1549a26ba0f6427fae87b204c5d49eff P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:51.221257 28987 log.cc:1196] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/7d3e78dcaa55491393f529ea33007786
I20260810 11:30:51.222465 28987 ts_tablet_manager.cc:1939] T 7d3e78dcaa55491393f529ea33007786 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:51.222560 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 310) took 2100 ms. Trace:
I20260810 11:30:51.222673 29500 rpcz_store.cc:276] 0810 11:30:49.122341 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.122414 (+ 73us) service_pool.cc:227] Handling call
0810 11:30:50.736798 (+1614384us) ts_tablet_manager.cc:1145] Deleting tablet 9079c8fec89043be9d0040a3728e93f4
0810 11:30:50.736809 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:50.930573 (+193764us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.111470 (+180897us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.222543 (+111073us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":81613,"tablet-delete.queue_time_us":1570949}
I20260810 11:30:51.223403 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 280) took 2507 ms. Trace:
I20260810 11:30:51.223519 28987 rpcz_store.cc:276] 0810 11:30:48.715950 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:48.724909 (+ 8959us) service_pool.cc:227] Handling call
0810 11:30:51.147277 (+2422368us) ts_tablet_manager.cc:1145] Deleting tablet 7d3e78dcaa55491393f529ea33007786
0810 11:30:51.147295 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.187330 (+ 40035us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.203005 (+ 15675us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.223380 (+ 20375us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":31382,"tablet-delete.queue_time_us":2422195}
I20260810 11:30:51.223915 28987 tablet_replica.cc:330] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:51.224125 28987 raft_consensus.cc:2229] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:51.224298 28987 raft_consensus.cc:2258] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.224327 26906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee803ddf27594d2b9e19fe440fc269c7" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:51.224648 26906 raft_consensus.cc:2454] T ee803ddf27594d2b9e19fe440fc269c7 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:51.225659 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 9079c8fec89043be9d0040a3728e93f4 (table default.Table_fabd7780b9224b7993ad4321be6f92e2 [id=c9c81bc9d6dc48c89ba4cc51ca4f8bd9]) successfully deleted
I20260810 11:30:51.225876 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_883130a240194491bd23c14d9aff2e99 [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 2 got 0
I20260810 11:30:51.226601 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:51.235925 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 501defb075d142ec8b22e5e8236a009c (table default.Table_03d4151647a047a1b1ba29fdba43f80d [id=46bda36574e1430dbada751ccf16703c]). Expected version 1 got 0
I20260810 11:30:51.241741 27231 tablet_bootstrap.cc:492] T 0cc17c55109b47eeb91920c3ed8178e0 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:51.241933 27231 ts_tablet_manager.cc:1397] T 0cc17c55109b47eeb91920c3ed8178e0 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.109s user 0.003s sys 0.002s
I20260810 11:30:51.249495 27231 raft_consensus.cc:348] T 0cc17c55109b47eeb91920c3ed8178e0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.249884 27231 raft_consensus.cc:374] T 0cc17c55109b47eeb91920c3ed8178e0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.249951 27231 raft_consensus.cc:729] T 0cc17c55109b47eeb91920c3ed8178e0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:51.250172 27231 consensus_queue.cc:260] T 0cc17c55109b47eeb91920c3ed8178e0 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.250903 27231 ts_tablet_manager.cc:1428] T 0cc17c55109b47eeb91920c3ed8178e0 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.009s user 0.002s sys 0.002s
W20260810 11:30:51.252660 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 45861.9us
I20260810 11:30:51.254884 27222 tablet_bootstrap.cc:492] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:51.255074 27222 ts_tablet_manager.cc:1397] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.062s user 0.001s sys 0.006s
I20260810 11:30:51.255329 27231 tablet_bootstrap.cc:492] T 3604b43dcdfc469db476f3d0e2f900bb P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:51.237988 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 7d3e78dcaa55491393f529ea33007786 (table default.Table_b7da728f12ba46d1a9f8b99d6d837238 [id=43d34198e1ae4e33ba4ae808df4d40b5]) successfully deleted
I20260810 11:30:51.236423 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:51.257130 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:51.257405 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:51.257830 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bcc69e8f87134d25a1329be52b08e794 (table default.Table_4e93c67b823f48028820e1e95415e455 [id=b4c0c92ef07f432cbb00a36ecd17d394]). Expected version 1 got 0
I20260810 11:30:51.258163 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b98aeb11beb54cf0a9829b715ad96d0f (table default.Table_c0f2f67fac3147edb223918339295177 [id=9410dc6b3fbc49b4b4f87eec32c4f420]). Expected version 1 got 0
I20260810 11:30:51.258585 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bb078d7c0d0e4cf5aa841a802e78d8ff (table default.Table_eb5bb59579c043d7b1d98e60e42899af [id=65218ea1c77a4098a4f1145607695dbd]). Expected version 1 got 0
I20260810 11:30:51.259485 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c3a5d7b8b0a14134ac55fa17a7dac21e (table default.Table_a4ae13338d184321b7cd7de27296ba58 [id=0cf740b2e59643899dac59acdf576fe2]). Expected version 1 got 0
I20260810 11:30:51.259757 27222 raft_consensus.cc:348] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.260007 27222 raft_consensus.cc:374] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.260116 27222 raft_consensus.cc:729] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:51.260341 27222 consensus_queue.cc:260] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.262615 27222 ts_tablet_manager.cc:1428] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260810 11:30:51.272064 28987 ts_tablet_manager.cc:1905] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:51.280141 27231 tablet_bootstrap.cc:654] T 3604b43dcdfc469db476f3d0e2f900bb P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:51.279920 27222 tablet_bootstrap.cc:492] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:51.285869 27222 tablet_bootstrap.cc:654] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:51.286397 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:51.289494 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa14fea852c24cd7bb3d57094af2e178" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:51.289793 27055 raft_consensus.cc:2454] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:51.295282 29724 tablet.cc:1722] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:51.298743 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f10ac7e043c240d8a14b2b4f96b864b9 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:51.299372 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:51.299806 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:51.300338 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_b472377e613b4475b7a0b58062d44535 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 2 got 0
I20260810 11:30:51.300899 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d91cb30457a74d51885ad81c4ab89d71 (table default.Table_1ec5963e30f5468cbde77670965bf92b [id=e985b1ae60d94bfa998e1986bdf3fcd9]). Expected version 1 got 0
I20260810 11:30:51.301189 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:51.301687 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:51.302354 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet ebaf046e524b485c8b3ebf419c8035bb (table default.Table_9756c2fbd13b45b9ab96cc4997e3377b [id=c48cb5a0af7b4f0483e799a49fd5d307]). Expected version 1 got 0
I20260810 11:30:51.303135 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:51.303483 29724 tablet.cc:1722] T a22cdf7d273d427cb32b811aa5caa3a3 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:51.253788 29746 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:51686 (request call id 352) took 1280 ms. Trace:
I20260810 11:30:51.306506 29746 rpcz_store.cc:276] 0810 11:30:49.972937 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.974254 (+ 1317us) service_pool.cc:227] Handling call
0810 11:30:51.253764 (+1279510us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:50.000626 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0810 11:30:50.000809 (+ 183us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 11:30:50.000820 (+ 11us) alter_schema_op.cc:65] Acquired schema lock
0810 11:30:50.000830 (+ 10us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0810 11:30:50.000895 (+ 65us) alter_schema_op.cc:126] START. Timestamp: 1786361450000531
0810 11:30:50.000898 (+ 3us) op_driver.cc:331] REPLICATION: starting
0810 11:30:50.001170 (+ 272us) log.cc:842] Serialized 173 byte log entry
0810 11:30:51.068392 (+1067222us) op_driver.cc:444] REPLICATION: finished
0810 11:30:51.110239 (+ 41847us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0810 11:30:51.201460 (+ 91221us) log.cc:842] Serialized 5 byte log entry
0810 11:30:51.253303 (+ 51843us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.253652 (+ 349us) log.cc:842] Serialized 14 byte log entry
0810 11:30:51.253705 (+ 53us) alter_schema_op.cc:71] Released schema lock
0810 11:30:51.253711 (+ 6us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":41774,"prepare.queue_time_us":25695,"prepare.run_cpu_time_us":42991,"prepare.run_wall_time_us":461593,"raft.queue_time_us":80,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":300,"replication_time_us":1067460,"thread_start_us":679421,"threads_started":3,"wal-append.queue_time_us":520649}]]}
I20260810 11:30:51.307379 29746 tablet.cc:1722] T 65756c37fe514194bebe76921419653c P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:51.312918 29638 raft_consensus.cc:482] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:51.313126 29638 raft_consensus.cc:504] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:51.313266 27222 tablet_bootstrap.cc:492] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:51.313854 29638 leader_election.cc:288] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:51.317123 27228 tablet_bootstrap.cc:492] T 7de2d60cf87c48459e6663a68ac96714 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:51.317585 27231 tablet_bootstrap.cc:492] T 3604b43dcdfc469db476f3d0e2f900bb P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:51.317723 27231 ts_tablet_manager.cc:1397] T 3604b43dcdfc469db476f3d0e2f900bb P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.003s
I20260810 11:30:51.318881 27231 raft_consensus.cc:348] T 3604b43dcdfc469db476f3d0e2f900bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.319183 27231 raft_consensus.cc:374] T 3604b43dcdfc469db476f3d0e2f900bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.319249 27231 raft_consensus.cc:729] T 3604b43dcdfc469db476f3d0e2f900bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:51.319490 27231 consensus_queue.cc:260] T 3604b43dcdfc469db476f3d0e2f900bb P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.319962 27228 tablet_bootstrap.cc:654] T 7de2d60cf87c48459e6663a68ac96714 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:51.323485 29500 tablet_replica.cc:330] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:51.323777 29500 raft_consensus.cc:2229] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:51.324008 29500 raft_consensus.cc:2258] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.328662 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:51.328431 27222 ts_tablet_manager.cc:1397] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.006s
I20260810 11:30:51.329802 27222 raft_consensus.cc:348] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.330092 27222 raft_consensus.cc:374] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.330152 27222 raft_consensus.cc:729] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
W20260810 11:30:51.328773 26566 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet ebaf046e524b485c8b3ebf419c8035bb (table default.Table_9756c2fbd13b45b9ab96cc4997e3377b [id=c48cb5a0af7b4f0483e799a49fd5d307], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ebaf046e524b485c8b3ebf419c8035bb consensus state has no leader
I20260810 11:30:51.330420 27222 consensus_queue.cc:260] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.331324 28987 ts_tablet_manager.cc:1918] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:51.331746 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:51.334992 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c317ccebde05457d9e81c5c871638092 (table default.Table_8c0c1ab3bbb944c888930a5d8116d888 [id=7b4e4650915f4c16bef68adf43618b89]). Expected version 1 got 0
I20260810 11:30:51.335289 28987 log.cc:1196] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/983916da755d4d14b7a3d43bb7cbc9c4
I20260810 11:30:51.336030 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:51.336308 28987 ts_tablet_manager.cc:1939] T 983916da755d4d14b7a3d43bb7cbc9c4 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:51.339761 29603 ts_tablet_manager.cc:1918] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:51.340090 29603 log.cc:1196] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/ea66da5bc20e4718901ffc473677421c
I20260810 11:30:51.340788 29603 ts_tablet_manager.cc:1939] T ea66da5bc20e4718901ffc473677421c P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:51.341960 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 267) took 1083 ms. Trace:
I20260810 11:30:51.342185 29603 rpcz_store.cc:276] 0810 11:30:50.258447 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.261391 (+ 2944us) service_pool.cc:227] Handling call
0810 11:30:51.162893 (+901502us) ts_tablet_manager.cc:1145] Deleting tablet ea66da5bc20e4718901ffc473677421c
0810 11:30:51.162904 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.266883 (+103979us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.339584 (+ 72701us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.341922 (+ 2338us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":901152}
I20260810 11:30:51.342706 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "262656cbd3944702ac0ce04222cda500" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:51.342893 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 268) took 1080 ms. Trace:
I20260810 11:30:51.342973 29603 rpcz_store.cc:276] 0810 11:30:50.262161 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.267178 (+ 5017us) service_pool.cc:227] Handling call
0810 11:30:51.342750 (+1075572us) ts_tablet_manager.cc:1145] Deleting tablet 4827800160e64883ba7bcadafeb13ead
0810 11:30:51.342764 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.342875 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1075329}
I20260810 11:30:51.343631 29267 ts_manager.cc:194] Registered new tserver with Master: b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:51.345899 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdeba015c2364ec385e8b06c18a2a9d2" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:51.347220 29500 ts_tablet_manager.cc:1905] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:51.347718 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "046fede13acf44e294fde386f78446a5" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:51.353259 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff8489499e4e318b127d9c1b19d2e4" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:51.338366 27222 ts_tablet_manager.cc:1428] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260810 11:30:51.362808 27222 tablet_bootstrap.cc:492] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:51.364352 27222 tablet_bootstrap.cc:654] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:51.371054 26848 leader_election.cc:302] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:51.371949 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:51.373137 29638 raft_consensus.cc:2781] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:51.373227 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:51.373296 29638 raft_consensus.cc:482] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:51.373394 29638 raft_consensus.cc:3037] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:51.373898 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:51.374123 26573 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet fccc21cfc1ce4eb586f03276ec6e987f (table default.Table_613e12f4afb54939af925475cab64f0e [id=e22f19a993564e53b1cc76633f25f505]). Expected version 2 got 1
I20260810 11:30:51.369133 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet ea66da5bc20e4718901ffc473677421c (table default.Table_23ac53b1a7794ddda0a697254fff0ede [id=80a1649fe2d74dd4bf5aa5e07a762de3]) successfully deleted
W20260810 11:30:51.375118 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 4827800160e64883ba7bcadafeb13ead because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4827800160e64883ba7bcadafeb13ead already in progress: creating tablet
W20260810 11:30:51.375413 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet b945cb22353f4d99a3836e3c0b8e26e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b945cb22353f4d99a3836e3c0b8e26e3 already in progress: creating tablet
I20260810 11:30:51.377389 29638 raft_consensus.cc:504] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.378371 29638 leader_election.cc:288] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:51.378816 26848 leader_election.cc:341] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: cc76d30f37094391b75076c92ccc277f
I20260810 11:30:51.371454 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 281) took 2270 ms. Trace:
I20260810 11:30:51.382622 28987 rpcz_store.cc:276] 0810 11:30:49.101027 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.101097 (+ 70us) service_pool.cc:227] Handling call
0810 11:30:51.223854 (+2122757us) ts_tablet_manager.cc:1145] Deleting tablet 983916da755d4d14b7a3d43bb7cbc9c4
0810 11:30:51.223867 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.308552 (+ 84685us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.331215 (+ 22663us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.371423 (+ 40208us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2122534}
I20260810 11:30:51.383396 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 983916da755d4d14b7a3d43bb7cbc9c4 (table default.Table_70976acd83de4eb39143c5afa72d8ec4 [id=ca04b6aa3fda4a89989d4a84d03bb15a]) successfully deleted
W20260810 11:30:51.382210 26848 leader_election.cc:341] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: e276b0fa124d42dfb3fe750d245e44d8
I20260810 11:30:51.388773 29638 consensus_queue.cc:1035] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:51.389228 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 282) took 2287 ms. Trace:
I20260810 11:30:51.389361 28987 rpcz_store.cc:276] 0810 11:30:49.101442 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.101479 (+ 37us) service_pool.cc:227] Handling call
0810 11:30:51.389050 (+2287571us) ts_tablet_manager.cc:1145] Deleting tablet aad22a5dfacf4fb88a5493376915a70f
0810 11:30:51.389066 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.389200 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2287402}
W20260810 11:30:51.389932 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet aad22a5dfacf4fb88a5493376915a70f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aad22a5dfacf4fb88a5493376915a70f already in progress: creating tablet
I20260810 11:30:51.392849 28987 tablet_replica.cc:330] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:51.394229 28987 raft_consensus.cc:2229] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
W20260810 11:30:51.394295 26848 leader_election.cc:341] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: d000f0ebaf0049a7bdaad93e307e16e2
I20260810 11:30:51.394595 28987 raft_consensus.cc:2258] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.395191 28987 ts_tablet_manager.cc:1905] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:51.408166 27222 tablet_bootstrap.cc:492] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:51.408355 27222 ts_tablet_manager.cc:1397] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.046s user 0.008s sys 0.000s
I20260810 11:30:51.409132 27222 raft_consensus.cc:348] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.409365 27222 raft_consensus.cc:374] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.409418 27222 raft_consensus.cc:729] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:51.409662 27222 consensus_queue.cc:260] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:51.373634 26991 leader_election.cc:341] T 262656cbd3944702ac0ce04222cda500 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.397987 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa14fea852c24cd7bb3d57094af2e178" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:51.412717 27061 raft_consensus.cc:3037] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:51.412772 26991 leader_election.cc:302] T 262656cbd3944702ac0ce04222cda500 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
W20260810 11:30:51.413365 26991 leader_election.cc:341] T fdeba015c2364ec385e8b06c18a2a9d2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.413465 26991 leader_election.cc:302] T fdeba015c2364ec385e8b06c18a2a9d2 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:51.413805 29455 raft_consensus.cc:2726] T 262656cbd3944702ac0ce04222cda500 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:51.414170 29455 raft_consensus.cc:2726] T fdeba015c2364ec385e8b06c18a2a9d2 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:51.416249 27061 raft_consensus.cc:2454] T fa14fea852c24cd7bb3d57094af2e178 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:51.417057 26848 leader_election.cc:302] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:51.417580 29743 raft_consensus.cc:2781] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:51.417786 29743 raft_consensus.cc:686] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:51.418143 29743 consensus_queue.cc:237] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.419095 27222 ts_tablet_manager.cc:1428] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260810 11:30:51.343502 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 269) took 1075 ms. Trace:
I20260810 11:30:51.426438 27222 tablet_bootstrap.cc:492] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:51.426842 29603 rpcz_store.cc:276] 0810 11:30:50.442234 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.443942 (+ 1708us) service_pool.cc:227] Handling call
0810 11:30:51.343402 (+899460us) ts_tablet_manager.cc:1145] Deleting tablet b121c13e9241468aa224e17093eb38f4
0810 11:30:51.343410 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.343482 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":887727}
I20260810 11:30:51.429685 29603 tablet_replica.cc:330] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:51.429968 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet b121c13e9241468aa224e17093eb38f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b121c13e9241468aa224e17093eb38f4 already in progress: creating tablet
I20260810 11:30:51.430083 27222 tablet_bootstrap.cc:654] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:51.430099 29603 raft_consensus.cc:2229] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:51.430310 29603 raft_consensus.cc:2258] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.431046 29603 ts_tablet_manager.cc:1905] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:51.433404 27231 ts_tablet_manager.cc:1428] T 3604b43dcdfc469db476f3d0e2f900bb P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.116s user 0.001s sys 0.001s
I20260810 11:30:51.433789 27231 tablet_bootstrap.cc:492] T 5eb3dd7bd54c485d9ea0c2186f799d0f P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
W20260810 11:30:51.440781 26991 leader_election.cc:341] T 046fede13acf44e294fde386f78446a5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.441104 26991 leader_election.cc:302] T 046fede13acf44e294fde386f78446a5 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:51.441807 29291 raft_consensus.cc:2726] T 046fede13acf44e294fde386f78446a5 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:51.442533 26991 leader_election.cc:341] T faff8489499e4e318b127d9c1b19d2e4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.442755 26991 leader_election.cc:302] T faff8489499e4e318b127d9c1b19d2e4 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:51.443049 29291 raft_consensus.cc:2726] T faff8489499e4e318b127d9c1b19d2e4 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:51.447441 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 227407us
W20260810 11:30:51.448143 26849 leader_election.cc:341] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 8228600e3f6b4f9993dd25e4ceb57e4d
I20260810 11:30:51.448621 26849 leader_election.cc:302] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:51.448968 29615 raft_consensus.cc:2726] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:51.448936 26575 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 254) took 1901 ms. Trace:
I20260810 11:30:51.449086 26575 rpcz_store.cc:276] 0810 11:30:49.547859 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.485574 (+937715us) service_pool.cc:227] Handling call
0810 11:30:51.448848 (+963274us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260810 11:30:51.449882 26575 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_307bbf62894b4edc922e0fd4afa1a91f" } modify_external_catalogs: true
I20260810 11:30:51.450121 26575 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51252:
table { table_name: "default.Table_307bbf62894b4edc922e0fd4afa1a91f" } modify_external_catalogs: true
W20260810 11:30:51.450245 26849 leader_election.cc:341] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.450582 26849 leader_election.cc:302] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:51.450827 29615 raft_consensus.cc:2781] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:51.450982 29615 raft_consensus.cc:686] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:51.451278 29615 consensus_queue.cc:237] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } } peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } }
I20260810 11:30:51.429067 29724 tablet.cc:1722] T 8083fa130cd04dae9d61aeed977c1c63 P 482e605580be48cbbacce05a3e61c215: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 11:30:51.454021 26821 heartbeater.cc:347] Connected to a master server at 127.25.195.252:34489
I20260810 11:30:51.454231 26821 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:51.455082 27110 heartbeater.cc:347] Connected to a master server at 127.25.195.252:34489
I20260810 11:30:51.455284 27110 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:51.460634 26963 heartbeater.cc:347] Connected to a master server at 127.25.195.252:34489
I20260810 11:30:51.461031 26963 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:51.466019 29500 ts_tablet_manager.cc:1918] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:51.466316 29500 log.cc:1196] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/524c8d37d3964e368695d182883b0bd5
I20260810 11:30:51.466979 29500 ts_tablet_manager.cc:1939] T 524c8d37d3964e368695d182883b0bd5 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:51.467434 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 309) took 2351 ms. Trace:
I20260810 11:30:51.467635 29500 rpcz_store.cc:276] 0810 11:30:49.116030 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.116108 (+ 78us) service_pool.cc:227] Handling call
0810 11:30:51.222999 (+2106891us) ts_tablet_manager.cc:1145] Deleting tablet 524c8d37d3964e368695d182883b0bd5
0810 11:30:51.314178 (+ 91179us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.359050 (+ 44872us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.465845 (+106795us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.467386 (+ 1541us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2052668}
I20260810 11:30:51.468263 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 311) took 2263 ms. Trace:
I20260810 11:30:51.468354 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]) successfully deleted
I20260810 11:30:51.468451 29500 rpcz_store.cc:276] 0810 11:30:49.205450 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.206181 (+ 731us) service_pool.cc:227] Handling call
0810 11:30:51.468091 (+2261910us) ts_tablet_manager.cc:1145] Deleting tablet 8400c601e9894ea9b68679f6d7927456
0810 11:30:51.468106 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.468227 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2261182}
W20260810 11:30:51.468955 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 8400c601e9894ea9b68679f6d7927456 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8400c601e9894ea9b68679f6d7927456 already in progress: creating tablet
I20260810 11:30:51.478777 27228 tablet_bootstrap.cc:492] T 7de2d60cf87c48459e6663a68ac96714 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:51.478978 27228 ts_tablet_manager.cc:1397] T 7de2d60cf87c48459e6663a68ac96714 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.162s user 0.000s sys 0.024s
I20260810 11:30:51.479954 27228 raft_consensus.cc:348] T 7de2d60cf87c48459e6663a68ac96714 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.480283 27228 raft_consensus.cc:374] T 7de2d60cf87c48459e6663a68ac96714 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.480365 27228 raft_consensus.cc:729] T 7de2d60cf87c48459e6663a68ac96714 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:51.481213 29770 tablet.cc:1722] T fccc21cfc1ce4eb586f03276ec6e987f P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260810 11:30:51.489943 26849 leader_election.cc:341] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.491506 26849 leader_election.cc:302] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
W20260810 11:30:51.495749 26849 leader_election.cc:341] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.499960 26849 leader_election.cc:302] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:51.466216 29781 tablet.cc:1722] T 8083fa130cd04dae9d61aeed977c1c63 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 11:30:51.501336 29706 catalog_manager.cc:1259] Loaded cluster ID: 5081849c8420415b9be91728667896d5
I20260810 11:30:51.501749 27231 tablet_bootstrap.cc:654] T 5eb3dd7bd54c485d9ea0c2186f799d0f P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:51.502625 29732 consensus_queue.cc:1035] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:51.503901 29746 tablet.cc:1722] T afbe6ce99f7c4f7cb939bea086cd90be P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:51.504977 27222 tablet_bootstrap.cc:492] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:51.505165 27222 ts_tablet_manager.cc:1397] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.000s
I20260810 11:30:51.506850 27222 raft_consensus.cc:348] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.508662 27222 raft_consensus.cc:374] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.508766 27222 raft_consensus.cc:729] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:51.509070 27222 consensus_queue.cc:260] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.526842 29658 tablet.cc:1722] T 52a9367b7a8345739b5b9acf9ea1e6d8 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:51.527657 27222 ts_tablet_manager.cc:1428] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20260810 11:30:51.496115 29741 raft_consensus.cc:2726] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:51.499477 27228 consensus_queue.cc:260] T 7de2d60cf87c48459e6663a68ac96714 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.519048 29744 raft_consensus.cc:2726] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:51.526697 29500 tablet_replica.cc:330] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:51.532001 29500 raft_consensus.cc:2229] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:51.532341 29500 raft_consensus.cc:2258] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.535293 28987 ts_tablet_manager.cc:1918] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:51.536132 29706 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: loading cluster ID for follower catalog manager: success
I20260810 11:30:51.545320 27228 ts_tablet_manager.cc:1428] T 7de2d60cf87c48459e6663a68ac96714 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.066s user 0.000s sys 0.003s
I20260810 11:30:51.545765 27228 tablet_bootstrap.cc:492] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:51.547518 27228 tablet_bootstrap.cc:654] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:51.555781 29781 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:51686 (request call id 353) took 1573 ms. Trace:
I20260810 11:30:51.562332 29794 raft_consensus.cc:482] T 72e0b69e7c7e4343b309d16c030d4306 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:51.562765 29794 raft_consensus.cc:504] T 72e0b69e7c7e4343b309d16c030d4306 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.564002 29794 leader_election.cc:288] T 72e0b69e7c7e4343b309d16c030d4306 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:51.568710 28987 log.cc:1196] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/eed0e2bead85466ca99cfb34e155a391
I20260810 11:30:51.565650 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e0b69e7c7e4343b309d16c030d4306" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:51.569370 28987 ts_tablet_manager.cc:1939] T eed0e2bead85466ca99cfb34e155a391 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:51.568456 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3853603eac544d769cef8cff9a008784" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:51.570000 26991 leader_election.cc:341] T 72e0b69e7c7e4343b309d16c030d4306 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.570075 29500 ts_tablet_manager.cc:1905] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:51.535797 27222 tablet_bootstrap.cc:492] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:51.548800 26700 leader_election.cc:302] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:51.570106 29781 rpcz_store.cc:276] 0810 11:30:49.982195 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.983637 (+ 1442us) service_pool.cc:227] Handling call
0810 11:30:51.555736 (+1572099us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:50.088139 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0810 11:30:50.162343 (+ 74204us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 11:30:50.162359 (+ 16us) alter_schema_op.cc:65] Acquired schema lock
0810 11:30:50.162373 (+ 14us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0810 11:30:50.172961 (+ 10588us) alter_schema_op.cc:126] START. Timestamp: 1786361450172538
0810 11:30:50.172965 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:50.173198 (+ 233us) log.cc:842] Serialized 173 byte log entry
0810 11:30:51.249201 (+1076003us) op_driver.cc:444] REPLICATION: finished
0810 11:30:51.466170 (+216969us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0810 11:30:51.501481 (+ 35311us) log.cc:842] Serialized 5 byte log entry
0810 11:30:51.534543 (+ 33062us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x61200001a91c. stack: 00007f7f891ce66e 00007f7f891ce430 00007f7f882555ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f7f890988d8 00007f7f8909a054 00007f7f940d0595 00007f7f940c711c 00007f7f940af91a 00007f7f940ae984 00007f7f940c337b 00007f7f940c31f8 00000000009edb7c 00007f7f89214344
0810 11:30:51.555127 (+ 20584us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.555634 (+ 507us) log.cc:842] Serialized 14 byte log entry
0810 11:30:51.555689 (+ 55us) alter_schema_op.cc:71] Released schema lock
0810 11:30:51.555692 (+ 3us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":216871,"prepare.queue_time_us":58925,"prepare.run_cpu_time_us":30598,"prepare.run_wall_time_us":367256,"raft.queue_time_us":65,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":415,"replication_time_us":1076200,"spinlock_wait_cycles":44496128,"thread_start_us":573060,"threads_started":4,"wal-append.queue_time_us":294344,"wal-append.run_cpu_time_us":588,"wal-append.run_wall_time_us":1004949}]]}
I20260810 11:30:51.554144 26753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa14fea852c24cd7bb3d57094af2e178" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:51.571060 29453 raft_consensus.cc:2781] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:51.571172 29453 raft_consensus.cc:482] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:51.571250 29453 raft_consensus.cc:3037] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:51.572337 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3853603eac544d769cef8cff9a008784" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:51.557638 29658 tablet.cc:1722] T 8083fa130cd04dae9d61aeed977c1c63 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 11:30:51.565213 26750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e0b69e7c7e4343b309d16c030d4306" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:51.573572 26993 leader_election.cc:341] T 72e0b69e7c7e4343b309d16c030d4306 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.573769 26993 leader_election.cc:302] T 72e0b69e7c7e4343b309d16c030d4306 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:51.574535 29453 raft_consensus.cc:504] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.575305 29453 leader_election.cc:288] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:51.575661 29770 tablet.cc:1722] T 5deec04c1be64473accf8b9df14bd22e P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 11:30:51.577306 29794 raft_consensus.cc:2726] T 72e0b69e7c7e4343b309d16c030d4306 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:51.579107 26702 leader_election.cc:341] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: ee803ddf27594d2b9e19fe440fc269c7
I20260810 11:30:51.583611 29781 tablet.cc:1722] T 372b49dc083d46538442fcbfdfeb3545 P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:51.584549 29812 tablet.cc:1722] T a22cdf7d273d427cb32b811aa5caa3a3 P 443ec871f1ed4232b932ecfb0b18510d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:51.588749 27228 tablet_bootstrap.cc:492] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
W20260810 11:30:51.590677 26564 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.253:34547, user_credentials={real_user=slave}} blocked reactor thread for 47194.6us
I20260810 11:30:51.591408 27228 ts_tablet_manager.cc:1397] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.002s
I20260810 11:30:51.592268 29603 ts_tablet_manager.cc:1918] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:51.585211 27222 tablet_bootstrap.cc:654] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:51.592593 29603 log.cc:1196] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/b6395bce17ee40c2822669246ce7eb42
I20260810 11:30:51.593221 29603 ts_tablet_manager.cc:1939] T b6395bce17ee40c2822669246ce7eb42 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:51.594604 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 283) took 2492 ms. Trace:
I20260810 11:30:51.595892 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 270) took 1153 ms. Trace:
I20260810 11:30:51.596411 27231 tablet_bootstrap.cc:492] T 5eb3dd7bd54c485d9ea0c2186f799d0f P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:51.596971 27231 ts_tablet_manager.cc:1397] T 5eb3dd7bd54c485d9ea0c2186f799d0f P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.163s user 0.005s sys 0.001s
I20260810 11:30:51.597684 27231 raft_consensus.cc:348] T 5eb3dd7bd54c485d9ea0c2186f799d0f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.597985 27231 raft_consensus.cc:374] T 5eb3dd7bd54c485d9ea0c2186f799d0f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.598078 27231 raft_consensus.cc:729] T 5eb3dd7bd54c485d9ea0c2186f799d0f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:51.598325 27231 consensus_queue.cc:260] T 5eb3dd7bd54c485d9ea0c2186f799d0f P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.599072 27231 ts_tablet_manager.cc:1428] T 5eb3dd7bd54c485d9ea0c2186f799d0f P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:51.603749 27231 tablet_bootstrap.cc:492] T d3c31d08ddd74ee28948427c726ed130 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:51.602555 29732 raft_consensus.cc:482] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:51.604022 29732 raft_consensus.cc:504] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.604602 29732 leader_election.cc:288] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:51.605559 27231 tablet_bootstrap.cc:654] T d3c31d08ddd74ee28948427c726ed130 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:51.605605 26702 leader_election.cc:341] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: e276b0fa124d42dfb3fe750d245e44d8
I20260810 11:30:51.603855 29813 raft_consensus.cc:482] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:51.605984 29813 raft_consensus.cc:504] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:51.607170 26702 leader_election.cc:341] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: b6395bce17ee40c2822669246ce7eb42
I20260810 11:30:51.605672 29603 rpcz_store.cc:276] 0810 11:30:50.442402 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.444120 (+ 1718us) service_pool.cc:227] Handling call
0810 11:30:51.429628 (+985508us) ts_tablet_manager.cc:1145] Deleting tablet b6395bce17ee40c2822669246ce7eb42
0810 11:30:51.429643 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.554858 (+125215us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.592122 (+ 37264us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.595866 (+ 3744us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":973902}
I20260810 11:30:51.607756 29813 leader_election.cc:288] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:51.607764 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet b6395bce17ee40c2822669246ce7eb42 (table default.Table_44e5f0610f934d889eaf76d00116f0e2 [id=801df0b567d947db90abd034d997ed3f]) successfully deleted
I20260810 11:30:51.608057 28987 rpcz_store.cc:276] 0810 11:30:49.101756 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.101795 (+ 39us) service_pool.cc:227] Handling call
0810 11:30:51.392781 (+2290986us) ts_tablet_manager.cc:1145] Deleting tablet eed0e2bead85466ca99cfb34e155a391
0810 11:30:51.392796 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.473610 (+ 80814us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.535151 (+ 61541us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.594570 (+ 59419us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2290841}
I20260810 11:30:51.608588 28987 tablet_replica.cc:330] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:51.608877 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 271) took 1166 ms. Trace:
I20260810 11:30:51.608912 28987 raft_consensus.cc:2229] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:51.609122 28987 raft_consensus.cc:2258] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.609067 29603 rpcz_store.cc:276] 0810 11:30:50.442503 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.444247 (+ 1744us) service_pool.cc:227] Handling call
0810 11:30:51.608766 (+1164519us) ts_tablet_manager.cc:1145] Deleting tablet ee803ddf27594d2b9e19fe440fc269c7
0810 11:30:51.608781 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.608855 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1151807}
I20260810 11:30:51.609436 26576 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 2b95f3ec8ff34c89a68cd1edf8391f9b
I20260810 11:30:51.608065 27222 tablet_bootstrap.cc:492] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:51.609532 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet eed0e2bead85466ca99cfb34e155a391 (table default.Table_09b119fffa254fd2a7062d12b8e9ca32 [id=d5f9b9e6462d44fe91ee6944c4fc8743]) successfully deleted
I20260810 11:30:51.609637 27222 ts_tablet_manager.cc:1397] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.074s user 0.005s sys 0.000s
I20260810 11:30:51.609645 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 272) took 1167 ms. Trace:
I20260810 11:30:51.609723 29603 rpcz_store.cc:276] 0810 11:30:50.442576 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.444365 (+ 1789us) service_pool.cc:227] Handling call
0810 11:30:51.609531 (+1165166us) ts_tablet_manager.cc:1145] Deleting tablet e700aa4c0c45496db8a2b4f4d6d746a4
0810 11:30:51.609541 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.609629 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1153721}
I20260810 11:30:51.609959 26576 catalog_manager.cc:6565] ReplaceTablet: tablet 2b95f3ec8ff34c89a68cd1edf8391f9b deleted and replaced by tablet d8f1d3915f2b4bd5984fc980b9984e60
I20260810 11:30:51.610085 26576 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 255) took 2002 ms. Trace:
I20260810 11:30:51.610167 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 273) took 1167 ms. Trace:
I20260810 11:30:51.610244 29603 rpcz_store.cc:276] 0810 11:30:50.442647 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.444512 (+ 1865us) service_pool.cc:227] Handling call
0810 11:30:51.610087 (+1165575us) ts_tablet_manager.cc:1145] Deleting tablet f6e264e8507446809f3c386fdb3c34ae
0810 11:30:51.610098 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.610152 (+ 54us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1153569}
I20260810 11:30:51.610455 27222 raft_consensus.cc:348] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.610741 27222 raft_consensus.cc:374] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.610215 26576 rpcz_store.cc:276] 0810 11:30:49.607913 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.487553 (+879640us) service_pool.cc:227] Handling call
0810 11:30:50.492121 (+ 4568us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00007f9c6612827d 00007f9c66128373 00007f9c62f4a361 00007f9c6a8bd66a 00007f9c6aa51527 00007f9c61d43da7 00007f9c61d43ad5 00007f9c5e54b9be 00007f9c5e54a79e 00007f9c5e550b25 00007f9c5e55154f
0810 11:30:51.610048 (+1117927us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:51.481784 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:51.481926 (+ 142us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:51.481934 (+ 8us) write_op.cc:435] Acquired schema lock
0810 11:30:51.481937 (+ 3us) tablet.cc:660] Decoding operations
0810 11:30:51.482103 (+ 166us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:51.482122 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:51.482130 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:51.482306 (+ 176us) tablet.cc:699] Row locks acquired
0810 11:30:51.482308 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:51.482365 (+ 57us) write_op.cc:270] Start()
0810 11:30:51.482417 (+ 52us) write_op.cc:276] Timestamp: P: 1786361451482184 usec, L: 0
0810 11:30:51.482422 (+ 5us) op_driver.cc:331] REPLICATION: starting
0810 11:30:51.482774 (+ 352us) log.cc:842] Serialized 631 byte log entry
0810 11:30:51.524738 (+ 41964us) op_driver.cc:444] REPLICATION: finished
0810 11:30:51.608235 (+ 83497us) write_op.cc:301] APPLY: starting
0810 11:30:51.608259 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:51.608316 (+ 57us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:51.608356 (+ 40us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:51.608525 (+ 169us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:51.608635 (+ 110us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:51.608646 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:51.608756 (+ 110us) log.cc:842] Serialized 29 byte log entry
0810 11:30:51.609048 (+ 292us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:51.609072 (+ 24us) write_op.cc:454] Released schema lock
0810 11:30:51.609081 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:51.609157 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:51.609161 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":7772416,"child_traces":[["op",{"apply.queue_time_us":83416,"apply.run_cpu_time_us":796,"apply.run_wall_time_us":1001,"num_ops":2,"prepare.queue_time_us":104594,"prepare.run_cpu_time_us":1393,"prepare.run_wall_time_us":31061,"raft.queue_time_us":1083,"raft.run_cpu_time_us":615,"raft.run_wall_time_us":615,"replication_time_us":42283,"thread_start_us":135847,"threads_started":3}]]}
I20260810 11:30:51.610798 27222 raft_consensus.cc:729] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:51.610730 27228 raft_consensus.cc:348] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.611004 27228 raft_consensus.cc:374] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.611088 27228 raft_consensus.cc:729] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:51.610997 27222 consensus_queue.cc:260] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.611348 27228 consensus_queue.cc:260] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.611662 27222 ts_tablet_manager.cc:1428] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:51.611953 27222 tablet_bootstrap.cc:492] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:51.611930 27228 ts_tablet_manager.cc:1428] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20260810 11:30:51.612365 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b95f3ec8ff34c89a68cd1edf8391f9b with delete_type TABLET_DATA_DELETED (replaced by tablet d8f1d3915f2b4bd5984fc980b9984e60) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:51.614387 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 274) took 1171 ms. Trace:
I20260810 11:30:51.614478 29603 rpcz_store.cc:276] 0810 11:30:50.442734 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.444641 (+ 1907us) service_pool.cc:227] Handling call
0810 11:30:51.614228 (+1169587us) ts_tablet_manager.cc:1145] Deleting tablet d50a8bdb17fa4332b288d03658c6b9c2
0810 11:30:51.614239 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.614364 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1157629}
I20260810 11:30:51.615061 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 275) took 1172 ms. Trace:
I20260810 11:30:51.615139 29603 rpcz_store.cc:276] 0810 11:30:50.442803 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.444736 (+ 1933us) service_pool.cc:227] Handling call
0810 11:30:51.614966 (+1170230us) ts_tablet_manager.cc:1145] Deleting tablet 7d3e78dcaa55491393f529ea33007786
0810 11:30:51.614976 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.615033 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1158313}
I20260810 11:30:51.615525 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 276) took 1172 ms. Trace:
I20260810 11:30:51.615593 29603 rpcz_store.cc:276] 0810 11:30:50.442864 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.444828 (+ 1964us) service_pool.cc:227] Handling call
0810 11:30:51.615453 (+1170625us) ts_tablet_manager.cc:1145] Deleting tablet 983916da755d4d14b7a3d43bb7cbc9c4
0810 11:30:51.615462 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.615510 (+ 48us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1158755}
I20260810 11:30:51.615973 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 277) took 1173 ms. Trace:
I20260810 11:30:51.616039 29603 rpcz_store.cc:276] 0810 11:30:50.442927 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.444946 (+ 2019us) service_pool.cc:227] Handling call
0810 11:30:51.615892 (+1170946us) ts_tablet_manager.cc:1145] Deleting tablet 34bd3c0edf6b49d1891c0ee9af344872
0810 11:30:51.615908 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.615958 (+ 50us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1159150}
I20260810 11:30:51.616422 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 279) took 1173 ms. Trace:
I20260810 11:30:51.616436 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b95f3ec8ff34c89a68cd1edf8391f9b with delete_type TABLET_DATA_DELETED (replaced by tablet d8f1d3915f2b4bd5984fc980b9984e60) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:51.616498 29603 rpcz_store.cc:276] 0810 11:30:50.443298 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.445079 (+ 1781us) service_pool.cc:227] Handling call
0810 11:30:51.616326 (+1171247us) ts_tablet_manager.cc:1145] Deleting tablet 78633fbe048b4534ae3277ce6b7c4313
0810 11:30:51.616336 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.616408 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1159539}
I20260810 11:30:51.616887 29603 tablet_replica.cc:330] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:51.619103 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet ee803ddf27594d2b9e19fe440fc269c7 because the tablet was not found. No further retry: Not found: Tablet not found: ee803ddf27594d2b9e19fe440fc269c7
I20260810 11:30:51.619236 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b95f3ec8ff34c89a68cd1edf8391f9b with delete_type TABLET_DATA_DELETED (replaced by tablet d8f1d3915f2b4bd5984fc980b9984e60) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:51.619364 27222 tablet_bootstrap.cc:654] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:51.619489 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet e700aa4c0c45496db8a2b4f4d6d746a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e700aa4c0c45496db8a2b4f4d6d746a4 already in progress: creating tablet
W20260810 11:30:51.619796 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet f6e264e8507446809f3c386fdb3c34ae because the tablet was not found. No further retry: Not found: Tablet not found: f6e264e8507446809f3c386fdb3c34ae
W20260810 11:30:51.620012 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet d50a8bdb17fa4332b288d03658c6b9c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d50a8bdb17fa4332b288d03658c6b9c2 already in progress: creating tablet
W20260810 11:30:51.620240 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7d3e78dcaa55491393f529ea33007786 because the tablet was not found. No further retry: Not found: Tablet not found: 7d3e78dcaa55491393f529ea33007786
W20260810 11:30:51.620508 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 983916da755d4d14b7a3d43bb7cbc9c4 because the tablet was not found. No further retry: Not found: Tablet not found: 983916da755d4d14b7a3d43bb7cbc9c4
W20260810 11:30:51.620823 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 34bd3c0edf6b49d1891c0ee9af344872 because the tablet was not found. No further retry: Not found: Tablet not found: 34bd3c0edf6b49d1891c0ee9af344872
W20260810 11:30:51.621060 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 78633fbe048b4534ae3277ce6b7c4313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78633fbe048b4534ae3277ce6b7c4313 already in progress: creating tablet
I20260810 11:30:51.628042 29603 raft_consensus.cc:2229] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:51.628337 29603 raft_consensus.cc:2258] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.629153 29603 ts_tablet_manager.cc:1905] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:51.632714 29732 raft_consensus.cc:482] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:51.632932 29732 raft_consensus.cc:504] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.633605 29732 leader_election.cc:288] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:51.634608 27049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a0284718f694a0591888e81357721b0" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:51.634891 27049 raft_consensus.cc:2454] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:51.635411 26702 leader_election.cc:302] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:51.635794 29732 raft_consensus.cc:2781] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:51.635910 29732 raft_consensus.cc:482] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:51.635993 29732 raft_consensus.cc:3037] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:51.639878 29732 raft_consensus.cc:504] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.641265 26571 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet 490ada0a918d48c3a07e12eed58bda19
I20260810 11:30:51.641980 26571 catalog_manager.cc:6565] ReplaceTablet: tablet 490ada0a918d48c3a07e12eed58bda19 deleted and replaced by tablet 958e9c4980934947a252b44ffcbea0de
I20260810 11:30:51.642153 26571 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51252 (request call id 256) took 1933 ms. Trace:
I20260810 11:30:51.642341 26571 rpcz_store.cc:276] 0810 11:30:49.709038 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.488039 (+779001us) service_pool.cc:227] Handling call
0810 11:30:51.642080 (+1154041us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:51.512945 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:51.513136 (+ 191us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:51.516300 (+ 3164us) write_op.cc:435] Acquired schema lock
0810 11:30:51.516304 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:51.516489 (+ 185us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:51.516503 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:51.516510 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:51.524702 (+ 8192us) tablet.cc:699] Row locks acquired
0810 11:30:51.524706 (+ 4us) write_op.cc:260] PREPARE: finished
0810 11:30:51.524752 (+ 46us) write_op.cc:270] Start()
0810 11:30:51.524795 (+ 43us) write_op.cc:276] Timestamp: P: 1786361451524574 usec, L: 0
0810 11:30:51.524799 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:51.621842 (+ 97043us) log.cc:842] Serialized 665 byte log entry
0810 11:30:51.622397 (+ 555us) spinlock_profiling.cc:243] Waited 96.7 ms on lock 0x615000033024. stack: 00007f9c57a0f66e 00007f9c57a0f430 00007f9c56a965ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f9c62f1dd02 00007f9c642507f1 00007f9c6424f359 00007f9c642571bb 00007f9c64257038 00000000009edb7c 00007f9c57a55344 00007f9c57a5891b 00007f9c57a58798 00000000009edb7c
0810 11:30:51.633183 (+ 10786us) op_driver.cc:444] REPLICATION: finished
0810 11:30:51.638578 (+ 5395us) write_op.cc:301] APPLY: starting
0810 11:30:51.638605 (+ 27us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:51.638662 (+ 57us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:51.638665 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:51.638808 (+ 143us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:51.638881 (+ 73us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:51.638888 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:51.638988 (+ 100us) log.cc:842] Serialized 29 byte log entry
0810 11:30:51.640768 (+ 1780us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:51.640795 (+ 27us) write_op.cc:454] Released schema lock
0810 11:30:51.640804 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:51.640872 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:51.640875 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":5302,"apply.run_cpu_time_us":714,"apply.run_wall_time_us":2375,"num_ops":2,"prepare.queue_time_us":64838,"prepare.run_cpu_time_us":2673,"prepare.run_wall_time_us":109530,"replication_time_us":108352,"spinlock_wait_cycles":222412032}]]}
I20260810 11:30:51.647092 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet 490ada0a918d48c3a07e12eed58bda19 with delete_type TABLET_DATA_DELETED (replaced by tablet 958e9c4980934947a252b44ffcbea0de) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:51.646852 29603 ts_tablet_manager.cc:1918] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:51.648731 29603 log.cc:1196] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/7c203cd90d2f472fa27cfabed5b87119
I20260810 11:30:51.649984 29603 ts_tablet_manager.cc:1939] T 7c203cd90d2f472fa27cfabed5b87119 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:51.653534 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 280) took 1210 ms. Trace:
I20260810 11:30:51.654273 29603 rpcz_store.cc:276] 0810 11:30:50.443383 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.445176 (+ 1793us) service_pool.cc:227] Handling call
0810 11:30:51.616839 (+1171663us) ts_tablet_manager.cc:1145] Deleting tablet 7c203cd90d2f472fa27cfabed5b87119
0810 11:30:51.616849 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.640007 (+ 23158us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.646685 (+ 6678us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.653505 (+ 6820us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10841,"tablet-delete.queue_time_us":1160003}
I20260810 11:30:51.655401 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 7c203cd90d2f472fa27cfabed5b87119 (table default.Table_9633fc0dda2b422baa0de7b537dc5479 [id=7885e7f1ab9f452a8b58aabdf808e0e0]) successfully deleted
I20260810 11:30:51.655874 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 281) took 1212 ms. Trace:
I20260810 11:30:51.656164 29603 rpcz_store.cc:276] 0810 11:30:50.443489 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.445282 (+ 1793us) service_pool.cc:227] Handling call
0810 11:30:51.655434 (+1210152us) ts_tablet_manager.cc:1145] Deleting tablet a3079a68c1c74b64bf13877bd0ee68c3
0810 11:30:51.655451 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.655552 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1198543}
I20260810 11:30:51.656688 29732 leader_election.cc:288] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:51.657047 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet a3079a68c1c74b64bf13877bd0ee68c3 because the tablet was not found. No further retry: Not found: Tablet not found: a3079a68c1c74b64bf13877bd0ee68c3
I20260810 11:30:51.657130 27228 tablet_bootstrap.cc:492] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:51.657070 27049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a0284718f694a0591888e81357721b0" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:51.657326 27049 raft_consensus.cc:3037] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:51.658591 28987 ts_tablet_manager.cc:1905] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:51.658784 26886 tablet_service.cc:1514] Processing DeleteTablet for tablet 490ada0a918d48c3a07e12eed58bda19 with delete_type TABLET_DATA_DELETED (replaced by tablet 958e9c4980934947a252b44ffcbea0de) from {username='slave'} at 127.0.0.1:51686
I20260810 11:30:51.660463 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee803ddf27594d2b9e19fe440fc269c7" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:51.660774 26913 raft_consensus.cc:3037] T ee803ddf27594d2b9e19fe440fc269c7 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:51.666538 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e276b0fa124d42dfb3fe750d245e44d8" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:51.666909 26908 raft_consensus.cc:2454] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:51.667066 26913 raft_consensus.cc:2454] T ee803ddf27594d2b9e19fe440fc269c7 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:51.669299 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6395bce17ee40c2822669246ce7eb42" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:51.673272 27049 raft_consensus.cc:2454] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:51.674057 26702 leader_election.cc:302] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:51.674464 29813 raft_consensus.cc:2781] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:51.674794 29813 raft_consensus.cc:686] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:51.675935 29813 consensus_queue.cc:237] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.676700 26912 raft_consensus.cc:3037] T 00d52e5c77d94854b8ba0b38c63ad015 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:51.677246 26566 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.254:41125, user_credentials={real_user=slave}} blocked reactor thread for 45935.6us
I20260810 11:30:51.678117 26743 tablet_service.cc:1514] Processing DeleteTablet for tablet 490ada0a918d48c3a07e12eed58bda19 with delete_type TABLET_DATA_DELETED (replaced by tablet 958e9c4980934947a252b44ffcbea0de) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:51.683143 27228 tablet_bootstrap.cc:654] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:51.685884 29741 raft_consensus.cc:482] T 7de2d60cf87c48459e6663a68ac96714 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:51.686158 29741 raft_consensus.cc:504] T 7de2d60cf87c48459e6663a68ac96714 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.687562 29741 leader_election.cc:288] T 7de2d60cf87c48459e6663a68ac96714 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:51.688081 26700 leader_election.cc:341] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:51.688503 26700 leader_election.cc:341] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.688759 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a0284718f694a0591888e81357721b0" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:51.689312 26700 consensus_peers.cc:487] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:51.690387 29744 raft_consensus.cc:482] T 00d52e5c77d94854b8ba0b38c63ad015 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:51.692265 29746 tablet.cc:1722] T 72209a805e3e4b4ea1bf99508e0f75db P b6079090b1124d84aa4477974bb53700: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 11:30:51.690546 29744 raft_consensus.cc:504] T 00d52e5c77d94854b8ba0b38c63ad015 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:51.693531 26848 leader_election.cc:341] T 7de2d60cf87c48459e6663a68ac96714 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 7de2d60cf87c48459e6663a68ac96714
I20260810 11:30:51.693673 29744 leader_election.cc:288] T 00d52e5c77d94854b8ba0b38c63ad015 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:51.691525 26849 leader_election.cc:341] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: d000f0ebaf0049a7bdaad93e307e16e2
I20260810 11:30:51.696915 26849 leader_election.cc:302] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:51.697259 29744 raft_consensus.cc:2726] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:51.698230 29744 consensus_queue.cc:1035] T 2b95f3ec8ff34c89a68cd1edf8391f9b P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 11:30:51.699128 26849 leader_election.cc:341] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:51.700834 26849 leader_election.cc:341] T 7de2d60cf87c48459e6663a68ac96714 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Not found: Tablet not found: 7de2d60cf87c48459e6663a68ac96714
I20260810 11:30:51.701035 26849 leader_election.cc:302] T 7de2d60cf87c48459e6663a68ac96714 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:51.701422 27049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d52e5c77d94854b8ba0b38c63ad015" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:51.705713 26700 leader_election.cc:302] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:51.706068 29316 raft_consensus.cc:2781] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:51.706152 29316 raft_consensus.cc:482] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:51.706215 29316 raft_consensus.cc:3037] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:51.706254 26700 leader_election.cc:302] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:51.706314 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a0284718f694a0591888e81357721b0" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:51.706727 29504 raft_consensus.cc:2781] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
W20260810 11:30:51.706879 26700 leader_election.cc:341] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.707002 26700 leader_election.cc:302] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d; no voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700
I20260810 11:30:51.707320 29453 raft_consensus.cc:2726] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:51.707326 26700 consensus_peers.cc:487] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:51.706878 29504 raft_consensus.cc:686] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:51.707671 29813 consensus_queue.cc:1035] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:51.707967 29504 consensus_queue.cc:237] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.709308 29500 ts_tablet_manager.cc:1918] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:51.709587 29316 raft_consensus.cc:504] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.710857 29316 leader_election.cc:288] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:51.711237 26700 leader_election.cc:341] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.717700 29794 raft_consensus.cc:482] T 3604b43dcdfc469db476f3d0e2f900bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:51.718060 28987 ts_tablet_manager.cc:1918] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:51.718189 28987 log.cc:1196] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/524c8d37d3964e368695d182883b0bd5
I20260810 11:30:51.718120 29794 raft_consensus.cc:504] T 3604b43dcdfc469db476f3d0e2f900bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.718568 28987 ts_tablet_manager.cc:1939] T 524c8d37d3964e368695d182883b0bd5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:51.711570 26754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d52e5c77d94854b8ba0b38c63ad015" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:51.713541 26702 leader_election.cc:341] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: e276b0fa124d42dfb3fe750d245e44d8
I20260810 11:30:51.719673 26750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3604b43dcdfc469db476f3d0e2f900bb" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:51.720054 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 284) took 2604 ms. Trace:
I20260810 11:30:51.720150 28987 rpcz_store.cc:276] 0810 11:30:49.115262 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.115321 (+ 59us) service_pool.cc:227] Handling call
0810 11:30:51.608500 (+2493179us) ts_tablet_manager.cc:1145] Deleting tablet 524c8d37d3964e368695d182883b0bd5
0810 11:30:51.608512 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.685480 (+ 76968us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.717938 (+ 32458us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.720023 (+ 2085us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2492955}
W20260810 11:30:51.720461 26993 leader_election.cc:341] T 3604b43dcdfc469db476f3d0e2f900bb P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.720806 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 524c8d37d3964e368695d182883b0bd5 (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]) successfully deleted
I20260810 11:30:51.721094 29794 leader_election.cc:288] T 3604b43dcdfc469db476f3d0e2f900bb P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:51.722329 28987 tablet_replica.cc:330] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:51.710420 29744 raft_consensus.cc:2726] T 7de2d60cf87c48459e6663a68ac96714 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:51.722031 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3604b43dcdfc469db476f3d0e2f900bb" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:51.722564 28987 raft_consensus.cc:2229] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:51.722684 29500 log.cc:1196] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/a45422addab84e9083df8665a0cf9322
I20260810 11:30:51.722746 28987 raft_consensus.cc:2258] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.723269 29500 ts_tablet_manager.cc:1939] T a45422addab84e9083df8665a0cf9322 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:51.723320 28987 ts_tablet_manager.cc:1905] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:51.723660 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 312) took 2347 ms. Trace:
W20260810 11:30:51.723906 26991 leader_election.cc:341] T 3604b43dcdfc469db476f3d0e2f900bb P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.723775 29500 rpcz_store.cc:276] 0810 11:30:49.376029 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.376096 (+ 67us) service_pool.cc:227] Handling call
0810 11:30:51.526604 (+2150508us) ts_tablet_manager.cc:1145] Deleting tablet a45422addab84e9083df8665a0cf9322
0810 11:30:51.526620 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.676179 (+149559us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.709173 (+ 32994us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.723641 (+ 14468us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2137451}
I20260810 11:30:51.724236 29500 tablet_replica.cc:330] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:51.724478 29500 raft_consensus.cc:2229] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:51.724447 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]) successfully deleted
I20260810 11:30:51.724668 29500 raft_consensus.cc:2258] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.724864 26991 leader_election.cc:302] T 3604b43dcdfc469db476f3d0e2f900bb P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:51.725385 29794 raft_consensus.cc:2726] T 3604b43dcdfc469db476f3d0e2f900bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:51.733441 26700 leader_election.cc:341] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.733969 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e276b0fa124d42dfb3fe750d245e44d8" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:51.734221 26911 raft_consensus.cc:3037] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:51.737749 26911 raft_consensus.cc:2454] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:51.739094 29603 tablet_replica.cc:330] T 0cc17c55109b47eeb91920c3ed8178e0 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:51.741314 26700 leader_election.cc:302] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:51.741724 29316 raft_consensus.cc:2781] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:51.741851 29316 raft_consensus.cc:686] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:51.742101 29316 consensus_queue.cc:237] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.742340 26849 leader_election.cc:302] T 00d52e5c77d94854b8ba0b38c63ad015 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6079090b1124d84aa4477974bb53700; no voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215
I20260810 11:30:51.742630 29744 raft_consensus.cc:2726] T 00d52e5c77d94854b8ba0b38c63ad015 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 11:30:51.739471 29603 raft_consensus.cc:2229] T 0cc17c55109b47eeb91920c3ed8178e0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:51.743944 29603 raft_consensus.cc:2258] T 0cc17c55109b47eeb91920c3ed8178e0 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.745265 29603 ts_tablet_manager.cc:1905] T 0cc17c55109b47eeb91920c3ed8178e0 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:51.747401 29500 ts_tablet_manager.cc:1905] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:51.780303 28987 ts_tablet_manager.cc:1918] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:51.783931 28987 log.cc:1196] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/9079c8fec89043be9d0040a3728e93f4
I20260810 11:30:51.785701 28987 ts_tablet_manager.cc:1939] T 9079c8fec89043be9d0040a3728e93f4 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:51.788967 29603 ts_tablet_manager.cc:1918] T 0cc17c55109b47eeb91920c3ed8178e0 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:51.789675 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 285) took 2672 ms. Trace:
I20260810 11:30:51.790882 28987 rpcz_store.cc:276] 0810 11:30:49.117630 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.117684 (+ 54us) service_pool.cc:227] Handling call
0810 11:30:51.722271 (+2604587us) ts_tablet_manager.cc:1145] Deleting tablet 9079c8fec89043be9d0040a3728e93f4
0810 11:30:51.722287 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.740481 (+ 18194us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.780179 (+ 39698us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.789651 (+ 9472us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2604365}
I20260810 11:30:51.791855 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 9079c8fec89043be9d0040a3728e93f4 (table default.Table_fabd7780b9224b7993ad4321be6f92e2 [id=c9c81bc9d6dc48c89ba4cc51ca4f8bd9]) successfully deleted
I20260810 11:30:51.792522 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 286) took 2582 ms. Trace:
I20260810 11:30:51.793241 28987 rpcz_store.cc:276] 0810 11:30:49.210081 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.210145 (+ 64us) service_pool.cc:227] Handling call
0810 11:30:51.792379 (+2582234us) ts_tablet_manager.cc:1145] Deleting tablet 8400c601e9894ea9b68679f6d7927456
0810 11:30:51.792389 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.792505 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2581984}
I20260810 11:30:51.793972 29500 ts_tablet_manager.cc:1918] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 11:30:51.795182 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 8400c601e9894ea9b68679f6d7927456 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8400c601e9894ea9b68679f6d7927456 already in progress: creating tablet
I20260810 11:30:51.796105 28987 tablet_replica.cc:330] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:51.797535 29603 log.cc:1196] T 0cc17c55109b47eeb91920c3ed8178e0 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/0cc17c55109b47eeb91920c3ed8178e0
I20260810 11:30:51.797888 28987 raft_consensus.cc:2229] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:51.798393 29603 ts_tablet_manager.cc:1939] T 0cc17c55109b47eeb91920c3ed8178e0 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:51.800143 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 282) took 1356 ms. Trace:
I20260810 11:30:51.801600 28987 raft_consensus.cc:2258] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.802105 29603 rpcz_store.cc:276] 0810 11:30:50.443582 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.445382 (+ 1800us) service_pool.cc:227] Handling call
0810 11:30:51.739002 (+1293620us) ts_tablet_manager.cc:1145] Deleting tablet 0cc17c55109b47eeb91920c3ed8178e0
0810 11:30:51.739040 (+ 38us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.751594 (+ 12554us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.788809 (+ 37215us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.800123 (+ 11314us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1282069}
I20260810 11:30:51.803203 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 0cc17c55109b47eeb91920c3ed8178e0 (table default.Table_fee5e058d63849c189e798c232542ad2 [id=2c6a659407bc4d8dad087cb73c16e229]) successfully deleted
I20260810 11:30:51.803318 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 283) took 1359 ms. Trace:
I20260810 11:30:51.803416 29603 rpcz_store.cc:276] 0810 11:30:50.443669 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.445531 (+ 1862us) service_pool.cc:227] Handling call
0810 11:30:51.803180 (+1357649us) ts_tablet_manager.cc:1145] Deleting tablet 0edef936026743a896d5a73c134a8bca
0810 11:30:51.803193 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.803299 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1346208}
I20260810 11:30:51.803869 29500 log.cc:1196] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/8228600e3f6b4f9993dd25e4ceb57e4d
I20260810 11:30:51.804636 29500 ts_tablet_manager.cc:1939] T 8228600e3f6b4f9993dd25e4ceb57e4d P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
W20260810 11:30:51.805667 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 0edef936026743a896d5a73c134a8bca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0edef936026743a896d5a73c134a8bca already in progress: creating tablet
I20260810 11:30:51.805881 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 284) took 1362 ms. Trace:
I20260810 11:30:51.806106 28987 ts_tablet_manager.cc:1905] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:51.807309 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 315) took 2103 ms. Trace:
I20260810 11:30:51.807663 29603 rpcz_store.cc:276] 0810 11:30:50.443751 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.451726 (+ 7975us) service_pool.cc:227] Handling call
0810 11:30:51.805735 (+1354009us) ts_tablet_manager.cc:1145] Deleting tablet 8b303be24f4e46d0b966e8191d76297b
0810 11:30:51.805750 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.805860 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1348602}
I20260810 11:30:51.808969 29603 tablet_replica.cc:330] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
W20260810 11:30:51.808974 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 8b303be24f4e46d0b966e8191d76297b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b303be24f4e46d0b966e8191d76297b already in progress: creating tablet
I20260810 11:30:51.809639 29603 raft_consensus.cc:2229] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:51.810357 29603 raft_consensus.cc:2258] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.810781 29500 rpcz_store.cc:276] 0810 11:30:49.703832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.703911 (+ 79us) service_pool.cc:227] Handling call
0810 11:30:51.724187 (+2020276us) ts_tablet_manager.cc:1145] Deleting tablet 8228600e3f6b4f9993dd25e4ceb57e4d
0810 11:30:51.724200 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.774974 (+ 50774us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.793847 (+ 18873us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.807285 (+ 13438us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2019991}
I20260810 11:30:51.811861 29603 ts_tablet_manager.cc:1905] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:51.813102 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 8228600e3f6b4f9993dd25e4ceb57e4d (table default.Table_94097f0758264fc986fbe731111c6851 [id=223e521d377e4209943be22f5ab4b422]) successfully deleted
I20260810 11:30:51.813665 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 316) took 2109 ms. Trace:
I20260810 11:30:51.813818 29500 rpcz_store.cc:276] 0810 11:30:49.704352 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.704407 (+ 55us) service_pool.cc:227] Handling call
0810 11:30:51.813521 (+2109114us) ts_tablet_manager.cc:1145] Deleting tablet 3ae27bf110114b70a3e3f6cf64f31b98
0810 11:30:51.813533 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.813643 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2108910}
W20260810 11:30:51.816982 26564 catalog_manager.cc:4808] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 3ae27bf110114b70a3e3f6cf64f31b98 because the tablet was not found. No further retry: Not found: Tablet not found: 3ae27bf110114b70a3e3f6cf64f31b98
I20260810 11:30:51.816531 27228 tablet_bootstrap.cc:492] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:51.817520 27228 ts_tablet_manager.cc:1397] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.166s user 0.009s sys 0.014s
I20260810 11:30:51.818607 27228 raft_consensus.cc:348] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.819206 27228 raft_consensus.cc:374] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.819324 27228 raft_consensus.cc:729] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:51.819633 27228 consensus_queue.cc:260] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.820298 27228 ts_tablet_manager.cc:1428] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 11:30:51.821664 27228 tablet_bootstrap.cc:492] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:51.819140 29500 tablet_replica.cc:330] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:51.823396 29500 raft_consensus.cc:2229] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:51.823697 29500 pending_rounds.cc:62] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700: Trying to abort 1 pending ops.
I20260810 11:30:51.823804 29500 pending_rounds.cc:68] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936505147772928 op_type: NO_OP noop_request { }
I20260810 11:30:51.824002 29500 raft_consensus.cc:2866] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:51.824160 29500 raft_consensus.cc:2258] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.829457 27228 tablet_bootstrap.cc:654] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:51.835268 28987 ts_tablet_manager.cc:1918] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:51.841760 28987 log.cc:1196] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/a45422addab84e9083df8665a0cf9322
I20260810 11:30:51.841747 29500 ts_tablet_manager.cc:1905] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:51.842620 28987 ts_tablet_manager.cc:1939] T a45422addab84e9083df8665a0cf9322 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:51.844295 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 287) took 2467 ms. Trace:
I20260810 11:30:51.848428 29813 raft_consensus.cc:482] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:51.849797 29813 raft_consensus.cc:504] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.850519 29813 leader_election.cc:288] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:51.851011 28987 rpcz_store.cc:276] 0810 11:30:49.376760 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.376823 (+ 63us) service_pool.cc:227] Handling call
0810 11:30:51.795888 (+2419065us) ts_tablet_manager.cc:1145] Deleting tablet a45422addab84e9083df8665a0cf9322
0810 11:30:51.795902 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.825718 (+ 29816us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.835148 (+ 9430us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.844269 (+ 9121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2418793}
I20260810 11:30:51.851454 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4124999339e4133b2bd47b3739da373" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:51.852145 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4124999339e4133b2bd47b3739da373" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:51.852423 27061 raft_consensus.cc:2454] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:51.852881 26702 leader_election.cc:302] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
W20260810 11:30:51.853677 26700 leader_election.cc:341] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.854041 29813 raft_consensus.cc:2781] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:51.854120 29813 raft_consensus.cc:482] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:51.854180 29813 raft_consensus.cc:3037] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:51.858497 29813 raft_consensus.cc:504] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.859795 27061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4124999339e4133b2bd47b3739da373" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:51.860119 27061 raft_consensus.cc:3037] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:51.865183 27061 raft_consensus.cc:2454] T c4124999339e4133b2bd47b3739da373 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:51.865864 26702 leader_election.cc:302] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:51.866807 29316 raft_consensus.cc:2781] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:51.867134 29316 raft_consensus.cc:686] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:51.867552 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4124999339e4133b2bd47b3739da373" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:51.867479 29316 consensus_queue.cc:237] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:51.868472 26700 leader_election.cc:341] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.868515 29291 raft_consensus.cc:482] T 5eff8ccaa3ad4187aa00c33abd7131ae P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:51.869592 29291 raft_consensus.cc:504] T 5eff8ccaa3ad4187aa00c33abd7131ae P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.870810 29291 leader_election.cc:288] T 5eff8ccaa3ad4187aa00c33abd7131ae P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:51.872102 26750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eff8ccaa3ad4187aa00c33abd7131ae" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:51.873410 26993 leader_election.cc:341] T 5eff8ccaa3ad4187aa00c33abd7131ae P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.873504 29813 leader_election.cc:288] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:51.874850 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet a45422addab84e9083df8665a0cf9322 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]) successfully deleted
I20260810 11:30:51.878815 27222 tablet_bootstrap.cc:492] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:51.879041 27222 ts_tablet_manager.cc:1397] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.267s user 0.008s sys 0.024s
I20260810 11:30:51.879914 27222 raft_consensus.cc:348] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.880138 27222 raft_consensus.cc:374] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.880182 27222 raft_consensus.cc:729] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:51.880410 27222 consensus_queue.cc:260] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.881336 27222 ts_tablet_manager.cc:1428] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:51.881654 27222 tablet_bootstrap.cc:492] T fa14fea852c24cd7bb3d57094af2e178 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:51.882853 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:51.883265 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 372b49dc083d46538442fcbfdfeb3545 (table default.Table_a68e701bfdd34aaf96d2fd11de8aa3dc [id=f2b356ef167240a28ff2b9e34a20ddc7]). Expected version 1 got 0
I20260810 11:30:51.883986 28987 tablet_replica.cc:330] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:51.884202 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:51.884330 28987 raft_consensus.cc:2229] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:51.885201 28987 raft_consensus.cc:2258] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.886240 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
I20260810 11:30:51.891738 29603 ts_tablet_manager.cc:1918] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:51.892022 28987 ts_tablet_manager.cc:1905] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:51.892064 29603 log.cc:1196] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/518c777e40ec40dcb3484c0374384959
I20260810 11:30:51.892498 29603 ts_tablet_manager.cc:1939] T 518c777e40ec40dcb3484c0374384959 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:51.896958 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eff8ccaa3ad4187aa00c33abd7131ae" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:51.900815 27222 tablet_bootstrap.cc:654] T fa14fea852c24cd7bb3d57094af2e178 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:51.909854 27228 tablet_bootstrap.cc:492] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:51.910248 27228 ts_tablet_manager.cc:1397] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.089s user 0.002s sys 0.003s
I20260810 11:30:51.911216 27228 raft_consensus.cc:348] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.911573 27228 raft_consensus.cc:374] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.911700 27228 raft_consensus.cc:729] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:51.912050 27228 consensus_queue.cc:260] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.920336 27228 ts_tablet_manager.cc:1428] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260810 11:30:51.922726 29500 ts_tablet_manager.cc:1918] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:51.923019 29500 log.cc:1196] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/e69916a35fba4714bbc565921738888f
I20260810 11:30:51.923961 29500 ts_tablet_manager.cc:1939] T e69916a35fba4714bbc565921738888f P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:51.926105 27222 tablet_bootstrap.cc:492] T fa14fea852c24cd7bb3d57094af2e178 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:51.926273 27222 ts_tablet_manager.cc:1397] T fa14fea852c24cd7bb3d57094af2e178 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.045s user 0.004s sys 0.001s
I20260810 11:30:51.893429 27231 tablet_bootstrap.cc:492] T d3c31d08ddd74ee28948427c726ed130 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:51.927153 27231 ts_tablet_manager.cc:1397] T d3c31d08ddd74ee28948427c726ed130 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.323s user 0.016s sys 0.020s
I20260810 11:30:51.928382 27231 raft_consensus.cc:348] T d3c31d08ddd74ee28948427c726ed130 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.928412 27222 raft_consensus.cc:348] T fa14fea852c24cd7bb3d57094af2e178 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.928700 27222 raft_consensus.cc:374] T fa14fea852c24cd7bb3d57094af2e178 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.928696 27231 raft_consensus.cc:374] T d3c31d08ddd74ee28948427c726ed130 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:51.928768 27222 raft_consensus.cc:729] T fa14fea852c24cd7bb3d57094af2e178 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:51.928777 27231 raft_consensus.cc:729] T d3c31d08ddd74ee28948427c726ed130 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:51.929014 27231 consensus_queue.cc:260] T d3c31d08ddd74ee28948427c726ed130 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.929188 27222 consensus_queue.cc:260] T fa14fea852c24cd7bb3d57094af2e178 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:51.929845 27231 ts_tablet_manager.cc:1428] T d3c31d08ddd74ee28948427c726ed130 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:51.930184 27231 tablet_bootstrap.cc:492] T c3a5d7b8b0a14134ac55fa17a7dac21e P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:51.930284 27222 ts_tablet_manager.cc:1428] T fa14fea852c24cd7bb3d57094af2e178 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 11:30:51.930558 27222 tablet_bootstrap.cc:492] T c60baf810a544a4a90dccd2337a39043 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:51.932194 27222 tablet_bootstrap.cc:654] T c60baf810a544a4a90dccd2337a39043 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:51.897853 26991 leader_election.cc:341] T 5eff8ccaa3ad4187aa00c33abd7131ae P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:51.933085 26991 leader_election.cc:302] T 5eff8ccaa3ad4187aa00c33abd7131ae P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:51.933995 28987 ts_tablet_manager.cc:1918] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:51.934120 28987 log.cc:1196] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/d1d0d55b526749059470504a27887b22
I20260810 11:30:51.934126 29291 raft_consensus.cc:2726] T 5eff8ccaa3ad4187aa00c33abd7131ae P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:51.933961 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet fccc21cfc1ce4eb586f03276ec6e987f (table default.Table_613e12f4afb54939af925475cab64f0e [id=e22f19a993564e53b1cc76633f25f505]). Expected version 2 got 1
I20260810 11:30:51.934510 28987 ts_tablet_manager.cc:1939] T d1d0d55b526749059470504a27887b22 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:51.934514 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:51.935169 27231 tablet_bootstrap.cc:654] T c3a5d7b8b0a14134ac55fa17a7dac21e P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:51.937163 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 289) took 2171 ms. Trace:
I20260810 11:30:51.937374 28987 rpcz_store.cc:276] 0810 11:30:49.765963 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.766013 (+ 50us) service_pool.cc:227] Handling call
0810 11:30:51.883902 (+2117889us) ts_tablet_manager.cc:1145] Deleting tablet d1d0d55b526749059470504a27887b22
0810 11:30:51.883923 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.903878 (+ 19955us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.933853 (+ 29975us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.936990 (+ 3137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2117688}
I20260810 11:30:51.941334 28987 tablet_replica.cc:330] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:51.941547 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet d1d0d55b526749059470504a27887b22 (table default.Table_a164cd4bbc4344ae905f395ab1e6cffb [id=62f404c62e4040fc801f70cafddf9d95]) successfully deleted
I20260810 11:30:51.941674 28987 raft_consensus.cc:2229] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:51.941982 28987 raft_consensus.cc:2258] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.942662 28987 ts_tablet_manager.cc:1905] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:51.946664 27228 tablet_bootstrap.cc:492] T c60baf810a544a4a90dccd2337a39043 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:51.948915 27228 tablet_bootstrap.cc:654] T c60baf810a544a4a90dccd2337a39043 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:51.956707 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:51.957836 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d91cb30457a74d51885ad81c4ab89d71 (table default.Table_1ec5963e30f5468cbde77670965bf92b [id=e985b1ae60d94bfa998e1986bdf3fcd9]). Expected version 1 got 0
I20260810 11:30:51.958877 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet ebaf046e524b485c8b3ebf419c8035bb (table default.Table_9756c2fbd13b45b9ab96cc4997e3377b [id=c48cb5a0af7b4f0483e799a49fd5d307]). Expected version 1 got 0
I20260810 11:30:51.959877 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:51.960364 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:51.961001 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_883130a240194491bd23c14d9aff2e99 [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 2 got 0
I20260810 11:30:51.969352 28987 ts_tablet_manager.cc:1918] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:51.973958 29706 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: acquiring CA information for follower catalog manager: success
I20260810 11:30:51.973831 29813 consensus_queue.cc:1035] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:51.981451 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 317) took 2276 ms. Trace:
I20260810 11:30:51.981627 29500 rpcz_store.cc:276] 0810 11:30:49.705020 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.705080 (+ 60us) service_pool.cc:227] Handling call
0810 11:30:51.819081 (+2114001us) ts_tablet_manager.cc:1145] Deleting tablet e69916a35fba4714bbc565921738888f
0810 11:30:51.819094 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.887900 (+ 68806us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.922609 (+ 34709us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.981414 (+ 58805us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16322,"tablet-delete.queue_time_us":2113804}
I20260810 11:30:51.982178 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 318) took 2275 ms. Trace:
I20260810 11:30:51.982287 29500 rpcz_store.cc:276] 0810 11:30:49.706507 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.706658 (+ 151us) service_pool.cc:227] Handling call
0810 11:30:51.982007 (+2275349us) ts_tablet_manager.cc:1145] Deleting tablet 5a2e1b54043444989ac64c87f30ffc07
0810 11:30:51.982022 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.982159 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2275138}
I20260810 11:30:51.986455 29500 tablet_replica.cc:330] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:51.986720 29500 raft_consensus.cc:2229] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:51.986905 29500 raft_consensus.cc:2258] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:51.987540 29500 ts_tablet_manager.cc:1905] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:51.997452 29706 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c40c76e125b44de181b88b7f63a566f7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 11:30:51.982427 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet e69916a35fba4714bbc565921738888f (table default.Table_c40dd8e327db40b59167de093a5c616d [id=10ebb746a2b343b08b5b13d1107a7cd8]) successfully deleted
W20260810 11:30:51.999032 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet 5a2e1b54043444989ac64c87f30ffc07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a2e1b54043444989ac64c87f30ffc07 already in progress: creating tablet
I20260810 11:30:52.007077 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 65756c37fe514194bebe76921419653c (table default.Table_fa0abf8b4ccd4bf3ab3498a932148e8e [id=49b798fce1c944b1a1967d790df94219]). Expected version 1 got 0
I20260810 11:30:52.008404 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 501defb075d142ec8b22e5e8236a009c (table default.Table_03d4151647a047a1b1ba29fdba43f80d [id=46bda36574e1430dbada751ccf16703c]). Expected version 1 got 0
I20260810 11:30:52.009462 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 285) took 1557 ms. Trace:
I20260810 11:30:52.009680 29603 rpcz_store.cc:276] 0810 11:30:50.452100 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.452158 (+ 58us) service_pool.cc:227] Handling call
0810 11:30:51.808915 (+1356757us) ts_tablet_manager.cc:1145] Deleting tablet 518c777e40ec40dcb3484c0374384959
0810 11:30:51.808928 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.826011 (+ 17083us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.891617 (+ 65606us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.009420 (+117803us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":69889,"tablet-delete.queue_time_us":1351737}
I20260810 11:30:52.010941 28987 log.cc:1196] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/40f5eecfc66a4711aef60c1a2bff6b97
I20260810 11:30:52.014819 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 518c777e40ec40dcb3484c0374384959 (table default.Table_0d634c04e624422da8830e84abf1339f [id=eefabebedc4b4002b527bea100cc632e]) successfully deleted
I20260810 11:30:52.015466 27231 tablet_bootstrap.cc:492] T c3a5d7b8b0a14134ac55fa17a7dac21e P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:52.015645 27231 ts_tablet_manager.cc:1397] T c3a5d7b8b0a14134ac55fa17a7dac21e P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.086s user 0.005s sys 0.000s
I20260810 11:30:52.015530 28987 ts_tablet_manager.cc:1939] T 40f5eecfc66a4711aef60c1a2bff6b97 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:52.016693 27231 raft_consensus.cc:348] T c3a5d7b8b0a14134ac55fa17a7dac21e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.016937 27231 raft_consensus.cc:374] T c3a5d7b8b0a14134ac55fa17a7dac21e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:52.017004 27231 raft_consensus.cc:729] T c3a5d7b8b0a14134ac55fa17a7dac21e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:52.017277 27231 consensus_queue.cc:260] T c3a5d7b8b0a14134ac55fa17a7dac21e P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.017879 27231 ts_tablet_manager.cc:1428] T c3a5d7b8b0a14134ac55fa17a7dac21e P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:52.020584 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 290) took 2254 ms. Trace:
I20260810 11:30:52.020816 28987 rpcz_store.cc:276] 0810 11:30:49.766128 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.766903 (+ 775us) service_pool.cc:227] Handling call
0810 11:30:51.941276 (+2174373us) ts_tablet_manager.cc:1145] Deleting tablet 40f5eecfc66a4711aef60c1a2bff6b97
0810 11:30:51.941290 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:51.956453 (+ 15163us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:51.969215 (+ 12762us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.020542 (+ 51327us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2174186}
I20260810 11:30:52.021664 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 40f5eecfc66a4711aef60c1a2bff6b97 (table default.Table_3efc57bdbafc46dfab4d324acb0d5f73 [id=bcba186b6e93492fb06f70e033be3296]) successfully deleted
I20260810 11:30:52.022358 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 291) took 2053 ms. Trace:
I20260810 11:30:52.022758 28987 rpcz_store.cc:276] 0810 11:30:49.969055 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.969123 (+ 68us) service_pool.cc:227] Handling call
0810 11:30:52.022163 (+2053040us) ts_tablet_manager.cc:1145] Deleting tablet bd34a4de1b93402c8a4bce1215660e77
0810 11:30:52.022184 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.022332 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2052704}
I20260810 11:30:52.024641 27228 tablet_bootstrap.cc:492] T c60baf810a544a4a90dccd2337a39043 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:52.024878 27228 ts_tablet_manager.cc:1397] T c60baf810a544a4a90dccd2337a39043 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.078s user 0.004s sys 0.000s
I20260810 11:30:52.025635 27228 raft_consensus.cc:348] T c60baf810a544a4a90dccd2337a39043 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.025900 27228 raft_consensus.cc:374] T c60baf810a544a4a90dccd2337a39043 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:52.025998 27228 raft_consensus.cc:729] T c60baf810a544a4a90dccd2337a39043 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:52.026258 27228 consensus_queue.cc:260] T c60baf810a544a4a90dccd2337a39043 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:52.033377 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet bd34a4de1b93402c8a4bce1215660e77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd34a4de1b93402c8a4bce1215660e77 already in progress: creating tablet
I20260810 11:30:52.035859 28987 tablet_replica.cc:330] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:52.040949 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:52.042550 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:52.043690 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:52.044221 28987 raft_consensus.cc:2229] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:52.044337 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet b98aeb11beb54cf0a9829b715ad96d0f (table default.Table_c0f2f67fac3147edb223918339295177 [id=9410dc6b3fbc49b4b4f87eec32c4f420]). Expected version 1 got 0
I20260810 11:30:52.044869 28987 raft_consensus.cc:2258] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:52.044826 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bb078d7c0d0e4cf5aa841a802e78d8ff (table default.Table_eb5bb59579c043d7b1d98e60e42899af [id=65218ea1c77a4098a4f1145607695dbd]). Expected version 1 got 0
I20260810 11:30:52.045815 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bcc69e8f87134d25a1329be52b08e794 (table default.Table_4e93c67b823f48028820e1e95415e455 [id=b4c0c92ef07f432cbb00a36ecd17d394]). Expected version 1 got 0
I20260810 11:30:52.046348 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c3a5d7b8b0a14134ac55fa17a7dac21e (table default.Table_a4ae13338d184321b7cd7de27296ba58 [id=0cf740b2e59643899dac59acdf576fe2]). Expected version 1 got 0
I20260810 11:30:52.047489 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f10ac7e043c240d8a14b2b4f96b864b9 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:52.050788 27222 tablet_bootstrap.cc:492] T c60baf810a544a4a90dccd2337a39043 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:52.051052 27222 ts_tablet_manager.cc:1397] T c60baf810a544a4a90dccd2337a39043 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.121s user 0.009s sys 0.007s
I20260810 11:30:52.052543 27228 ts_tablet_manager.cc:1428] T c60baf810a544a4a90dccd2337a39043 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.028s user 0.001s sys 0.000s
I20260810 11:30:52.053079 27222 raft_consensus.cc:348] T c60baf810a544a4a90dccd2337a39043 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.053416 27222 raft_consensus.cc:374] T c60baf810a544a4a90dccd2337a39043 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:52.053519 27228 tablet_bootstrap.cc:492] T 2da86554bc51486e91f1ea5995a245b5 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:52.056038 27222 raft_consensus.cc:729] T c60baf810a544a4a90dccd2337a39043 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:52.056406 27222 consensus_queue.cc:260] T c60baf810a544a4a90dccd2337a39043 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.060313 27228 tablet_bootstrap.cc:654] T 2da86554bc51486e91f1ea5995a245b5 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:52.060380 27222 ts_tablet_manager.cc:1428] T c60baf810a544a4a90dccd2337a39043 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260810 11:30:52.060638 28987 ts_tablet_manager.cc:1905] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:52.065176 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:52.065824 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_b472377e613b4475b7a0b58062d44535 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 2 got 0
I20260810 11:30:52.066120 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:52.066754 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:52.067178 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:52.067796 27222 tablet_bootstrap.cc:492] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:52.068065 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:52.068336 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c317ccebde05457d9e81c5c871638092 (table default.Table_8c0c1ab3bbb944c888930a5d8116d888 [id=7b4e4650915f4c16bef68adf43618b89]). Expected version 1 got 0
I20260810 11:30:52.069799 27222 tablet_bootstrap.cc:654] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:52.075793 28987 ts_tablet_manager.cc:1918] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:52.077158 29500 ts_tablet_manager.cc:1918] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:52.079459 29500 log.cc:1196] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/d000f0ebaf0049a7bdaad93e307e16e2
I20260810 11:30:52.080010 29500 ts_tablet_manager.cc:1939] T d000f0ebaf0049a7bdaad93e307e16e2 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:52.086395 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:52.088258 28987 log.cc:1196] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/f8e6fc49f5e54f6c8fb710220a6cbf0f
I20260810 11:30:52.089655 27228 tablet_bootstrap.cc:492] T 2da86554bc51486e91f1ea5995a245b5 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:52.089907 27228 ts_tablet_manager.cc:1397] T 2da86554bc51486e91f1ea5995a245b5 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.000s
I20260810 11:30:52.090960 27228 raft_consensus.cc:348] T 2da86554bc51486e91f1ea5995a245b5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.091374 27228 raft_consensus.cc:374] T 2da86554bc51486e91f1ea5995a245b5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:52.091499 27228 raft_consensus.cc:729] T 2da86554bc51486e91f1ea5995a245b5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:52.092018 27228 consensus_queue.cc:260] T 2da86554bc51486e91f1ea5995a245b5 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.092962 27228 ts_tablet_manager.cc:1428] T 2da86554bc51486e91f1ea5995a245b5 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 11:30:52.095295 27222 tablet_bootstrap.cc:492] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:52.095512 27222 ts_tablet_manager.cc:1397] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20260810 11:30:52.096048 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 286) took 1643 ms. Trace:
I20260810 11:30:52.096164 29603 rpcz_store.cc:276] 0810 11:30:50.470296 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.470376 (+ 80us) service_pool.cc:227] Handling call
0810 11:30:52.014893 (+1544517us) ts_tablet_manager.cc:1145] Deleting tablet 7de2d60cf87c48459e6663a68ac96714
0810 11:30:52.095887 (+ 80994us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.096018 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1544253}
I20260810 11:30:52.096601 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 288) took 1614 ms. Trace:
I20260810 11:30:52.096474 27222 raft_consensus.cc:348] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.096673 29603 rpcz_store.cc:276] 0810 11:30:50.489979 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.490048 (+ 69us) service_pool.cc:227] Handling call
0810 11:30:52.096441 (+1606393us) ts_tablet_manager.cc:1145] Deleting tablet 25efcc18e8444b09ae2556345c36a710
0810 11:30:52.096451 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.096586 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1606131}
I20260810 11:30:52.096757 27222 raft_consensus.cc:374] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:52.096820 27222 raft_consensus.cc:729] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:52.096937 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 290) took 1599 ms. Trace:
I20260810 11:30:52.096999 29603 rpcz_store.cc:276] 0810 11:30:50.497463 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.497956 (+ 493us) service_pool.cc:227] Handling call
0810 11:30:52.096856 (+1598900us) ts_tablet_manager.cc:1145] Deleting tablet d08250001e1542f9978bc6f89ace458b
0810 11:30:52.096864 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.096925 (+ 61us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1532932}
I20260810 11:30:52.097044 27222 consensus_queue.cc:260] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.097221 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 291) took 1599 ms. Trace:
I20260810 11:30:52.097316 29603 rpcz_store.cc:276] 0810 11:30:50.498266 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.500146 (+ 1880us) service_pool.cc:227] Handling call
0810 11:30:52.097165 (+1597019us) ts_tablet_manager.cc:1145] Deleting tablet b945038c03e343489af6ae7e50131d97
0810 11:30:52.097172 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.097212 (+ 40us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1533062}
I20260810 11:30:52.097591 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 292) took 1597 ms. Trace:
I20260810 11:30:52.097658 29603 rpcz_store.cc:276] 0810 11:30:50.500521 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.505264 (+ 4743us) service_pool.cc:227] Handling call
0810 11:30:52.097508 (+1592244us) ts_tablet_manager.cc:1145] Deleting tablet 4efa31ad2ce8436b9638e6759d9b5421
0810 11:30:52.097517 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.097576 (+ 59us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1533372}
I20260810 11:30:52.097764 27222 ts_tablet_manager.cc:1428] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 11:30:52.097906 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 293) took 1597 ms. Trace:
I20260810 11:30:52.097966 29603 rpcz_store.cc:276] 0810 11:30:50.500729 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.505497 (+ 4768us) service_pool.cc:227] Handling call
0810 11:30:52.097825 (+1592328us) ts_tablet_manager.cc:1145] Deleting tablet 713663be70014b17b17056a865e7db63
0810 11:30:52.097834 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.097895 (+ 61us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1533467}
I20260810 11:30:52.098170 29603 tablet_replica.cc:330] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:52.098376 29603 raft_consensus.cc:2229] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:52.098510 27222 tablet_bootstrap.cc:492] T 98de7ce411bb4b54ada2df3b78b72190 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:52.098745 29603 raft_consensus.cc:2258] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:52.099354 29603 ts_tablet_manager.cc:1905] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:52.101243 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 7de2d60cf87c48459e6663a68ac96714 because the tablet was not found. No further retry: Not found: Tablet not found: 7de2d60cf87c48459e6663a68ac96714
W20260810 11:30:52.101594 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 25efcc18e8444b09ae2556345c36a710 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25efcc18e8444b09ae2556345c36a710 already in progress: creating tablet
W20260810 11:30:52.102015 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet d08250001e1542f9978bc6f89ace458b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d08250001e1542f9978bc6f89ace458b already in progress: creating tablet
W20260810 11:30:52.102313 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet b945038c03e343489af6ae7e50131d97 because the tablet was not found. No further retry: Not found: Tablet not found: b945038c03e343489af6ae7e50131d97
W20260810 11:30:52.102667 26565 catalog_manager.cc:4808] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 4efa31ad2ce8436b9638e6759d9b5421 because the tablet was not found. No further retry: Not found: Tablet not found: 4efa31ad2ce8436b9638e6759d9b5421
W20260810 11:30:52.103029 26565 catalog_manager.cc:4821] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): delete failed for tablet 713663be70014b17b17056a865e7db63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 713663be70014b17b17056a865e7db63 already in progress: creating tablet
I20260810 11:30:52.098358 28987 ts_tablet_manager.cc:1939] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:52.107573 27231 tablet_bootstrap.cc:492] T 728f273a89cd48f8bf0d8616645f5eed P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:52.109735 27231 tablet_bootstrap.cc:654] T 728f273a89cd48f8bf0d8616645f5eed P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:52.110406 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 295) took 1935 ms. Trace:
I20260810 11:30:52.124657 28987 rpcz_store.cc:276] 0810 11:30:50.175084 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.175146 (+ 62us) service_pool.cc:227] Handling call
0810 11:30:52.035792 (+1860646us) ts_tablet_manager.cc:1145] Deleting tablet f8e6fc49f5e54f6c8fb710220a6cbf0f
0810 11:30:52.035808 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.071796 (+ 35988us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.075657 (+ 3861us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.110379 (+ 34722us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1860365}
I20260810 11:30:52.125708 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet f8e6fc49f5e54f6c8fb710220a6cbf0f (table default.Table_11e3ca2d0589464586b01e41dcd46bbf [id=d63533f5d837481889b34a78d860e018]) successfully deleted
I20260810 11:30:52.113653 27222 tablet_bootstrap.cc:654] T 98de7ce411bb4b54ada2df3b78b72190 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:52.127522 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 298) took 1945 ms. Trace:
I20260810 11:30:52.128633 29316 raft_consensus.cc:482] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.128975 29316 raft_consensus.cc:504] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:52.131013 26702 leader_election.cc:341] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: 2da86554bc51486e91f1ea5995a245b5
I20260810 11:30:52.132050 29316 leader_election.cc:288] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.128616 28987 rpcz_store.cc:276] 0810 11:30:50.182389 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.182479 (+ 90us) service_pool.cc:227] Handling call
0810 11:30:52.127302 (+1944823us) ts_tablet_manager.cc:1145] Deleting tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a
0810 11:30:52.127334 (+ 32us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.127497 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1944561}
I20260810 11:30:52.144770 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 300) took 1960 ms. Trace:
I20260810 11:30:52.145013 28987 rpcz_store.cc:276] 0810 11:30:50.183866 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.183911 (+ 45us) service_pool.cc:227] Handling call
0810 11:30:52.144611 (+1960700us) ts_tablet_manager.cc:1145] Deleting tablet d000f0ebaf0049a7bdaad93e307e16e2
0810 11:30:52.144630 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.144744 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1960452}
I20260810 11:30:52.145545 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 301) took 1948 ms. Trace:
I20260810 11:30:52.145720 28987 rpcz_store.cc:276] 0810 11:30:50.196936 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.197152 (+ 216us) service_pool.cc:227] Handling call
0810 11:30:52.145444 (+1948292us) ts_tablet_manager.cc:1145] Deleting tablet 8228600e3f6b4f9993dd25e4ceb57e4d
0810 11:30:52.145458 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.145526 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1948020}
I20260810 11:30:52.146214 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 302) took 1949 ms. Trace:
W20260810 11:30:52.146483 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 6dc4fd6ca8a541f99eed57a6f51c1f0a because the tablet was not found. No further retry: Not found: Tablet not found: 6dc4fd6ca8a541f99eed57a6f51c1f0a
W20260810 11:30:52.146838 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet d000f0ebaf0049a7bdaad93e307e16e2 because the tablet was not found. No further retry: Not found: Tablet not found: d000f0ebaf0049a7bdaad93e307e16e2
I20260810 11:30:52.146379 28987 rpcz_store.cc:276] 0810 11:30:50.197091 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.197165 (+ 74us) service_pool.cc:227] Handling call
0810 11:30:52.146124 (+1948959us) ts_tablet_manager.cc:1145] Deleting tablet 3ae27bf110114b70a3e3f6cf64f31b98
0810 11:30:52.146137 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.146198 (+ 61us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1948526}
W20260810 11:30:52.147086 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 8228600e3f6b4f9993dd25e4ceb57e4d because the tablet was not found. No further retry: Not found: Tablet not found: 8228600e3f6b4f9993dd25e4ceb57e4d
W20260810 11:30:52.147540 26566 catalog_manager.cc:4808] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet 3ae27bf110114b70a3e3f6cf64f31b98 because the tablet was not found. No further retry: Not found: Tablet not found: 3ae27bf110114b70a3e3f6cf64f31b98
I20260810 11:30:52.147611 28987 tablet_replica.cc:330] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:52.147922 28987 raft_consensus.cc:2229] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:52.148761 28987 raft_consensus.cc:2258] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:52.149636 28987 ts_tablet_manager.cc:1905] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:52.156798 27231 tablet_bootstrap.cc:492] T 728f273a89cd48f8bf0d8616645f5eed P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:52.157039 27231 ts_tablet_manager.cc:1397] T 728f273a89cd48f8bf0d8616645f5eed P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.050s user 0.001s sys 0.004s
I20260810 11:30:52.158188 27231 raft_consensus.cc:348] T 728f273a89cd48f8bf0d8616645f5eed P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.158480 27231 raft_consensus.cc:374] T 728f273a89cd48f8bf0d8616645f5eed P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:52.158564 27231 raft_consensus.cc:729] T 728f273a89cd48f8bf0d8616645f5eed P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:52.158811 27231 consensus_queue.cc:260] T 728f273a89cd48f8bf0d8616645f5eed P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.159859 27231 ts_tablet_manager.cc:1428] T 728f273a89cd48f8bf0d8616645f5eed P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260810 11:30:52.160459 26993 consensus_peers.cc:487] T f8e6fc49f5e54f6c8fb710220a6cbf0f P 482e605580be48cbbacce05a3e61c215 -> Peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Couldn't send request to peer 443ec871f1ed4232b932ecfb0b18510d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8e6fc49f5e54f6c8fb710220a6cbf0f. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:52.107681 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 319) took 2399 ms. Trace:
I20260810 11:30:52.160682 29500 rpcz_store.cc:276] 0810 11:30:49.708113 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.708167 (+ 54us) service_pool.cc:227] Handling call
0810 11:30:51.986390 (+2278223us) ts_tablet_manager.cc:1145] Deleting tablet d000f0ebaf0049a7bdaad93e307e16e2
0810 11:30:51.986406 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.035697 (+ 49291us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.077019 (+ 41322us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.107650 (+ 30631us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2278030}
I20260810 11:30:52.161065 29500 tablet_replica.cc:330] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:52.161262 29500 raft_consensus.cc:2229] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:52.161407 29500 raft_consensus.cc:2258] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:52.161945 29500 ts_tablet_manager.cc:1905] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:52.163378 27231 tablet_bootstrap.cc:492] T e9732b90bc054f8a83fc17c0df9dfafe P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:52.132160 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2da86554bc51486e91f1ea5995a245b5" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:52.164703 26912 raft_consensus.cc:2454] T 2da86554bc51486e91f1ea5995a245b5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:52.165376 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet d000f0ebaf0049a7bdaad93e307e16e2 (table default.Table_2c4f303b1d1c47c9a4c089efccdd1d37 [id=fe5337909463467788d24d76e379cb48]) successfully deleted
I20260810 11:30:52.166817 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:52.167057 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:52.167223 26574 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 5deec04c1be64473accf8b9df14bd22e (table default.Table_7bb952472de04323b2d5dfcc6ced359e [id=49171f94f6254f3f8e02643ee05e6e14]). Expected version 3 got 0
I20260810 11:30:52.169106 26700 leader_election.cc:302] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
W20260810 11:30:52.169320 26700 raft_consensus.cc:2670] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 11:30:52.170677 27222 tablet_bootstrap.cc:492] T 98de7ce411bb4b54ada2df3b78b72190 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:52.170980 27222 ts_tablet_manager.cc:1397] T 98de7ce411bb4b54ada2df3b78b72190 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.073s user 0.009s sys 0.002s
I20260810 11:30:52.172222 27222 raft_consensus.cc:348] T 98de7ce411bb4b54ada2df3b78b72190 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.172478 27222 raft_consensus.cc:374] T 98de7ce411bb4b54ada2df3b78b72190 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:52.172546 27222 raft_consensus.cc:729] T 98de7ce411bb4b54ada2df3b78b72190 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:52.174767 29504 raft_consensus.cc:482] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.174970 29504 raft_consensus.cc:504] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.175712 29504 leader_election.cc:288] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:52.176918 26702 leader_election.cc:341] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: cc76d30f37094391b75076c92ccc277f
I20260810 11:30:52.182410 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc76d30f37094391b75076c92ccc277f" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:52.182685 26912 raft_consensus.cc:2454] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
W20260810 11:30:52.183629 26700 consensus_peers.cc:487] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:52.183970 26700 leader_election.cc:302] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:52.184302 29504 raft_consensus.cc:2781] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:52.184399 29504 raft_consensus.cc:482] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:52.184473 29504 raft_consensus.cc:3037] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:52.185752 27228 tablet_bootstrap.cc:492] T 3853603eac544d769cef8cff9a008784 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:52.186499 27222 consensus_queue.cc:260] T 98de7ce411bb4b54ada2df3b78b72190 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.187242 27222 ts_tablet_manager.cc:1428] T 98de7ce411bb4b54ada2df3b78b72190 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.016s user 0.000s sys 0.002s
I20260810 11:30:52.187372 29504 raft_consensus.cc:504] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.187711 27222 tablet_bootstrap.cc:492] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:52.187948 27228 tablet_bootstrap.cc:654] T 3853603eac544d769cef8cff9a008784 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:52.188025 29504 leader_election.cc:288] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.190071 27231 tablet_bootstrap.cc:654] T e9732b90bc054f8a83fc17c0df9dfafe P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:52.192167 29603 ts_tablet_manager.cc:1918] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 11:30:52.192361 29603 log.cc:1196] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/d1d0d55b526749059470504a27887b22
W20260810 11:30:52.193324 26702 leader_election.cc:341] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: cc76d30f37094391b75076c92ccc277f
I20260810 11:30:52.194535 28987 ts_tablet_manager.cc:1918] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:52.194654 28987 log.cc:1196] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/2da86554bc51486e91f1ea5995a245b5
I20260810 11:30:52.195739 29500 ts_tablet_manager.cc:1918] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:52.195894 29500 log.cc:1196] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/e276b0fa124d42dfb3fe750d245e44d8
I20260810 11:30:52.196439 29500 ts_tablet_manager.cc:1939] T e276b0fa124d42dfb3fe750d245e44d8 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:52.196625 28987 ts_tablet_manager.cc:1939] T 2da86554bc51486e91f1ea5995a245b5 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:52.197527 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 305) took 1998 ms. Trace:
I20260810 11:30:52.197634 28987 rpcz_store.cc:276] 0810 11:30:50.199151 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.199208 (+ 57us) service_pool.cc:227] Handling call
0810 11:30:52.147549 (+1948341us) ts_tablet_manager.cc:1145] Deleting tablet 2da86554bc51486e91f1ea5995a245b5
0810 11:30:52.147565 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.162650 (+ 15085us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.194421 (+ 31771us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.197508 (+ 3087us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1948065}
I20260810 11:30:52.198046 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 306) took 1998 ms. Trace:
I20260810 11:30:52.198129 28987 rpcz_store.cc:276] 0810 11:30:50.199249 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.199532 (+ 283us) service_pool.cc:227] Handling call
0810 11:30:52.197927 (+1998395us) ts_tablet_manager.cc:1145] Deleting tablet ce73798a721b4a6d892f0c24b6b40e2c
0810 11:30:52.197937 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.198030 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1998246}
I20260810 11:30:52.198366 28987 tablet_replica.cc:330] T c60baf810a544a4a90dccd2337a39043 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:52.198311 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc76d30f37094391b75076c92ccc277f" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:52.198522 26912 raft_consensus.cc:3037] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:52.198609 28987 raft_consensus.cc:2229] T c60baf810a544a4a90dccd2337a39043 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:52.198766 28987 raft_consensus.cc:2258] T c60baf810a544a4a90dccd2337a39043 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:52.200225 27222 tablet_bootstrap.cc:654] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:52.201506 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 320) took 2493 ms. Trace:
I20260810 11:30:52.201730 29500 rpcz_store.cc:276] 0810 11:30:49.708274 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.708338 (+ 64us) service_pool.cc:227] Handling call
0810 11:30:52.161002 (+2452664us) ts_tablet_manager.cc:1145] Deleting tablet e276b0fa124d42dfb3fe750d245e44d8
0810 11:30:52.161017 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.168153 (+ 7136us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.195599 (+ 27446us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.201473 (+ 5874us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2452505}
I20260810 11:30:52.202239 26912 raft_consensus.cc:2454] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:52.202610 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet e276b0fa124d42dfb3fe750d245e44d8 (table default.Table_2d6c3a53213a458aaee6bd445240041c [id=097ff3abe81b415799933e50feab6c39]) successfully deleted
I20260810 11:30:52.203217 29500 tablet_replica.cc:330] T c60baf810a544a4a90dccd2337a39043 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:52.203632 29500 raft_consensus.cc:2229] T c60baf810a544a4a90dccd2337a39043 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:52.204216 29500 raft_consensus.cc:2258] T c60baf810a544a4a90dccd2337a39043 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:52.204797 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet 2da86554bc51486e91f1ea5995a245b5 (table default.Table_a0630a37a4e44862b8947cd848615cdb [id=f7931f3f7e9c45fba1aff648c50250f2]) successfully deleted
W20260810 11:30:52.205178 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ce73798a721b4a6d892f0c24b6b40e2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce73798a721b4a6d892f0c24b6b40e2c already in progress: creating tablet
I20260810 11:30:52.205844 26700 leader_election.cc:302] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:52.206358 29316 raft_consensus.cc:2781] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:52.206514 29316 raft_consensus.cc:686] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:52.206782 29316 consensus_queue.cc:237] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.208962 28987 ts_tablet_manager.cc:1905] T c60baf810a544a4a90dccd2337a39043 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:52.215323 29603 ts_tablet_manager.cc:1939] T d1d0d55b526749059470504a27887b22 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:52.216346 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 295) took 1715 ms. Trace:
I20260810 11:30:52.216535 29603 rpcz_store.cc:276] 0810 11:30:50.500936 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.506119 (+ 5183us) service_pool.cc:227] Handling call
0810 11:30:52.098133 (+1592014us) ts_tablet_manager.cc:1145] Deleting tablet d1d0d55b526749059470504a27887b22
0810 11:30:52.098141 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.130749 (+ 32608us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.192002 (+ 61253us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.216320 (+ 24318us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1533672}
I20260810 11:30:52.217182 29603 tablet_replica.cc:330] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:52.217466 29603 raft_consensus.cc:2229] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:52.217360 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet d1d0d55b526749059470504a27887b22 (table default.Table_a164cd4bbc4344ae905f395ab1e6cffb [id=62f404c62e4040fc801f70cafddf9d95]) successfully deleted
I20260810 11:30:52.217754 29603 raft_consensus.cc:2258] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:52.218456 29603 ts_tablet_manager.cc:1905] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:52.221331 29845 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac259bcf213a4aa297d1d8e73b262361)
I20260810 11:30:52.224262 29845 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" member_type: VOTER last_known_addr { host: "127.25.195.254" port: 41125 } } peers { permanent_uuid: "c40c76e125b44de181b88b7f63a566f7" member_type: VOTER last_known_addr { host: "127.25.195.253" port: 34547 } } peers { permanent_uuid: "ac259bcf213a4aa297d1d8e73b262361" member_type: VOTER last_known_addr { host: "127.25.195.252" port: 34489 } }
I20260810 11:30:52.226718 26589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" candidate_term: 7 candidate_status { last_received { term: 6 index: 827 } } ignore_live_leader: false dest_uuid: "ac259bcf213a4aa297d1d8e73b262361" is_pre_election: true
I20260810 11:30:52.238206 27228 tablet_bootstrap.cc:492] T 3853603eac544d769cef8cff9a008784 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:52.238381 27228 ts_tablet_manager.cc:1397] T 3853603eac544d769cef8cff9a008784 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.001s
I20260810 11:30:52.242497 29500 ts_tablet_manager.cc:1905] T c60baf810a544a4a90dccd2337a39043 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:52.243187 27231 tablet_bootstrap.cc:492] T e9732b90bc054f8a83fc17c0df9dfafe P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:52.245668 27231 ts_tablet_manager.cc:1397] T e9732b90bc054f8a83fc17c0df9dfafe P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.082s user 0.002s sys 0.010s
I20260810 11:30:52.246031 27222 tablet_bootstrap.cc:492] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:52.246272 27222 ts_tablet_manager.cc:1397] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.059s user 0.000s sys 0.008s
I20260810 11:30:52.247394 27222 raft_consensus.cc:348] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.247291 27231 raft_consensus.cc:348] T e9732b90bc054f8a83fc17c0df9dfafe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.247713 27222 raft_consensus.cc:374] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:52.247782 27222 raft_consensus.cc:729] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:52.226011 29845 leader_election.cc:288] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c40c76e125b44de181b88b7f63a566f7 (127.25.195.253:34547), ac259bcf213a4aa297d1d8e73b262361 (127.25.195.252:34489)
I20260810 11:30:52.245434 27228 raft_consensus.cc:348] T 3853603eac544d769cef8cff9a008784 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.249521 27228 raft_consensus.cc:374] T 3853603eac544d769cef8cff9a008784 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:52.249665 27228 raft_consensus.cc:729] T 3853603eac544d769cef8cff9a008784 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:52.247834 27231 raft_consensus.cc:374] T e9732b90bc054f8a83fc17c0df9dfafe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:52.250023 27228 consensus_queue.cc:260] T 3853603eac544d769cef8cff9a008784 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.250370 27231 raft_consensus.cc:729] T e9732b90bc054f8a83fc17c0df9dfafe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:52.253353 27231 consensus_queue.cc:260] T e9732b90bc054f8a83fc17c0df9dfafe P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.254403 28987 ts_tablet_manager.cc:1918] T c60baf810a544a4a90dccd2337a39043 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:52.254558 28987 log.cc:1196] T c60baf810a544a4a90dccd2337a39043 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/c60baf810a544a4a90dccd2337a39043
I20260810 11:30:52.254920 28987 ts_tablet_manager.cc:1939] T c60baf810a544a4a90dccd2337a39043 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:52.254630 29794 raft_consensus.cc:482] T 5eb3dd7bd54c485d9ea0c2186f799d0f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.258203 29794 raft_consensus.cc:504] T 5eb3dd7bd54c485d9ea0c2186f799d0f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.258898 29794 leader_election.cc:288] T 5eb3dd7bd54c485d9ea0c2186f799d0f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.259958 27231 ts_tablet_manager.cc:1428] T e9732b90bc054f8a83fc17c0df9dfafe P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260810 11:30:52.261389 26750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eb3dd7bd54c485d9ea0c2186f799d0f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:52.262336 26993 leader_election.cc:341] T 5eb3dd7bd54c485d9ea0c2186f799d0f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:52.263000 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eb3dd7bd54c485d9ea0c2186f799d0f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:52.263768 27231 tablet_bootstrap.cc:492] T cc032509e78c4a04bbe504f54e9d6c6b P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:52.267351 27231 tablet_bootstrap.cc:654] T cc032509e78c4a04bbe504f54e9d6c6b P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
W20260810 11:30:52.269780 26991 leader_election.cc:341] T 5eb3dd7bd54c485d9ea0c2186f799d0f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:52.269953 26991 leader_election.cc:302] T 5eb3dd7bd54c485d9ea0c2186f799d0f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:52.270503 29794 raft_consensus.cc:2726] T 5eb3dd7bd54c485d9ea0c2186f799d0f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:52.271042 27222 consensus_queue.cc:260] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.282383 27228 ts_tablet_manager.cc:1428] T 3853603eac544d769cef8cff9a008784 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.044s user 0.003s sys 0.000s
I20260810 11:30:52.284920 27228 tablet_bootstrap.cc:492] T 501defb075d142ec8b22e5e8236a009c P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:52.290725 27222 ts_tablet_manager.cc:1428] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.044s user 0.001s sys 0.002s
I20260810 11:30:52.301622 29504 raft_consensus.cc:482] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.301738 27222 tablet_bootstrap.cc:492] T 8400c601e9894ea9b68679f6d7927456 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:52.301661 26886 tablet_service.cc:1467] Processing CreateTablet for tablet 75411ef446f44c119df557d21c8ff8e0 (DEFAULT_TABLE table=default.Table_7030d6d0f57d4968bc6fa7a1b8dabbba [id=5c211d30442248609d3aa73f6d26a0b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.301798 29504 raft_consensus.cc:504] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.302197 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75411ef446f44c119df557d21c8ff8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.302719 29504 leader_election.cc:288] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.303371 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebaf046e524b485c8b3ebf419c8035bb" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:52.303931 27049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebaf046e524b485c8b3ebf419c8035bb" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:52.304177 27222 tablet_bootstrap.cc:654] T 8400c601e9894ea9b68679f6d7927456 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:52.304226 27049 raft_consensus.cc:2454] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
W20260810 11:30:52.304210 26700 leader_election.cc:341] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:52.304980 26702 leader_election.cc:302] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:52.305625 29316 raft_consensus.cc:2781] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:52.305698 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 307) took 2106 ms. Trace:
I20260810 11:30:52.305716 29316 raft_consensus.cc:482] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:52.305891 29316 raft_consensus.cc:3037] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:52.305837 28987 rpcz_store.cc:276] 0810 11:30:50.199418 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.199743 (+ 325us) service_pool.cc:227] Handling call
0810 11:30:52.198326 (+1998583us) ts_tablet_manager.cc:1145] Deleting tablet c60baf810a544a4a90dccd2337a39043
0810 11:30:52.198338 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.240461 (+ 42123us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.254249 (+ 13788us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.305676 (+ 51427us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":60,"tablet-delete.queue_time_us":1998445}
I20260810 11:30:52.306341 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 309) took 2106 ms. Trace:
I20260810 11:30:52.306432 28987 rpcz_store.cc:276] 0810 11:30:50.199623 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.199911 (+ 288us) service_pool.cc:227] Handling call
0810 11:30:52.306193 (+2106282us) ts_tablet_manager.cc:1145] Deleting tablet ea66da5bc20e4718901ffc473677421c
0810 11:30:52.306207 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.306323 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2106122}
I20260810 11:30:52.306795 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 312) took 2106 ms. Trace:
I20260810 11:30:52.306880 28987 rpcz_store.cc:276] 0810 11:30:50.199991 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.200056 (+ 65us) service_pool.cc:227] Handling call
0810 11:30:52.306674 (+2106618us) ts_tablet_manager.cc:1145] Deleting tablet b121c13e9241468aa224e17093eb38f4
0810 11:30:52.306686 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.306778 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2106409}
I20260810 11:30:52.307155 28987 tablet_replica.cc:330] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:52.307287 26878 tablet_service.cc:1467] Processing CreateTablet for tablet 89b52d000001465c8a796d65821519a3 (DEFAULT_TABLE table=default.Table_48393021647145c3b0a8e5ad71ff11e8 [id=d1ba89c4090b4bc68e84db817e3776be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.307392 28987 raft_consensus.cc:2229] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:52.307643 28987 pending_rounds.cc:62] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d: Trying to abort 1 pending ops.
I20260810 11:30:52.307750 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89b52d000001465c8a796d65821519a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.307695 28987 pending_rounds.cc:68] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936506199060480 op_type: NO_OP noop_request { }
I20260810 11:30:52.307874 28987 raft_consensus.cc:2866] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:52.308079 28987 raft_consensus.cc:2258] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:52.309412 27023 tablet_service.cc:1467] Processing CreateTablet for tablet 75411ef446f44c119df557d21c8ff8e0 (DEFAULT_TABLE table=default.Table_7030d6d0f57d4968bc6fa7a1b8dabbba [id=5c211d30442248609d3aa73f6d26a0b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.309901 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75411ef446f44c119df557d21c8ff8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.310237 26881 tablet_service.cc:1467] Processing CreateTablet for tablet 71fba4e1cbb940778ad894f33bae527d (DEFAULT_TABLE table=default.Table_84b09f8712134781a968568083e2d72d [id=459ebf654cde4b30bacdc1e423d3f5b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.310544 29316 raft_consensus.cc:504] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.310813 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71fba4e1cbb940778ad894f33bae527d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.313460 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 89b52d000001465c8a796d65821519a3 (DEFAULT_TABLE table=default.Table_48393021647145c3b0a8e5ad71ff11e8 [id=d1ba89c4090b4bc68e84db817e3776be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.313921 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89b52d000001465c8a796d65821519a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.314242 26750 raft_consensus.cc:3037] T fa14fea852c24cd7bb3d57094af2e178 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:52.318005 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet c60baf810a544a4a90dccd2337a39043 (table default.Table_e58ae45f9ea949a2a0d7bf7f0e862647 [id=76b87112ac8e4024965d44a9b62b8c1a]) successfully deleted
I20260810 11:30:52.318085 26743 tablet_service.cc:1467] Processing CreateTablet for tablet 75411ef446f44c119df557d21c8ff8e0 (DEFAULT_TABLE table=default.Table_7030d6d0f57d4968bc6fa7a1b8dabbba [id=5c211d30442248609d3aa73f6d26a0b5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:52.318395 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet ea66da5bc20e4718901ffc473677421c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea66da5bc20e4718901ffc473677421c already in progress: creating tablet
W20260810 11:30:52.318670 26566 catalog_manager.cc:4821] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): delete failed for tablet b121c13e9241468aa224e17093eb38f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b121c13e9241468aa224e17093eb38f4 already in progress: creating tablet
I20260810 11:30:52.320339 27029 tablet_service.cc:1467] Processing CreateTablet for tablet 71fba4e1cbb940778ad894f33bae527d (DEFAULT_TABLE table=default.Table_84b09f8712134781a968568083e2d72d [id=459ebf654cde4b30bacdc1e423d3f5b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.320341 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 29969a3cb69a488b8ba530089332b48d (DEFAULT_TABLE table=default.Table_b88e63a675fd460389f84a6f935346af [id=f413e456be344da1a07fdb346cc95f8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.320816 27029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71fba4e1cbb940778ad894f33bae527d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.321038 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29969a3cb69a488b8ba530089332b48d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.325044 26743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75411ef446f44c119df557d21c8ff8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.326767 26730 tablet_service.cc:1467] Processing CreateTablet for tablet 89b52d000001465c8a796d65821519a3 (DEFAULT_TABLE table=default.Table_48393021647145c3b0a8e5ad71ff11e8 [id=d1ba89c4090b4bc68e84db817e3776be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.327276 26730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89b52d000001465c8a796d65821519a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.328420 29318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83cc8e39a3b9455f8242a6da6a54c38a" candidate_term: 7 candidate_status { last_received { term: 6 index: 827 } } ignore_live_leader: false dest_uuid: "c40c76e125b44de181b88b7f63a566f7" is_pre_election: true
I20260810 11:30:52.329970 27286 leader_election.cc:302] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83cc8e39a3b9455f8242a6da6a54c38a; no voters: ac259bcf213a4aa297d1d8e73b262361, c40c76e125b44de181b88b7f63a566f7
I20260810 11:30:52.330233 29316 leader_election.cc:288] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.330390 26881 tablet_service.cc:1467] Processing CreateTablet for tablet f05a55a0652d4828b400e2d418df48ff (DEFAULT_TABLE table=default.Table_7ab2a0eaec2b43f6bd0a082bd2f089c6 [id=2e501edbc5834e3c9a8f59a328a10d75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.330868 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f05a55a0652d4828b400e2d418df48ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.331144 27049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebaf046e524b485c8b3ebf419c8035bb" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:52.331449 27049 raft_consensus.cc:3037] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:52.332934 26744 tablet_service.cc:1467] Processing CreateTablet for tablet 71fba4e1cbb940778ad894f33bae527d (DEFAULT_TABLE table=default.Table_84b09f8712134781a968568083e2d72d [id=459ebf654cde4b30bacdc1e423d3f5b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.333393 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71fba4e1cbb940778ad894f33bae527d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.333928 26732 tablet_service.cc:1467] Processing CreateTablet for tablet 29969a3cb69a488b8ba530089332b48d (DEFAULT_TABLE table=default.Table_b88e63a675fd460389f84a6f935346af [id=f413e456be344da1a07fdb346cc95f8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.334282 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29969a3cb69a488b8ba530089332b48d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.335017 27049 raft_consensus.cc:2454] T ebaf046e524b485c8b3ebf419c8035bb P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:52.335565 26702 leader_election.cc:302] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:52.336314 29316 raft_consensus.cc:2781] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:52.336447 29316 raft_consensus.cc:686] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:52.336838 29316 consensus_queue.cc:237] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.337535 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebaf046e524b485c8b3ebf419c8035bb" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:52.338452 26700 leader_election.cc:341] T ebaf046e524b485c8b3ebf419c8035bb P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:52.340277 27023 tablet_service.cc:1467] Processing CreateTablet for tablet 29969a3cb69a488b8ba530089332b48d (DEFAULT_TABLE table=default.Table_b88e63a675fd460389f84a6f935346af [id=f413e456be344da1a07fdb346cc95f8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.341078 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29969a3cb69a488b8ba530089332b48d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.355173 29845 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 83cc8e39a3b9455f8242a6da6a54c38a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 11:30:52.355859 27022 tablet_service.cc:1467] Processing CreateTablet for tablet 3f7cd3fa967a47d8b469bc80b9d665b3 (DEFAULT_TABLE table=default.Table_e845854916d84c01bc7d0efb85bd7328 [id=a9c57742da7f466b856a23df7aa5ffda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.356372 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f7cd3fa967a47d8b469bc80b9d665b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.358696 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 3f7cd3fa967a47d8b469bc80b9d665b3 (DEFAULT_TABLE table=default.Table_e845854916d84c01bc7d0efb85bd7328 [id=a9c57742da7f466b856a23df7aa5ffda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.359282 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f7cd3fa967a47d8b469bc80b9d665b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.360656 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 8920061626614b219424eaba8f19e368 (DEFAULT_TABLE table=default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.361052 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8920061626614b219424eaba8f19e368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.376662 26738 tablet_service.cc:1467] Processing CreateTablet for tablet f05a55a0652d4828b400e2d418df48ff (DEFAULT_TABLE table=default.Table_7ab2a0eaec2b43f6bd0a082bd2f089c6 [id=2e501edbc5834e3c9a8f59a328a10d75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.378365 27228 tablet_bootstrap.cc:654] T 501defb075d142ec8b22e5e8236a009c P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:52.384022 29500 ts_tablet_manager.cc:1918] T c60baf810a544a4a90dccd2337a39043 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:52.384059 29741 raft_consensus.cc:482] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.384361 29741 raft_consensus.cc:504] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.385353 29741 leader_election.cc:288] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:52.386467 26754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b945038c03e343489af6ae7e50131d97" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:52.386771 26754 raft_consensus.cc:2454] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:52.387730 26849 leader_election.cc:302] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:52.388515 29741 raft_consensus.cc:2781] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:52.388653 29741 raft_consensus.cc:482] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:52.388744 29741 raft_consensus.cc:3037] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:52.392517 26848 leader_election.cc:341] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: b945038c03e343489af6ae7e50131d97
I20260810 11:30:52.395531 29741 raft_consensus.cc:504] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.399101 26754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b945038c03e343489af6ae7e50131d97" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:52.399334 26754 raft_consensus.cc:3037] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:52.403474 29741 leader_election.cc:288] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:52.404098 26848 leader_election.cc:341] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: b945038c03e343489af6ae7e50131d97
I20260810 11:30:52.397315 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 3f7cd3fa967a47d8b469bc80b9d665b3 (DEFAULT_TABLE table=default.Table_e845854916d84c01bc7d0efb85bd7328 [id=a9c57742da7f466b856a23df7aa5ffda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.407058 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f7cd3fa967a47d8b469bc80b9d665b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.407593 26738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f05a55a0652d4828b400e2d418df48ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.383987 29823 consensus_queue.cc:1035] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260810 11:30:52.422196 28987 ts_tablet_manager.cc:1905] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:52.426736 26754 raft_consensus.cc:2454] T b945038c03e343489af6ae7e50131d97 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:52.427685 26849 leader_election.cc:302] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:52.429533 29741 raft_consensus.cc:2781] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:52.430160 29741 raft_consensus.cc:686] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:52.435941 29744 consensus_queue.cc:1035] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:52.430534 29741 consensus_queue.cc:237] T b945038c03e343489af6ae7e50131d97 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.448271 27228 tablet_bootstrap.cc:492] T 501defb075d142ec8b22e5e8236a009c P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:52.448644 27228 ts_tablet_manager.cc:1397] T 501defb075d142ec8b22e5e8236a009c P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.164s user 0.006s sys 0.000s
I20260810 11:30:52.449852 27228 raft_consensus.cc:348] T 501defb075d142ec8b22e5e8236a009c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.450423 27228 raft_consensus.cc:374] T 501defb075d142ec8b22e5e8236a009c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:52.452051 29744 raft_consensus.cc:482] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.452237 29744 raft_consensus.cc:504] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.453044 29744 leader_election.cc:288] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:52.455127 26848 leader_election.cc:341] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: b6395bce17ee40c2822669246ce7eb42
I20260810 11:30:52.456727 26889 tablet_service.cc:1467] Processing CreateTablet for tablet eaf0560c5b974927a1a1c33c14db9510 (DEFAULT_TABLE table=default.Table_e510bc69fa8a4595b1080535403c3828 [id=a9677d962dbb4ecf9e51adadaa31f04b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.456737 27032 tablet_service.cc:1467] Processing CreateTablet for tablet 6b605db407654a339f5d758a0e07494a (DEFAULT_TABLE table=default.Table_0f779427a62c484bab2cc50e9b46a8e8 [id=bff55c8c5a694b418faa77b8417c66bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.457243 27032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b605db407654a339f5d758a0e07494a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.457242 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaf0560c5b974927a1a1c33c14db9510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.461153 27022 tablet_service.cc:1467] Processing CreateTablet for tablet eaf0560c5b974927a1a1c33c14db9510 (DEFAULT_TABLE table=default.Table_e510bc69fa8a4595b1080535403c3828 [id=a9677d962dbb4ecf9e51adadaa31f04b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.461880 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaf0560c5b974927a1a1c33c14db9510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.465765 27028 tablet_service.cc:1467] Processing CreateTablet for tablet 8920061626614b219424eaba8f19e368 (DEFAULT_TABLE table=default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.466346 27028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8920061626614b219424eaba8f19e368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.472805 27029 tablet_service.cc:1467] Processing CreateTablet for tablet f05a55a0652d4828b400e2d418df48ff (DEFAULT_TABLE table=default.Table_7ab2a0eaec2b43f6bd0a082bd2f089c6 [id=2e501edbc5834e3c9a8f59a328a10d75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.473598 27029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f05a55a0652d4828b400e2d418df48ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.474030 26886 tablet_service.cc:1467] Processing CreateTablet for tablet 6b605db407654a339f5d758a0e07494a (DEFAULT_TABLE table=default.Table_0f779427a62c484bab2cc50e9b46a8e8 [id=bff55c8c5a694b418faa77b8417c66bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.474619 26886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b605db407654a339f5d758a0e07494a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.477061 26732 tablet_service.cc:1467] Processing CreateTablet for tablet 8920061626614b219424eaba8f19e368 (DEFAULT_TABLE table=default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.477762 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8920061626614b219424eaba8f19e368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.477981 26878 tablet_service.cc:1467] Processing CreateTablet for tablet af70351753d34937a3bf7b13b1176874 (DEFAULT_TABLE table=default.Table_3de73bd3d7014055bd94d7d5865463fe [id=6d173e84bd754142a1968047beb937cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.484886 26878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af70351753d34937a3bf7b13b1176874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.487766 26383 master-stress-test.cc:578] Killing test thread 1/25
I20260810 11:30:52.488183 27110 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:52.495556 27030 tablet_service.cc:1467] Processing CreateTablet for tablet af70351753d34937a3bf7b13b1176874 (DEFAULT_TABLE table=default.Table_3de73bd3d7014055bd94d7d5865463fe [id=6d173e84bd754142a1968047beb937cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.495832 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 91225dc1f7664fd7a79e2d62f33401cd (DEFAULT_TABLE table=default.Table_5256d55e5aee47ee88a92177e8df8577 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.496102 27030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af70351753d34937a3bf7b13b1176874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.496856 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91225dc1f7664fd7a79e2d62f33401cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.510684 27021 tablet_service.cc:1467] Processing CreateTablet for tablet 99df3b85a47b4ba08cd1dce4bfb80c8c (DEFAULT_TABLE table=default.Table_97f1301f1c104946a668d06aecfc8687 [id=a01ec3741dc145dbab530d8bb3d65a87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.511222 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99df3b85a47b4ba08cd1dce4bfb80c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.511487 26881 tablet_service.cc:1467] Processing CreateTablet for tablet caf5ed278bd648068d0d8a3b0bdfd642 (DEFAULT_TABLE table=default.Table_3fd59f07e4ee4f54bce7829aec4cf4c4 [id=3719720e5ca241b1a500a1aaf7f310c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.511974 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf5ed278bd648068d0d8a3b0bdfd642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.519793 29744 consensus_queue.cc:1035] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:52.520656 27030 tablet_service.cc:1467] Processing CreateTablet for tablet 91225dc1f7664fd7a79e2d62f33401cd (DEFAULT_TABLE table=default.Table_5256d55e5aee47ee88a92177e8df8577 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.522120 26883 tablet_service.cc:1467] Processing CreateTablet for tablet 99df3b85a47b4ba08cd1dce4bfb80c8c (DEFAULT_TABLE table=default.Table_97f1301f1c104946a668d06aecfc8687 [id=a01ec3741dc145dbab530d8bb3d65a87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.522775 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99df3b85a47b4ba08cd1dce4bfb80c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.531149 27030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91225dc1f7664fd7a79e2d62f33401cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.534337 29603 ts_tablet_manager.cc:1918] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:52.536365 26744 tablet_service.cc:1467] Processing CreateTablet for tablet eaf0560c5b974927a1a1c33c14db9510 (DEFAULT_TABLE table=default.Table_e510bc69fa8a4595b1080535403c3828 [id=a9677d962dbb4ecf9e51adadaa31f04b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.537068 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaf0560c5b974927a1a1c33c14db9510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.537134 26821 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:52.473197 26750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6395bce17ee40c2822669246ce7eb42" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:52.537518 26750 raft_consensus.cc:2454] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 0.
I20260810 11:30:52.538084 26849 leader_election.cc:302] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
I20260810 11:30:52.538697 29744 raft_consensus.cc:2781] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:52.538805 29744 raft_consensus.cc:482] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:52.538883 29744 raft_consensus.cc:3037] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:52.545773 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 91225dc1f7664fd7a79e2d62f33401cd (DEFAULT_TABLE table=default.Table_5256d55e5aee47ee88a92177e8df8577 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.546562 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91225dc1f7664fd7a79e2d62f33401cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.547932 26741 tablet_service.cc:1467] Processing CreateTablet for tablet af70351753d34937a3bf7b13b1176874 (DEFAULT_TABLE table=default.Table_3de73bd3d7014055bd94d7d5865463fe [id=6d173e84bd754142a1968047beb937cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.548437 26741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af70351753d34937a3bf7b13b1176874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.554661 26963 heartbeater.cc:503] Master 127.25.195.252:34489 was elected leader, sending a full tablet report...
I20260810 11:30:52.560065 26742 tablet_service.cc:1467] Processing CreateTablet for tablet 99df3b85a47b4ba08cd1dce4bfb80c8c (DEFAULT_TABLE table=default.Table_97f1301f1c104946a668d06aecfc8687 [id=a01ec3741dc145dbab530d8bb3d65a87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.561470 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99df3b85a47b4ba08cd1dce4bfb80c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.574467 29744 raft_consensus.cc:504] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.571909 26738 tablet_service.cc:1467] Processing CreateTablet for tablet 6b605db407654a339f5d758a0e07494a (DEFAULT_TABLE table=default.Table_0f779427a62c484bab2cc50e9b46a8e8 [id=bff55c8c5a694b418faa77b8417c66bc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:52.581645 26567 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet f10ac7e043c240d8a14b2b4f96b864b9 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet f10ac7e043c240d8a14b2b4f96b864b9 consensus state has no leader
I20260810 11:30:52.581895 26730 tablet_service.cc:1467] Processing CreateTablet for tablet caf5ed278bd648068d0d8a3b0bdfd642 (DEFAULT_TABLE table=default.Table_3fd59f07e4ee4f54bce7829aec4cf4c4 [id=3719720e5ca241b1a500a1aaf7f310c4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:52.584275 26848 leader_election.cc:341] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Not found: Tablet not found: b6395bce17ee40c2822669246ce7eb42
I20260810 11:30:52.584736 29744 leader_election.cc:288] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
W20260810 11:30:52.586885 26702 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 193134us
I20260810 11:30:52.587467 29500 log.cc:1196] T c60baf810a544a4a90dccd2337a39043 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/c60baf810a544a4a90dccd2337a39043
I20260810 11:30:52.595906 29500 ts_tablet_manager.cc:1939] T c60baf810a544a4a90dccd2337a39043 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:52.596042 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:52.596989 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:52.598773 26730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf5ed278bd648068d0d8a3b0bdfd642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.602290 26738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b605db407654a339f5d758a0e07494a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.605548 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 321) took 2897 ms. Trace:
I20260810 11:30:52.588387 29823 raft_consensus.cc:482] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.608139 29823 raft_consensus.cc:504] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.609018 29823 leader_election.cc:288] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:52.597929 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 56687us
I20260810 11:30:52.610934 26754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6395bce17ee40c2822669246ce7eb42" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:52.612926 26754 raft_consensus.cc:3037] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:52.616209 26754 raft_consensus.cc:2454] T b6395bce17ee40c2822669246ce7eb42 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:52.617298 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:52.618079 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
I20260810 11:30:52.619055 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet ebaf046e524b485c8b3ebf419c8035bb (table default.Table_9756c2fbd13b45b9ab96cc4997e3377b [id=c48cb5a0af7b4f0483e799a49fd5d307]). Expected version 1 got 0
I20260810 11:30:52.619638 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:52.620133 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:52.620723 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_883130a240194491bd23c14d9aff2e99 [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 2 got 0
I20260810 11:30:52.621652 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:52.621881 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:52.622153 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:52.622707 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b98aeb11beb54cf0a9829b715ad96d0f (table default.Table_c0f2f67fac3147edb223918339295177 [id=9410dc6b3fbc49b4b4f87eec32c4f420]). Expected version 1 got 0
I20260810 11:30:52.623097 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bb078d7c0d0e4cf5aa841a802e78d8ff (table default.Table_eb5bb59579c043d7b1d98e60e42899af [id=65218ea1c77a4098a4f1145607695dbd]). Expected version 1 got 0
I20260810 11:30:52.624514 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bcc69e8f87134d25a1329be52b08e794 (table default.Table_4e93c67b823f48028820e1e95415e455 [id=b4c0c92ef07f432cbb00a36ecd17d394]). Expected version 1 got 0
I20260810 11:30:52.625077 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c3a5d7b8b0a14134ac55fa17a7dac21e (table default.Table_a4ae13338d184321b7cd7de27296ba58 [id=0cf740b2e59643899dac59acdf576fe2]). Expected version 1 got 0
I20260810 11:30:52.625495 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:52.625985 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f10ac7e043c240d8a14b2b4f96b864b9 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:52.626698 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:52.627307 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_b472377e613b4475b7a0b58062d44535 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 2 got 0
I20260810 11:30:52.627987 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d91cb30457a74d51885ad81c4ab89d71 (table default.Table_1ec5963e30f5468cbde77670965bf92b [id=e985b1ae60d94bfa998e1986bdf3fcd9]). Expected version 1 got 0
I20260810 11:30:52.628328 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:52.629432 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:52.629964 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 501defb075d142ec8b22e5e8236a009c (table default.Table_03d4151647a047a1b1ba29fdba43f80d [id=46bda36574e1430dbada751ccf16703c]). Expected version 1 got 0
I20260810 11:30:52.613708 26912 raft_consensus.cc:3037] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:52.630947 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet afbe6ce99f7c4f7cb939bea086cd90be (table default.Table_77ec2f167ce54c869f280c782936aabc [id=0d443055d28146b9a2bf6780b6f44daa]). Expected version 1 got 0
I20260810 11:30:52.631763 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:52.632337 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:52.633127 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c317ccebde05457d9e81c5c871638092 (table default.Table_8c0c1ab3bbb944c888930a5d8116d888 [id=7b4e4650915f4c16bef68adf43618b89]). Expected version 1 got 0
I20260810 11:30:52.634651 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:52.635114 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet fccc21cfc1ce4eb586f03276ec6e987f (table default.Table_613e12f4afb54939af925475cab64f0e [id=e22f19a993564e53b1cc76633f25f505]). Expected version 2 got 1
I20260810 11:30:52.635617 26572 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 72209a805e3e4b4ea1bf99508e0f75db (table default.Table_2c888d6a14f943e9b4dd4285c53791b4 [id=8de05bfacc2e40dda2832803fa5b69d8]). Expected version 1 got 0
I20260810 11:30:52.450546 27228 raft_consensus.cc:729] T 501defb075d142ec8b22e5e8236a009c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
I20260810 11:30:52.609979 29500 rpcz_store.cc:276] 0810 11:30:49.708396 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.708446 (+ 50us) service_pool.cc:227] Handling call
0810 11:30:52.203145 (+2494699us) ts_tablet_manager.cc:1145] Deleting tablet c60baf810a544a4a90dccd2337a39043
0810 11:30:52.203163 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.324605 (+121442us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.383776 (+ 59171us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.605526 (+221750us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2494480}
I20260810 11:30:52.662070 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet c60baf810a544a4a90dccd2337a39043 (table default.Table_e58ae45f9ea949a2a0d7bf7f0e862647 [id=76b87112ac8e4024965d44a9b62b8c1a]) successfully deleted
I20260810 11:30:52.663890 29500 tablet_replica.cc:330] T 2da86554bc51486e91f1ea5995a245b5 P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:52.663645 27228 consensus_queue.cc:260] T 501defb075d142ec8b22e5e8236a009c P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.673545 29500 raft_consensus.cc:2229] T 2da86554bc51486e91f1ea5995a245b5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:52.558758 29794 raft_consensus.cc:482] T d3c31d08ddd74ee28948427c726ed130 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.701773 29794 raft_consensus.cc:504] T d3c31d08ddd74ee28948427c726ed130 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.581367 27021 tablet_service.cc:1467] Processing CreateTablet for tablet caf5ed278bd648068d0d8a3b0bdfd642 (DEFAULT_TABLE table=default.Table_3fd59f07e4ee4f54bce7829aec4cf4c4 [id=3719720e5ca241b1a500a1aaf7f310c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.684800 29291 raft_consensus.cc:482] T c3a5d7b8b0a14134ac55fa17a7dac21e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.709117 29500 raft_consensus.cc:2258] T 2da86554bc51486e91f1ea5995a245b5 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:52.710569 29500 ts_tablet_manager.cc:1905] T 2da86554bc51486e91f1ea5995a245b5 P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:52.711256 27222 tablet_bootstrap.cc:492] T 8400c601e9894ea9b68679f6d7927456 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:52.711452 27222 ts_tablet_manager.cc:1397] T 8400c601e9894ea9b68679f6d7927456 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.410s user 0.002s sys 0.016s
I20260810 11:30:52.712669 29823 raft_consensus.cc:482] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.712462 27222 raft_consensus.cc:348] T 8400c601e9894ea9b68679f6d7927456 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.712878 27222 raft_consensus.cc:374] T 8400c601e9894ea9b68679f6d7927456 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:52.712942 27222 raft_consensus.cc:729] T 8400c601e9894ea9b68679f6d7927456 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:52.713135 27222 consensus_queue.cc:260] T 8400c601e9894ea9b68679f6d7927456 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.713245 29823 raft_consensus.cc:504] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.713937 29823 leader_election.cc:288] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.714324 29455 raft_consensus.cc:482] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.714488 29455 raft_consensus.cc:504] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.715143 29455 leader_election.cc:288] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.715672 27222 ts_tablet_manager.cc:1428] T 8400c601e9894ea9b68679f6d7927456 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260810 11:30:52.716003 27222 tablet_bootstrap.cc:492] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:52.719527 27222 tablet_bootstrap.cc:654] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:52.721827 26750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba9d15002e6a40f58a7be07f46e7c328" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:52.731650 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
I20260810 11:30:52.732698 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:52.733482 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_883130a240194491bd23c14d9aff2e99 [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 2 got 0
I20260810 11:30:52.733726 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:52.733960 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:52.734566 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet b98aeb11beb54cf0a9829b715ad96d0f (table default.Table_c0f2f67fac3147edb223918339295177 [id=9410dc6b3fbc49b4b4f87eec32c4f420]). Expected version 1 got 0
I20260810 11:30:52.734899 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bb078d7c0d0e4cf5aa841a802e78d8ff (table default.Table_eb5bb59579c043d7b1d98e60e42899af [id=65218ea1c77a4098a4f1145607695dbd]). Expected version 1 got 0
I20260810 11:30:52.735337 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet bcc69e8f87134d25a1329be52b08e794 (table default.Table_4e93c67b823f48028820e1e95415e455 [id=b4c0c92ef07f432cbb00a36ecd17d394]). Expected version 1 got 0
I20260810 11:30:52.736008 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:52.736478 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:52.737044 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:52.738296 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet a09cf2b015414598b9e9b6e76eb0a9df (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]). Expected version 1 got 0
I20260810 11:30:52.739233 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c3a5d7b8b0a14134ac55fa17a7dac21e (table default.Table_a4ae13338d184321b7cd7de27296ba58 [id=0cf740b2e59643899dac59acdf576fe2]). Expected version 1 got 0
I20260810 11:30:52.739708 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:52.740259 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet f10ac7e043c240d8a14b2b4f96b864b9 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:52.741024 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:52.743136 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet d91cb30457a74d51885ad81c4ab89d71 (table default.Table_1ec5963e30f5468cbde77670965bf92b [id=e985b1ae60d94bfa998e1986bdf3fcd9]). Expected version 1 got 0
W20260810 11:30:52.743575 26700 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.25.195.253:34547, user_credentials={real_user=slave}} blocked reactor thread for 47623us
I20260810 11:30:52.743932 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_b472377e613b4475b7a0b58062d44535 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 2 got 0
I20260810 11:30:52.744493 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 501defb075d142ec8b22e5e8236a009c (table default.Table_03d4151647a047a1b1ba29fdba43f80d [id=46bda36574e1430dbada751ccf16703c]). Expected version 1 got 0
I20260810 11:30:52.744836 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet ebaf046e524b485c8b3ebf419c8035bb (table default.Table_9756c2fbd13b45b9ab96cc4997e3377b [id=c48cb5a0af7b4f0483e799a49fd5d307]). Expected version 1 got 0
I20260810 11:30:52.745535 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:52.745999 27222 tablet_bootstrap.cc:492] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:52.746024 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:52.746273 27222 ts_tablet_manager.cc:1397] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.001s
I20260810 11:30:52.746788 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:52.747869 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet c317ccebde05457d9e81c5c871638092 (table default.Table_8c0c1ab3bbb944c888930a5d8116d888 [id=7b4e4650915f4c16bef68adf43618b89]). Expected version 1 got 0
I20260810 11:30:52.715267 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 958e9c4980934947a252b44ffcbea0de (DEFAULT_TABLE table=default.Table_ba61129cdf35481dbf06effd223949f6 [id=e20f1c45c6d743cba2c3cc60c78186a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.749800 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 958e9c4980934947a252b44ffcbea0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.725026 27228 ts_tablet_manager.cc:1428] T 501defb075d142ec8b22e5e8236a009c P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.276s user 0.000s sys 0.003s
I20260810 11:30:52.757082 27228 tablet_bootstrap.cc:492] T d91cb30457a74d51885ad81c4ab89d71 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:52.760211 27228 tablet_bootstrap.cc:654] T d91cb30457a74d51885ad81c4ab89d71 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:52.708451 26881 tablet_service.cc:1467] Processing CreateTablet for tablet d8f1d3915f2b4bd5984fc980b9984e60 (DEFAULT_TABLE table=default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.761721 26881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8f1d3915f2b4bd5984fc980b9984e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.761104 26571 catalog_manager.cc:5587] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
W20260810 11:30:52.728114 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 107028us
I20260810 11:30:52.768384 26849 leader_election.cc:302] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters: 482e605580be48cbbacce05a3e61c215
W20260810 11:30:52.729923 26848 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.195:38993, user_credentials={real_user=slave}} blocked reactor thread for 95058.4us
I20260810 11:30:52.771533 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba9d15002e6a40f58a7be07f46e7c328" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:52.773119 26991 leader_election.cc:341] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:52.774365 29869 raft_consensus.cc:2781] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:52.775362 29869 raft_consensus.cc:686] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [term 1 LEADER]: Becoming Leader. State: Replica: b6079090b1124d84aa4477974bb53700, State: Running, Role: LEADER
I20260810 11:30:52.776152 29869 consensus_queue.cc:237] T b6395bce17ee40c2822669246ce7eb42 P b6079090b1124d84aa4477974bb53700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.784497 26744 tablet_service.cc:1467] Processing CreateTablet for tablet d8f1d3915f2b4bd5984fc980b9984e60 (DEFAULT_TABLE table=default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.788679 26742 tablet_service.cc:1467] Processing CreateTablet for tablet 958e9c4980934947a252b44ffcbea0de (DEFAULT_TABLE table=default.Table_ba61129cdf35481dbf06effd223949f6 [id=e20f1c45c6d743cba2c3cc60c78186a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.793226 27222 raft_consensus.cc:348] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.798720 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "501defb075d142ec8b22e5e8236a009c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:52.798964 26912 raft_consensus.cc:2454] T 501defb075d142ec8b22e5e8236a009c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:52.800478 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c317ccebde05457d9e81c5c871638092" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:52.808673 27222 raft_consensus.cc:374] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:52.808897 27222 raft_consensus.cc:729] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
W20260810 11:30:52.794782 26700 consensus_peers.cc:487] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e276b0fa124d42dfb3fe750d245e44d8. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:52.798209 26742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 958e9c4980934947a252b44ffcbea0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.810407 26744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8f1d3915f2b4bd5984fc980b9984e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.805154 28987 ts_tablet_manager.cc:1918] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 11:30:52.811595 28987 log.cc:1196] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-0/wal/wals/ee803ddf27594d2b9e19fe440fc269c7
I20260810 11:30:52.812408 28987 ts_tablet_manager.cc:1939] T ee803ddf27594d2b9e19fe440fc269c7 P 443ec871f1ed4232b932ecfb0b18510d: Deleting consensus metadata
I20260810 11:30:52.816639 29865 consensus_queue.cc:1035] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:52.816955 26700 leader_election.cc:302] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:52.824318 29823 raft_consensus.cc:2781] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:52.824429 29823 raft_consensus.cc:482] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:52.824496 29823 raft_consensus.cc:3037] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:52.826316 26700 leader_election.cc:341] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:52.827069 26700 consensus_peers.cc:487] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d -> Peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Couldn't send request to peer b6079090b1124d84aa4477974bb53700. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:52.831234 27021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf5ed278bd648068d0d8a3b0bdfd642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.832085 27029 tablet_service.cc:1467] Processing CreateTablet for tablet d8f1d3915f2b4bd5984fc980b9984e60 (DEFAULT_TABLE table=default.Table_a8f81228863444c590a0b549f6a1b48c [id=f1d5f4a93ec04266af883a2988c4d35e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 11:30:52.832526 27029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8f1d3915f2b4bd5984fc980b9984e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.704099 29291 raft_consensus.cc:504] T c3a5d7b8b0a14134ac55fa17a7dac21e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.837463 27222 consensus_queue.cc:260] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.837793 29813 raft_consensus.cc:482] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.837918 29813 raft_consensus.cc:504] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.838711 29813 leader_election.cc:288] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.838769 29455 raft_consensus.cc:482] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.838961 29455 raft_consensus.cc:504] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.839749 29455 leader_election.cc:288] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.840472 27222 ts_tablet_manager.cc:1428] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.094s user 0.003s sys 0.001s
I20260810 11:30:52.841529 27222 tablet_bootstrap.cc:492] T 0bb01711769f457aa0696bb59582166d P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:52.843132 27222 tablet_bootstrap.cc:654] T 0bb01711769f457aa0696bb59582166d P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:52.848629 29823 raft_consensus.cc:504] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.850525 29823 leader_election.cc:288] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.851984 29316 raft_consensus.cc:482] T 98de7ce411bb4b54ada2df3b78b72190 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.852254 29316 raft_consensus.cc:504] T 98de7ce411bb4b54ada2df3b78b72190 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.852900 29316 leader_election.cc:288] T 98de7ce411bb4b54ada2df3b78b72190 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.863972 26750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98de7ce411bb4b54ada2df3b78b72190" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:52.864637 26750 raft_consensus.cc:2454] T 98de7ce411bb4b54ada2df3b78b72190 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 0.
I20260810 11:30:52.865139 29794 leader_election.cc:288] T d3c31d08ddd74ee28948427c726ed130 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.865708 26754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3c31d08ddd74ee28948427c726ed130" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:52.866380 29291 leader_election.cc:288] T c3a5d7b8b0a14134ac55fa17a7dac21e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.875837 27030 tablet_service.cc:1467] Processing CreateTablet for tablet 958e9c4980934947a252b44ffcbea0de (DEFAULT_TABLE table=default.Table_ba61129cdf35481dbf06effd223949f6 [id=e20f1c45c6d743cba2c3cc60c78186a4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 11:30:52.876989 26993 leader_election.cc:341] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:52.877156 26993 leader_election.cc:302] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:52.877656 26993 leader_election.cc:302] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
W20260810 11:30:52.877909 26993 leader_election.cc:341] T d3c31d08ddd74ee28948427c726ed130 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:52.878022 29455 raft_consensus.cc:2726] T ba9d15002e6a40f58a7be07f46e7c328 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:52.878664 29455 raft_consensus.cc:2781] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:52.878787 29455 raft_consensus.cc:482] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:52.878742 26750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3a5d7b8b0a14134ac55fa17a7dac21e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:52.878881 29455 raft_consensus.cc:3037] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
W20260810 11:30:52.879987 26993 leader_election.cc:341] T c3a5d7b8b0a14134ac55fa17a7dac21e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:52.878674 29794 raft_consensus.cc:482] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.881739 29875 raft_consensus.cc:482] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.882226 29794 raft_consensus.cc:504] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.882915 29794 leader_election.cc:288] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.883068 29500 ts_tablet_manager.cc:1918] T 2da86554bc51486e91f1ea5995a245b5 P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:52.883220 29500 log.cc:1196] T 2da86554bc51486e91f1ea5995a245b5 P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/2da86554bc51486e91f1ea5995a245b5
I20260810 11:30:52.887673 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 8083fa130cd04dae9d61aeed977c1c63 (table default.Table_f7a27d5218ae44a18c1de689474ef3c8 [id=39e1741c8eed4714b9fd844fb1f3e81d]). Expected version 3 got 0
I20260810 11:30:52.888741 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 52a9367b7a8345739b5b9acf9ea1e6d8 (table default.Table_4685fd339d3a48e28d9ef36812b6dac7 [id=a4755db8deca4541b6f671cd5444f070]). Expected version 1 got 0
I20260810 11:30:52.889500 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a22cdf7d273d427cb32b811aa5caa3a3 (table default.Table_e3bd143020ca4c18a396c5db56a85efc [id=72544a36bf7e46ca8a020d40d5370b82]). Expected version 1 got 0
I20260810 11:30:52.889889 26754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17ff4152fc6a449db3a172c5d948168f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:52.890031 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
I20260810 11:30:52.891404 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:52.891916 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:52.892323 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:52.885689 26901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17ff4152fc6a449db3a172c5d948168f" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:52.886245 26908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3a5d7b8b0a14134ac55fa17a7dac21e" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:52.893293 29500 ts_tablet_manager.cc:1939] T 2da86554bc51486e91f1ea5995a245b5 P b6079090b1124d84aa4477974bb53700: Deleting consensus metadata
I20260810 11:30:52.886454 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98de7ce411bb4b54ada2df3b78b72190" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:52.886608 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3c31d08ddd74ee28948427c726ed130" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:52.894697 26991 leader_election.cc:341] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:52.894994 26991 leader_election.cc:341] T c3a5d7b8b0a14134ac55fa17a7dac21e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:52.895072 26991 leader_election.cc:302] T c3a5d7b8b0a14134ac55fa17a7dac21e P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
W20260810 11:30:52.895776 26991 leader_election.cc:341] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
W20260810 11:30:52.896126 26991 leader_election.cc:341] T d3c31d08ddd74ee28948427c726ed130 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:52.896701 26991 leader_election.cc:302] T d3c31d08ddd74ee28948427c726ed130 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:52.896588 29794 raft_consensus.cc:2726] T c3a5d7b8b0a14134ac55fa17a7dac21e P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:52.897257 29794 raft_consensus.cc:2726] T d3c31d08ddd74ee28948427c726ed130 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:52.882640 29875 raft_consensus.cc:504] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.898077 29875 leader_election.cc:288] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:52.898640 29869 raft_consensus.cc:482] T 3853603eac544d769cef8cff9a008784 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.898837 29869 raft_consensus.cc:504] T 3853603eac544d769cef8cff9a008784 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.899678 29869 leader_election.cc:288] T 3853603eac544d769cef8cff9a008784 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:52.901285 27058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "501defb075d142ec8b22e5e8236a009c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:52.901666 27058 raft_consensus.cc:2454] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:52.901902 29455 raft_consensus.cc:504] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.902679 29455 leader_election.cc:288] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.905848 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98de7ce411bb4b54ada2df3b78b72190" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
W20260810 11:30:52.907223 26991 leader_election.cc:341] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:52.909096 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_883130a240194491bd23c14d9aff2e99 [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 2 got 0
I20260810 11:30:52.910868 27030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 958e9c4980934947a252b44ffcbea0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 11:30:52.916710 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:52.916926 26754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98de7ce411bb4b54ada2df3b78b72190" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"
I20260810 11:30:52.917243 26754 raft_consensus.cc:3037] T 98de7ce411bb4b54ada2df3b78b72190 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:52.920840 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:52.921051 26754 raft_consensus.cc:2454] T 98de7ce411bb4b54ada2df3b78b72190 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e605580be48cbbacce05a3e61c215 in term 1.
W20260810 11:30:52.921588 26993 leader_election.cc:341] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:52.921762 26993 leader_election.cc:302] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:52.922081 29455 raft_consensus.cc:2726] T 17ff4152fc6a449db3a172c5d948168f P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:52.922250 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet b98aeb11beb54cf0a9829b715ad96d0f (table default.Table_c0f2f67fac3147edb223918339295177 [id=9410dc6b3fbc49b4b4f87eec32c4f420]). Expected version 1 got 0
I20260810 11:30:52.922291 26993 leader_election.cc:302] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:52.922561 29455 raft_consensus.cc:2781] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:52.922559 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bb078d7c0d0e4cf5aa841a802e78d8ff (table default.Table_eb5bb59579c043d7b1d98e60e42899af [id=65218ea1c77a4098a4f1145607695dbd]). Expected version 1 got 0
I20260810 11:30:52.922698 29455 raft_consensus.cc:686] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [term 1 LEADER]: Becoming Leader. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Running, Role: LEADER
I20260810 11:30:52.922780 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:52.923116 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet bcc69e8f87134d25a1329be52b08e794 (table default.Table_4e93c67b823f48028820e1e95415e455 [id=b4c0c92ef07f432cbb00a36ecd17d394]). Expected version 1 got 0
I20260810 11:30:52.922969 29455 consensus_queue.cc:237] T 98de7ce411bb4b54ada2df3b78b72190 P 482e605580be48cbbacce05a3e61c215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.923548 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:52.924400 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet a09cf2b015414598b9e9b6e76eb0a9df (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]). Expected version 1 got 0
I20260810 11:30:52.929780 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c317ccebde05457d9e81c5c871638092" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:52.930047 27060 raft_consensus.cc:2454] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:52.931574 27047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a0284718f694a0591888e81357721b0" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:52.931870 27047 raft_consensus.cc:2454] T 3a0284718f694a0591888e81357721b0 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6079090b1124d84aa4477974bb53700 in term 1.
I20260810 11:30:52.933892 27228 tablet_bootstrap.cc:492] T d91cb30457a74d51885ad81c4ab89d71 P b6079090b1124d84aa4477974bb53700: No bootstrap required, opened a new log
I20260810 11:30:52.935946 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:52.937220 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c3a5d7b8b0a14134ac55fa17a7dac21e (table default.Table_a4ae13338d184321b7cd7de27296ba58 [id=0cf740b2e59643899dac59acdf576fe2]). Expected version 1 got 0
I20260810 11:30:52.938045 28987 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52750 (request call id 311) took 2738 ms. Trace:
I20260810 11:30:52.938516 28987 rpcz_store.cc:276] 0810 11:30:50.199896 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.200126 (+ 230us) service_pool.cc:227] Handling call
0810 11:30:52.307113 (+2106987us) ts_tablet_manager.cc:1145] Deleting tablet ee803ddf27594d2b9e19fe440fc269c7
0810 11:30:52.307125 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.660437 (+353312us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.804985 (+144548us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.938020 (+133035us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2106840}
I20260810 11:30:52.941375 26576 catalog_manager.cc:5495] T 3853603eac544d769cef8cff9a008784 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:52.944103 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:52.946812 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet f10ac7e043c240d8a14b2b4f96b864b9 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:52.948421 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:52.949775 28987 tablet_replica.cc:330] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d: stopping tablet replica
I20260810 11:30:52.950138 28987 raft_consensus.cc:2229] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Raft consensus shutting down.
I20260810 11:30:52.950621 28987 pending_rounds.cc:62] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d: Trying to abort 1 pending ops.
I20260810 11:30:52.950765 28987 pending_rounds.cc:68] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316936506337972224 op_type: NO_OP noop_request { }
I20260810 11:30:52.950997 28987 raft_consensus.cc:2866] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 11:30:52.951161 28987 raft_consensus.cc:2258] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:52.952034 28987 ts_tablet_manager.cc:1905] T e276b0fa124d42dfb3fe750d245e44d8 P 443ec871f1ed4232b932ecfb0b18510d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 11:30:52.953621 27231 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.685s user 0.050s sys 0.151s
W20260810 11:30:52.953995 27231 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.685s user 0.050s sys 0.151s
I20260810 11:30:52.935627 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 322) took 3227 ms. Trace:
I20260810 11:30:52.955734 27060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3853603eac544d769cef8cff9a008784" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:52.955871 29500 rpcz_store.cc:276] 0810 11:30:49.708504 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.708597 (+ 93us) service_pool.cc:227] Handling call
0810 11:30:52.662424 (+2953827us) ts_tablet_manager.cc:1145] Deleting tablet 2da86554bc51486e91f1ea5995a245b5
0810 11:30:52.662444 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.818173 (+155729us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.882900 (+ 64727us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.935593 (+ 52693us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2952452}
I20260810 11:30:52.956817 26564 catalog_manager.cc:4841] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): tablet 2da86554bc51486e91f1ea5995a245b5 (table default.Table_a0630a37a4e44862b8947cd848615cdb [id=f7931f3f7e9c45fba1aff648c50250f2]) successfully deleted
I20260810 11:30:52.957777 27048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98de7ce411bb4b54ada2df3b78b72190" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
W20260810 11:30:52.937707 26849 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.193:36885, user_credentials={real_user=slave}} blocked reactor thread for 63351.7us
I20260810 11:30:52.944233 26848 leader_election.cc:302] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e605580be48cbbacce05a3e61c215, b6079090b1124d84aa4477974bb53700; no voters:
I20260810 11:30:52.957681 26576 catalog_manager.cc:5495] T d91cb30457a74d51885ad81c4ab89d71 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:52.958473 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet d91cb30457a74d51885ad81c4ab89d71 (table default.Table_1ec5963e30f5468cbde77670965bf92b [id=e985b1ae60d94bfa998e1986bdf3fcd9]). Expected version 1 got 0
I20260810 11:30:52.958581 29869 raft_consensus.cc:2781] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 11:30:52.958731 29869 raft_consensus.cc:482] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:52.958729 27057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "501defb075d142ec8b22e5e8236a009c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:52.958879 29869 raft_consensus.cc:3037] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Advancing to term 2
I20260810 11:30:52.958904 27057 raft_consensus.cc:3037] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:52.949878 26566 catalog_manager.cc:4841] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): tablet ee803ddf27594d2b9e19fe440fc269c7 (table default.Table_67580ad3fe7a47d6a051e7da7005c171 [id=5ae9efa77fb54cf58ff2a1662eee03f7]) successfully deleted
I20260810 11:30:52.963121 26702 leader_election.cc:302] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters: b6079090b1124d84aa4477974bb53700
I20260810 11:30:52.961781 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_b472377e613b4475b7a0b58062d44535 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 2 got 0
I20260810 11:30:52.963629 29813 raft_consensus.cc:2781] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:52.963732 29813 raft_consensus.cc:482] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:52.963802 29813 raft_consensus.cc:3037] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:52.964402 26754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a0284718f694a0591888e81357721b0" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:52.964700 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet ebaf046e524b485c8b3ebf419c8035bb (table default.Table_9756c2fbd13b45b9ab96cc4997e3377b [id=c48cb5a0af7b4f0483e799a49fd5d307]). Expected version 1 got 0
I20260810 11:30:52.965395 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 501defb075d142ec8b22e5e8236a009c (table default.Table_03d4151647a047a1b1ba29fdba43f80d [id=46bda36574e1430dbada751ccf16703c]). Expected version 1 got 0
I20260810 11:30:52.965611 26754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3853603eac544d769cef8cff9a008784" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:52.966516 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 67364e1082184aad82a85c3fda850a26 (table default.Table_078ba3396f414043a14962c817c6ad28 [id=4cda0e139cc34db8ae99e56a074f5557]). Expected version 1 got 0
I20260810 11:30:52.967592 27228 ts_tablet_manager.cc:1397] T d91cb30457a74d51885ad81c4ab89d71 P b6079090b1124d84aa4477974bb53700: Time spent bootstrapping tablet: real 0.211s user 0.001s sys 0.005s
I20260810 11:30:52.967634 29813 raft_consensus.cc:504] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.968263 29813 leader_election.cc:288] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.969798 29504 consensus_queue.cc:1035] T 3a0284718f694a0591888e81357721b0 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:52.973641 29500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51686 (request call id 323) took 3264 ms. Trace:
I20260810 11:30:52.973867 29500 rpcz_store.cc:276] 0810 11:30:49.709180 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:49.709238 (+ 58us) service_pool.cc:227] Handling call
0810 11:30:52.957399 (+3248161us) ts_tablet_manager.cc:1145] Deleting tablet ce73798a721b4a6d892f0c24b6b40e2c
0810 11:30:52.957416 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.973605 (+ 16189us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3247265}
W20260810 11:30:52.974730 26564 catalog_manager.cc:4821] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): delete failed for tablet ce73798a721b4a6d892f0c24b6b40e2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce73798a721b4a6d892f0c24b6b40e2c already in progress: creating tablet
I20260810 11:30:52.975268 29500 tablet_replica.cc:330] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700: stopping tablet replica
I20260810 11:30:52.975494 27057 raft_consensus.cc:2454] T 501defb075d142ec8b22e5e8236a009c P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:52.975628 29500 raft_consensus.cc:2229] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:52.975814 29500 raft_consensus.cc:2258] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:52.976528 29500 ts_tablet_manager.cc:1905] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:52.976675 27049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67364e1082184aad82a85c3fda850a26" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215" is_pre_election: true
I20260810 11:30:52.976995 27049 raft_consensus.cc:2454] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 0.
I20260810 11:30:52.967615 26576 catalog_manager.cc:5495] T 00d52e5c77d94854b8ba0b38c63ad015 P 443ec871f1ed4232b932ecfb0b18510d reported cstate change: term changed from 0 to 1, leader changed from <none> to 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193). New cstate: current_term: 1 leader_uuid: "443ec871f1ed4232b932ecfb0b18510d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: UNKNOWN } } }
I20260810 11:30:52.978026 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:52.978197 26702 leader_election.cc:302] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:52.978647 29813 raft_consensus.cc:2781] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:52.978680 26576 catalog_manager.cc:5587] TS 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885) does not have the latest schema for tablet c317ccebde05457d9e81c5c871638092 (table default.Table_8c0c1ab3bbb944c888930a5d8116d888 [id=7b4e4650915f4c16bef68adf43618b89]). Expected version 1 got 0
I20260810 11:30:52.978785 29813 raft_consensus.cc:686] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:52.979035 29813 consensus_queue.cc:237] T 501defb075d142ec8b22e5e8236a009c P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.979195 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67364e1082184aad82a85c3fda850a26" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:52.983055 27231 tablet_bootstrap.cc:492] T cc032509e78c4a04bbe504f54e9d6c6b P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:52.984978 26702 leader_election.cc:302] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:52.985644 29823 raft_consensus.cc:2781] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 11:30:52.985790 29823 raft_consensus.cc:482] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 11:30:52.985936 29823 raft_consensus.cc:3037] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:52.991671 29823 raft_consensus.cc:504] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.993295 29823 leader_election.cc:288] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Requested vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
W20260810 11:30:52.993253 26578 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7161d94d80b24eeaa357cc0922a874af consensus state has no leader
I20260810 11:30:52.993697 26578 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51252 (request call id 245) took 4004 ms. Trace:
I20260810 11:30:52.984316 27049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c317ccebde05457d9e81c5c871638092" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:52.994405 27049 raft_consensus.cc:3037] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:52.993927 26578 rpcz_store.cc:276] 0810 11:30:48.988890 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.266402 (+1277512us) service_pool.cc:227] Handling call
0810 11:30:50.269907 (+ 3505us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:50.270164 (+ 257us) catalog_manager.cc:3616] Apply alter schema
0810 11:30:50.270371 (+ 207us) catalog_manager.cc:3639] Acquired catalog manager lock
0810 11:30:50.270488 (+ 117us) catalog_manager.cc:3786] Updating metadata on disk
0810 11:30:50.293925 (+ 23437us) catalog_manager.cc:3817] Committing alterations to in-memory state
0810 11:30:52.993520 (+2699595us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:50.271186 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:50.271286 (+ 100us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:50.271292 (+ 6us) write_op.cc:435] Acquired schema lock
0810 11:30:50.271297 (+ 5us) tablet.cc:660] Decoding operations
0810 11:30:50.271427 (+ 130us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:50.271438 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:50.271443 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0810 11:30:50.271515 (+ 72us) tablet.cc:699] Row locks acquired
0810 11:30:50.271517 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:50.271551 (+ 34us) write_op.cc:270] Start()
0810 11:30:50.271585 (+ 34us) write_op.cc:276] Timestamp: P: 1786361450271522 usec, L: 0
0810 11:30:50.271589 (+ 4us) op_driver.cc:331] REPLICATION: starting
0810 11:30:50.271751 (+ 162us) log.cc:842] Serialized 405 byte log entry
0810 11:30:50.290417 (+ 18666us) op_driver.cc:444] REPLICATION: finished
0810 11:30:50.291467 (+ 1050us) write_op.cc:301] APPLY: starting
0810 11:30:50.291486 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:50.291527 (+ 41us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:50.291615 (+ 88us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:50.291670 (+ 55us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:50.291704 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 11:30:50.291711 (+ 7us) write_op.cc:312] APPLY: finished
0810 11:30:50.291784 (+ 73us) log.cc:842] Serialized 23 byte log entry
0810 11:30:50.291855 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.291874 (+ 19us) write_op.cc:454] Released schema lock
0810 11:30:50.291881 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0810 11:30:50.291941 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.291947 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":977,"apply.run_cpu_time_us":542,"apply.run_wall_time_us":542,"num_ops":1,"prepare.queue_time_us":41,"prepare.run_cpu_time_us":632,"prepare.run_wall_time_us":632,"replication_time_us":18795}]]}
W20260810 11:30:52.995081 26578 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.195.194:35117 (request call id 277) took 1445 ms (client timeout 1000 ms). Trace:
W20260810 11:30:52.995302 26578 rpcz_store.cc:269] 0810 11:30:51.549393 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:52.994938 (+1445545us) service_pool.cc:214] Skipping call since client already timed out
0810 11:30:52.994984 (+ 46us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260810 11:30:52.997684 29291 raft_consensus.cc:482] T 728f273a89cd48f8bf0d8616645f5eed P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.997746 27049 raft_consensus.cc:2454] T c317ccebde05457d9e81c5c871638092 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:52.993039 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67364e1082184aad82a85c3fda850a26" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:52.997860 29291 raft_consensus.cc:504] T 728f273a89cd48f8bf0d8616645f5eed P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.998051 27055 raft_consensus.cc:3037] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:52.998566 29291 leader_election.cc:288] T 728f273a89cd48f8bf0d8616645f5eed P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.998690 29291 raft_consensus.cc:482] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:52.998785 29291 raft_consensus.cc:504] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.998941 29869 raft_consensus.cc:504] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:52.999290 29291 leader_election.cc:288] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:52.999416 26913 raft_consensus.cc:1226] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700 [term 2 FOLLOWER]: Rejecting Update request from peer 443ec871f1ed4232b932ecfb0b18510d for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260810 11:30:53.000353 29869 leader_election.cc:288] T 3a0284718f694a0591888e81357721b0 P b6079090b1124d84aa4477974bb53700 [CANDIDATE]: Term 2 election: Requested vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993)
I20260810 11:30:52.994120 29794 raft_consensus.cc:482] T e9732b90bc054f8a83fc17c0df9dfafe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:53.000667 29794 raft_consensus.cc:504] T e9732b90bc054f8a83fc17c0df9dfafe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:53.001411 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "728f273a89cd48f8bf0d8616645f5eed" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:53.001958 29794 leader_election.cc:288] T e9732b90bc054f8a83fc17c0df9dfafe P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:53.002175 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb01711769f457aa0696bb59582166d" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
W20260810 11:30:53.002329 26991 leader_election.cc:341] T 728f273a89cd48f8bf0d8616645f5eed P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:53.003021 27055 raft_consensus.cc:2454] T 67364e1082184aad82a85c3fda850a26 P 482e605580be48cbbacce05a3e61c215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:53.003108 27228 raft_consensus.cc:348] T d91cb30457a74d51885ad81c4ab89d71 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:53.003451 27228 raft_consensus.cc:374] T d91cb30457a74d51885ad81c4ab89d71 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:53.003584 27228 raft_consensus.cc:729] T d91cb30457a74d51885ad81c4ab89d71 P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6079090b1124d84aa4477974bb53700, State: Initialized, Role: FOLLOWER
W20260810 11:30:53.003747 26991 leader_election.cc:341] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:53.004284 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9732b90bc054f8a83fc17c0df9dfafe" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:53.004443 26702 leader_election.cc:302] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:53.004047 27228 consensus_queue.cc:260] T d91cb30457a74d51885ad81c4ab89d71 P b6079090b1124d84aa4477974bb53700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
W20260810 11:30:53.004760 26991 leader_election.cc:341] T e9732b90bc054f8a83fc17c0df9dfafe P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:53.005288 26702 leader_election.cc:302] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 443ec871f1ed4232b932ecfb0b18510d, 482e605580be48cbbacce05a3e61c215; no voters:
I20260810 11:30:53.005601 27228 ts_tablet_manager.cc:1428] T d91cb30457a74d51885ad81c4ab89d71 P b6079090b1124d84aa4477974bb53700: Time spent starting tablet: real 0.038s user 0.002s sys 0.001s
I20260810 11:30:53.005601 29865 raft_consensus.cc:2781] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:53.005786 29504 raft_consensus.cc:2781] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 11:30:53.005926 29504 raft_consensus.cc:686] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:53.006140 27228 tablet_bootstrap.cc:492] T c4124999339e4133b2bd47b3739da373 P b6079090b1124d84aa4477974bb53700: Bootstrap starting.
I20260810 11:30:53.006224 29504 consensus_queue.cc:237] T 67364e1082184aad82a85c3fda850a26 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:53.006762 26581 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac259bcf213a4aa297d1d8e73b262361: Sending DeleteTablet for 3 replicas of tablet cc032509e78c4a04bbe504f54e9d6c6b
I20260810 11:30:53.007596 26581 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51252 (request call id 259) took 3071 ms. Trace:
I20260810 11:30:53.007736 26581 rpcz_store.cc:276] 0810 11:30:49.936192 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.645772 (+709580us) service_pool.cc:227] Handling call
0810 11:30:50.646824 (+ 1052us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0810 11:30:50.646994 (+ 170us) catalog_manager.cc:2752] Modifying in-memory table state
0810 11:30:50.647111 (+ 117us) catalog_manager.cc:2761] Locking tablets
0810 11:30:50.647275 (+ 164us) catalog_manager.cc:2775] Removing table and tablets from system table
0810 11:30:50.879102 (+231827us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.879113 (+ 11us) write_op.cc:454] Released schema lock
0810 11:30:50.879356 (+ 243us) catalog_manager.cc:2793] Removing table from by-name map
0810 11:30:50.879531 (+ 175us) catalog_manager.cc:2809] Committing in-memory state
0810 11:30:53.006688 (+2127157us) catalog_manager.cc:2813] Aborting table tasks
0810 11:30:53.007510 (+ 822us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0810 11:30:50.649973 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 11:30:50.650123 (+ 150us) write_op.cc:432] Acquiring schema lock in shared mode
0810 11:30:50.650133 (+ 10us) write_op.cc:435] Acquired schema lock
0810 11:30:50.650137 (+ 4us) tablet.cc:660] Decoding operations
0810 11:30:50.650294 (+ 157us) write_op.cc:620] Acquiring the partition lock for write op
0810 11:30:50.650308 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0810 11:30:50.650312 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0810 11:30:50.650454 (+ 142us) tablet.cc:699] Row locks acquired
0810 11:30:50.650456 (+ 2us) write_op.cc:260] PREPARE: finished
0810 11:30:50.650500 (+ 44us) write_op.cc:270] Start()
0810 11:30:50.650534 (+ 34us) write_op.cc:276] Timestamp: P: 1786361450650432 usec, L: 0
0810 11:30:50.650540 (+ 6us) op_driver.cc:331] REPLICATION: starting
0810 11:30:50.650733 (+ 193us) log.cc:842] Serialized 734 byte log entry
0810 11:30:50.654505 (+ 3772us) op_driver.cc:444] REPLICATION: finished
0810 11:30:50.654783 (+ 278us) write_op.cc:301] APPLY: starting
0810 11:30:50.654809 (+ 26us) tablet.cc:1365] starting BulkCheckPresence
0810 11:30:50.654875 (+ 66us) tablet.cc:1368] finished BulkCheckPresence
0810 11:30:50.655033 (+ 158us) tablet.cc:1370] starting ApplyRowOperation cycle
0810 11:30:50.655137 (+ 104us) tablet.cc:1381] finished ApplyRowOperation cycle
0810 11:30:50.655191 (+ 54us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 11:30:50.655202 (+ 11us) write_op.cc:312] APPLY: finished
0810 11:30:50.655400 (+ 198us) log.cc:842] Serialized 29 byte log entry
0810 11:30:50.655495 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0810 11:30:50.655520 (+ 25us) write_op.cc:454] Released schema lock
0810 11:30:50.655528 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":204,"apply.run_cpu_time_us":825,"apply.run_wall_time_us":825,"num_ops":2,"prepare.queue_time_us":437,"prepare.run_cpu_time_us":882,"prepare.run_wall_time_us":883,"raft.queue_time_us":95,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":249,"replication_time_us":3936}]]}
I20260810 11:30:53.008837 27228 tablet_bootstrap.cc:654] T c4124999339e4133b2bd47b3739da373 P b6079090b1124d84aa4477974bb53700: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:53.009652 29865 raft_consensus.cc:686] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [term 1 LEADER]: Becoming Leader. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Running, Role: LEADER
I20260810 11:30:53.010185 29865 consensus_queue.cc:237] T c317ccebde05457d9e81c5c871638092 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:53.010668 26750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb01711769f457aa0696bb59582166d" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:53.010782 27055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a0284718f694a0591888e81357721b0" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482e605580be48cbbacce05a3e61c215"
I20260810 11:30:53.011624 26769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9732b90bc054f8a83fc17c0df9dfafe" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:53.013375 26754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "728f273a89cd48f8bf0d8616645f5eed" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:53.013602 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet cc032509e78c4a04bbe504f54e9d6c6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:50 UTC) from {username='slave'} at 127.0.0.1:51686
W20260810 11:30:53.021271 26993 leader_election.cc:341] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:53.021304 27030 tablet_service.cc:1514] Processing DeleteTablet for tablet cc032509e78c4a04bbe504f54e9d6c6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:50 UTC) from {username='slave'} at 127.0.0.1:58800
I20260810 11:30:53.021634 26993 leader_election.cc:302] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:53.022374 29794 raft_consensus.cc:2726] T 0bb01711769f457aa0696bb59582166d P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:53.022445 26993 leader_election.cc:341] T e9732b90bc054f8a83fc17c0df9dfafe P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:53.022568 26993 leader_election.cc:302] T e9732b90bc054f8a83fc17c0df9dfafe P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:53.022888 29878 raft_consensus.cc:2726] T e9732b90bc054f8a83fc17c0df9dfafe P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 11:30:53.022948 26993 leader_election.cc:341] T 728f273a89cd48f8bf0d8616645f5eed P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:53.023190 26993 leader_election.cc:302] T 728f273a89cd48f8bf0d8616645f5eed P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e605580be48cbbacce05a3e61c215; no voters: 443ec871f1ed4232b932ecfb0b18510d, b6079090b1124d84aa4477974bb53700
I20260810 11:30:53.023494 29455 raft_consensus.cc:2726] T 728f273a89cd48f8bf0d8616645f5eed P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 11:30:53.027313 27231 ts_tablet_manager.cc:1397] T cc032509e78c4a04bbe504f54e9d6c6b P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.764s user 0.055s sys 0.151s
I20260810 11:30:53.028267 27231 raft_consensus.cc:348] T cc032509e78c4a04bbe504f54e9d6c6b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:53.028744 26742 tablet_service.cc:1514] Processing DeleteTablet for tablet cc032509e78c4a04bbe504f54e9d6c6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 11:30:50 UTC) from {username='slave'} at 127.0.0.1:52750
I20260810 11:30:53.029801 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "501defb075d142ec8b22e5e8236a009c" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:53.030100 26913 raft_consensus.cc:3037] T 501defb075d142ec8b22e5e8236a009c P b6079090b1124d84aa4477974bb53700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 11:30:53.033757 26913 raft_consensus.cc:2454] T 501defb075d142ec8b22e5e8236a009c P b6079090b1124d84aa4477974bb53700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 443ec871f1ed4232b932ecfb0b18510d in term 1.
I20260810 11:30:53.035223 29823 consensus_queue.cc:1035] T c4124999339e4133b2bd47b3739da373 P 443ec871f1ed4232b932ecfb0b18510d [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 11:30:53.039924 26913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98de7ce411bb4b54ada2df3b78b72190" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700" is_pre_election: true
I20260810 11:30:53.040808 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c317ccebde05457d9e81c5c871638092" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:53.028501 27231 raft_consensus.cc:374] T cc032509e78c4a04bbe504f54e9d6c6b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:53.040966 27231 raft_consensus.cc:729] T cc032509e78c4a04bbe504f54e9d6c6b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:53.042105 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67364e1082184aad82a85c3fda850a26" candidate_uuid: "443ec871f1ed4232b932ecfb0b18510d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6079090b1124d84aa4477974bb53700"
I20260810 11:30:53.048465 27231 consensus_queue.cc:260] T cc032509e78c4a04bbe504f54e9d6c6b P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:53.052450 27222 tablet_bootstrap.cc:492] T 0bb01711769f457aa0696bb59582166d P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:53.052711 27222 ts_tablet_manager.cc:1397] T 0bb01711769f457aa0696bb59582166d P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.211s user 0.022s sys 0.014s
I20260810 11:30:53.053464 27222 raft_consensus.cc:348] T 0bb01711769f457aa0696bb59582166d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:53.053709 27222 raft_consensus.cc:374] T 0bb01711769f457aa0696bb59582166d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:53.053777 27222 raft_consensus.cc:729] T 0bb01711769f457aa0696bb59582166d P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:53.053966 27222 consensus_queue.cc:260] T 0bb01711769f457aa0696bb59582166d P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:53.054234 29500 ts_tablet_manager.cc:1918] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:53.054388 29500 log.cc:1196] T cc76d30f37094391b75076c92ccc277f P b6079090b1124d84aa4477974bb53700: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-1/wal/wals/cc76d30f37094391b75076c92ccc277f
I20260810 11:30:53.054620 27222 ts_tablet_manager.cc:1428] T 0bb01711769f457aa0696bb59582166d P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:53.058302 27231 ts_tablet_manager.cc:1428] T cc032509e78c4a04bbe504f54e9d6c6b P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.031s user 0.002s sys 0.000s
I20260810 11:30:53.058686 27231 tablet_bootstrap.cc:492] T 7c9e437989e54e459f74b49617dabf52 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:53.063735 27222 tablet_bootstrap.cc:492] T a74acd5078ec4a45987d68a1e4d138b9 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:53.065822 27222 tablet_bootstrap.cc:654] T a74acd5078ec4a45987d68a1e4d138b9 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:53.066780 29603 log.cc:1196] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/40f5eecfc66a4711aef60c1a2bff6b97
I20260810 11:30:53.076220 29603 ts_tablet_manager.cc:1939] T 40f5eecfc66a4711aef60c1a2bff6b97 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:53.078135 27222 tablet_bootstrap.cc:492] T a74acd5078ec4a45987d68a1e4d138b9 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:53.078397 27222 ts_tablet_manager.cc:1397] T a74acd5078ec4a45987d68a1e4d138b9 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.001s
I20260810 11:30:53.079435 27222 raft_consensus.cc:348] T a74acd5078ec4a45987d68a1e4d138b9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:53.079775 27222 raft_consensus.cc:374] T a74acd5078ec4a45987d68a1e4d138b9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:53.079879 27222 raft_consensus.cc:729] T a74acd5078ec4a45987d68a1e4d138b9 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:53.080155 27222 consensus_queue.cc:260] T a74acd5078ec4a45987d68a1e4d138b9 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:53.081447 27222 ts_tablet_manager.cc:1428] T a74acd5078ec4a45987d68a1e4d138b9 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 11:30:53.081878 27222 tablet_bootstrap.cc:492] T 77f0c916ccf24e86b0ec29de1ba54b84 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:53.084915 29603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58800 (request call id 296) took 2583 ms. Trace:
I20260810 11:30:53.088436 27222 tablet_bootstrap.cc:654] T 77f0c916ccf24e86b0ec29de1ba54b84 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:53.088721 29603 rpcz_store.cc:276] 0810 11:30:50.501056 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 11:30:50.506275 (+ 5219us) service_pool.cc:227] Handling call
0810 11:30:52.217128 (+1710853us) ts_tablet_manager.cc:1145] Deleting tablet 40f5eecfc66a4711aef60c1a2bff6b97
0810 11:30:52.217140 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0810 11:30:52.347833 (+130693us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:52.534206 (+186373us) tablet_metadata.cc:641] Metadata flushed
0810 11:30:53.084881 (+550675us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1652608}
I20260810 11:30:53.088956 29455 raft_consensus.cc:482] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:53.089228 29455 raft_consensus.cc:504] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:53.089989 29455 leader_election.cc:288] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:53.077991 27231 tablet_bootstrap.cc:654] T 7c9e437989e54e459f74b49617dabf52 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:53.090736 26581 catalog_manager.cc:5495] T fa14fea852c24cd7bb3d57094af2e178 P b6079090b1124d84aa4477974bb53700 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6079090b1124d84aa4477974bb53700 (127.25.195.194). New cstate: current_term: 1 leader_uuid: "b6079090b1124d84aa4477974bb53700" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } health_report { overall_health: HEALTHY } } }
I20260810 11:30:53.091580 29603 tablet_replica.cc:330] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215: stopping tablet replica
I20260810 11:30:53.091892 29603 raft_consensus.cc:2229] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 11:30:53.092144 29603 raft_consensus.cc:2258] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 11:30:53.092494 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3b607279006c4baeae79325926088014 (table default.Table_6abaa68586814b00811cc1b2211bd8ed [id=9d480f65788b486db55bbbe48a0ad5eb]). Expected version 1 got 0
I20260810 11:30:53.092866 29603 ts_tablet_manager.cc:1905] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 11:30:53.093808 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 0bb01711769f457aa0696bb59582166d (table default.Table_d6cf37fdb7354b7aa9cd2227a94c407e [id=95c1850f17d3460b8d7fff2ce922d7d6]). Expected version 1 got 0
I20260810 11:30:53.094169 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 3853603eac544d769cef8cff9a008784 (table default.Table_5905efbf8298477abec7629be773b347 [id=72829be151bc48dba287b32c7028caf7]). Expected version 1 got 0
I20260810 11:30:53.095256 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f9c7ab7f075d459d8b1f1a0bb0e2e2d7 (table default.Table_1ce6ca6db4f34d89a4db20f32c50fb12 [id=480613c985b74b2786f4c23dfb9a5f4b]). Expected version 1 got 0
I20260810 11:30:53.095399 29455 raft_consensus.cc:482] T cc032509e78c4a04bbe504f54e9d6c6b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:53.095548 29455 raft_consensus.cc:504] T cc032509e78c4a04bbe504f54e9d6c6b P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:53.096107 29455 leader_election.cc:288] T cc032509e78c4a04bbe504f54e9d6c6b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:53.097319 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f756689d4c99489885a0cd59f84a6e8a (table default.Table_883130a240194491bd23c14d9aff2e99 [id=8163ad85405f4f18bb06706c5d66fb57]). Expected version 2 got 0
I20260810 11:30:53.100257 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet b98aeb11beb54cf0a9829b715ad96d0f (table default.Table_c0f2f67fac3147edb223918339295177 [id=9410dc6b3fbc49b4b4f87eec32c4f420]). Expected version 1 got 0
W20260810 11:30:53.100772 26702 consensus_peers.cc:487] T cc76d30f37094391b75076c92ccc277f P 443ec871f1ed4232b932ecfb0b18510d -> Peer 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): Couldn't send request to peer 482e605580be48cbbacce05a3e61c215. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cc76d30f37094391b75076c92ccc277f. This is attempt 1: this message will repeat every 5th retry.
I20260810 11:30:53.101856 27222 tablet_bootstrap.cc:492] T 77f0c916ccf24e86b0ec29de1ba54b84 P 443ec871f1ed4232b932ecfb0b18510d: No bootstrap required, opened a new log
I20260810 11:30:53.102125 27222 ts_tablet_manager.cc:1397] T 77f0c916ccf24e86b0ec29de1ba54b84 P 443ec871f1ed4232b932ecfb0b18510d: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.001s
I20260810 11:30:53.103024 27222 raft_consensus.cc:348] T 77f0c916ccf24e86b0ec29de1ba54b84 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:53.103363 27222 raft_consensus.cc:374] T 77f0c916ccf24e86b0ec29de1ba54b84 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:53.103474 27222 raft_consensus.cc:729] T 77f0c916ccf24e86b0ec29de1ba54b84 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443ec871f1ed4232b932ecfb0b18510d, State: Initialized, Role: FOLLOWER
I20260810 11:30:53.103775 27222 consensus_queue.cc:260] T 77f0c916ccf24e86b0ec29de1ba54b84 P 443ec871f1ed4232b932ecfb0b18510d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:53.104485 27222 ts_tablet_manager.cc:1428] T 77f0c916ccf24e86b0ec29de1ba54b84 P 443ec871f1ed4232b932ecfb0b18510d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 11:30:53.104900 27222 tablet_bootstrap.cc:492] T a4dde1d1eef74911b20498149e8c1785 P 443ec871f1ed4232b932ecfb0b18510d: Bootstrap starting.
I20260810 11:30:53.105361 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bb078d7c0d0e4cf5aa841a802e78d8ff (table default.Table_eb5bb59579c043d7b1d98e60e42899af [id=65218ea1c77a4098a4f1145607695dbd]). Expected version 1 got 0
I20260810 11:30:53.107535 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 2acbbbd72845428384d65c8c423c0db6 (table default.Table_c165e15433ec4785bfa7365a319f4c60 [id=e2a272a0f465472d869a1f0f169557b9]). Expected version 1 got 0
I20260810 11:30:53.108009 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet bcc69e8f87134d25a1329be52b08e794 (table default.Table_4e93c67b823f48028820e1e95415e455 [id=b4c0c92ef07f432cbb00a36ecd17d394]). Expected version 1 got 0
I20260810 11:30:53.108531 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d3c31d08ddd74ee28948427c726ed130 (table default.Table_6ebb0ef24ef8473d8a0373a7c128de51 [id=34056ce268f8490c94a38351b43357a6]). Expected version 1 got 0
I20260810 11:30:53.109210 27222 tablet_bootstrap.cc:654] T a4dde1d1eef74911b20498149e8c1785 P 443ec871f1ed4232b932ecfb0b18510d: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:53.109536 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 7abf8e1e7f2c4519902cf31c6e0e86e2 (table default.Table_9b4f87cb356f4d98a42e3315907a2c68 [id=09e6c654505c448389915f4b634188b9]). Expected version 1 got 0
I20260810 11:30:53.109660 27231 tablet_bootstrap.cc:492] T 7c9e437989e54e459f74b49617dabf52 P 482e605580be48cbbacce05a3e61c215: No bootstrap required, opened a new log
I20260810 11:30:53.109899 27231 ts_tablet_manager.cc:1397] T 7c9e437989e54e459f74b49617dabf52 P 482e605580be48cbbacce05a3e61c215: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.002s
I20260810 11:30:53.109956 26754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00e63f994ff84941852b0cfee763c303" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
W20260810 11:30:53.110200 26700 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.195.194:41945, user_credentials={real_user=slave}} blocked reactor thread for 66166.2us
I20260810 11:30:53.110970 27231 raft_consensus.cc:348] T 7c9e437989e54e459f74b49617dabf52 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:53.111337 26754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc032509e78c4a04bbe504f54e9d6c6b" candidate_uuid: "482e605580be48cbbacce05a3e61c215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d" is_pre_election: true
I20260810 11:30:53.111617 27231 raft_consensus.cc:374] T 7c9e437989e54e459f74b49617dabf52 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 11:30:53.111699 27231 raft_consensus.cc:729] T 7c9e437989e54e459f74b49617dabf52 P 482e605580be48cbbacce05a3e61c215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e605580be48cbbacce05a3e61c215, State: Initialized, Role: FOLLOWER
I20260810 11:30:53.112049 27231 consensus_queue.cc:260] T 7c9e437989e54e459f74b49617dabf52 P 482e605580be48cbbacce05a3e61c215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:53.110723 26565 catalog_manager.cc:4841] TS 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993): tablet 40f5eecfc66a4711aef60c1a2bff6b97 (table default.Table_3efc57bdbafc46dfab4d324acb0d5f73 [id=bcba186b6e93492fb06f70e033be3296]) successfully deleted
I20260810 11:30:53.110409 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 41e7ace2693b4b8c8a978e7853e42472 (table default.Table_598f0479773f405c8fae9ad75653db34 [id=ac295842a377405890198a17654d63ea]). Expected version 1 got 0
I20260810 11:30:53.121491 27231 ts_tablet_manager.cc:1428] T 7c9e437989e54e459f74b49617dabf52 P 482e605580be48cbbacce05a3e61c215: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260810 11:30:53.121954 27231 tablet_bootstrap.cc:492] T 713663be70014b17b17056a865e7db63 P 482e605580be48cbbacce05a3e61c215: Bootstrap starting.
I20260810 11:30:53.122081 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet a09cf2b015414598b9e9b6e76eb0a9df (table default.Table_c051b544f1954fc48687f0316471ebd4 [id=052fbe3da03d4ebca9347725f5dbe3ae]). Expected version 1 got 0
I20260810 11:30:53.123008 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c3a5d7b8b0a14134ac55fa17a7dac21e (table default.Table_a4ae13338d184321b7cd7de27296ba58 [id=0cf740b2e59643899dac59acdf576fe2]). Expected version 1 got 0
I20260810 11:30:53.123590 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 00d52e5c77d94854b8ba0b38c63ad015 (table default.Table_3425866f9a834dd48a943c7dc9e41827 [id=9a684007540c48269be762ceb59b40c7]). Expected version 3 got 0
I20260810 11:30:53.124143 27231 tablet_bootstrap.cc:654] T 713663be70014b17b17056a865e7db63 P 482e605580be48cbbacce05a3e61c215: Neither blocks nor log segments found. Creating new log.
I20260810 11:30:53.124104 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet e0e4e8f9ba3448a0b50081c8cd22642c (table default.Table_0008c2b497d34b5b9534d3601c9fae49 [id=a47869d3574543b19e821bbfcb5d3785]). Expected version 1 got 0
I20260810 11:30:53.125232 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 997cff3351724953bd9c792085a38364 (table default.Table_a3eeadc0a55545c9a6af769a972a62d5 [id=363de84151b04f18917c36bd9fd499b9]). Expected version 1 got 0
I20260810 11:30:53.125752 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 91225dc1f7664fd7a79e2d62f33401cd (table default.Table_5256d55e5aee47ee88a92177e8df8577 [id=5c8a2cbef71f4c9fb038a49e1ca7f704]). Expected version 3 got 0
I20260810 11:30:53.126857 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 7161d94d80b24eeaa357cc0922a874af (table default.Table_14a68d6fff274195aac026309faee0fc [id=0186ddbf3c144b4e86ae21cbdac555d2]). Expected version 1 got 0
I20260810 11:30:53.128278 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet f10ac7e043c240d8a14b2b4f96b864b9 (table default.Table_dc1b23eedbd04b3eaff47cd2e647b29c [id=59cbbd4c63d6417c807a18d47211fcbd]). Expected version 2 got 0
I20260810 11:30:53.129293 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet d91cb30457a74d51885ad81c4ab89d71 (table default.Table_1ec5963e30f5468cbde77670965bf92b [id=e985b1ae60d94bfa998e1986bdf3fcd9]). Expected version 1 got 0
W20260810 11:30:53.112057 26993 leader_election.cc:341] T 00e63f994ff84941852b0cfee763c303 P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:53.130210 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet ebaf046e524b485c8b3ebf419c8035bb (table default.Table_9756c2fbd13b45b9ab96cc4997e3377b [id=c48cb5a0af7b4f0483e799a49fd5d307]). Expected version 1 got 0
W20260810 11:30:53.130275 26993 leader_election.cc:341] T cc032509e78c4a04bbe504f54e9d6c6b P 482e605580be48cbbacce05a3e61c215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 443ec871f1ed4232b932ecfb0b18510d (127.25.195.193:36885): Illegal state: must be running to vote when last-logged opid is not known
I20260810 11:30:53.132148 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet c8c9267e2da64738b5f7550c83b7c4a3 (table default.Table_b472377e613b4475b7a0b58062d44535 [id=eafb437d77e14e42a0cb38d6ec1fd5b4]). Expected version 2 got 0
I20260810 11:30:53.133747 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 501defb075d142ec8b22e5e8236a009c (table default.Table_03d4151647a047a1b1ba29fdba43f80d [id=46bda36574e1430dbada751ccf16703c]). Expected version 1 got 0
I20260810 11:30:53.134968 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 9bfed03f765f4c5aa77604ebf2e211b0 (table default.Table_dff842ea56e74537a3124efd9e956e11 [id=b457cccecbf24d6dab4e74bf16bb68eb]). Expected version 1 got 0
I20260810 11:30:53.136693 26581 catalog_manager.cc:5587] TS b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945) does not have the latest schema for tablet 8920061626614b219424eaba8f19e368 (table default.Table_64b627b42e6747c1b2023d393c3738b5 [id=bbde7d0c0eb543e79e48a60205aa8079]). Expected version 1 got 0
I20260810 11:30:53.136727 29865 raft_consensus.cc:482] T 8400c601e9894ea9b68679f6d7927456 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 11:30:53.136871 29865 raft_consensus.cc:504] T 8400c601e9894ea9b68679f6d7927456 P 443ec871f1ed4232b932ecfb0b18510d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "443ec871f1ed4232b932ecfb0b18510d" member_type: VOTER last_known_addr { host: "127.25.195.193" port: 36885 } } peers { permanent_uuid: "482e605580be48cbbacce05a3e61c215" member_type: VOTER last_known_addr { host: "127.25.195.195" port: 38993 } } peers { permanent_uuid: "b6079090b1124d84aa4477974bb53700" member_type: VOTER last_known_addr { host: "127.25.195.194" port: 41945 } }
I20260810 11:30:53.136998 29603 ts_tablet_manager.cc:1918] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 11:30:53.137197 29603 log.cc:1196] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215: Deleting WAL directory at /tmp/dist-test-taskNjNKA2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786361403672892-26383-0/minicluster-data/ts-2/wal/wals/bd34a4de1b93402c8a4bce1215660e77
I20260810 11:30:53.137478 29865 leader_election.cc:288] T 8400c601e9894ea9b68679f6d7927456 P 443ec871f1ed4232b932ecfb0b18510d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482e605580be48cbbacce05a3e61c215 (127.25.195.195:38993), b6079090b1124d84aa4477974bb53700 (127.25.195.194:41945)
I20260810 11:30:53.137638 29603 ts_tablet_manager.cc:1939] T bd34a4de1b93402c8a4bce1215660e77 P 482e605580be48cbbacce05a3e61c215: Deleting consensus metadata
I20260810 11:30:53.138083 26754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a0284718f694a0591888e81357721b0" candidate_uuid: "b6079090b1124d84aa4477974bb53700" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "443ec871f1ed4232b932ecfb0b18510d"